-- Logs begin at Sat 2022-07-02 20:01:19 UTC, end at Sat 2022-07-02 22:26:44 UTC. -- Jul 02 20:49:18.324917 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 02 20:49:18.333600 ncdv-master-1 devstack@n-api.service[114917]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 20:49:18 2022] *** Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: nodename: ncdv-master-1 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: machine: x86_64 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: clock source: unix Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: pcre jit disabled Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: detected number of CPU cores: 4 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: current working directory: / Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: detected binary path: /usr/bin/uwsgi-core Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: your processes number limit is 47680 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: your memory page size is 4096 bytes Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: detected max file descriptor number: 2048 Jul 02 20:49:18.335756 ncdv-master-1 devstack@n-api.service[114917]: lock engine: pthread robust mutexes Jul 02 20:49:18.336619 ncdv-master-1 devstack@n-api.service[114917]: thunder lock: enabled Jul 02 20:49:18.336619 ncdv-master-1 devstack@n-api.service[114917]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 02 20:49:18.336619 ncdv-master-1 devstack@n-api.service[114917]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 20:49:18.384017 ncdv-master-1 devstack@n-api.service[114917]: Python main interpreter initialized at 0x5591c26739c0 Jul 02 20:49:18.384017 ncdv-master-1 devstack@n-api.service[114917]: python threads support enabled Jul 02 20:49:18.384017 ncdv-master-1 devstack@n-api.service[114917]: your server socket listen backlog is limited to 100 connections Jul 02 20:49:18.384017 ncdv-master-1 devstack@n-api.service[114917]: your mercy for graceful operations on workers is 90 seconds Jul 02 20:49:18.384389 ncdv-master-1 devstack@n-api.service[114917]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 20:49:18.384389 ncdv-master-1 devstack@n-api.service[114917]: *** Operational MODE: preforking *** Jul 02 20:49:18.384615 ncdv-master-1 devstack@n-api.service[114917]: *** uWSGI is running in multiple interpreter mode *** Jul 02 20:49:18.384615 ncdv-master-1 devstack@n-api.service[114917]: spawned uWSGI master process (pid: 114917) Jul 02 20:49:18.384767 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 02 20:49:18.385721 ncdv-master-1 devstack@n-api.service[114917]: spawned uWSGI worker 1 (pid: 114918, cores: 1) Jul 02 20:49:18.386203 ncdv-master-1 devstack@n-api.service[114917]: spawned uWSGI worker 2 (pid: 114919, cores: 1) Jul 02 20:49:18.386203 ncdv-master-1 devstack@n-api.service[114917]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 20:49:19.693157 ncdv-master-1 devstack@n-api.service[114918]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 20:49:19.707902 ncdv-master-1 devstack@n-api.service[114919]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 20:49:20.365281 ncdv-master-1 devstack@n-api.service[114918]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:49:20.365281 ncdv-master-1 devstack@n-api.service[114918]: from cryptography.utils import int_from_bytes Jul 02 20:49:20.365569 ncdv-master-1 devstack@n-api.service[114918]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:49:20.365569 ncdv-master-1 devstack@n-api.service[114918]: from cryptography.utils import int_from_bytes Jul 02 20:49:20.370142 ncdv-master-1 devstack@n-api.service[114919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:49:20.370142 ncdv-master-1 devstack@n-api.service[114919]: from cryptography.utils import int_from_bytes Jul 02 20:49:20.370447 ncdv-master-1 devstack@n-api.service[114919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:49:20.370447 ncdv-master-1 devstack@n-api.service[114919]: from cryptography.utils import int_from_bytes Jul 02 20:49:22.922544 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:49:22.923135 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:49:22.923298 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:49:22.923455 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:49:22.923824 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:49:22.923914 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:49:22.923914 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:49:22.924125 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:49:22.924305 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.924448 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:49:22.924596 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.924686 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:49:22.924939 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.925082 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.925301 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.925450 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.925546 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.925639 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.925882 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926028 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926189 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926327 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926512 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926610 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926832 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.926928 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.927078 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.927166 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.927399 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.927490 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.927720 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.927824 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928061 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928163 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928355 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928449 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928667 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928754 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.928976 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.929062 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.929277 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.929371 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.929594 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.929679 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.929927 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.930012 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.930250 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.930428 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.930559 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.931606 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.931738 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.931856 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.931960 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932122 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932214 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932340 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932422 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932501 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932638 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932724 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932817 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932897 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.932989 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.933070 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.933201 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.933311 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.933500 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.933616 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.933823 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934010 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934134 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934327 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934530 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934624 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934846 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.934955 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.935160 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.935332 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.935475 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.935644 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.935887 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.935983 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.936226 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.936316 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.936536 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.936623 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.936855 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.936951 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.937178 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.937266 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.937489 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.937575 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.937802 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.937905 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.938118 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.938252 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.938420 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.938508 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.938725 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.938814 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939028 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939125 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939335 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939429 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939634 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939727 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.939934 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940026 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940210 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940297 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940515 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940603 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940819 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.940999 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941101 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941191 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941397 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941484 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941672 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941759 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.941917 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942015 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942229 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942315 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942488 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942574 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942805 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.942903 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.943123 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.943211 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.943422 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.943508 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.943725 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.943812 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944027 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944134 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944349 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944452 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944647 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944733 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.944948 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.945039 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.945252 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.945348 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.945614 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.945710 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.945930 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946014 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946235 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946337 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946553 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946646 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946862 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.946948 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.947177 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.947341 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.947525 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.947609 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.947801 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.947896 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.948133 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.948235 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.948439 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.948526 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.948752 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.948840 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949068 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949156 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949372 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949466 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949675 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949762 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.949977 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950073 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950282 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950367 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950590 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950678 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950888 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.950974 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.951134 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.951225 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.951430 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.951517 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.951729 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.951816 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952028 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952130 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952350 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952455 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952649 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952733 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.952952 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953038 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953248 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953353 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953551 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953637 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953851 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.953936 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.954149 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.954243 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.954448 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.954534 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.954747 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.954839 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955044 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955140 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955363 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955451 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955644 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955729 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.955941 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956027 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956267 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956364 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956573 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956660 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956872 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.956957 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.957170 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.957257 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.957468 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.957569 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.957767 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.957891 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958069 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958168 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958367 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958451 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958664 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958764 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.958971 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959057 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959271 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959363 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959572 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959667 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959876 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.959961 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.960204 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.960291 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.960504 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.960592 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.960807 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.960900 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.961127 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.961230 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.961428 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.961516 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.961737 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.961823 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962038 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962125 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962340 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962428 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962637 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962724 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.962935 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963030 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963231 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963331 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963547 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963637 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963827 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.963928 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.964148 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.964251 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.964445 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.964541 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.964760 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.964930 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965073 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965166 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965373 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965458 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965674 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965769 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.965973 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.966061 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.966277 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.966361 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.966584 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.966680 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.966904 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:49:22.966991 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.967239 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.967334 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.967548 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.967635 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.967876 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968002 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968232 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968318 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968548 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968634 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968855 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.968942 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.969165 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.969266 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.969484 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.969570 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.969790 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.969875 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.970096 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.970190 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.970404 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.970500 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.970715 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.970800 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971028 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971120 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971343 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971447 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971654 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971747 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.971966 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.972118 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.972309 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.972404 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.972619 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.972717 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.972933 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973028 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973245 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973343 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973559 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973646 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973866 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.973960 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.974193 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.974286 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.974505 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.974592 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.974823 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.974917 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.975146 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.975240 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.975464 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.975550 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.975771 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.975919 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.976901 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977026 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977118 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977206 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977297 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977297 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977549 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977768 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.977920 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.978078 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.978487 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.978589 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.978801 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.978940 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.979119 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.979254 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.979433 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.979564 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.979748 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.979878 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.980086 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.980232 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.980543 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.980686 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.980851 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.980985 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981118 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981277 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981433 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981575 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981706 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981842 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.981970 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.982107 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.982236 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.982365 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.982500 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.982636 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.982765 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983000 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983148 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983339 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983477 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983636 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983763 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.983953 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.984128 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.984288 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.984420 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.984592 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.984733 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.984904 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985037 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985212 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985354 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985518 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985664 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985829 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.985963 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.986139 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.986279 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.986450 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.986594 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.986761 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.986897 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.987073 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.987216 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.987379 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.987521 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.987697 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.987826 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988005 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988155 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988374 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988463 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988642 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988775 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.988942 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989036 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989246 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989341 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989558 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989645 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989861 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.989946 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.990166 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.990252 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.990475 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.990562 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.990777 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.990862 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.991092 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.991179 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.991400 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.991520 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.991708 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.991803 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.992019 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.992170 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.992379 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.992466 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.992692 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.992791 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993004 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993091 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993317 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993411 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993632 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993730 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.993935 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994028 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994245 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994341 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994547 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994634 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994849 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.994937 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.995152 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.995238 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.995460 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.995547 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.995762 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.995850 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996085 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996176 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996389 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996477 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996691 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996777 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.996992 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997077 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997294 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997381 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997605 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997692 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997903 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.997996 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.998203 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.998327 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.998499 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.998585 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.998817 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.998912 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.999127 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.999220 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.999425 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.999520 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.999728 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:22.999828 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.000031 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.000131 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.000394 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.000481 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.000703 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.000802 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001016 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001101 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001327 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001413 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001638 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001726 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.001946 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002033 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002257 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002345 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002575 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002670 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002883 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.002968 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.003196 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.003284 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.003503 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.003591 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.003811 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.003897 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.004140 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.004230 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.004458 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.004553 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.004757 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.004842 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.005070 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.005157 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.005394 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.005481 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.005705 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.005793 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006021 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006114 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006323 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006410 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006639 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006724 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.006953 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.007053 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.007260 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.007348 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.007567 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.007662 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.007920 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008076 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008259 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008350 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008577 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008675 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008885 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.008980 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.009196 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.009291 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.009500 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.009587 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.009807 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.009905 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.010112 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.010198 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.010425 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.010512 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.010729 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.010817 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.011040 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.011135 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.011363 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.011450 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.011692 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.011781 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012002 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012220 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012336 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012423 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012652 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012742 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.012957 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013054 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013263 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013386 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013572 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013669 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013873 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.013960 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.014176 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.014271 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.014485 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.014573 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.014795 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.014881 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.015102 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.015201 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.015405 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.015497 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.015702 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.015787 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016011 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016175 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016339 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016424 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016645 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016739 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.016946 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017121 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017250 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017336 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017567 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017652 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017874 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.017961 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.018180 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.018268 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.018486 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.018573 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.018785 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.018872 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.019087 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.019175 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.019407 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.019493 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.019712 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.019798 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020011 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020147 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020334 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020422 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020634 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020722 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.020964 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.021058 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.021270 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.021363 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.021571 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.021659 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.021875 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022009 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022178 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022323 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022481 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022619 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022792 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.022945 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.023088 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.023229 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.023389 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.023523 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.023732 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.023867 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024063 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024206 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024353 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024484 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024659 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024749 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.024968 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025055 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025273 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025360 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025579 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025667 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025887 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.025974 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.026190 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.026274 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.026497 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.026583 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.026800 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.026894 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.027103 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.027190 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.027408 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.027495 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.027721 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.027817 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.028029 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.028318 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.028406 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.028646 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.028742 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.028953 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.029039 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.029269 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.029356 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.029584 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.029833 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.029921 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.030168 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.030254 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.030485 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.030585 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.030805 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.030892 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.031123 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.031224 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.031428 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.031525 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.031731 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.031826 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032032 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032151 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032363 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032450 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032666 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032768 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.032965 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033053 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033266 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033359 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033572 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033669 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033870 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.033956 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.034170 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.034255 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.034468 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.034565 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.034768 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.034854 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035072 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035157 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035369 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035458 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035669 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035755 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.035964 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036067 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036289 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036377 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036600 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036687 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036894 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.036981 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.037190 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.037279 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.037487 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.037581 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.037807 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.037895 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038111 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038197 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038410 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038544 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038712 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038853 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.038996 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.039130 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.039390 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.039521 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.039697 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.039836 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.040016 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.040213 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.040346 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.040476 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.040627 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.040850 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041012 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041145 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041278 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041411 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041542 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041686 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041818 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.041948 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042077 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042210 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042356 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042489 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042657 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042792 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.042961 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.043096 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.043262 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.043397 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.043567 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.043703 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.043867 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.044002 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.044204 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.044343 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.044512 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.044646 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.044797 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.045317 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.045538 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.045705 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.045705 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.045959 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046092 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046232 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046378 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046512 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046597 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046678 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046861 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.046959 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.047170 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.047264 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.047476 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.047625 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.047766 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.047929 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.048154 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.048318 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.048502 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.048642 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.048778 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.048930 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049074 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049209 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049364 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049514 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049673 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049815 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.049959 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050103 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050248 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050392 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050560 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050705 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050842 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.050971 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.051108 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.051252 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.051412 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.051557 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.051701 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.051859 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052004 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052255 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052423 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052570 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052732 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052880 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.052985 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053072 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053154 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053286 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053371 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053496 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053580 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053713 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053873 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.053961 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.054178 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.054357 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.054507 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.054671 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.054844 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.054984 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055137 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055284 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055425 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055578 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055668 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055800 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.055955 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.056084 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.056281 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.056373 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.056584 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.056682 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.056912 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057067 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057232 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057367 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057509 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057596 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057814 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.057905 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.058115 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.058215 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.058426 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.058556 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.058738 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.058894 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.059092 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.059238 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.059381 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.059566 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.059708 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.059921 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.060113 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.060230 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.060423 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.060568 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.060709 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.060863 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061002 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061152 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061318 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061404 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061528 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061626 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.061771 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.062085 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.062172 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.062389 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.062653 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.062750 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063001 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063087 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063313 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063470 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063624 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063816 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.063971 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.064200 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.064349 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.064484 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.064640 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.064771 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.064910 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.065067 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.065198 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.065382 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.065531 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.065694 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.065836 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066010 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066117 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066322 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066420 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066639 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066725 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.066949 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067034 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067258 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067353 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067564 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067656 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067876 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.067962 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.068208 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.068299 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.068512 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.068597 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.068819 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.068909 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.069125 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.069216 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.069428 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.069513 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.069739 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.069830 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.070043 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.070133 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.070406 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.070510 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.070720 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.070809 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.071060 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.071148 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.071366 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.071461 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.071808 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.072143 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.072298 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.072450 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.072553 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.072766 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.072871 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.073074 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.073171 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.073387 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.073481 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.073689 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.073777 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074007 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074095 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074328 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074422 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074638 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074734 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.074992 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.075112 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.075301 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.075456 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.075596 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.075744 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.075883 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.076020 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.076240 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.076384 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.076550 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.076726 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.076866 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077003 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077138 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077273 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077446 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077600 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077739 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.077876 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.078048 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.078199 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.078441 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.078610 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.078775 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.078920 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079066 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079211 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079387 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079540 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079684 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079828 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.079979 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.080164 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.080357 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.080507 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.080662 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.080844 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.080981 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081079 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081282 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081378 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081593 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081681 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081901 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.081999 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.082221 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.082316 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.082536 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.082641 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.082837 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.082924 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.083152 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.083247 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.083454 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.083543 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.083769 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.083862 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.084107 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.084214 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.084411 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.084509 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.084730 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.084816 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.085051 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.085159 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.085367 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.085456 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.085689 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.085783 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.086076 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.086181 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.086402 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.086507 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.086705 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.086794 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087007 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087103 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087317 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087405 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087621 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087711 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.087924 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.088616 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.088756 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.088756 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.088955 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089059 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089180 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089311 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089448 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089633 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089755 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.089962 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.090085 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.090272 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.090386 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.090585 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.090707 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.090962 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091103 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091211 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091372 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091536 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091649 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091856 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.091970 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.092196 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.092502 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.092811 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.092927 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.093113 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.093227 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.093417 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.093530 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.093717 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.094154 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.094287 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.094396 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.094502 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095114 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095188 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095280 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095363 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095431 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095497 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095576 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095770 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.095913 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.096075 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.096400 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.096718 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.097033 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.097353 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.097651 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.097953 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.098145 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.098241 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.098511 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.098656 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.098808 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.098897 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.099120 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.099228 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.099423 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.099525 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.099720 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.099813 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.100022 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.100182 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.100518 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.100862 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.101088 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.101424 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.101800 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.102130 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.102448 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.102861 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103022 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103163 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103294 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103425 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103568 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103711 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.103909 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.104074 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.104314 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.104636 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.105107 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.105280 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.105589 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.105911 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.106227 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.106547 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.106863 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.107176 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.107488 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.107573 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.107799 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.107907 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.108136 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.108288 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.108443 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.108621 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.108756 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.108948 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.109064 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.109269 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.109383 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.109593 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.109909 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110033 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110223 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110337 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110537 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110659 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110847 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.110960 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.111187 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.111308 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.111466 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.111578 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.111773 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.111892 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.112105 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.112236 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.112448 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.112560 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.112709 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.112823 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113020 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113173 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113376 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113545 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113663 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113794 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.113961 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.114161 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.114310 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.114492 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.114637 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.114819 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.114953 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.115158 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.115271 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.115460 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.115595 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.115785 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.115919 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.116137 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.116309 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.116456 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.116594 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.116739 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.116877 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117038 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117223 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117369 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117525 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117672 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117810 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.117976 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.118134 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.118273 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.118410 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.118581 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.118726 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.118890 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.119043 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.119182 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.119493 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.119635 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.119803 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.119956 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.120335 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.120495 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.120648 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.120820 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.120964 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.121187 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.121335 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.121473 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.121610 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.121760 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.121896 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.122042 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.122179 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.122486 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.122636 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.122774 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.122926 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.123089 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.123295 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.123436 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.123573 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.123720 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.123868 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.124007 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.124183 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.124404 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.124546 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.124727 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.124897 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125039 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125193 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125396 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125536 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125682 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125839 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.125990 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126127 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126263 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126409 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126560 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126697 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126834 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.126986 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.127139 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.127283 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.127435 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.127596 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.127740 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.127890 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.128201 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.128445 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.128602 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.128746 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.128889 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129032 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129176 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129331 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129479 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129656 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129805 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.129949 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.130099 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.130254 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.130407 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.130563 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.130710 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.130853 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131006 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131150 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131295 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131446 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131605 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131749 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.131906 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.132101 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.132254 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.132399 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.132629 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.132782 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.132989 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.133137 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.133394 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.133556 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.133719 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.133874 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134037 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134183 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134336 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134482 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134632 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134787 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.134931 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.135075 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.135218 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.135438 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.135606 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.135771 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.135916 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136079 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136230 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136374 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136374 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136664 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136810 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.136995 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.137152 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.137322 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.137490 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.137668 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.137860 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.138031 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.138206 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.138206 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.138536 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.138709 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.138876 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.139053 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.139214 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.139367 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.139521 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.139666 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.139910 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140085 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140235 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140378 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140534 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140679 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140822 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.140965 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.141121 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.141266 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.141427 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.141572 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.141715 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.141877 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142021 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142172 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142324 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142324 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142602 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142829 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.142979 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.143131 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.143276 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.143436 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.143436 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.143781 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.143935 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.144113 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.144280 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.144434 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.144578 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.144721 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.144864 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145017 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145161 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145303 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145446 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145667 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145826 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.145984 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.146127 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.146269 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.146470 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.146619 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.146775 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.146926 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147075 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147218 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147362 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147518 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147674 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147830 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.147975 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.148154 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.148300 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.148476 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.148651 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.148794 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.148937 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149081 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149224 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149376 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149520 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149663 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149825 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.149969 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.150113 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.150264 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.150416 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.150560 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.150703 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.150854 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151008 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151163 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151307 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151457 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151599 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151753 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.151905 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.152073 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.152224 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.152367 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.152367 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.152637 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.152818 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.153034 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.153182 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.153326 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.153479 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.153652 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.153880 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154030 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154173 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154323 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154478 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154638 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154638 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154920 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.154920 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.155193 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.155346 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.155499 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.155499 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.155875 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156027 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156195 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156339 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156500 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156645 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156788 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.156930 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.157094 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.157238 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.157463 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.157628 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.157773 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.157915 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158057 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158209 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158353 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158497 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158639 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158788 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.158932 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159083 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159227 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159388 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159533 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159676 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159820 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.159820 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.160162 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.160309 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.160452 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.160452 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.160742 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.160888 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161031 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161173 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161326 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161469 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161630 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161774 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.161918 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162068 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162212 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162353 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162506 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162651 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162804 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.162948 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.163188 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.163357 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.163503 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.163646 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.163791 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164013 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164207 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164370 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164516 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164516 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164798 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.164941 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.165084 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.165245 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.165390 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.165540 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.165684 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.165829 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166064 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166223 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166368 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166522 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166678 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166823 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.166989 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.167138 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.167291 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.167435 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.167578 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.167734 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.167889 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168087 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168240 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168385 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168529 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168671 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168826 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.168971 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.169124 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.169267 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.169410 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.169561 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.169705 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.169848 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.170302 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.170455 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.170607 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.170760 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.170905 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171048 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171191 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171344 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171488 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171645 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171800 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.171944 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.172169 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.172319 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.172463 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.172664 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.172827 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.172972 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.173124 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.173352 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.173528 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.173674 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.173817 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.173967 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174196 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174287 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174367 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174450 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174530 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174609 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174695 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174785 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174876 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.174965 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175053 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175134 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175220 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175396 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175495 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175709 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.175797 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.176072 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.176442 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.176593 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.176726 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.176819 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.176991 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.177125 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.177312 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.177423 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.177632 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.177729 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.177946 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.178041 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.178269 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.178375 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.178592 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.178696 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.178906 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179004 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179216 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179310 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179527 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179630 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179883 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.179981 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.180223 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.180426 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 20:49:23.180527 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.180838 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.181153 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.181467 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.181793 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.182119 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.182427 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.182753 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.183073 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.183394 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.183713 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.184024 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.184567 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.184910 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.185257 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.185599 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.185933 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.186262 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.186599 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.186924 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.187262 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.187598 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.187921 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.188614 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.188954 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.189314 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.189637 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.189990 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.190325 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.190647 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.190968 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.191281 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:49:23.191537 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=114919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 20:49:23.247002 ncdv-master-1 devstack@n-api.service[114918]: INFO dbcounter [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Registered counter for database nova_api Jul 02 20:49:23.259949 ncdv-master-1 devstack@n-api.service[114919]: INFO dbcounter [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Registered counter for database nova_api Jul 02 20:49:23.269104 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_db.sqlalchemy.engines [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.276449 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writer thread running {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.280981 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.287688 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writer thread running {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.332716 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.context [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=114918) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 20:49:23.337121 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_concurrency.lockutils [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:49:23.339084 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_concurrency.lockutils [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:49:23.340141 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_concurrency.lockutils [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:49:23.342437 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_concurrency.lockutils [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:49:23.343506 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.context [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=114919) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 20:49:23.344928 ncdv-master-1 devstack@n-api.service[114918]: INFO dbcounter [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Registered counter for database nova_cell0 Jul 02 20:49:23.350040 ncdv-master-1 devstack@n-api.service[114918]: INFO dbcounter [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Registered counter for database nova_cell1 Jul 02 20:49:23.350730 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:49:23.353570 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:49:23.354531 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:49:23.357226 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:49:23.359783 ncdv-master-1 devstack@n-api.service[114919]: INFO dbcounter [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Registered counter for database nova_cell0 Jul 02 20:49:23.359909 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_db.sqlalchemy.engines [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.363756 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_db.sqlalchemy.engines [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.365900 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writer thread running {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.366669 ncdv-master-1 devstack@n-api.service[114919]: INFO dbcounter [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Registered counter for database nova_cell1 Jul 02 20:49:23.377019 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.377968 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.384889 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writer thread running {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.386958 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writer thread running {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.507896 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writer thread running {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.517001 ncdv-master-1 devstack@n-api.service[114918]: INFO dbcounter [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Registered counter for database nova_cell0 Jul 02 20:49:23.526134 ncdv-master-1 devstack@n-api.service[114918]: DEBUG oslo_db.sqlalchemy.engines [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.531581 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writer thread running {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.533270 ncdv-master-1 devstack@n-api.service[114919]: INFO dbcounter [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Registered counter for database nova_cell0 Jul 02 20:49:23.541822 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_db.sqlalchemy.engines [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=114919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:49:23.546518 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writer thread running {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:49:23.986746 ncdv-master-1 devstack@n-api.service[114918]: WARNING keystonemiddleware.auth_token [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 20:49:23.987322 ncdv-master-1 devstack@n-api.service[114919]: WARNING keystonemiddleware.auth_token [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 20:49:23.994125 ncdv-master-1 devstack@n-api.service[114918]: WARNING keystonemiddleware.auth_token [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 20:49:23.994513 ncdv-master-1 devstack@n-api.service[114919]: WARNING keystonemiddleware.auth_token [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 20:49:24.214914 ncdv-master-1 devstack@n-api.service[114918]: WARNING keystonemiddleware.auth_token [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 20:49:24.217673 ncdv-master-1 devstack@n-api.service[114919]: WARNING keystonemiddleware.auth_token [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 20:49:24.220957 ncdv-master-1 devstack@n-api.service[114918]: WARNING keystonemiddleware.auth_token [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 20:49:24.223637 ncdv-master-1 devstack@n-api.service[114919]: WARNING keystonemiddleware.auth_token [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 20:49:24.226188 ncdv-master-1 devstack@n-api.service[114918]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591c26739c0 pid: 114918 (default app) Jul 02 20:49:24.228610 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:49:24.228779 ncdv-master-1 devstack@n-api.service[114919]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591c26739c0 pid: 114919 (default app) Jul 02 20:49:24.229800 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-90ee14b5-f668-4b20-9eb9-5c096d6f0661 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002019 Jul 02 20:49:24.230171 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Sat Jul 2 20:49:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:44.531703 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:44.533755 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002988 Jul 02 20:50:44.534335 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:50:44 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:44.545798 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writing DB stats nova_api:SELECT=3 {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:44.546761 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writing DB stats nova_cell0:SELECT=3 {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:44.548624 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writing DB stats nova_cell1:SELECT=3 {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:44.549475 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:44.972853 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-61240ab5-feb8-443d-a656-e46342c81bf5 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:45.003233 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-61240ab5-feb8-443d-a656-e46342c81bf5 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462944 Jul 02 20:50:45.004157 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 20:50:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:50:47.370897 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:47.371914 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-ad84202a-0734-45dc-bbec-44ae7304029a None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 02 20:50:47.372346 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 2/4] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:47.438097 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-8ae418e6-8cb8-4656-8ebd-2ed947c1bb1a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:47.459954 ncdv-master-1 devstack@n-api.service[114918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:50:47.459954 ncdv-master-1 devstack@n-api.service[114918]: warnings.warn(msg) Jul 02 20:50:47.489742 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-8ae418e6-8cb8-4656-8ebd-2ed947c1bb1a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.111496 Jul 02 20:50:47.490459 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 3/5] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:50:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:50:47.505019 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_api:SELECT=3 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:47.506365 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_cell0:SELECT=3 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:47.507245 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_cell1:SELECT=3 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:47.508065 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:47.710077 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-ecc82e72-d7d6-4fa1-9d40-9c28ddb96348 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:47.712667 ncdv-master-1 devstack@n-api.service[114919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:50:47.712667 ncdv-master-1 devstack@n-api.service[114919]: warnings.warn(msg) Jul 02 20:50:47.787311 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-ecc82e72-d7d6-4fa1-9d40-9c28ddb96348 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287848 Jul 02 20:50:47.799066 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 3/6] 10.222.0.43 () {64 vars in 1335 bytes} [Sat Jul 2 20:50:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:50:50.137381 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-8ae418e6-8cb8-4656-8ebd-2ed947c1bb1a admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:50.138417 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-8ae418e6-8cb8-4656-8ebd-2ed947c1bb1a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 02 20:50:50.138814 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 4/7] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:50.248703 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-486b3ee4-57e9-4d91-b7b7-f679828ebe6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:50.268058 ncdv-master-1 devstack@n-api.service[114919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:50:50.268058 ncdv-master-1 devstack@n-api.service[114919]: warnings.warn(msg) Jul 02 20:50:50.287009 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-486b3ee4-57e9-4d91-b7b7-f679828ebe6f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142305 Jul 02 20:50:50.287520 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 4/8] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:50:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:50:50.300192 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-946efcca-c173-4a8e-83de-a346373aa819 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:50.301861 ncdv-master-1 devstack@n-api.service[114918]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:50:50.301861 ncdv-master-1 devstack@n-api.service[114918]: warnings.warn(msg) Jul 02 20:50:50.341585 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-946efcca-c173-4a8e-83de-a346373aa819 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045476 Jul 02 20:50:50.342164 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 5/9] 10.222.0.43 () {64 vars in 1335 bytes} [Sat Jul 2 20:50:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:50:52.724485 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-486b3ee4-57e9-4d91-b7b7-f679828ebe6f admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:52.726257 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-486b3ee4-57e9-4d91-b7b7-f679828ebe6f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002298 Jul 02 20:50:52.727127 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:52.804636 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-519b58af-c178-4918-a392-611c2cb7a027 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:52.828654 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-519b58af-c178-4918-a392-611c2cb7a027 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094719 Jul 02 20:50:52.829913 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 6/11] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:50:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:50:52.844209 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-2ca416d0-354e-47bd-963b-941d693f4ee9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:52.877389 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-2ca416d0-354e-47bd-963b-941d693f4ee9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037476 Jul 02 20:50:52.878329 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 6/12] 10.222.0.43 () {64 vars in 1335 bytes} [Sat Jul 2 20:50:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) Jul 02 20:50:55.628362 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-519b58af-c178-4918-a392-611c2cb7a027 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:55.630038 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-519b58af-c178-4918-a392-611c2cb7a027 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Jul 02 20:50:55.630635 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 7/13] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:55.696521 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-491620af-d05b-4747-82d1-413fa68d7766 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:55.719271 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-491620af-d05b-4747-82d1-413fa68d7766 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082387 Jul 02 20:50:55.727877 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 7/14] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:50:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:50:55.732505 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-d0b05d50-6c1d-4c62-a9a4-93d075f4656d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:55.760715 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-d0b05d50-6c1d-4c62-a9a4-93d075f4656d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031892 Jul 02 20:50:55.762174 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 8/15] 10.222.0.43 () {64 vars in 1335 bytes} [Sat Jul 2 20:50:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:50:58.266208 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-491620af-d05b-4747-82d1-413fa68d7766 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:50:58.267234 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-491620af-d05b-4747-82d1-413fa68d7766 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 02 20:50:58.267835 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 8/16] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:50:58.330510 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-c0392ffe-5749-4195-bcfe-a81c6741b25a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 20, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:58.353336 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-c0392ffe-5749-4195-bcfe-a81c6741b25a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078937 Jul 02 20:50:58.354771 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 9/17] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:50:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 20:50:58.366978 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-fc76b7e8-0c40-4d6c-9823-aaa34fe3aa51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:50:58.393129 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-fc76b7e8-0c40-4d6c-9823-aaa34fe3aa51 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030190 Jul 02 20:50:58.394196 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 9/18] 10.222.0.43 () {64 vars in 1335 bytes} [Sat Jul 2 20:50:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:51:00.916776 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-c0392ffe-5749-4195-bcfe-a81c6741b25a admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:00.917795 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-c0392ffe-5749-4195-bcfe-a81c6741b25a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 02 20:51:00.918199 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 10/19] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:00.977823 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-d8ab7a50-de3c-4785-860b-994537f25a91 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:01.009763 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-d8ab7a50-de3c-4785-860b-994537f25a91 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085273 Jul 02 20:51:01.010311 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 10/20] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 20:51:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 20:51:03.516598 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-c0392ffe-5749-4195-bcfe-a81c6741b25a admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:03.517655 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-c0392ffe-5749-4195-bcfe-a81c6741b25a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jul 02 20:51:03.518056 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 11/21] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 20:51:03.579383 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-b4e93087-740a-47d3-be08-eee537acd68d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:03.598115 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-b4e93087-740a-47d3-be08-eee537acd68d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074052 Jul 02 20:51:03.598653 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 11/22] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:51:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:03.610695 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-1e16f705-b3c3-41ae-843b-27f533484355 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:03.634480 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-1e16f705-b3c3-41ae-843b-27f533484355 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027533 Jul 02 20:51:03.643574 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 12/23] 10.222.0.43 () {64 vars in 1332 bytes} [Sat Jul 2 20:51:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:51:06.238637 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-b4e93087-740a-47d3-be08-eee537acd68d admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:06.239642 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-b4e93087-740a-47d3-be08-eee537acd68d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 02 20:51:06.240053 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 20:51:06.302555 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-7a2aec1f-5b8f-49d5-8bfa-02cc976bd7da admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "2", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:06.322570 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-7a2aec1f-5b8f-49d5-8bfa-02cc976bd7da admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076472 Jul 02 20:51:06.323153 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 13/25] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:51:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:06.336221 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-0f140e08-4a51-45ed-9c37-b33dcf759ab9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:06.359904 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-0f140e08-4a51-45ed-9c37-b33dcf759ab9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027320 Jul 02 20:51:06.360651 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 13/26] 10.222.0.43 () {64 vars in 1332 bytes} [Sat Jul 2 20:51:06 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:51:08.824012 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-7a2aec1f-5b8f-49d5-8bfa-02cc976bd7da admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:08.825293 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-7a2aec1f-5b8f-49d5-8bfa-02cc976bd7da admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jul 02 20:51:08.825955 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 14/27] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:08.890613 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-4ac79bdf-ccfb-4c6f-a642-bbcd302c242f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:08.914607 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-4ac79bdf-ccfb-4c6f-a642-bbcd302c242f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082832 Jul 02 20:51:08.915364 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 14/28] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:51:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 20:51:08.927447 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-21c5a556-ffe3-4ee5-814e-b9ad74c84941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:08.951591 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-21c5a556-ffe3-4ee5-814e-b9ad74c84941 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028102 Jul 02 20:51:08.952204 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 15/29] 10.222.0.43 () {64 vars in 1332 bytes} [Sat Jul 2 20:51:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:51:11.399876 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-4ac79bdf-ccfb-4c6f-a642-bbcd302c242f admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:11.400932 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-4ac79bdf-ccfb-4c6f-a642-bbcd302c242f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jul 02 20:51:11.401358 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 15/30] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:11.464728 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-69108635-e51d-48b7-9c4d-bdc8f8e7b475 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "id": "4", "os-flavor-access:is_public": true, "disk": 80}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:11.483476 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-69108635-e51d-48b7-9c4d-bdc8f8e7b475 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076316 Jul 02 20:51:11.484022 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 16/31] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:51:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:11.496329 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-35350d9f-17ed-40a2-80c7-1301b0f6042e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:11.520676 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-35350d9f-17ed-40a2-80c7-1301b0f6042e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028235 Jul 02 20:51:11.521252 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 16/32] 10.222.0.43 () {64 vars in 1332 bytes} [Sat Jul 2 20:51:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 20:51:13.896293 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-69108635-e51d-48b7-9c4d-bdc8f8e7b475 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:13.897331 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-69108635-e51d-48b7-9c4d-bdc8f8e7b475 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 02 20:51:13.897747 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 17/33] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:13.955160 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-c30db2f0-6907-4d74-bad8-c7e580b3d600 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "id": "5"}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:13.974500 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-c30db2f0-6907-4d74-bad8-c7e580b3d600 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070817 Jul 02 20:51:13.975230 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 17/34] 10.222.0.43 () {64 vars in 1282 bytes} [Sat Jul 2 20:51:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:13.988208 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-2db3d301-2f3f-4536-9c85-05749538c7bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:14.013778 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-2db3d301-2f3f-4536-9c85-05749538c7bc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029566 Jul 02 20:51:14.014682 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 18/35] 10.222.0.43 () {64 vars in 1332 bytes} [Sat Jul 2 20:51:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:51:41.233840 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-c30db2f0-6907-4d74-bad8-c7e580b3d600 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:41.235119 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-c30db2f0-6907-4d74-bad8-c7e580b3d600 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Jul 02 20:51:41.235656 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 18/36] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:51:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:41.249540 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:41.299569 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-50f32daf-bf3e-4490-b59f-c33a17bee13b admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:41.317338 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-50f32daf-bf3e-4490-b59f-c33a17bee13b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072703 Jul 02 20:51:41.317862 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 20:51:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:42.327026 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-c30db2f0-6907-4d74-bad8-c7e580b3d600 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:42.328641 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-c30db2f0-6907-4d74-bad8-c7e580b3d600 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002402 Jul 02 20:51:42.329264 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 19/38] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:42.614662 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-0558c3dc-964f-464b-82aa-ac7c5d5edcac admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:42.622986 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.wsgi [None req-0558c3dc-964f-464b-82aa-ac7c5d5edcac admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-0558c3dc-964f-464b-82aa-ac7c5d5edcac admin admin] Request method failure captured: Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Accept: application/json Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Accept-Encoding: gzip, deflate Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Connection: keep-alive Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Content-Length: 0 Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Host: 10.222.0.43 Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Openstack-Api-Version: compute 2.90 Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: Openstack-System-Scope: None Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: User-Agent: python-novaclient Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Auth-Token: gAAAAABiwK_egUdq70JpuTDU4OHVIBtBVX8d99W5RPVAw4ycTA9Xl0TZi6dADSYffRIxC1_Guzk9ubR9mns-F3OJ-8UNx9RL8jN-zcSfI6KShY5_qhY6weU9m88IZWR3h8WRtHkZeF2Sn9l3BRhRlAbQuQzHTkrkxzJCDtu5x-vm2tNMBzISZAc Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Domain-Id: None Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Domain-Name: None Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Identity-Status: Confirmed Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Is-Admin-Project: True Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Domain-Id: default Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Domain-Name: Default Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Name: admin Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Role: admin,member,reader Jul 02 20:51:42.655002 ncdv-master-1 devstack@n-api.service[114918]: X-Roles: admin,member,reader Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4c9de22f7474b6f9c2ca908dc6ecd1f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}] Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant: admin Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant-Name: admin Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-User: admin Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-User-Domain-Id: default Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-User-Domain-Name: Default Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-User-Id: a7a87f488da04c6c9c5276b1487113d6 Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: X-User-Name: admin Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: method: > Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: exception: Flavor 42 could not be found. Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: action_args: {'id': '42'} Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 20:51:42.656874 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:42.657899 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.659115 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-0558c3dc-964f-464b-82aa-ac7c5d5edcac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 20:51:42.660338 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-0558c3dc-964f-464b-82aa-ac7c5d5edcac admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.105144 Jul 02 20:51:42.660338 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 20:51:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:42.666875 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-f6714991-277e-422b-8086-97f7793e27d6 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:42.674625 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:42.696116 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-f6714991-277e-422b-8086-97f7793e27d6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032962 Jul 02 20:51:42.696704 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 20/40] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 20:51:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:42.714476 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-4c5256ff-fee6-48f8-bf54-74f817697bef admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:42.736752 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-4c5256ff-fee6-48f8-bf54-74f817697bef admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025938 Jul 02 20:51:42.737273 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 21/41] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 20:51:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:42.748142 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-5a0cf8c5-4ec5-424d-8c10-e5fb01cf116d admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:42.755259 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.wsgi [None req-5a0cf8c5-4ec5-424d-8c10-e5fb01cf116d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-5a0cf8c5-4ec5-424d-8c10-e5fb01cf116d admin admin] Request method failure captured: Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Accept: application/json Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Accept-Encoding: gzip, deflate Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Connection: keep-alive Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Content-Length: 0 Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Host: 10.222.0.43 Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Openstack-Api-Version: compute 2.90 Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: Openstack-System-Scope: None Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: User-Agent: python-novaclient Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Auth-Token: gAAAAABiwK_egUdq70JpuTDU4OHVIBtBVX8d99W5RPVAw4ycTA9Xl0TZi6dADSYffRIxC1_Guzk9ubR9mns-F3OJ-8UNx9RL8jN-zcSfI6KShY5_qhY6weU9m88IZWR3h8WRtHkZeF2Sn9l3BRhRlAbQuQzHTkrkxzJCDtu5x-vm2tNMBzISZAc Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Domain-Id: None Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Domain-Name: None Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Identity-Status: Confirmed Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Is-Admin-Project: True Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Domain-Id: default Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Domain-Name: Default Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Name: admin Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Role: admin,member,reader Jul 02 20:51:42.758614 ncdv-master-1 devstack@n-api.service[114919]: X-Roles: admin,member,reader Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4c9de22f7474b6f9c2ca908dc6ecd1f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}] Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant: admin Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant-Name: admin Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-User: admin Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-User-Domain-Id: default Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-User-Domain-Name: Default Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-User-Id: a7a87f488da04c6c9c5276b1487113d6 Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: X-User-Name: admin Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: method: > Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: exception: Flavor 42 could not be found. Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: action_args: {'id': '42'} Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 20:51:42.761042 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:42.762145 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:42.763313 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-5a0cf8c5-4ec5-424d-8c10-e5fb01cf116d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=114919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 20:51:42.764458 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-5a0cf8c5-4ec5-424d-8c10-e5fb01cf116d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015838 Jul 02 20:51:42.764458 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 21/42] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 20:51:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:43.598775 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-4c5256ff-fee6-48f8-bf54-74f817697bef admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:43.599844 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-4c5256ff-fee6-48f8-bf54-74f817697bef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jul 02 20:51:43.600435 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 22/43] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:43.824548 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-239d7119-830f-4613-91cb-65dca2eb2b02 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:43.830678 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.wsgi [None req-239d7119-830f-4613-91cb-65dca2eb2b02 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-239d7119-830f-4613-91cb-65dca2eb2b02 admin admin] Request method failure captured: Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Accept: application/json Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Accept-Encoding: gzip, deflate Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Connection: keep-alive Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Content-Length: 0 Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Host: 10.222.0.43 Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Openstack-Api-Version: compute 2.90 Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: Openstack-System-Scope: None Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: User-Agent: python-novaclient Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Auth-Token: gAAAAABiwK_fp5sJP8JGviCJ5N21plB8I_A4qIALshx9Xm0cFh53OpNLYPeoARPfV38JBbfFJqcGbx0g08r1VavI6GUYyd0hQ2neuIu3-NlLkL-OLtnu6zfVkOREMDaRrno9a-_ha-C5NklqGHQP-0h1TWwiP2GGixKcLBS20N6m6q4FLLLdHEw Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Domain-Id: None Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Domain-Name: None Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Identity-Status: Confirmed Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Is-Admin-Project: True Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Domain-Id: default Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Domain-Name: Default Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Name: admin Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Role: admin,member,reader Jul 02 20:51:43.832269 ncdv-master-1 devstack@n-api.service[114919]: X-Roles: admin,member,reader Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4c9de22f7474b6f9c2ca908dc6ecd1f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}] Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant: admin Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant-Name: admin Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-User: admin Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-User-Domain-Id: default Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-User-Domain-Name: Default Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-User-Id: a7a87f488da04c6c9c5276b1487113d6 Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: X-User-Name: admin Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: method: > Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: exception: Flavor 84 could not be found. Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: action_args: {'id': '84'} Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 20:51:43.833803 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:43.834909 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.836344 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-239d7119-830f-4613-91cb-65dca2eb2b02 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 20:51:43.838140 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-239d7119-830f-4613-91cb-65dca2eb2b02 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.088655 Jul 02 20:51:43.838140 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 22/44] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 20:51:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:43.846955 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-daa0177c-9c54-45bd-90ee-d2d19de0e7b3 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:43.863685 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-daa0177c-9c54-45bd-90ee-d2d19de0e7b3 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022748 Jul 02 20:51:43.864282 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 20:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:43.874335 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-64ea74e8-da27-466a-9f88-9454804b3e07 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:43.888564 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-64ea74e8-da27-466a-9f88-9454804b3e07 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017923 Jul 02 20:51:43.889054 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 20:51:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:43.898542 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fcbad25e-3d7c-442a-a1fd-8ba6536d0fdd admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:43.904219 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.wsgi [None req-fcbad25e-3d7c-442a-a1fd-8ba6536d0fdd admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fcbad25e-3d7c-442a-a1fd-8ba6536d0fdd admin admin] Request method failure captured: Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Accept: application/json Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Accept-Encoding: gzip, deflate Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Connection: keep-alive Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Content-Length: 0 Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Host: 10.222.0.43 Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Openstack-Api-Version: compute 2.90 Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: Openstack-System-Scope: None Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: User-Agent: python-novaclient Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Auth-Token: gAAAAABiwK_fp5sJP8JGviCJ5N21plB8I_A4qIALshx9Xm0cFh53OpNLYPeoARPfV38JBbfFJqcGbx0g08r1VavI6GUYyd0hQ2neuIu3-NlLkL-OLtnu6zfVkOREMDaRrno9a-_ha-C5NklqGHQP-0h1TWwiP2GGixKcLBS20N6m6q4FLLLdHEw Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Domain-Id: None Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Domain-Name: None Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Identity-Status: Confirmed Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Is-Admin-Project: True Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Domain-Id: default Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Domain-Name: Default Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Name: admin Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Role: admin,member,reader Jul 02 20:51:43.905701 ncdv-master-1 devstack@n-api.service[114918]: X-Roles: admin,member,reader Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4c9de22f7474b6f9c2ca908dc6ecd1f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}] Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant: admin Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant-Name: admin Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-User: admin Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-User-Domain-Id: default Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-User-Domain-Name: Default Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-User-Id: a7a87f488da04c6c9c5276b1487113d6 Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: X-User-Name: admin Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: method: > Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: exception: Flavor 84 could not be found. Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: action_args: {'id': '84'} Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 20:51:43.907053 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:43.907916 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:43.909195 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fcbad25e-3d7c-442a-a1fd-8ba6536d0fdd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=114918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 20:51:43.910571 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fcbad25e-3d7c-442a-a1fd-8ba6536d0fdd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012125 Jul 02 20:51:43.910571 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 20:51:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:44.787105 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-64ea74e8-da27-466a-9f88-9454804b3e07 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:44.788167 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-64ea74e8-da27-466a-9f88-9454804b3e07 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 02 20:51:44.788570 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 24/48] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:44.991983 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-23a72457-aa06-42be-ba13-5c4db8d87453 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:44.998201 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.wsgi [None req-23a72457-aa06-42be-ba13-5c4db8d87453 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-23a72457-aa06-42be-ba13-5c4db8d87453 admin admin] Request method failure captured: Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Accept: application/json Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Accept-Encoding: gzip, deflate Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Connection: keep-alive Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Content-Length: 0 Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Host: 10.222.0.43 Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Openstack-Api-Version: compute 2.90 Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: Openstack-System-Scope: None Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: User-Agent: python-novaclient Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Auth-Token: gAAAAABiwK_gCamo8fJz-RQb0IgV5RcNdR6ARUbXlKR8FJUhTBJ8LwGEi9rWjkVIV8Hk3v2NXpOf2-OBASeDbadzoF0EEJc9rW1lxpNukNZZa3oCpA4s4vVEc8vXks-67qsvLx0g8FWm6k8K0V5v2GO7M3FKSTnqSKL3jPpe6qzEAd6vE0rG274 Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Domain-Id: None Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Domain-Name: None Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Identity-Status: Confirmed Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Is-Admin-Project: True Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Domain-Id: default Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Domain-Name: Default Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Project-Name: admin Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Role: admin,member,reader Jul 02 20:51:44.999694 ncdv-master-1 devstack@n-api.service[114918]: X-Roles: admin,member,reader Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4c9de22f7474b6f9c2ca908dc6ecd1f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}] Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant: admin Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-Tenant-Name: admin Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-User: admin Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-User-Domain-Id: default Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-User-Domain-Name: Default Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-User-Id: a7a87f488da04c6c9c5276b1487113d6 Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: X-User-Name: admin Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: method: > Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: exception: Flavor 451 could not be found. Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: action_args: {'id': '451'} Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 20:51:45.001217 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:45.002202 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.003510 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-23a72457-aa06-42be-ba13-5c4db8d87453 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114918) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 20:51:45.004795 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-23a72457-aa06-42be-ba13-5c4db8d87453 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066804 Jul 02 20:51:45.004795 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 25/49] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 20:51:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:45.010839 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-6a6e37b2-5fc1-4178-8462-d24e2f2113b4 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:45.025045 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-6a6e37b2-5fc1-4178-8462-d24e2f2113b4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017818 Jul 02 20:51:45.025769 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 25/50] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 20:51:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:45.035866 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:45.050020 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018375 Jul 02 20:51:45.050535 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 26/51] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 20:51:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:51:45.060371 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-366bab31-199e-46d5-b562-40b1f140208f admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:45.065969 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.wsgi [None req-366bab31-199e-46d5-b562-40b1f140208f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-366bab31-199e-46d5-b562-40b1f140208f admin admin] Request method failure captured: Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Accept: application/json Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Accept-Encoding: gzip, deflate Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Connection: keep-alive Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Content-Length: 0 Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Host: 10.222.0.43 Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Openstack-Api-Version: compute 2.90 Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: Openstack-System-Scope: None Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: User-Agent: python-novaclient Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Auth-Token: gAAAAABiwK_gCamo8fJz-RQb0IgV5RcNdR6ARUbXlKR8FJUhTBJ8LwGEi9rWjkVIV8Hk3v2NXpOf2-OBASeDbadzoF0EEJc9rW1lxpNukNZZa3oCpA4s4vVEc8vXks-67qsvLx0g8FWm6k8K0V5v2GO7M3FKSTnqSKL3jPpe6qzEAd6vE0rG274 Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Domain-Id: None Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Domain-Name: None Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Identity-Status: Confirmed Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Is-Admin-Project: True Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Openstack-Nova-Api-Version: 2.90 Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Domain-Id: default Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Domain-Name: Default Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Project-Name: admin Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Role: admin,member,reader Jul 02 20:51:45.067501 ncdv-master-1 devstack@n-api.service[114919]: X-Roles: admin,member,reader Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d4c9de22f7474b6f9c2ca908dc6ecd1f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d4c9de22f7474b6f9c2ca908dc6ecd1f"}]}] Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant: admin Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant-Id: d4c9de22f7474b6f9c2ca908dc6ecd1f Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-Tenant-Name: admin Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-User: admin Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-User-Domain-Id: default Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-User-Domain-Name: Default Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-User-Id: a7a87f488da04c6c9c5276b1487113d6 Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: X-User-Name: admin Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: method: > Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: exception: Flavor 451 could not be found. Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: action_args: {'id': '451'} Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 20:51:45.069284 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:45.070240 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: ERROR nova.api.openstack.wsgi Jul 02 20:51:45.071537 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-366bab31-199e-46d5-b562-40b1f140208f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=114919) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 20:51:45.072843 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-366bab31-199e-46d5-b562-40b1f140208f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012455 Jul 02 20:51:45.072843 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 26/52] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 20:51:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:45.908046 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:45.909078 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 02 20:51:45.909482 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:46.117781 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-27e1d9a9-fd00-44fd-8103-4dab1cf200d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:46.138561 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-27e1d9a9-fd00-44fd-8103-4dab1cf200d7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.080764 Jul 02 20:51:46.139130 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 27/54] 10.222.0.43 () {64 vars in 1235 bytes} [Sat Jul 2 20:51:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:46.978737 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:46.979756 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 02 20:51:46.980235 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:47.194491 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-44a5315e-bb0f-4388-8156-88a99230d9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:47.219254 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-44a5315e-bb0f-4388-8156-88a99230d9a4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.091029 Jul 02 20:51:47.219804 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 28/56] 10.222.0.43 () {64 vars in 1235 bytes} [Sat Jul 2 20:51:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:48.062385 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:48.063425 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jul 02 20:51:48.063838 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 29/57] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:48.268411 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-693f7453-f92b-4ea0-8af0-9dadf380b102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:48.287145 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-693f7453-f92b-4ea0-8af0-9dadf380b102 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073253 Jul 02 20:51:48.287686 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 29/58] 10.222.0.43 () {64 vars in 1235 bytes} [Sat Jul 2 20:51:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 20:51:49.135581 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:49.136808 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Jul 02 20:51:49.137384 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 30/59] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:49.341351 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-f0c57776-74b2-44f2-821a-b101ad3d111f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 20:51:49.361704 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-f0c57776-74b2-44f2-821a-b101ad3d111f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078701 Jul 02 20:51:49.362225 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 30/60] 10.222.0.43 () {64 vars in 1235 bytes} [Sat Jul 2 20:51:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 20:51:50.207717 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:50.208777 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Jul 02 20:51:50.209158 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 31/61] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:51:50.424572 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-3823f2d9-555c-4a70-b396-845d92bc6323 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:51:50.445711 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-3823f2d9-555c-4a70-b396-845d92bc6323 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080132 Jul 02 20:51:50.446338 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 31/62] 10.222.0.43 () {60 vars in 1202 bytes} [Sat Jul 2 20:51:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:52:57.889635 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:52:57.890633 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-fbf04abf-0b63-4fe3-aaa5-579e73dd98d8 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 02 20:52:57.891025 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 930 bytes} [Sat Jul 2 20:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:52:57.899678 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:57.953702 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-b5a486ce-dcf1-43fb-af7e-018986a50342 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:52:57.974022 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-b5a486ce-dcf1-43fb-af7e-018986a50342 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076721 Jul 02 20:52:57.974547 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 32/64] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 20:52:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:52:58.003557 ncdv-master-1 devstack@n-api.service[114918]: DEBUG dbcounter [-] [114918] Writing DB stats nova_api:SELECT=14 {{(pid=114918) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:58.007728 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-201e5890-ede2-4775-90f2-c4beff05ee9f admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:52:58.015761 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-201e5890-ede2-4775-90f2-c4beff05ee9f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013684 Jul 02 20:52:58.016355 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 33/65] 10.222.0.43 () {60 vars in 1282 bytes} [Sat Jul 2 20:52:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:52:58.030158 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-d76fbeff-c16a-444a-a6c3-47a499493d2f admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:52:58.042297 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-d76fbeff-c16a-444a-a6c3-47a499493d2f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017200 Jul 02 20:52:58.043039 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 33/66] 10.222.0.43 () {60 vars in 1285 bytes} [Sat Jul 2 20:52:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 20:52:58.055373 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-d2ea9748-ed7a-4f07-a906-28bd81b46f6a admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:52:58.063827 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-d2ea9748-ed7a-4f07-a906-28bd81b46f6a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012101 Jul 02 20:52:58.064420 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 34/67] 10.222.0.43 () {60 vars in 1285 bytes} [Sat Jul 2 20:52:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:52:58.076892 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-5f255b14-e594-4bfd-830c-84db4a00af36 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:52:58.085376 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-5f255b14-e594-4bfd-830c-84db4a00af36 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012643 Jul 02 20:52:58.085919 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 34/68] 10.222.0.43 () {60 vars in 1282 bytes} [Sat Jul 2 20:52:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 20:59:06.617357 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-d2ea9748-ed7a-4f07-a906-28bd81b46f6a admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:59:06.618378 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-d2ea9748-ed7a-4f07-a906-28bd81b46f6a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 02 20:59:06.618768 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 35/69] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:59:06.768486 ncdv-master-1 devstack@n-api.service[114919]: DEBUG dbcounter [-] [114919] Writing DB stats nova_api:SELECT=6 {{(pid=114919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:06.889270 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-74877541-3660-4a8f-9973-967d0f32fbe3 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:59:06.890434 ncdv-master-1 devstack@n-api.service[114919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:59:06.890434 ncdv-master-1 devstack@n-api.service[114919]: warnings.warn(msg) Jul 02 20:59:06.891646 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-74877541-3660-4a8f-9973-967d0f32fbe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:59:06.892074 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-74877541-3660-4a8f-9973-967d0f32fbe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:59:06.892892 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-74877541-3660-4a8f-9973-967d0f32fbe3 admin admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:59:06.893315 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-74877541-3660-4a8f-9973-967d0f32fbe3 admin admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:59:06.934654 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-74877541-3660-4a8f-9973-967d0f32fbe3 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.167810 Jul 02 20:59:06.935557 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 35/70] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 20:59:06 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:59:07.782745 ncdv-master-1 devstack@n-api.service[114918]: DEBUG nova.api.openstack.wsgi [None req-d2ea9748-ed7a-4f07-a906-28bd81b46f6a admin admin] Calling method '>' {{(pid=114918) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:59:07.784176 ncdv-master-1 devstack@n-api.service[114918]: INFO nova.api.openstack.requestlog [None req-d2ea9748-ed7a-4f07-a906-28bd81b46f6a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Jul 02 20:59:07.784568 ncdv-master-1 devstack@n-api.service[114918]: [pid: 114918|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1074 bytes} [Sat Jul 2 20:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 20:59:07.997774 ncdv-master-1 devstack@n-api.service[114919]: DEBUG nova.api.openstack.wsgi [None req-f213ded0-731e-4518-b581-7b9934449bb5 admin admin] Calling method '>' {{(pid=114919) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 20:59:07.998953 ncdv-master-1 devstack@n-api.service[114919]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:59:07.998953 ncdv-master-1 devstack@n-api.service[114919]: warnings.warn(msg) Jul 02 20:59:08.000250 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-f213ded0-731e-4518-b581-7b9934449bb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:59:08.000686 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-f213ded0-731e-4518-b581-7b9934449bb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:59:08.001476 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-f213ded0-731e-4518-b581-7b9934449bb5 admin admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 20:59:08.001908 ncdv-master-1 devstack@n-api.service[114919]: DEBUG oslo_concurrency.lockutils [None req-f213ded0-731e-4518-b581-7b9934449bb5 admin admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=114919) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 20:59:08.024993 ncdv-master-1 devstack@n-api.service[114919]: INFO nova.api.openstack.requestlog [None req-f213ded0-731e-4518-b581-7b9934449bb5 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.090497 Jul 02 20:59:08.025538 ncdv-master-1 devstack@n-api.service[114919]: [pid: 114919|app: 0|req: 36/72] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 20:59:07 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 20:59:54.126680 ncdv-master-1 devstack@n-api.service[114917]: Sat Jul 2 20:59:54 2022 - graceful shutdown triggered... Jul 02 20:59:54.126805 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 02 20:59:54.127847 ncdv-master-1 devstack@n-api.service[114919]: Gracefully killing worker 2 (pid: 114919)... Jul 02 20:59:54.128272 ncdv-master-1 devstack@n-api.service[114918]: Gracefully killing worker 1 (pid: 114918)... Jul 02 20:59:55.127917 ncdv-master-1 devstack@n-api.service[114917]: worker 1 buried after 1 seconds Jul 02 20:59:55.127917 ncdv-master-1 devstack@n-api.service[114917]: worker 2 buried after 1 seconds Jul 02 20:59:55.127917 ncdv-master-1 devstack@n-api.service[114917]: goodbye to uWSGI. Jul 02 20:59:55.129651 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 02 20:59:55.130264 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 02 20:59:55.133029 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 02 20:59:55.173737 ncdv-master-1 devstack@n-api.service[131029]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 20:59:55 2022] *** Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: nodename: ncdv-master-1 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: machine: x86_64 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: clock source: unix Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: pcre jit disabled Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: detected number of CPU cores: 4 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: current working directory: / Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: detected binary path: /usr/bin/uwsgi-core Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: your processes number limit is 47680 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: your memory page size is 4096 bytes Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: detected max file descriptor number: 2048 Jul 02 20:59:55.176649 ncdv-master-1 devstack@n-api.service[131029]: lock engine: pthread robust mutexes Jul 02 20:59:55.177793 ncdv-master-1 devstack@n-api.service[131029]: thunder lock: enabled Jul 02 20:59:55.177793 ncdv-master-1 devstack@n-api.service[131029]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 02 20:59:55.177793 ncdv-master-1 devstack@n-api.service[131029]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 20:59:55.226878 ncdv-master-1 devstack@n-api.service[131029]: Python main interpreter initialized at 0x56192e4a59c0 Jul 02 20:59:55.226878 ncdv-master-1 devstack@n-api.service[131029]: python threads support enabled Jul 02 20:59:55.226878 ncdv-master-1 devstack@n-api.service[131029]: your server socket listen backlog is limited to 100 connections Jul 02 20:59:55.226878 ncdv-master-1 devstack@n-api.service[131029]: your mercy for graceful operations on workers is 90 seconds Jul 02 20:59:55.227304 ncdv-master-1 devstack@n-api.service[131029]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 20:59:55.227304 ncdv-master-1 devstack@n-api.service[131029]: *** Operational MODE: preforking *** Jul 02 20:59:55.227558 ncdv-master-1 devstack@n-api.service[131029]: *** uWSGI is running in multiple interpreter mode *** Jul 02 20:59:55.227558 ncdv-master-1 devstack@n-api.service[131029]: spawned uWSGI master process (pid: 131029) Jul 02 20:59:55.227783 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 02 20:59:55.228929 ncdv-master-1 devstack@n-api.service[131029]: spawned uWSGI worker 1 (pid: 131044, cores: 1) Jul 02 20:59:55.228929 ncdv-master-1 devstack@n-api.service[131029]: spawned uWSGI worker 2 (pid: 131045, cores: 1) Jul 02 20:59:55.228929 ncdv-master-1 devstack@n-api.service[131029]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 20:59:56.558601 ncdv-master-1 devstack@n-api.service[131044]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 20:59:56.560015 ncdv-master-1 devstack@n-api.service[131045]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 02 20:59:57.322586 ncdv-master-1 devstack@n-api.service[131044]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:59:57.322586 ncdv-master-1 devstack@n-api.service[131044]: from cryptography.utils import int_from_bytes Jul 02 20:59:57.322886 ncdv-master-1 devstack@n-api.service[131044]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:59:57.322886 ncdv-master-1 devstack@n-api.service[131044]: from cryptography.utils import int_from_bytes Jul 02 20:59:57.326384 ncdv-master-1 devstack@n-api.service[131045]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:59:57.326384 ncdv-master-1 devstack@n-api.service[131045]: from cryptography.utils import int_from_bytes Jul 02 20:59:57.326699 ncdv-master-1 devstack@n-api.service[131045]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:59:57.326699 ncdv-master-1 devstack@n-api.service[131045]: from cryptography.utils import int_from_bytes Jul 02 20:59:59.754273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:59:59.754859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:59:59.755089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:59:59.755444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:59:59.755677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:59:59.756077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.756435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.756761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.757047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.757414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.757728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.758156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.758352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.758657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.758934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.759245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.759574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.759876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:59:59.760326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.760416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:59:59.760493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.760584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.760783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:59:59.760887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.761078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:59:59.761177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.761334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:59:59.761447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.761717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.761821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.762052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.762229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.762414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.762704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.763043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.763364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.763699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.764023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.764195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.764399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.764656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.764829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.764977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.765295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.765480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.765679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.765910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.766086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.766304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.766469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.766620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.766935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.767100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.767256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.767555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.767732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.768080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.768282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.768428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.768602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.768768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.768914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.769063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.769307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.769469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.769633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.769783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.769954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.770106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.770261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.770403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.770565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.770721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.770866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.771072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.771238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.771406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.772148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.772334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.772506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.772664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.772809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.773997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.774142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.774292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.774435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.774585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.774766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.774912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.775999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.776190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.776363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.776526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.776689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.776833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.776985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.777140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.777294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.777446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.777620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.777771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.779427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.779603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.779762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.779925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.780157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.780662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.780835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.780983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.781164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.781327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.781472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.781636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.781786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.781939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.782110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.782255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.782408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.782574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.782737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.782895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.783047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.783201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.783352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.783501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.784325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.784503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.784653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.784798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.784952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.785104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.785261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.785413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.785571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.785716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.785859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.786001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.786368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.786531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.786676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.786835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.788032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.788247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.788443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.788624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.788789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.788938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.789978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.790130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.790284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.790445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.790591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.790740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.791020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.791684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.791855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.792012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.792204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.792355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.792514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.792670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.792822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.793236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.793405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.793550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.793720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.793940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.794997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.795140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.795293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.795448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.795600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.795758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.795912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.796075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.796235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.796394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.799997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.801026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.801166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.801329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.801623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.801816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.801976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.802158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.802305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.802467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.802614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.802768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.802919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.803071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.803223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.803374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.803535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.803688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.803882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.804077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.804240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.804535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.804701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.804846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.804997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.805150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.808207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.808920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.809083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.809253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.809401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.809555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.809710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.809867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.810989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.811136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.811297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.811450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.811593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.811743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.811903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.812067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.812232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.812395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.812551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.812551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.814049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.814260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.814260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.814578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.814819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.815053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.815180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.815292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.815486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.815829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.816616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.816793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.816940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.817628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.817798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.817953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.818122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.818279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.818425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.818831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.819653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.820471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.820642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.820886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.821003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.821750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.821913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.822060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.822275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.822467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.822625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.823340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.823539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.823699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.823860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.824237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.824401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.824556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.824714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.826331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:59:59.826501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.826663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.826816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.826968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.827112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.827363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.827527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.827680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.827880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.828064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.828357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.828518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.828666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.828666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.828970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.829122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.829265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.829422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.829574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.829718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.829874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.830032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.830311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.830465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.830623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.830770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.831146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.831319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.831465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.831617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.831874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.832032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.832425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.832577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.832730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.832883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.833044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.833188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.833362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.833554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.833702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.833887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.834045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.834446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.834652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.834799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.834952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.835111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.835256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.835526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.835703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.835858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.836369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.836847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.837002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.837165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.837360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.837649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.837649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.838000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.838154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.838384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.838541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.838735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.838937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.839094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.839240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.839383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.839638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.839825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.840011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.840319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.840463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.840576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.840820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.841078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.841273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.841439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.841584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.841792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.841968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.842149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.842317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.842466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.842617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.842617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.842938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.843125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.843274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.843465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.843662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.843802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.844076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.844240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.844623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.844783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.844994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.845176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.845332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.845514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.845671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.845823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.846055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.846225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.846457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.846621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.846773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.846925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.847083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.847299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.847588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.847850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.848001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.848483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.848483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.848786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.848946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.849091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.850358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.851617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.852932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.853074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.853224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.853409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.853601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.853601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.853887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.854038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.854189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.854341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.854549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.854872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.855984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.856833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.857398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.857542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.857722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.857955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.858274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.858274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.858566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.858566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.858953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.859132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.859324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.859482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.859634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.859823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.859975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.860194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.860348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.860505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.860505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.860505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.860505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.861096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.861242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.861242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.861605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.861847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.862718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.863904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.864076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.864226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.864434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.864587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.864757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.865963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.866119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.866271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.866416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.866565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.866565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.866843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.867028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.867183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.867326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.867478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.867648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.867648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.868098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.868463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.868627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.868771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.868922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.869080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.869080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.869369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.869554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.869698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.869849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.870928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.871121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.871121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.871396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.871545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.871696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.871912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.872236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.872405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.872554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.872743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.872903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.873050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.873226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.873387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.873568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.873746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.873900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.874882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.875256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.875423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.875423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.875754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.875754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.876195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.876195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.877068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.877573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.878291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.878884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.879074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.879226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.879436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.879643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.879643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.879643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.880262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.880466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.880632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.880795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.880958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.881118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.881269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.881418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.881630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.881782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.881975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.882138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.882349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.882502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.882502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.882812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.882973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.883306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.883465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.883625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.883784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.883973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.884223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.884397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.884602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.884764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.884915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.885170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.885524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.885708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.885877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.886994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.887154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.887315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.887466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.887623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.887801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.887963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.888148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.888400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.888557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.888718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.888868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.889807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.890110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.890293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.890452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.890452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.890753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.890912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.891071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.891071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.891484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.891637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.891799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.891974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.892212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.892368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.892527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.892527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.892827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.892827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.893127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.893127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.893421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.893585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.893747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.894161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.894330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.894488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.894664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.894942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.895104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.895264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.895440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.895739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.895912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.896083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.896239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.896420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.896573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.896743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.896911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.897070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.897228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.897378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.897538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.897688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.897846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.898994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.899144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.899293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.899293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.899637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.899788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.899960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.900160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.900344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.900497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.900662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.900826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.900975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.901125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.901275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.901438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.901590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.901590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.901882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.902962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.903121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.903285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.903436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.903586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.903745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.903896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.904066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.904235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.904426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.904584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.904752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.904936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.905165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.905855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.906049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.906210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.906362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.906528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.906689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.906848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.907971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.908172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.908368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.908524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.908674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.908825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.908973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.909177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.909339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.909499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.909668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.909952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.910132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.910294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.910446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.910605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.910756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.910913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.911073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.911233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.911384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.911534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.911691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.911691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.912009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.912182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.912343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.912529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.912684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.912840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.913035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.913291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.913582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.913836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.914929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.915078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.915320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.915484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.915643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.915820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.916155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.916334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.916507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.916668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.916827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.916988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.917146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.917380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.918111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.918268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.918427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.918588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.918748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.918900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.919061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.919219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.919378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.919531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.919688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.919839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.920117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.920285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.920450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.920610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.920760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.920919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.921097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.923663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.923859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.924033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.924220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.924386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.924386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.924736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.924899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.925053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.925204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.925392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.925547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.925707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.925871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.926050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.926227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.926381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.926531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.926691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.926859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.927020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.927171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.928661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.928837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.929084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.929240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.929240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.929556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.929940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.930099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.930917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.931159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.931328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.931480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.931632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.931795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.931947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.932128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.932307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.932508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.932672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.932832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.933000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.933151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.933301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.933767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.933911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.934953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.935993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.936913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.937925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.938978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.939961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.940939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.941913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.942903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.943906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.944855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.945945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.946950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.947958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.948851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.949914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.950676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.951905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.952937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.953936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.954791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.955023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.955195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.955357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.955640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.955743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.955993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.956179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.956355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.956650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.956745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.956969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.957155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.957283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.957616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.957710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.957940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.958126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.958271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.958671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.958779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.959167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.959276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.959496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.959681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.960153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.960518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.960637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.960890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.961043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.961356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.961470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.961716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.961885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.962074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.962359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.962482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.962724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.962826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.963240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.963352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.963441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.963698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.963834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.964033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.964226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.964376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.964668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.964780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.965016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.965167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.965336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.965632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.965789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.965977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.966083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.966318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.966458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.966646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.966761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.966964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.967064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.967281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.967388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.967597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.967708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.967950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.968120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.968360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.968479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.968775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.968887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.969205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.969309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.969455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.969558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.969817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.969936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.970093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.970284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.970435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.970562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.970719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.970822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.971044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.971207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.971513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.971694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.971889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.972090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.972251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.972438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.972582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.972727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.972879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.973958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.974103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.974254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.974427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.974584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.974738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.974882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.975075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.975224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.975404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.975568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.975714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.975975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.976173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.976320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.976463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.976617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.976770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.976916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.977979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.978130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.978315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.978478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.978667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.978841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.978991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.979145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.979521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.979677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.979820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.979973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.980187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.980427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.980594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.980742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.980894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.981043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.981194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.981347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.981492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.981810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.981965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.982133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.982280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.982440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.982585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.982736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.982891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.983944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.984172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.984331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.984476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.984626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.984782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.984927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.985096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.985242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.985395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.985538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.985688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.985860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.986104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.986263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.986440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.986595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.986779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.987882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.988091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.988246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.988390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.988565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.988723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.988868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.989012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.989155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.989298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.989593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.989757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.989903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.990958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.991111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.991265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.991451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.991598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.991892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.992100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.992100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.992393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.992560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.992706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.992858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.993885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.994038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.994202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.994357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.994541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.994688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.994863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.995918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.996110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.996342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.996499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.996685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.996832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.996976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.997128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.997275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.997426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.997578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.997722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.997874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.998902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.999047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.999197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.999342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.999486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:59:59.999898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.000094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.000262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.000420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.000565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.000717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.000876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.001021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.001173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.001173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.001464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.001617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.001763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.002066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.002216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.002376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.002578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.002738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.002926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.003975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.004153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.004299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.004462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.004620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.004799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.004947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.005107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.005261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.027977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.028971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.029937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.030017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.030099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.030160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.030853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.031185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.031448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.031776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.031776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.031972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.035412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.035495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.035569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.035660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.035743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.035817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.036635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.036704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.036794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.036794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.036928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.036999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.037922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.038058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.038144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.038144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.043901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.043901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.044968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.045948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.046877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.047930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.048927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.049921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.050935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.051966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.052940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.053729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.054924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.055983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.056952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131044) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 21:00:00.057828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.057828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.058122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.058291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.058626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.059001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.059392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.059704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.060065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.060402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.060751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.061091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.061413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.061831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.062101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.062538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.062869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.063229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.063572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.063903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.064257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.064577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 21:00:00.064832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131045) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 21:00:00.126037 ncdv-master-1 devstack@n-api.service[131044]: INFO dbcounter [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Registered counter for database nova_api Jul 02 21:00:00.134716 ncdv-master-1 devstack@n-api.service[131045]: INFO dbcounter [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Registered counter for database nova_api Jul 02 21:00:00.148295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.155560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.161733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_db.sqlalchemy.engines [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.168930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writer thread running {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.218529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.context [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=131044) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 21:00:00.222904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:00.224705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:00.225599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:00.227394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.context [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=131045) load_cells /opt/stack/nova/nova/context.py:464}} Jul 02 21:00:00.227507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:00.229610 ncdv-master-1 devstack@n-api.service[131044]: INFO dbcounter [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Registered counter for database nova_cell0 Jul 02 21:00:00.231786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:00.233589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:00.233852 ncdv-master-1 devstack@n-api.service[131044]: INFO dbcounter [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Registered counter for database nova_cell1 Jul 02 21:00:00.234598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:00.236919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:00.240077 ncdv-master-1 devstack@n-api.service[131045]: INFO dbcounter [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Registered counter for database nova_cell0 Jul 02 21:00:00.243849 ncdv-master-1 devstack@n-api.service[131045]: INFO dbcounter [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Registered counter for database nova_cell1 Jul 02 21:00:00.244253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.245074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.251676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.254419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_db.sqlalchemy.engines [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.255660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_db.sqlalchemy.engines [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.262121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writer thread running {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.391581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.402594 ncdv-master-1 devstack@n-api.service[131044]: INFO dbcounter [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Registered counter for database nova_cell0 Jul 02 21:00:00.403538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writer thread running {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.410040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_db.sqlalchemy.engines [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131044) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.413379 ncdv-master-1 devstack@n-api.service[131045]: INFO dbcounter [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Registered counter for database nova_cell0 Jul 02 21:00:00.414949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writer thread running {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.422535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_db.sqlalchemy.engines [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131045) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 21:00:00.427211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writer thread running {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 21:00:00.852760 ncdv-master-1 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 21:00:00.860332 ncdv-master-1 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 21:00:00.869583 ncdv-master-1 devstack@n-api.service[131045]: WARNING keystonemiddleware.auth_token [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 21:00:00.877185 ncdv-master-1 devstack@n-api.service[131045]: WARNING keystonemiddleware.auth_token [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 21:00:01.080135 ncdv-master-1 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 21:00:01.086101 ncdv-master-1 devstack@n-api.service[131044]: WARNING keystonemiddleware.auth_token [None req-35ff69f7-63e3-4815-879b-3e542a300794 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 21:00:01.091978 ncdv-master-1 devstack@n-api.service[131044]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56192e4a59c0 pid: 131044 (default app) Jul 02 21:00:01.105203 ncdv-master-1 devstack@n-api.service[131045]: WARNING keystonemiddleware.auth_token [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 02 21:00:01.111350 ncdv-master-1 devstack@n-api.service[131045]: WARNING keystonemiddleware.auth_token [None req-9e3b7d3f-f207-4857-8936-e014de0997b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 02 21:00:01.116802 ncdv-master-1 devstack@n-api.service[131045]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56192e4a59c0 pid: 131045 (default app) Jul 02 21:00:48.297398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.298201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.299123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.299265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.299817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.300596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.301502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:48.315574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:49.491517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-300d2861-ee7c-4cd5-b8aa-0ed48182ded5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:49.493410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-300d2861-ee7c-4cd5-b8aa-0ed48182ded5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:49.493867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-300d2861-ee7c-4cd5-b8aa-0ed48182ded5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:49.494911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-300d2861-ee7c-4cd5-b8aa-0ed48182ded5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:49.495344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-300d2861-ee7c-4cd5-b8aa-0ed48182ded5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:49.529594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2f4b9c6-f34e-43fc-9045-667b28a96321 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:49.531188 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:49.531188 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:49.533678 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a2f4b9c6-f34e-43fc-9045-667b28a96321 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2f4b9c6-f34e-43fc-9045-667b28a96321 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin] Request method failure captured: Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIAd0yFJvRTpAWfRAZaVKdnStVMf8hf2hJrovQjM3PYhlPqz4ql1qyx83sboa7a0UuudVz1jETgr0T92UBdu2xNBkjoFsyHr0ShgVWbHN9hSUpRqssOwNbP_OE-3UmFQatCdjXm7azlFDhMmyo5VkxFRgDbrTcGQdlnF7LI2ga5x2Y Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ff96e14a835e4928a68e5df0452ad248 Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:00:49.549238 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff96e14a835e4928a68e5df0452ad248"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ff96e14a835e4928a68e5df0452ad248", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ff96e14a835e4928a68e5df0452ad248"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ff96e14a835e4928a68e5df0452ad248"}]}] Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ff96e14a835e4928a68e5df0452ad248 Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d707707ad60a4feb9e766a0e8ed8c2dd Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:49.550442 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid timestamp for date invalid_time Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'invalid_time'} Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:49.551076 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2f4b9c6-f34e-43fc-9045-667b28a96321 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:49.552780 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2f4b9c6-f34e-43fc-9045-667b28a96321 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524 tempest-InstanceUsageAuditLogNegativeTestJSON-1924230524-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.259093 Jul 02 21:00:49.557841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1/1] 10.222.0.43 () {58 vars in 1223 bytes} [Sat Jul 2 21:00:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1267 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:49.562822 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-300d2861-ee7c-4cd5-b8aa-0ed48182ded5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.270853 Jul 02 21:00:49.563669 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1163 bytes} [Sat Jul 2 21:00:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:00:49.868162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b261ecb4-be4c-4eff-92f5-77fc18c42c08 tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-681107083", "id": 1410157460, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:49.886063 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:49.886063 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:49.920945 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b261ecb4-be4c-4eff-92f5-77fc18c42c08 tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.361384 Jul 02 21:00:49.922024 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2/3] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:00:49 2022] POST /compute/v2.1/flavors => generated 448 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:00:49.975916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f4041c6-87f7-4559-b051-740bcb4fb1ad tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:49.978413 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:49.978413 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:49.980457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f4041c6-87f7-4559-b051-740bcb4fb1ad tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:49.980650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f4041c6-87f7-4559-b051-740bcb4fb1ad tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:49.981478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f4041c6-87f7-4559-b051-740bcb4fb1ad tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:49.981916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f4041c6-87f7-4559-b051-740bcb4fb1ad tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.006594 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f4041c6-87f7-4559-b051-740bcb4fb1ad tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.441762 Jul 02 21:00:50.007174 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:00:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:50.018875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c50f370f-75ee-41f7-8404-e825cdbed6d5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.019634 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.019634 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:50.020799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50f370f-75ee-41f7-8404-e825cdbed6d5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.021244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50f370f-75ee-41f7-8404-e825cdbed6d5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.022106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50f370f-75ee-41f7-8404-e825cdbed6d5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.022569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c50f370f-75ee-41f7-8404-e825cdbed6d5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.045975 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c50f370f-75ee-41f7-8404-e825cdbed6d5 tempest-AZAdminV2TestJSON-1576828409 tempest-AZAdminV2TestJSON-1576828409-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.037547 Jul 02 21:00:50.046582 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:50.078639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b8823ca-0fa0-4f82-8455-c48c18c093c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.079713 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.079713 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.082262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1b8823ca-0fa0-4f82-8455-c48c18c093c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '3e60c8745b5b4bcdaf75e83b4264dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44f2953a422441c8c6b6cb9ef62f295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b8823ca-0fa0-4f82-8455-c48c18c093c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Request method failure captured: Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH9xi9YOHFY0NxBdWX1qga8kV9vCK0WefImcXfPsJowhqUQxhJlXnyGQFnKuEYm3hKOiHDkJpIFafKWvENby-o8brLUJc5_sdgLHjGbDnvcB7xvBZBL0bWg4ohbOwoirHvZ8R266FCEPlSXSPWdKkLMx_MXuCYYw2EZkBjR2jH2h1E Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c44f2953a422441c8c6b6cb9ef62f295 Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:50.089986 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c44f2953a422441c8c6b6cb9ef62f295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c44f2953a422441c8c6b6cb9ef62f295", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c44f2953a422441c8c6b6cb9ef62f295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c44f2953a422441c8c6b6cb9ef62f295"}]}] Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c44f2953a422441c8c6b6cb9ef62f295 Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3e60c8745b5b4bcdaf75e83b4264dd3b Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:50.091271 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: action_args: {} Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:50.092120 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 02 21:00:50.093383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.095945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b8823ca-0fa0-4f82-8455-c48c18c093c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:50.096824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b8823ca-0fa0-4f82-8455-c48c18c093c4 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.173168 Jul 02 21:00:50.097367 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:00:49 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 174 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:50.178674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Calling method '.version_select at 0x7fabe7174670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.180171 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.180171 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:50.186904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=131044) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 02 21:00:50.187932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.188506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.215703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.216571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.221580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '.version_select at 0x7fabe71094c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.222701 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.222701 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.230646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.231179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.235783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=131045) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 02 21:00:50.237708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.238156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.238656 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7284f901-ab32-4a85-8277-3e84abb9e2d7 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.191086 Jul 02 21:00:50.239263 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 4/7] 10.222.0.43 () {60 vars in 1207 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:50.265746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.266200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.281487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.281908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.288118 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e806fd9c-5cc6-4301-8b6c-49235a14df2e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.189423 Jul 02 21:00:50.289013 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1166 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:50.308293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-845d8774-8d4c-45f3-bb97-04128a0ccb0e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-217356123", "id": 1674932858, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:50.325887 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.325887 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:50.363047 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-845d8774-8d4c-45f3-bb97-04128a0ccb0e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.122479 Jul 02 21:00:50.363652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 5/9] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:50 2022] POST /compute/v2.1/flavors => generated 429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:50.480661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-686ad3e0-f212-46d4-b9d1-6daeed49888f tempest-FlavorsV255TestJSON-674663129 tempest-FlavorsV255TestJSON-674663129-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.501194 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-686ad3e0-f212-46d4-b9d1-6daeed49888f tempest-FlavorsV255TestJSON-674663129 tempest-FlavorsV255TestJSON-674663129-project] 10.222.0.43 "GET /compute/v2.1/flavors/1410157460" status: 200 len: 448 microversion: 2.55 time: 0.211072 Jul 02 21:00:50.502123 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 5/10] 10.222.0.43 () {60 vars in 1198 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/flavors/1410157460 => generated 448 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:00:50.507022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bfc56376-5a6b-453a-b802-2a343ad1195b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1748191374"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:50.508498 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.508498 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.509800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-bfc56376-5a6b-453a-b802-2a343ad1195b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid 2dd6cb81-e582-4b7d-ac37-1bc3aa4b428c for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:50.566381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18e3d487-add1-4e15-b968-465d0e10e671 tempest-AZAdminNegativeTestJSON-601763336 tempest-AZAdminNegativeTestJSON-601763336-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.567347 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.567347 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:50.568425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18e3d487-add1-4e15-b968-465d0e10e671 tempest-AZAdminNegativeTestJSON-601763336 tempest-AZAdminNegativeTestJSON-601763336-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '031d2a0dc253402e82289c197d9cfd5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2be8b6009c94753aae37882ed620670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18e3d487-add1-4e15-b968-465d0e10e671 tempest-AZAdminNegativeTestJSON-601763336 tempest-AZAdminNegativeTestJSON-601763336-project] Request method failure captured: Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLH_apHamQxRtgcatlKf6nOMzsrbgldaf0qq2q7FZnC1Bm6oOvl6S-FjGiC5U3jYAvFV3aXURS1Ny3j8RfUTfR3kzEong86H4HObxW9sMg_a2-pV9HkIqYZkJHMoJ9CGzwQM5_oexzmmzBkeSq3hR3f2kQ9Cm8taLRw57JB1gB3Q6Iw Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f2be8b6009c94753aae37882ed620670 Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AZAdminNegativeTestJSON-601763336 Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:00:50.571386 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2be8b6009c94753aae37882ed620670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f2be8b6009c94753aae37882ed620670", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f2be8b6009c94753aae37882ed620670"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f2be8b6009c94753aae37882ed620670"}]}] Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AZAdminNegativeTestJSON-601763336 Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f2be8b6009c94753aae37882ed620670 Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-601763336 Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AZAdminNegativeTestJSON-601763336-project Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 031d2a0dc253402e82289c197d9cfd5d Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AZAdminNegativeTestJSON-601763336-project Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 02 21:00:50.572523 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:50.573387 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 02 21:00:50.574566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.576030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18e3d487-add1-4e15-b968-465d0e10e671 tempest-AZAdminNegativeTestJSON-601763336 tempest-AZAdminNegativeTestJSON-601763336-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:50.576253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bfc56376-5a6b-453a-b802-2a343ad1195b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072605 Jul 02 21:00:50.576943 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 6/11] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:50.578914 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18e3d487-add1-4e15-b968-465d0e10e671 tempest-AZAdminNegativeTestJSON-601763336 tempest-AZAdminNegativeTestJSON-601763336-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.212967 Jul 02 21:00:50.579928 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 215 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:50.581801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b718f60-7989-4361-b063-410a625da4f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.582917 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.582917 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.586998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62a45309-9696-4368-9335-8662578cedc8 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.588344 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.588344 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:50.598308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b718f60-7989-4361-b063-410a625da4f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '3e60c8745b5b4bcdaf75e83b4264dd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c44f2953a422441c8c6b6cb9ef62f295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b718f60-7989-4361-b063-410a625da4f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Request method failure captured: Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-02%2021:00:50 HTTP/1.1 Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH9xi9YOHFY0NxBdWX1qga8kV9vCK0WefImcXfPsJowhqUQxhJlXnyGQFnKuEYm3hKOiHDkJpIFafKWvENby-o8brLUJc5_sdgLHjGbDnvcB7xvBZBL0bWg4ohbOwoirHvZ8R266FCEPlSXSPWdKkLMx_MXuCYYw2EZkBjR2jH2h1E Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c44f2953a422441c8c6b6cb9ef62f295 Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:50.601232 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c44f2953a422441c8c6b6cb9ef62f295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c44f2953a422441c8c6b6cb9ef62f295", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c44f2953a422441c8c6b6cb9ef62f295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c44f2953a422441c8c6b6cb9ef62f295"}]}] Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c44f2953a422441c8c6b6cb9ef62f295 Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3e60c8745b5b4bcdaf75e83b4264dd3b Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:50.602534 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '2022-07-02 21:00:50'} Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:50.603140 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 02 21:00:50.604265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:50.605097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b718f60-7989-4361-b063-410a625da4f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:50.606336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b718f60-7989-4361-b063-410a625da4f2 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277 tempest-InstanceUsageAuditLogNegativeTestJSON-1915281277-project] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-02 21:00:50" status: 403 len: 128 microversion: 2.1 time: 0.028366 Jul 02 21:00:50.611099 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-02%2021%3A00%3A50 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:50.630532 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62a45309-9696-4368-9335-8662578cedc8 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1674932858" status: 202 len: 0 microversion: 2.1 time: 0.049225 Jul 02 21:00:50.632350 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:50 2022] DELETE /compute/v2.1/flavors/1674932858 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:50.638696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb6402da-1255-4c73-882c-e71290606b78 tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] Action: 'update', calling method: .version_select at 0x7fabe76981f0>, body: {"flavor": {"description": "new"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:50.639892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69dc62c7-3cd6-42f2-81ea-76f02db38e0d tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:50.642318 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.642318 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:50.658929 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.658929 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.699503 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb6402da-1255-4c73-882c-e71290606b78 tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/1410157460" status: 200 len: 449 microversion: 2.55 time: 0.069907 Jul 02 21:00:50.700742 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 8/15] 10.222.0.43 () {62 vars in 1218 bytes} [Sat Jul 2 21:00:50 2022] PUT /compute/v2.1/flavors/1410157460 => generated 449 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:00:50.705452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-95cf3349-fdc7-4ee4-a849-736cd4bc53a1 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.709766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dc62c7-3cd6-42f2-81ea-76f02db38e0d tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:50.711687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69dc62c7-3cd6-42f2-81ea-76f02db38e0d tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:50.741235 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-95cf3349-fdc7-4ee4-a849-736cd4bc53a1 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.039176 Jul 02 21:00:50.742304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:50.755140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1df507c9-d9b1-4fad-a8b8-6c87cec0d453 tempest-FlavorsV255TestJSON-674663129 tempest-FlavorsV255TestJSON-674663129-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.790597 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1df507c9-d9b1-4fad-a8b8-6c87cec0d453 tempest-FlavorsV255TestJSON-674663129 tempest-FlavorsV255TestJSON-674663129-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.047201 Jul 02 21:00:50.791516 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 10/17] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:50.796350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11df2285-bf54-405c-acb8-84153b2ab435 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1654910181", "id": 1795636116, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:50.798840 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.798840 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.836906 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11df2285-bf54-405c-acb8-84153b2ab435 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.044019 Jul 02 21:00:50.840183 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 11/18] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:50 2022] POST /compute/v2.1/flavors => generated 417 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:50.849472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07d924c3-188c-48f0-a5e5-4f311a53c4e4 tempest-FlavorsV255TestJSON-674663129 tempest-FlavorsV255TestJSON-674663129-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.875746 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07d924c3-188c-48f0-a5e5-4f311a53c4e4 tempest-FlavorsV255TestJSON-674663129 tempest-FlavorsV255TestJSON-674663129-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3410 microversion: 2.55 time: 0.034270 Jul 02 21:00:50.876909 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 12/19] 10.222.0.43 () {60 vars in 1165 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/flavors => generated 3410 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:50.881661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d37189b1-5e0d-458a-8e6e-5835321db532 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.901205 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d37189b1-5e0d-458a-8e6e-5835321db532 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5815 microversion: 2.1 time: 0.023011 Jul 02 21:00:50.902241 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 13/20] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/flavors/detail => generated 5815 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:50.907153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e52f6f96-7464-47d0-a10b-7f2eaec84c6a tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.908196 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:50.908196 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:50.934582 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e52f6f96-7464-47d0-a10b-7f2eaec84c6a tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1410157460" status: 202 len: 0 microversion: 2.55 time: 0.030655 Jul 02 21:00:50.935904 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 14/21] 10.222.0.43 () {60 vars in 1201 bytes} [Sat Jul 2 21:00:50 2022] DELETE /compute/v2.1/flavors/1410157460 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:00:50.943149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d1cb7d2c-6dd5-4d6e-ac7e-293c6d3ce22e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.965112 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d1cb7d2c-6dd5-4d6e-ac7e-293c6d3ce22e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1795636116" status: 202 len: 0 microversion: 2.1 time: 0.026646 Jul 02 21:00:50.966664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 15/22] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:50 2022] DELETE /compute/v2.1/flavors/1795636116 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:50.973986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-82b42ee3-e9e7-4513-a8e6-ea2e1b11906a tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:50.999024 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-82b42ee3-e9e7-4513-a8e6-ea2e1b11906a tempest-FlavorsV255TestJSON-434959067 tempest-FlavorsV255TestJSON-434959067-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.030327 Jul 02 21:00:51.000452 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 16/23] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:00:50 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:51.006315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a1d77445-2123-4257-be45-75425fdde9f3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.027213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a1d77445-2123-4257-be45-75425fdde9f3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024501 Jul 02 21:00:51.028158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 17/24] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:51.045898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8f0ad9f-bfd1-497e-a1c2-9286b0d747b8 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1137568548", "id": 1319895889, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:51.070181 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8f0ad9f-bfd1-497e-a1c2-9286b0d747b8 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.027913 Jul 02 21:00:51.078548 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 18/25] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:51 2022] POST /compute/v2.1/flavors => generated 429 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:00:51.087185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c76ac456-e8e9-4347-baf6-a2442efde01e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.109735 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c76ac456-e8e9-4347-baf6-a2442efde01e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1319895889" status: 202 len: 0 microversion: 2.1 time: 0.027675 Jul 02 21:00:51.111092 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 19/26] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:51 2022] DELETE /compute/v2.1/flavors/1319895889 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:51.118902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ba754d5-ffd0-4997-9fab-a7b0792874a3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.138514 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ba754d5-ffd0-4997-9fab-a7b0792874a3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023292 Jul 02 21:00:51.139249 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 20/27] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:00:51.159505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e75c57e4-09e0-478f-ac2d-eb6dcf3a38b1 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-733453822", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:51.180861 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e75c57e4-09e0-478f-ac2d-eb6dcf3a38b1 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.026644 Jul 02 21:00:51.182080 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 21/28] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:51 2022] POST /compute/v2.1/flavors => generated 506 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:51.194832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5db648f9-e37f-4d74-9e22-c1183a442df7 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.223475 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5db648f9-e37f-4d74-9e22-c1183a442df7 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/5745d842-25b5-4a65-8727-8b22641a9de7" status: 202 len: 0 microversion: 2.1 time: 0.034298 Jul 02 21:00:51.225350 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 22/29] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:00:51 2022] DELETE /compute/v2.1/flavors/5745d842-25b5-4a65-8727-8b22641a9de7 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:51.234079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aea73134-5e2b-401f-b61b-28afffdc96c3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.256798 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aea73134-5e2b-401f-b61b-28afffdc96c3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026812 Jul 02 21:00:51.257903 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 23/30] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:51.276343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e97ae3f8-12de-4948-a284-3e2fa71cd8f4 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1614446244", "id": "48d753fa-d441-46e4-abda-2fcd39b6aba8", "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:51.303029 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e97ae3f8-12de-4948-a284-3e2fa71cd8f4 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032364 Jul 02 21:00:51.308096 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 24/31] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:51 2022] POST /compute/v2.1/flavors => generated 507 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:51.327726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-72a5cc71-223b-4965-ab89-b7c2181ff577 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.375917 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-72a5cc71-223b-4965-ab89-b7c2181ff577 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/48d753fa-d441-46e4-abda-2fcd39b6aba8" status: 202 len: 0 microversion: 2.1 time: 0.065009 Jul 02 21:00:51.377215 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 25/32] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:00:51 2022] DELETE /compute/v2.1/flavors/48d753fa-d441-46e4-abda-2fcd39b6aba8 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:51.384983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-864a08b7-5048-469d-adea-c507d37fbe95 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.411486 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-864a08b7-5048-469d-adea-c507d37fbe95 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030181 Jul 02 21:00:51.412764 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 26/33] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:51.430894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0127bc53-1bcd-4a96-a788-1913fb4933db tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-395546878", "id": 970503610, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:51.467609 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0127bc53-1bcd-4a96-a788-1913fb4933db tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.042380 Jul 02 21:00:51.472582 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 27/34] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:51 2022] POST /compute/v2.1/flavors => generated 410 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:51.483190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3fa80942-3148-4748-b9e5-204302d4c2c1 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:51.516740 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3fa80942-3148-4748-b9e5-204302d4c2c1 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/970503610" status: 200 len: 410 microversion: 2.1 time: 0.039652 Jul 02 21:00:51.517331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 28/35] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:00:51 2022] GET /compute/v2.1/flavors/970503610 => generated 410 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:00:52.033343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-faba8ae8-e10e-4d62-8d42-6f6b34235193 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.038763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=15 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:52.071253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-faba8ae8-e10e-4d62-8d42-6f6b34235193 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.545352 Jul 02 21:00:52.071878 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 29/36] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:51 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.089698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a0ca0f4-5a0e-42f1-83fe-65d1c349b6d6 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.110209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a0ca0f4-5a0e-42f1-83fe-65d1c349b6d6 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/970503610" status: 202 len: 0 microversion: 2.1 time: 0.027050 Jul 02 21:00:52.111385 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 30/37] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:00:52 2022] DELETE /compute/v2.1/flavors/970503610 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:52.119572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4d6dec1-a113-4ec3-9576-ba4b7e65c8f2 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.142307 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e4d6dec1-a113-4ec3-9576-ba4b7e65c8f2 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026495 Jul 02 21:00:52.143085 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 31/38] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.160183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6d066a2e-6316-47c3-8bd4-b1fa27f20742 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-173685315", "id": 1152044748, "os-flavor-access:is_public": "False"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.182351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6d066a2e-6316-47c3-8bd4-b1fa27f20742 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026854 Jul 02 21:00:52.183720 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 32/39] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/flavors => generated 429 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.194078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10c335c-38b2-4183-a3ad-1e5491974b07 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "1152044748"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.205928 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-f10c335c-38b2-4183-a3ad-1e5491974b07 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] HTTP exception thrown: Flavor 1152044748 could not be found. Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10c335c-38b2-4183-a3ad-1e5491974b07 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] Request method failure captured: Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 107 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH_uYClANKH3oc1n4zfkymeOew4ZE1suNpyTzWBSvhyEIPSzHiBHfoQJyXvlVAG__thV6drapjbwA08KYFBnNRrU-ksb1MqHvh6CV-qezYpK3JqQZAygz1Kpbp0rD4KC3-2MYZ7zkE4WPk79-e9JRKlQIUp7FCrhviHLfe0Qh4Cd80 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 939eb4bb7d8744f7a76ed90eaf2366a7 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsAdminTestJSON-912710509 Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:52.222552 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/939eb4bb7d8744f7a76ed90eaf2366a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_939eb4bb7d8744f7a76ed90eaf2366a7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/939eb4bb7d8744f7a76ed90eaf2366a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/939eb4bb7d8744f7a76ed90eaf2366a7"}]}] Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsAdminTestJSON-912710509 Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 939eb4bb7d8744f7a76ed90eaf2366a7 Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-912710509 Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsAdminTestJSON-912710509-project Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 181505c4f41b4a53bed9d4f362f6b8fa Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsAdminTestJSON-912710509-project Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "test", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "1152044748"}} Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:52.223692 ncdv-master-1 devstack@n-api.service[131045]: exception: Flavor 1152044748 could not be found. Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '1152044748'}}} Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1152044748 could not be found. Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.224390 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1152044748 could not be found. Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.225476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:52.226543 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:52.226543 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:52.226543 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:52.226543 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1152044748 could not be found. Jul 02 21:00:52.226543 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.229662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10c335c-38b2-4183-a3ad-1e5491974b07 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] Returning 400 to user: Flavor 1152044748 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:52.233405 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f10c335c-38b2-4183-a3ad-1e5491974b07 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.041565 Jul 02 21:00:52.235607 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 33/40] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/servers => generated 81 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:52.246342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac68911d-0636-4dca-88b2-b6a1ea1b1250 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.280094 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac68911d-0636-4dca-88b2-b6a1ea1b1250 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1152044748" status: 202 len: 0 microversion: 2.1 time: 0.040833 Jul 02 21:00:52.281832 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 34/41] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:52 2022] DELETE /compute/v2.1/flavors/1152044748 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:52.295728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cea1cf53-a968-415e-a0ef-46802353d0f3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.310330 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69dc62c7-3cd6-42f2-81ea-76f02db38e0d tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.676290 Jul 02 21:00:52.316636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 8/42] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:00:50 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.322719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.324559 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.324559 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.329090 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cea1cf53-a968-415e-a0ef-46802353d0f3 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042463 Jul 02 21:00:52.334270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:52.334719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:52.338634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 35/43] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.351957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23141a4e-0569-481c-bff7-e34433ecae81 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-67753837", "id": 950618098, "os-flavor-access:is_public": "False"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.372219 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Jul 02 21:00:52.379192 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-23141a4e-0569-481c-bff7-e34433ecae81 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.030987 Jul 02 21:00:52.380262 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 36/44] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/flavors => generated 410 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.393233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-97558070-4a5c-4051-829e-ae37fb091e5b tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1276943843", "id": 1084644216, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 39 Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:52.418001 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: {"add_host": {"host": "nch2-master-1"}} Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:52.419361 ncdv-master-1 devstack@n-api.service[131044]: exception: Aggregate 1 already has host nch2-master-1. Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result.read() Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:00:52.420303 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi session.flush() Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 21:00:52.421270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 21:00:52.423654 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:00:52.425918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result.read() Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 2, 21, 0, 52, 352649), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 1}] Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.428310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch2-master-1. Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.430215 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch2-master-1. Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:52.432995 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:52.435449 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch2-master-1. Jul 02 21:00:52.435449 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:52.435449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:52.435449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e9805e5-a86f-418b-97eb-db88788abadb tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.099394 Jul 02 21:00:52.435449 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 9/45] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 02 21:00:52.436907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c350f0ae-eb49-41ae-92fa-0fd1fe637cdd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.438473 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-97558070-4a5c-4051-829e-ae37fb091e5b tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.052106 Jul 02 21:00:52.438641 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.438641 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.439755 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 37/46] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:00:52.454266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c350f0ae-eb49-41ae-92fa-0fd1fe637cdd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:52.454465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-41367526-964b-4cff-91da-2542b000b91e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.454724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c350f0ae-eb49-41ae-92fa-0fd1fe637cdd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:52.475276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-41367526-964b-4cff-91da-2542b000b91e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.028047 Jul 02 21:00:52.480510 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 38/47] 10.222.0.43 () {58 vars in 1168 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.487188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-569b4a94-7796-4cbe-8a86-c73150d29415 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.495789 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-569b4a94-7796-4cbe-8a86-c73150d29415 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.012123 Jul 02 21:00:52.498402 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 39/48] 10.222.0.43 () {58 vars in 1176 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:00:52.507702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-583f7b92-c433-4199-a801-39a857ddad8a tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.516164 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-583f7b92-c433-4199-a801-39a857ddad8a tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.012100 Jul 02 21:00:52.523112 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 40/49] 10.222.0.43 () {58 vars in 1170 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.528374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34c6e8a7-d88b-4673-8cf5-2fed17ad8800 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.539842 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34c6e8a7-d88b-4673-8cf5-2fed17ad8800 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.015628 Jul 02 21:00:52.547590 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 41/50] 10.222.0.43 () {58 vars in 1168 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.552388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e59f76f-ac1e-4eca-90a3-fe9a7888af94 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.572847 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e59f76f-ac1e-4eca-90a3-fe9a7888af94 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.023849 Jul 02 21:00:52.573571 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 42/51] 10.222.0.43 () {58 vars in 1168 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.588462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fd713ce-2ca0-4afb-b1fa-b035829597b2 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.612309 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2fd713ce-2ca0-4afb-b1fa-b035829597b2 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.027704 Jul 02 21:00:52.616499 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 43/52] 10.222.0.43 () {58 vars in 1174 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.630176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51b74916-61cd-4f3e-8af7-2f370f486158 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.652959 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c350f0ae-eb49-41ae-92fa-0fd1fe637cdd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.222074 Jul 02 21:00:52.653657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 10/53] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.665408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86d31db7-0feb-422c-a644-de470883ba4a tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.667070 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.667070 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.672006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51b74916-61cd-4f3e-8af7-2f370f486158 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.046710 Jul 02 21:00:52.675257 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 44/54] 10.222.0.43 () {58 vars in 1172 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.694145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33cb3035-96e7-4a12-b3dc-700bc8cc1726 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.709079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86d31db7-0feb-422c-a644-de470883ba4a tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.046930 Jul 02 21:00:52.715759 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 11/55] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:52 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 02 21:00:52.726113 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33cb3035-96e7-4a12-b3dc-700bc8cc1726 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.037366 Jul 02 21:00:52.726749 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 45/56] 10.222.0.43 () {58 vars in 1168 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.731177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dbdd9c8-757d-4bf5-becd-cbe6ee10ae74 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-34024335"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.737209 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.737209 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.743512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-9dbdd9c8-757d-4bf5-becd-cbe6ee10ae74 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid 40744e4d-8100-47ff-8aa9-93af5554bb9b for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:52.743626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73039819-f0f7-41a1-8696-66fa780d945f tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.784880 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-73039819-f0f7-41a1-8696-66fa780d945f tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1084644216" status: 202 len: 0 microversion: 2.1 time: 0.046256 Jul 02 21:00:52.786007 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dbdd9c8-757d-4bf5-becd-cbe6ee10ae74 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.060702 Jul 02 21:00:52.786939 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 12/57] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.795852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65d02bc7-4468-4406-b914-cc6062b76775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-279986932", "name": "tempest-test_aggregate-1972605469"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.796059 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 46/58] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:52 2022] DELETE /compute/v2.1/flavors/1084644216 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:00:52.818833 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.818833 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.818833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-65d02bc7-4468-4406-b914-cc6062b76775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 8ba9b337-b5aa-4bbf-a756-0ff7166a5791 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:52.855044 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65d02bc7-4468-4406-b914-cc6062b76775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.066012 Jul 02 21:00:52.856357 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 13/59] 10.222.0.43 () {60 vars in 1164 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.862278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8172aa3b-3cdb-4271-a803-f4b1b84d9c3e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.904731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8172aa3b-3cdb-4271-a803-f4b1b84d9c3e tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047352 Jul 02 21:00:52.906054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 14/60] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:52.910954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f3e3ed5-1f02-4c8d-b5b1-99f7aacf164e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.911724 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.911724 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.932531 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f3e3ed5-1f02-4c8d-b5b1-99f7aacf164e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 513 microversion: 2.1 time: 0.025212 Jul 02 21:00:52.939446 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 15/61] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:00:52 2022] GET /compute/v2.1/os-aggregates => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:52.948202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c17cd402-5220-4c98-89ba-2f9edceb17c4 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:52.949750 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.949750 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.975623 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c17cd402-5220-4c98-89ba-2f9edceb17c4 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/950618098" status: 202 len: 0 microversion: 2.1 time: 0.038588 Jul 02 21:00:52.976200 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 16/62] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:00:52 2022] DELETE /compute/v2.1/flavors/950618098 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:52.984826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31074acd-60e5-4737-8d8b-795cfbe4c899 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:52.986388 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:52.986388 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:52.995713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31074acd-60e5-4737-8d8b-795cfbe4c899 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:52.996502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31074acd-60e5-4737-8d8b-795cfbe4c899 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:53.174366 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31074acd-60e5-4737-8d8b-795cfbe4c899 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.1 time: 0.193719 Jul 02 21:00:53.187189 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 17/63] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:53.187189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d1fab92-dcba-4327-9b2d-78e76d43b53b tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.198502 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d1fab92-dcba-4327-9b2d-78e76d43b53b tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022402 Jul 02 21:00:53.199116 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 18/64] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:53.216652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8541b5ec-dfca-4a6a-b41b-d739b738e785 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-748953440", "id": 1059966082, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.218280 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.218280 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.237717 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8541b5ec-dfca-4a6a-b41b-d739b738e785 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.024788 Jul 02 21:00:53.239488 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 19/65] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/flavors => generated 414 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:53.252863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0cea5f5-f6e1-4437-b6ab-9d21e820749f tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.276470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0cea5f5-f6e1-4437-b6ab-9d21e820749f tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029099 Jul 02 21:00:53.277998 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 20/66] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:53.296981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b3bbe35-8154-4634-9a9b-180bc22a5db5 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.336628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:53.345464 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b3bbe35-8154-4634-9a9b-180bc22a5db5 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057115 Jul 02 21:00:53.346593 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 21/67] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:53.360975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7201b52b-8f03-45ab-9792-90125fcf6594 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.361737 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.361737 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.385101 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7201b52b-8f03-45ab-9792-90125fcf6594 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1059966082" status: 202 len: 0 microversion: 2.1 time: 0.028046 Jul 02 21:00:53.386019 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 22/68] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/flavors/1059966082 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:53.397120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ffbe040-10b0-4515-807e-a438511c19ae tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.420767 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ffbe040-10b0-4515-807e-a438511c19ae tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029117 Jul 02 21:00:53.421723 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 23/69] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:00:53.439217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1cf11f8-615e-4618-8fdd-98fe89c954e6 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1151657669", "id": 2000933408, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.462934 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1cf11f8-615e-4618-8fdd-98fe89c954e6 tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.027842 Jul 02 21:00:53.463538 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 24/70] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/flavors => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:53.477021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5bba921-ea12-4ab6-95f7-c1cc03dfa819 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.478843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30e61b36-b96c-4ef2-87b2-e417169267bc tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.480587 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.480587 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:53.481728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-30e61b36-b96c-4ef2-87b2-e417169267bc tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '8f03e55928514c9c99289d5002af5349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60101912b2e94f7485de6b7adc5642c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30e61b36-b96c-4ef2-87b2-e417169267bc tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Request method failure captured: Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 39 Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH-Fk87FS4yz5vfUorSugZTmoNDJjvej7W_dEcXDtfV0ViSyDoGDGhC671IxaV0ueJoUfeAbvJTF2_5hJhhMS7RyH9akp_4EnV92kLlfSDMRvqkBTF0OPw8LD2jCgxKqc9c7hEZozjlC2fAaOTmRVxtLdtYQ0x8xB4DnlEtYjoHT8c Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:53.483712 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60101912b2e94f7485de6b7adc5642c9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60101912b2e94f7485de6b7adc5642c9"}]}] Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8f03e55928514c9c99289d5002af5349 Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: {"add_host": {"host": "nch2-master-1"}} Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:53.484844 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:53.485587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 02 21:00:53.486686 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.487831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30e61b36-b96c-4ef2-87b2-e417169267bc tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.487831 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-30e61b36-b96c-4ef2-87b2-e417169267bc tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.692083 Jul 02 21:00:53.494125 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 47/71] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:00:52 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 698 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:53.500028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-704b166c-ab56-44de-abcd-7ada7dcc2755 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.500818 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.500818 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:53.505880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5bba921-ea12-4ab6-95f7-c1cc03dfa819 tempest-FlavorsAdminTestJSON-912710509 tempest-FlavorsAdminTestJSON-912710509-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.033477 Jul 02 21:00:53.506373 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 25/72] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:53 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:53.521690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4db956a-4705-4d6e-a8ac-10531367553c tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.549430 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4db956a-4705-4d6e-a8ac-10531367553c tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2000933408" status: 202 len: 0 microversion: 2.1 time: 0.031600 Jul 02 21:00:53.550223 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 26/73] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/flavors/2000933408 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:00:53.561097 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-704b166c-ab56-44de-abcd-7ada7dcc2755 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.065686 Jul 02 21:00:53.562225 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 48/74] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:00:53.566688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-037c0270-7a88-4754-b8c9-badabda548ce tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.574443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-82482cf4-4d7c-4d53-b41c-85f6fac27634 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1149625565"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.582194 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.582194 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:53.583638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-82482cf4-4d7c-4d53-b41c-85f6fac27634 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid d33bd859-dee0-430f-87d8-b0482f24acb1 for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:53.587922 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-037c0270-7a88-4754-b8c9-badabda548ce tempest-FlavorsAdminTestJSON-1518152121 tempest-FlavorsAdminTestJSON-1518152121-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033200 Jul 02 21:00:53.588741 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 27/75] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:53 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:00:53.609183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-82482cf4-4d7c-4d53-b41c-85f6fac27634 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041407 Jul 02 21:00:53.615336 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 49/76] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:53.621587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-174387501"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.624377 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.624377 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.634391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:53.634839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:53.643800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:53.644542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:53.657073 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-174387501 could not be found. Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 57 Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:53.663704 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: {"add_host": {"host": "tempest-nonexist_host-174387501"}} Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.665034 ncdv-master-1 devstack@n-api.service[131044]: exception: Compute host tempest-nonexist_host-174387501 could not be found. Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-174387501'}}} Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-174387501' is not mapped to any cell Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.665921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 02 21:00:53.667085 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-174387501 could not be found. Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-174387501 could not be found. Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.668414 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-174387501 could not be found. Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.670544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-174387501 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.671871 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a734091f-708e-47de-860a-f4ea15028f1b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.055119 Jul 02 21:00:53.672737 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 28/77] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:53.680704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12667dad-f527-4dca-bb54-e67b7fb418c2 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.681564 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.681564 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.705994 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12667dad-f527-4dca-bb54-e67b7fb418c2 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.029069 Jul 02 21:00:53.706912 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 29/78] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 02 21:00:53.716324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3451845a-f21e-46b2-8671-eea1fb9d5c7b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3451845a-f21e-46b2-8671-eea1fb9d5c7b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 283 Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:53.748842 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:53.749977 ncdv-master-1 devstack@n-api.service[131044]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:00:53.750583 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:00:53.751185 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:00:53.752162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:00:53.752879 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:00:53.752879 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.752879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3451845a-f21e-46b2-8671-eea1fb9d5c7b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.752879 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3451845a-f21e-46b2-8671-eea1fb9d5c7b tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.038333 Jul 02 21:00:53.753128 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 30/79] 10.222.0.43 () {60 vars in 1164 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:00:53.761266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb07ce39-613a-4e87-a601-5b6bfbbac7ab tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb07ce39-613a-4e87-a601-5b6bfbbac7ab tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 27 Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:53.763641 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: {"aggregate": {"name": ""}} Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.764985 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '' Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.765686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:00:53.766877 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.767959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb07ce39-613a-4e87-a601-5b6bfbbac7ab tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.767959 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb07ce39-613a-4e87-a601-5b6bfbbac7ab tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.007853 Jul 02 21:00:53.767959 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 31/80] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:00:53.778796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c960fb0-36f2-44dc-bcb7-a06306bbf51d tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1286560048"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.780153 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.780153 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.781086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c960fb0-36f2-44dc-bcb7-a06306bbf51d tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '8f03e55928514c9c99289d5002af5349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60101912b2e94f7485de6b7adc5642c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c960fb0-36f2-44dc-bcb7-a06306bbf51d tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Request method failure captured: Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 60 Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLH-Fk87FS4yz5vfUorSugZTmoNDJjvej7W_dEcXDtfV0ViSyDoGDGhC671IxaV0ueJoUfeAbvJTF2_5hJhhMS7RyH9akp_4EnV92kLlfSDMRvqkBTF0OPw8LD2jCgxKqc9c7hEZozjlC2fAaOTmRVxtLdtYQ0x8xB4DnlEtYjoHT8c Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:00:53.782739 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60101912b2e94f7485de6b7adc5642c9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60101912b2e94f7485de6b7adc5642c9"}]}] Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8f03e55928514c9c99289d5002af5349 Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: {"aggregate": {"name": "tempest-test_aggregate-1286560048"}} Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.783844 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1286560048'}}} Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:53.784998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:53.786012 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 02 21:00:53.787341 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.787341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c960fb0-36f2-44dc-bcb7-a06306bbf51d tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.787341 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c960fb0-36f2-44dc-bcb7-a06306bbf51d tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012313 Jul 02 21:00:53.787341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 32/81] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:53.794154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f1b7d7a3-490d-401c-ab2e-15a521fc8964 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1100810775"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.796281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-f1b7d7a3-490d-401c-ab2e-15a521fc8964 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid 89a4102d-2859-46e5-8209-daf0fe034c90 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:53.818018 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f1b7d7a3-490d-401c-ab2e-15a521fc8964 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.027816 Jul 02 21:00:53.818913 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 33/82] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:53.829306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0918c79b-5441-4f14-9f6c-4567da67c493 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1100810775"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.830695 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.830695 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.831499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-0918c79b-5441-4f14-9f6c-4567da67c493 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid c18a5cec-b0ef-4ab7-971c-6bcd3cb9561c for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:53.843851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0918c79b-5441-4f14-9f6c-4567da67c493 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1100810775 already exists. Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0918c79b-5441-4f14-9f6c-4567da67c493 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 60 Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:53.845633 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: {"aggregate": {"name": "tempest-test_aggregate-1100810775"}} Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.846836 ncdv-master-1 devstack@n-api.service[131044]: exception: Aggregate tempest-test_aggregate-1100810775 already exists. Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1100810775'}}} Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 02 21:00:53.847504 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1100810775 already exists. Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:53.848499 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1100810775 already exists. Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1100810775 already exists. Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0918c79b-5441-4f14-9f6c-4567da67c493 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1100810775 already exists. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.849588 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0918c79b-5441-4f14-9f6c-4567da67c493 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.021875 Jul 02 21:00:53.850404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 34/83] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 23 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:00:53.858862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63a426b1-8520-4268-a42c-b84053f8d102 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.859622 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.859622 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.886099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63a426b1-8520-4268-a42c-b84053f8d102 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.027719 Jul 02 21:00:53.887735 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 35/84] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 02 21:00:53.893341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6c09c3c-737c-4d43-a9bd-2ae289363227 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-792823118"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:53.894640 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.894640 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.895594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-a6c09c3c-737c-4d43-a9bd-2ae289363227 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid 5a2558fd-3cde-487e-a5b7-376cf119ab41 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:53.918585 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6c09c3c-737c-4d43-a9bd-2ae289363227 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.029296 Jul 02 21:00:53.919616 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 36/85] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:53.930136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47d68328-a144-48ff-95a9-37b6c90d6177 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.930900 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.930900 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.931742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47d68328-a144-48ff-95a9-37b6c90d6177 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '8f03e55928514c9c99289d5002af5349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60101912b2e94f7485de6b7adc5642c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47d68328-a144-48ff-95a9-37b6c90d6177 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Request method failure captured: Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLH-Fk87FS4yz5vfUorSugZTmoNDJjvej7W_dEcXDtfV0ViSyDoGDGhC671IxaV0ueJoUfeAbvJTF2_5hJhhMS7RyH9akp_4EnV92kLlfSDMRvqkBTF0OPw8LD2jCgxKqc9c7hEZozjlC2fAaOTmRVxtLdtYQ0x8xB4DnlEtYjoHT8c Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:00:53.933368 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60101912b2e94f7485de6b7adc5642c9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60101912b2e94f7485de6b7adc5642c9"}]}] Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8f03e55928514c9c99289d5002af5349 Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 02 21:00:53.934595 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '6'} Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:53.935210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.936220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47d68328-a144-48ff-95a9-37b6c90d6177 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.937476 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47d68328-a144-48ff-95a9-37b6c90d6177 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.008443 Jul 02 21:00:53.937476 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 37/86] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:53.945934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fab4b31f-4bd6-4538-a6fb-72a70c9fe571 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.966084 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fab4b31f-4bd6-4538-a6fb-72a70c9fe571 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.026266 Jul 02 21:00:53.967153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 38/87] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 02 21:00:53.976829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-095ca7c4-9616-4559-9bf3-9db30ddd5a83 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:53.977837 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:53.977837 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:53.987918 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-095ca7c4-9616-4559-9bf3-9db30ddd5a83 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-095ca7c4-9616-4559-9bf3-9db30ddd5a83 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:53.989698 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: exception: Aggregate -1 could not be found. Jul 02 21:00:53.990848 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '-1'} Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 02 21:00:53.991519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.993250 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-095ca7c4-9616-4559-9bf3-9db30ddd5a83 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-095ca7c4-9616-4559-9bf3-9db30ddd5a83 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018904 Jul 02 21:00:53.994455 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 39/88] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:00:53 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:00:54.000853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee2a8d47-4443-4fc5-ba8e-9950c29f8ffd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1223547616"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:54.002159 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:54.002159 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:54.003153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-ee2a8d47-4443-4fc5-ba8e-9950c29f8ffd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid 072556f3-4da9-46ca-87e1-fb043f71982c for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:00:54.027048 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee2a8d47-4443-4fc5-ba8e-9950c29f8ffd tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.029672 Jul 02 21:00:54.032386 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 40/89] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:54.038493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0000e341-1eee-4779-b055-c631040e6cc1 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:54.039310 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:54.039310 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:54.040315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0000e341-1eee-4779-b055-c631040e6cc1 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '8f03e55928514c9c99289d5002af5349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60101912b2e94f7485de6b7adc5642c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0000e341-1eee-4779-b055-c631040e6cc1 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Request method failure captured: Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLH-Fk87FS4yz5vfUorSugZTmoNDJjvej7W_dEcXDtfV0ViSyDoGDGhC671IxaV0ueJoUfeAbvJTF2_5hJhhMS7RyH9akp_4EnV92kLlfSDMRvqkBTF0OPw8LD2jCgxKqc9c7hEZozjlC2fAaOTmRVxtLdtYQ0x8xB4DnlEtYjoHT8c Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:00:54.042050 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60101912b2e94f7485de6b7adc5642c9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60101912b2e94f7485de6b7adc5642c9"}]}] Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8f03e55928514c9c99289d5002af5349 Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 02 21:00:54.043272 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7'} Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:54.043908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.044925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0000e341-1eee-4779-b055-c631040e6cc1 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:54.045851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0000e341-1eee-4779-b055-c631040e6cc1 tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.009185 Jul 02 21:00:54.047217 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 41/90] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:00:54 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:54.056640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75bfa141-e764-4f36-97ff-19b6a70f64d4 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:54.056640 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:54.056640 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:54.073917 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75bfa141-e764-4f36-97ff-19b6a70f64d4 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.025555 Jul 02 21:00:54.075217 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 42/91] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:54 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:00:54.086223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26b49070-e866-453b-9ac3-0ffeb15ac3a0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:54.086969 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:54.086969 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:54.097077 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-26b49070-e866-453b-9ac3-0ffeb15ac3a0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26b49070-e866-453b-9ac3-0ffeb15ac3a0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:54.098681 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: exception: Aggregate -1 could not be found. Jul 02 21:00:54.099958 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '-1'} Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.100626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 02 21:00:54.101626 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.102554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26b49070-e866-453b-9ac3-0ffeb15ac3a0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:54.102554 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26b49070-e866-453b-9ac3-0ffeb15ac3a0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.017501 Jul 02 21:00:54.102554 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 43/92] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:00:54 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:00:54.110739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f9ad10c-476b-42ba-823e-651611c960ed tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:54.111567 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:54.111567 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:54.112438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f9ad10c-476b-42ba-823e-651611c960ed tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '8f03e55928514c9c99289d5002af5349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60101912b2e94f7485de6b7adc5642c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f9ad10c-476b-42ba-823e-651611c960ed tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Request method failure captured: Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLH-Fk87FS4yz5vfUorSugZTmoNDJjvej7W_dEcXDtfV0ViSyDoGDGhC671IxaV0ueJoUfeAbvJTF2_5hJhhMS7RyH9akp_4EnV92kLlfSDMRvqkBTF0OPw8LD2jCgxKqc9c7hEZozjlC2fAaOTmRVxtLdtYQ0x8xB4DnlEtYjoHT8c Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:00:54.114514 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60101912b2e94f7485de6b7adc5642c9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60101912b2e94f7485de6b7adc5642c9"}]}] Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8f03e55928514c9c99289d5002af5349 Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 02 21:00:54.115624 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:54.116699 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:54.117756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f9ad10c-476b-42ba-823e-651611c960ed tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:54.118734 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f9ad10c-476b-42ba-823e-651611c960ed tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.008875 Jul 02 21:00:54.121487 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 44/93] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:00:54 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:00:54.182312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-311038536", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "availability_zone": "tempest-test_az-279986932"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:54.192748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:54.193187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:54.193956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:54.194641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:54.957120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:00:55.336089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:00:55.336920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:00:55.337503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:00:55.338009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:00:55.338759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:00:55.363385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:55.364962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:55.365955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:55.367029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:55.412180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Getting quotas for project 347aae622773490aa3e8f0716b37d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:00:55.421106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Getting quotas for user b62db007a28947abbb19e137f52472a0 and project 347aae622773490aa3e8f0716b37d77e. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:00:55.438443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:00:55.443446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:00:55.528624 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad6e82f1-1c6f-40dc-8661-2943c732c24f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872270 Jul 02 21:00:55.529347 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 50/94] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:00:55.542101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a329be4a-ac16-4a44-80dc-f5ffafece3bc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:55.544346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a329be4a-ac16-4a44-80dc-f5ffafece3bc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:00:56.615185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a329be4a-ac16-4a44-80dc-f5ffafece3bc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:56.631724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a329be4a-ac16-4a44-80dc-f5ffafece3bc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1241 microversion: 2.1 time: 1.095609 Jul 02 21:00:56.632832 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 45/95] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:00:55 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1241 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:57.539008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59c8e3ed-aa53-42d9-99e4-11b2b846e652 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1535647207", "id": 828494726, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:57.540711 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:57.540711 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:57.566567 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59c8e3ed-aa53-42d9-99e4-11b2b846e652 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.318736 Jul 02 21:00:57.567451 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 51/96] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:00:57 2022] POST /compute/v2.1/flavors => generated 465 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:00:57.907754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e786ffa7-c186-4270-96b2-b07c405ef21f tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] Calling method '.version_select at 0x7fabe54aaf70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:57.908799 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:57.908799 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:57.910630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0da6f834-ea7f-4ad5-b61c-da08e208eb88 tempest-FlavorsV261TestJSON-1356513320 tempest-FlavorsV261TestJSON-1356513320-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:57.922383 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0da6f834-ea7f-4ad5-b61c-da08e208eb88 tempest-FlavorsV261TestJSON-1356513320 tempest-FlavorsV261TestJSON-1356513320-project] 10.222.0.43 "GET /compute/v2.1/flavors/828494726" status: 200 len: 465 microversion: 2.61 time: 0.347241 Jul 02 21:00:57.923185 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 52/97] 10.222.0.43 () {60 vars in 1195 bytes} [Sat Jul 2 21:00:57 2022] GET /compute/v2.1/flavors/828494726 => generated 465 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:00:57.927860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:57.928703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:00:57.935035 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e786ffa7-c186-4270-96b2-b07c405ef21f tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.367629 Jul 02 21:00:57.936285 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 46/98] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:00:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:57.941802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-377ef7cc-8741-42fd-bc25-4d484c91b533 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] Action: 'update', calling method: .version_select at 0x7fabe76941f0>, body: {"flavor": {"description": "new"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:57.943669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:57.944370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:57.945351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:57.946968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:57.953613 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:57.953613 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:57.999941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-377ef7cc-8741-42fd-bc25-4d484c91b533 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/828494726" status: 200 len: 466 microversion: 2.61 time: 0.061992 Jul 02 21:00:58.008301 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 47/99] 10.222.0.43 () {62 vars in 1215 bytes} [Sat Jul 2 21:00:57 2022] PUT /compute/v2.1/flavors/828494726 => generated 466 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:00:58.014857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea923762-f25d-40ec-859a-8de0b82f1cea tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] Action: 'update', calling method: .version_select at 0x7fabe548d160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:58.018594 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.018594 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:58.094766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:58.115214 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-258baff5-53d8-445d-b348-7cda66045915 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1295 microversion: 2.1 time: 0.190682 Jul 02 21:00:58.116642 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 53/100] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:00:57 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1295 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:58.123945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e9e3fe0e-2851-40bc-8705-e8fa4d0b4443 tempest-FlavorsV261TestJSON-1356513320 tempest-FlavorsV261TestJSON-1356513320-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.193657 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e9e3fe0e-2851-40bc-8705-e8fa4d0b4443 tempest-FlavorsV261TestJSON-1356513320 tempest-FlavorsV261TestJSON-1356513320-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.072944 Jul 02 21:00:58.196020 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 54/101] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:58.208399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=14,nova_api:INSERT=8,nova_api:UPDATE=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:58.305040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5052902b-c819-4369-a06f-2e2d7d5b2f13 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe5624670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.306800 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.306800 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:58.308351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5052902b-c819-4369-a06f-2e2d7d5b2f13 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:58.308834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5052902b-c819-4369-a06f-2e2d7d5b2f13 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:58.309811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5052902b-c819-4369-a06f-2e2d7d5b2f13 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:58.310593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5052902b-c819-4369-a06f-2e2d7d5b2f13 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:58.334729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:58.344459 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5052902b-c819-4369-a06f-2e2d7d5b2f13 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.135597 Jul 02 21:00:58.345085 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 55/102] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:58.352875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-921c2acc-831f-4041-a315-581c1a222627 tempest-FlavorsV261TestJSON-1356513320 tempest-FlavorsV261TestJSON-1356513320-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.378986 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-921c2acc-831f-4041-a315-581c1a222627 tempest-FlavorsV261TestJSON-1356513320 tempest-FlavorsV261TestJSON-1356513320-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.032635 Jul 02 21:00:58.388962 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 56/103] 10.222.0.43 () {60 vars in 1165 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:58.531394 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea923762-f25d-40ec-859a-8de0b82f1cea tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.521257 Jul 02 21:00:58.533252 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 48/104] 10.222.0.43 () {60 vars in 1205 bytes} [Sat Jul 2 21:00:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:58.539049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f7d8bbf-c04f-4ccc-a5db-622b3afa8251 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe548d670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.540617 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.540617 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:58.542449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f7d8bbf-c04f-4ccc-a5db-622b3afa8251 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:58.543159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f7d8bbf-c04f-4ccc-a5db-622b3afa8251 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:58.544188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f7d8bbf-c04f-4ccc-a5db-622b3afa8251 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:58.545669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f7d8bbf-c04f-4ccc-a5db-622b3afa8251 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:58.579563 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f7d8bbf-c04f-4ccc-a5db-622b3afa8251 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 400 microversion: 2.1 time: 0.044686 Jul 02 21:00:58.580399 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 49/105] 10.222.0.43 () {58 vars in 1138 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/os-hosts?zone= => generated 400 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:58.584867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88078271-a2d9-4d6d-b8a3-3d23324cbc57 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.585615 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.585615 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:58.604000 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88078271-a2d9-4d6d-b8a3-3d23324cbc57 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/828494726" status: 202 len: 0 microversion: 2.61 time: 0.022356 Jul 02 21:00:58.604677 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 50/106] 10.222.0.43 () {60 vars in 1198 bytes} [Sat Jul 2 21:00:58 2022] DELETE /compute/v2.1/flavors/828494726 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:00:58.609084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c617355-f4f9-4cc8-9284-e6f564e8f324 tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] Calling method '.version_select at 0x7fabe54435e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.609880 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.609880 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:58.622023 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c617355-f4f9-4cc8-9284-e6f564e8f324 tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016299 Jul 02 21:00:58.622597 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 51/107] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:58.633653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ce3a02c-8b6c-4d94-97f3-751888772f67 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe5431dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.635218 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.635218 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:58.636196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-16544188-01d3-4beb-bd56-05ebee7de055 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1504973123", "ram": 512, "vcpus": 1, "disk": 10, "id": 637964688, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:58.637345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ce3a02c-8b6c-4d94-97f3-751888772f67 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:58.637885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ce3a02c-8b6c-4d94-97f3-751888772f67 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:58.638810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ce3a02c-8b6c-4d94-97f3-751888772f67 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:58.639105 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.639105 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:58.639485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ce3a02c-8b6c-4d94-97f3-751888772f67 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:58.662336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-16544188-01d3-4beb-bd56-05ebee7de055 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.271869 Jul 02 21:00:58.667393 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 57/108] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:00:58 2022] POST /compute/v2.1/flavors => generated 413 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:58.676109 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ce3a02c-8b6c-4d94-97f3-751888772f67 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.052415 Jul 02 21:00:58.677222 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 52/109] 10.222.0.43 () {58 vars in 1144 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:00:58.677369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45f8fad4-59c2-41c9-9400-8606da1b9c18 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:58.683500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-735f5702-9452-4bb3-8f6e-5ed16a73df7a tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] Action: 'update', calling method: .version_select at 0x7fabe54d28b0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:58.685447 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:58.685447 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:58.900757 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-735f5702-9452-4bb3-8f6e-5ed16a73df7a tempest-QuotaClassesAdminTestJSON-832706880 tempest-QuotaClassesAdminTestJSON-832706880-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.221962 Jul 02 21:00:58.902756 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 53/110] 10.222.0.43 () {60 vars in 1205 bytes} [Sat Jul 2 21:00:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:00:58.987964 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45f8fad4-59c2-41c9-9400-8606da1b9c18 tempest-FlavorsV261TestJSON-400812527 tempest-FlavorsV261TestJSON-400812527-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6234 microversion: 2.61 time: 0.318631 Jul 02 21:00:58.990616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 58/111] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/flavors/detail => generated 6234 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:00:59.136348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:59.137663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:00:59.149051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:59.149592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:59.150312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:00:59.150750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:00:59.542514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79706e49-26c2-4380-b663-f977a588f81d tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:59.553127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:59.567047 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-70fc7274-d89a-4c83-9995-895e7ef98ef8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.436645 Jul 02 21:00:59.584789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-79706e49-26c2-4380-b663-f977a588f81d tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] HTTP exception thrown: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.586105 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 59/112] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:00:59 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79706e49-26c2-4380-b663-f977a588f81d tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Request method failure captured: Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/flavors/637964688/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIHvW-46x2ln8Z1Ib3qVR6IyRWGx-T4OskmUqfZSdsBBF-EjGTK7ehb30KhN6aZeTMyCzPrdOJuzaXO_c4fsYuKgLJOibJacIjxTVpKszuCEQooETCNnhRybahz_2YVy0sIiYozG2Lnqakjwk8QvpjtmIga43CIAnPKhz4hfaB0juQ Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:00:59.588302 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b01ef5940f47eab5705b2393dcad53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b01ef5940f47eab5705b2393dcad53"}]}] Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: d81aa185b2134cf090495a03bf3cdf02 Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:59.589869 ncdv-master-1 devstack@n-api.service[131044]: exception: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'flavor_id': '637964688', 'id': 'hw:cpu_thread_policy'} Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.590880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.592886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79706e49-26c2-4380-b663-f977a588f81d tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Returning 404 to user: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.594530 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79706e49-26c2-4380-b663-f977a588f81d tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] 10.222.0.43 "GET /compute/v2.1/flavors/637964688/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.682270 Jul 02 21:00:59.596448 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 54/113] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:00:58 2022] GET /compute/v2.1/flavors/637964688/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:59.614037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-979925d7-4320-4660-95ec-bb80f28a0f44 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:59.616404 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:59.616404 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:59.617612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-979925d7-4320-4660-95ec-bb80f28a0f44 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'd81aa185b2134cf090495a03bf3cdf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b01ef5940f47eab5705b2393dcad53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-979925d7-4320-4660-95ec-bb80f28a0f44 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Request method failure captured: Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/flavors/637964688/os-extra_specs HTTP/1.1 Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 66 Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIHvW-46x2ln8Z1Ib3qVR6IyRWGx-T4OskmUqfZSdsBBF-EjGTK7ehb30KhN6aZeTMyCzPrdOJuzaXO_c4fsYuKgLJOibJacIjxTVpKszuCEQooETCNnhRybahz_2YVy0sIiYozG2Lnqakjwk8QvpjtmIga43CIAnPKhz4hfaB0juQ Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:59.620134 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b01ef5940f47eab5705b2393dcad53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b01ef5940f47eab5705b2393dcad53"}]}] Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d81aa185b2134cf090495a03bf3cdf02 Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 02 21:00:59.621713 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'flavor_id': '637964688', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:59.622591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 02 21:00:59.623669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.625290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-979925d7-4320-4660-95ec-bb80f28a0f44 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.625290 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-979925d7-4320-4660-95ec-bb80f28a0f44 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] 10.222.0.43 "POST /compute/v2.1/flavors/637964688/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019021 Jul 02 21:00:59.625290 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 60/114] 10.222.0.43 () {60 vars in 1220 bytes} [Sat Jul 2 21:00:59 2022] POST /compute/v2.1/flavors/637964688/os-extra_specs => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:59.633377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d1cc234-9140-4897-9153-218341e1609b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:59.635781 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:59.635781 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:59.694205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d1cc234-9140-4897-9153-218341e1609b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/637964688/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.065068 Jul 02 21:00:59.695800 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 55/115] 10.222.0.43 () {60 vars in 1220 bytes} [Sat Jul 2 21:00:59 2022] POST /compute/v2.1/flavors/637964688/os-extra_specs => generated 66 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:00:59.706432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b85b7bdf-2e91-439f-8ada-e2ce618d65d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:59.707420 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:59.707420 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:59.708151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b85b7bdf-2e91-439f-8ada-e2ce618d65d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'd81aa185b2134cf090495a03bf3cdf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b01ef5940f47eab5705b2393dcad53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b85b7bdf-2e91-439f-8ada-e2ce618d65d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Request method failure captured: Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIHvW-46x2ln8Z1Ib3qVR6IyRWGx-T4OskmUqfZSdsBBF-EjGTK7ehb30KhN6aZeTMyCzPrdOJuzaXO_c4fsYuKgLJOibJacIjxTVpKszuCEQooETCNnhRybahz_2YVy0sIiYozG2Lnqakjwk8QvpjtmIga43CIAnPKhz4hfaB0juQ Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:59.709714 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b01ef5940f47eab5705b2393dcad53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b01ef5940f47eab5705b2393dcad53"}]}] Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d81aa185b2134cf090495a03bf3cdf02 Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:59.711320 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'flavor_id': '637964688', 'id': 'hw:numa_nodes'} Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:59.712340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.713769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b85b7bdf-2e91-439f-8ada-e2ce618d65d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.715215 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b85b7bdf-2e91-439f-8ada-e2ce618d65d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] 10.222.0.43 "DELETE /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009432 Jul 02 21:00:59.723054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccf6d430-c9b6-460d-9502-737d8d7c6c47 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:59.726771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=20,nova_api:INSERT=10,nova_api:DELETE=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:00:59.728134 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 61/116] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:00:59 2022] DELETE /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:59.750790 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccf6d430-c9b6-460d-9502-737d8d7c6c47 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/637964688/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031709 Jul 02 21:00:59.762493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a07b50e-8eba-4e1f-ac8a-3a6e33fcfa57 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:59.763778 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:59.763778 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:59.764729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a07b50e-8eba-4e1f-ac8a-3a6e33fcfa57 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'd81aa185b2134cf090495a03bf3cdf02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b01ef5940f47eab5705b2393dcad53', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a07b50e-8eba-4e1f-ac8a-3a6e33fcfa57 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Request method failure captured: Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 22 Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIHvW-46x2ln8Z1Ib3qVR6IyRWGx-T4OskmUqfZSdsBBF-EjGTK7ehb30KhN6aZeTMyCzPrdOJuzaXO_c4fsYuKgLJOibJacIjxTVpKszuCEQooETCNnhRybahz_2YVy0sIiYozG2Lnqakjwk8QvpjtmIga43CIAnPKhz4hfaB0juQ Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:00:59.766374 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0b01ef5940f47eab5705b2393dcad53", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0b01ef5940f47eab5705b2393dcad53"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0b01ef5940f47eab5705b2393dcad53"}]}] Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0b01ef5940f47eab5705b2393dcad53 Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d81aa185b2134cf090495a03bf3cdf02 Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: {"hw:numa_nodes": "1"} Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:59.767828 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'flavor_id': '637964688', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:00:59.768746 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 02 21:00:59.769975 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.771930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a07b50e-8eba-4e1f-ac8a-3a6e33fcfa57 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.771930 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8a07b50e-8eba-4e1f-ac8a-3a6e33fcfa57 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315 tempest-FlavorsExtraSpecsNegativeTestJSON-1578102315-project] 10.222.0.43 "PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010529 Jul 02 21:00:59.772140 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 56/117] 10.222.0.43 () {60 vars in 1220 bytes} [Sat Jul 2 21:00:59 2022] POST /compute/v2.1/flavors/637964688/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:00:59.780764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01ff523f-94df-44b3-86c3-256bcd828d79 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:59.781529 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:59.781529 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:00:59.782034 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 62/118] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:00:59 2022] PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:00:59.791172 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-01ff523f-94df-44b3-86c3-256bcd828d79 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] HTTP exception thrown: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01ff523f-94df-44b3-86c3-256bcd828d79 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Request method failure captured: Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/flavors/637964688/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIKL51RY_2mcy5tIeO6aRySOtHqpmlyTCSHThsSl9Zy1428ciOHI1n83pswza4yLi8FveguMN-wejAjEFCO34UWYmGy7kmtYYCMNvHh36MC5c7JQDN-KrfLXBZ2sa95VYpiEPar-PH2Z1knau9ITnGOBqV6Jgif6t6kOPMYEZnHkUs Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 0e5534e7aab045a9ba93b7fd2d2d888e Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:59.792941 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e5534e7aab045a9ba93b7fd2d2d888e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0e5534e7aab045a9ba93b7fd2d2d888e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e5534e7aab045a9ba93b7fd2d2d888e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0e5534e7aab045a9ba93b7fd2d2d888e"}]}] Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 0e5534e7aab045a9ba93b7fd2d2d888e Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: a114d547a12a49af863a437afe3a4dbd Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:59.794458 ncdv-master-1 devstack@n-api.service[131044]: exception: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'flavor_id': '637964688', 'id': 'hw:cpu_thread_policy'} Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.795214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. Jul 02 21:00:59.796495 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.797748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01ff523f-94df-44b3-86c3-256bcd828d79 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Returning 404 to user: Flavor 637964688 has no extra specs with key hw:cpu_thread_policy. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.798778 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01ff523f-94df-44b3-86c3-256bcd828d79 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/637964688/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.022759 Jul 02 21:00:59.806559 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 57/119] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:00:59 2022] DELETE /compute/v2.1/flavors/637964688/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:00:59.811217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-430d536d-d75b-483b-b51d-09d0cc0b411b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:59.813818 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-430d536d-d75b-483b-b51d-09d0cc0b411b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-430d536d-d75b-483b-b51d-09d0cc0b411b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Request method failure captured: Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 27 Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIKL51RY_2mcy5tIeO6aRySOtHqpmlyTCSHThsSl9Zy1428ciOHI1n83pswza4yLi8FveguMN-wejAjEFCO34UWYmGy7kmtYYCMNvHh36MC5c7JQDN-KrfLXBZ2sa95VYpiEPar-PH2Z1knau9ITnGOBqV6Jgif6t6kOPMYEZnHkUs Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 0e5534e7aab045a9ba93b7fd2d2d888e Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:00:59.815235 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e5534e7aab045a9ba93b7fd2d2d888e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0e5534e7aab045a9ba93b7fd2d2d888e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e5534e7aab045a9ba93b7fd2d2d888e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0e5534e7aab045a9ba93b7fd2d2d888e"}]}] Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 0e5534e7aab045a9ba93b7fd2d2d888e Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a114d547a12a49af863a437afe3a4dbd Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: {"hw:cpu_policy": "shared"} Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:00:59.816630 ncdv-master-1 devstack@n-api.service[131045]: exception: Request body and URI mismatch Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'flavor_id': '637964688', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.822111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.823395 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:00:59.823395 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:00:59.823395 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 02 21:00:59.823395 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.823395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-430d536d-d75b-483b-b51d-09d0cc0b411b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.823395 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-430d536d-d75b-483b-b51d-09d0cc0b411b tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.009557 Jul 02 21:00:59.824814 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 63/120] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:00:59 2022] PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes => generated 73 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:00:59.839102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1eb1b030-9e03-40cf-b41e-c940fa696609 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1eb1b030-9e03-40cf-b41e-c940fa696609 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Request method failure captured: Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 49 Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIKL51RY_2mcy5tIeO6aRySOtHqpmlyTCSHThsSl9Zy1428ciOHI1n83pswza4yLi8FveguMN-wejAjEFCO34UWYmGy7kmtYYCMNvHh36MC5c7JQDN-KrfLXBZ2sa95VYpiEPar-PH2Z1knau9ITnGOBqV6Jgif6t6kOPMYEZnHkUs Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 0e5534e7aab045a9ba93b7fd2d2d888e Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:00:59.845502 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e5534e7aab045a9ba93b7fd2d2d888e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0e5534e7aab045a9ba93b7fd2d2d888e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e5534e7aab045a9ba93b7fd2d2d888e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0e5534e7aab045a9ba93b7fd2d2d888e"}]}] Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 0e5534e7aab045a9ba93b7fd2d2d888e Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: a114d547a12a49af863a437afe3a4dbd Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 02 21:00:59.846942 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'flavor_id': '637964688', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance: Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 02 21:00:59.847600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.849004 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:00:59.850284 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:00:59.850284 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:00:59.850284 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:00:59.850284 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:00:59.850284 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 02 21:00:59.850284 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:00:59.852011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1eb1b030-9e03-40cf-b41e-c940fa696609 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:00:59.853102 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1eb1b030-9e03-40cf-b41e-c940fa696609 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.020366 Jul 02 21:00:59.863028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75baae46-27b2-4d3b-8b39-c87176bed425 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:59.863814 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:00:59.863814 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:00:59.868253 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 58/121] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:00:59 2022] PUT /compute/v2.1/flavors/637964688/os-extra_specs/hw:numa_nodes => generated 117 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:00:59.888566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75baae46-27b2-4d3b-8b39-c87176bed425 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/637964688" status: 202 len: 0 microversion: 2.1 time: 0.029097 Jul 02 21:00:59.889346 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 64/122] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:00:59 2022] DELETE /compute/v2.1/flavors/637964688 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:00:59.900755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74536be4-614d-4088-81dd-f0c547e00965 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:00:59.946177 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74536be4-614d-4088-81dd-f0c547e00965 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267 tempest-FlavorsExtraSpecsNegativeTestJSON-956695267-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051759 Jul 02 21:00:59.947725 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 59/123] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:00:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:00.585827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:00.587737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:00.600393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:00.602051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:00.603013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:00.607853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:00.883522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:00.893289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-98131f0a-9023-4135-88e3-734dbbf13d42 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.311822 Jul 02 21:01:00.893877 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 65/124] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:00 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:01.917661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:01.919672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:01.954716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:01.955564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:01.956704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:01.957336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:02.118639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49e402b3-0c09-4381-a89f-3a883be54279 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1383840232", "id": 1870996094, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:02.120291 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:02.120291 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:02.150812 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49e402b3-0c09-4381-a89f-3a883be54279 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.435926 Jul 02 21:01:02.152926 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 60/125] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:01 2022] POST /compute/v2.1/flavors => generated 439 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:02.165735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac84fa22-a238-431a-a1c8-dd6cdd90c538 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:02.168134 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:02.168134 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:02.414635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac84fa22-a238-431a-a1c8-dd6cdd90c538 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1870996094/action" status: 200 len: 97 microversion: 2.1 time: 0.253324 Jul 02 21:01:02.427000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:02.427167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 61/126] 10.222.0.43 () {60 vars in 1199 bytes} [Sat Jul 2 21:01:02 2022] POST /compute/v2.1/flavors/1870996094/action => generated 97 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:02.439030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a43ef56-81d3-4138-bd01-1fab9b17c271 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:02.441913 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-04ec71e9-8bae-40d0-a94e-721b7f046892 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.534419 Jul 02 21:01:02.443017 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 66/127] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:01 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:03.121388 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1a43ef56-81d3-4138-bd01-1fab9b17c271 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project 4b24a22b9a2043ce990653db8ea28a5a combination. Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a43ef56-81d3-4138-bd01-1fab9b17c271 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Request method failure captured: Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/1870996094/action HTTP/1.1 Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 67 Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIMsYmQy8LzKTASmtrsxHODhuyEnF-_xEF55ShUFC-X2OAOZlriDuh-L_csajGVCkcyN_xyCXrAYnDzuNV91o4NRkDDFB_X4q5FizQclk-oe3_FciCQh0jOhBe6LwmEe-svkgmUVMZE1ZvVw7rl0R8Gs3ZZmsb1i77eq95B4BRf0xo Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 907d1642a1eb4a68b58522e541f43393 Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:03.126944 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/907d1642a1eb4a68b58522e541f43393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_907d1642a1eb4a68b58522e541f43393", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/907d1642a1eb4a68b58522e541f43393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/907d1642a1eb4a68b58522e541f43393"}]}] Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 907d1642a1eb4a68b58522e541f43393 Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 327fa782b7e343269362a697106fa772 Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: {"addTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} Jul 02 21:01:03.128425 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: exception: Flavor access already exists for flavor 29 and project 4b24a22b9a2043ce990653db8ea28a5a combination. Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1870996094', 'body': {'addTenantAccess': {'tenant': '4b24a22b9a2043ce990653db8ea28a5a'}}} Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result.read() Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:01:03.129219 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-4b24a22b9a2043ce990653db8ea28a5a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi session.flush() Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 21:01:03.130338 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 21:01:03.131515 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:01:03.133309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result.read() Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-4b24a22b9a2043ce990653db8ea28a5a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 2, 21, 1, 3, 108509), 'updated_at': None, 'flavor_id': 29, 'project_id': '4b24a22b9a2043ce990653db8ea28a5a'}] Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:03.134396 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project 4b24a22b9a2043ce990653db8ea28a5a combination. Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:03.135474 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project 4b24a22b9a2043ce990653db8ea28a5a combination. Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:03.136712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:03.137909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project 4b24a22b9a2043ce990653db8ea28a5a combination. Jul 02 21:01:03.137909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:03.141307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a43ef56-81d3-4138-bd01-1fab9b17c271 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project 4b24a22b9a2043ce990653db8ea28a5a combination. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:03.142263 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a43ef56-81d3-4138-bd01-1fab9b17c271 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1870996094/action" status: 409 len: 152 microversion: 2.1 time: 0.708051 Jul 02 21:01:03.145088 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 62/128] 10.222.0.43 () {60 vars in 1199 bytes} [Sat Jul 2 21:01:02 2022] POST /compute/v2.1/flavors/1870996094/action => generated 152 bytes in 714 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:01:03.160263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a434525a-264d-4c12-b449-5a7e36dac36c tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:03.161512 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:03.161512 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:03.665136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d95b17d8-045b-4275-a28c-605ec16bbca8 req-78dc8495-374b-4bf7-b868-80441cf0ae11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f3342e-3072-4091-856d-3d791e0a46b3", "tag": "677e71c2-e786-4fb8-9f12-8357194bf8cd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:03.687277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d95b17d8-045b-4275-a28c-605ec16bbca8 req-78dc8495-374b-4bf7-b868-80441cf0ae11 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:03.688023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d95b17d8-045b-4275-a28c-605ec16bbca8 req-78dc8495-374b-4bf7-b868-80441cf0ae11 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:03.717024 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d95b17d8-045b-4275-a28c-605ec16bbca8 req-78dc8495-374b-4bf7-b868-80441cf0ae11 service nova] Creating event network-changed:677e71c2-e786-4fb8-9f12-8357194bf8cd for instance 15f3342e-3072-4091-856d-3d791e0a46b3 on nch2-master-1 Jul 02 21:01:03.718323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d95b17d8-045b-4275-a28c-605ec16bbca8 req-78dc8495-374b-4bf7-b868-80441cf0ae11 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:01:03.719583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:03.720208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:03.721178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:03.721760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:03.734133 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.compute.rpcapi [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 02 21:01:03.735264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] Releasing lock "compute-rpcapi-router" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:01:03.762433 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-962ab606-8488-4d8c-8d69-4b09aa0861c2 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.728599 Jul 02 21:01:03.763311 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 67/129] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:03.769601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:03.770450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:03.778462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:03.779276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:03.780303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:03.781078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:03.999427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:04.010398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f19faca-7988-45d0-8741-6b957b20feb0 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.245300 Jul 02 21:01:04.013107 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 68/130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:03 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:04.320459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a434525a-264d-4c12-b449-5a7e36dac36c tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1870996094/action" status: 200 len: 21 microversion: 2.1 time: 1.163315 Jul 02 21:01:04.331021 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 63/131] 10.222.0.43 () {60 vars in 1199 bytes} [Sat Jul 2 21:01:03 2022] POST /compute/v2.1/flavors/1870996094/action => generated 21 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:04.334791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-afb8f674-fc91-44a5-82b6-b0d01c49c3e6 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:04.335993 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:04.335993 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:04.383982 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-afb8f674-fc91-44a5-82b6-b0d01c49c3e6 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1870996094" status: 202 len: 0 microversion: 2.1 time: 0.052755 Jul 02 21:01:04.386112 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 69/132] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:01:04 2022] DELETE /compute/v2.1/flavors/1870996094 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:04.395389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fd604aa-bc90-4831-a3c0-a80de87db6a5 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:04.446689 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fd604aa-bc90-4831-a3c0-a80de87db6a5 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055044 Jul 02 21:01:04.447336 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 64/133] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:04.462754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5da55e09-b5fa-4a8a-899d-e7f6425f728a tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2016151801", "id": 460383627, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:04.464712 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:04.464712 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:04.502015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5da55e09-b5fa-4a8a-899d-e7f6425f728a tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.043058 Jul 02 21:01:04.511263 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 70/134] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:04 2022] POST /compute/v2.1/flavors => generated 435 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:04.516021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03305dec-fec4-4afb-9428-878d371cdea1 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:04.516819 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:04.516819 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:04.525629 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-03305dec-fec4-4afb-9428-878d371cdea1 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03305dec-fec4-4afb-9428-878d371cdea1 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Request method failure captured: Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/flavors/460383627/os-flavor-access HTTP/1.1 Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIMsYmQy8LzKTASmtrsxHODhuyEnF-_xEF55ShUFC-X2OAOZlriDuh-L_csajGVCkcyN_xyCXrAYnDzuNV91o4NRkDDFB_X4q5FizQclk-oe3_FciCQh0jOhBe6LwmEe-svkgmUVMZE1ZvVw7rl0R8Gs3ZZmsb1i77eq95B4BRf0xo Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 907d1642a1eb4a68b58522e541f43393 Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:04.527389 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/907d1642a1eb4a68b58522e541f43393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_907d1642a1eb4a68b58522e541f43393", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/907d1642a1eb4a68b58522e541f43393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/907d1642a1eb4a68b58522e541f43393"}]}] Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 907d1642a1eb4a68b58522e541f43393 Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 327fa782b7e343269362a697106fa772 Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: exception: Access list not available for public flavors. Jul 02 21:01:04.528784 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'flavor_id': '460383627'} Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 02 21:01:04.532302 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:04.534483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03305dec-fec4-4afb-9428-878d371cdea1 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:04.534483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03305dec-fec4-4afb-9428-878d371cdea1 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/460383627/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.017037 Jul 02 21:01:04.534483 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 65/135] 10.222.0.43 () {58 vars in 1205 bytes} [Sat Jul 2 21:01:04 2022] GET /compute/v2.1/flavors/460383627/os-flavor-access => generated 91 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:01:04.538897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-476859fb-a1a0-430e-97af-65a3b4177628 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:04.568856 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-476859fb-a1a0-430e-97af-65a3b4177628 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/460383627" status: 202 len: 0 microversion: 2.1 time: 0.033410 Jul 02 21:01:04.571041 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 71/136] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:01:04 2022] DELETE /compute/v2.1/flavors/460383627 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:04.580651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-765a3253-7ecc-431c-9af2-f745de829422 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:04.781704 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-765a3253-7ecc-431c-9af2-f745de829422 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.205999 Jul 02 21:01:04.782788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 66/137] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:04.798999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe48fe6f-67c9-46cd-a640-fb2feeee52be tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1628779114", "id": 2008920991, "os-flavor-access:is_public": "False"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:04.854691 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe48fe6f-67c9-46cd-a640-fb2feeee52be tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.059357 Jul 02 21:01:04.862093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 72/138] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:04 2022] POST /compute/v2.1/flavors => generated 439 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:05.033162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:05.034018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:05.042196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:05.042846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:05.044384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:05.045042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:05.279944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:05.311521 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c890894-4585-4872-b217-dae4f13d89eb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.287276 Jul 02 21:01:05.314765 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 73/139] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:05 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:05.390450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b1f0716-2a97-4d0a-93d9-820691f57f00 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:05.392748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b1f0716-2a97-4d0a-93d9-820691f57f00 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '69ce5d41ca8a41a0a9a6e42f1f08ba04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24a22b9a2043ce990653db8ea28a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b1f0716-2a97-4d0a-93d9-820691f57f00 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Request method failure captured: Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/flavors/2008920991/action HTTP/1.1 Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 67 Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIKUCEWTaYQ6eiQkJoGhkzNNNGc6JhPw7CVTTLN1E-eS9gy4DyZdtKfCT8rcJeZMNO8MsnxB5syJogDKM5AfP22EaSUfceJdZy3C2nQ7RaJS14fXPgYquhgMoYtrRPKd7hTNtNnU39ZFUfGMOiajMW_jMg1vxmWAGlF2gEljD0ApVw Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 4b24a22b9a2043ce990653db8ea28a5a Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-220542627 Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:05.394713 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b24a22b9a2043ce990653db8ea28a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b24a22b9a2043ce990653db8ea28a5a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b24a22b9a2043ce990653db8ea28a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b24a22b9a2043ce990653db8ea28a5a"}]}] Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-220542627 Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 4b24a22b9a2043ce990653db8ea28a5a Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-220542627 Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsAccessNegativeTestJSON-220542627-project Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 69ce5d41ca8a41a0a9a6e42f1f08ba04 Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-220542627-project Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: {"addTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} Jul 02 21:01:05.395901 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2008920991', 'body': {'addTenantAccess': {'tenant': '4b24a22b9a2043ce990653db8ea28a5a'}}} Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:05.396647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 02 21:01:05.397691 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:05.398858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b1f0716-2a97-4d0a-93d9-820691f57f00 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:05.398858 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b1f0716-2a97-4d0a-93d9-820691f57f00 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] 10.222.0.43 "POST /compute/v2.1/flavors/2008920991/action" status: 403 len: 130 microversion: 2.1 time: 0.530747 Jul 02 21:01:05.398858 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 67/140] 10.222.0.43 () {60 vars in 1199 bytes} [Sat Jul 2 21:01:04 2022] POST /compute/v2.1/flavors/2008920991/action => generated 130 bytes in 532 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:05.405610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a3efdb7-fb67-4da4-a466-b19502354c55 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:05.406598 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:05.406598 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:05.432744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:05.435869 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a3efdb7-fb67-4da4-a466-b19502354c55 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2008920991" status: 202 len: 0 microversion: 2.1 time: 0.034678 Jul 02 21:01:05.440809 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:01:05 2022] DELETE /compute/v2.1/flavors/2008920991 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:05.454533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c04d0697-3214-4a80-9e00-1bc21b5abc22 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:05.480700 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c04d0697-3214-4a80-9e00-1bc21b5abc22 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035556 Jul 02 21:01:05.481852 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 68/142] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:05.500522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76ceec68-5e17-4dfa-84ed-f343aef32a55 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1511159950", "id": 132331199, "os-flavor-access:is_public": "False"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:05.502856 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:05.502856 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:05.526336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76ceec68-5e17-4dfa-84ed-f343aef32a55 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.030728 Jul 02 21:01:05.532075 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 75/143] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:05 2022] POST /compute/v2.1/flavors => generated 436 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:05.542057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c2793cd-7aa9-4f44-8f86-a130b3ebf5e3 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:06.001752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c2793cd-7aa9-4f44-8f86-a130b3ebf5e3 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/132331199/action" status: 200 len: 96 microversion: 2.1 time: 0.467281 Jul 02 21:01:06.002977 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 69/144] 10.222.0.43 () {60 vars in 1196 bytes} [Sat Jul 2 21:01:05 2022] POST /compute/v2.1/flavors/132331199/action => generated 96 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:06.021297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-adbd6d3f-a5aa-4798-982c-3e0349a41dc7 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:06.023470 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:06.023470 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:06.025874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-adbd6d3f-a5aa-4798-982c-3e0349a41dc7 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '69ce5d41ca8a41a0a9a6e42f1f08ba04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b24a22b9a2043ce990653db8ea28a5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-adbd6d3f-a5aa-4798-982c-3e0349a41dc7 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Request method failure captured: Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/flavors/132331199/action HTTP/1.1 Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 70 Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIKUCEWTaYQ6eiQkJoGhkzNNNGc6JhPw7CVTTLN1E-eS9gy4DyZdtKfCT8rcJeZMNO8MsnxB5syJogDKM5AfP22EaSUfceJdZy3C2nQ7RaJS14fXPgYquhgMoYtrRPKd7hTNtNnU39ZFUfGMOiajMW_jMg1vxmWAGlF2gEljD0ApVw Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4b24a22b9a2043ce990653db8ea28a5a Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-220542627 Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:06.030137 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b24a22b9a2043ce990653db8ea28a5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b24a22b9a2043ce990653db8ea28a5a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b24a22b9a2043ce990653db8ea28a5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b24a22b9a2043ce990653db8ea28a5a"}]}] Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-220542627 Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4b24a22b9a2043ce990653db8ea28a5a Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-220542627 Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsAccessNegativeTestJSON-220542627-project Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 69ce5d41ca8a41a0a9a6e42f1f08ba04 Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-220542627-project Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: {"removeTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} Jul 02 21:01:06.031649 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '132331199', 'body': {'removeTenantAccess': {'tenant': '4b24a22b9a2043ce990653db8ea28a5a'}}} Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can( Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:06.032480 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 02 21:01:06.033747 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:06.037368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-adbd6d3f-a5aa-4798-982c-3e0349a41dc7 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:06.039861 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-adbd6d3f-a5aa-4798-982c-3e0349a41dc7 tempest-FlavorsAccessNegativeTestJSON-220542627 tempest-FlavorsAccessNegativeTestJSON-220542627-project] 10.222.0.43 "POST /compute/v2.1/flavors/132331199/action" status: 403 len: 133 microversion: 2.1 time: 0.031085 Jul 02 21:01:06.041437 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 76/145] 10.222.0.43 () {60 vars in 1196 bytes} [Sat Jul 2 21:01:06 2022] POST /compute/v2.1/flavors/132331199/action => generated 133 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:01:06.051325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e893521-edc1-41a9-a7c3-0b814dba07a2 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4b24a22b9a2043ce990653db8ea28a5a"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:06.330833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:06.331546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:06.343211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:06.347574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:06.348607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:06.349269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:06.512905 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e893521-edc1-41a9-a7c3-0b814dba07a2 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/132331199/action" status: 200 len: 21 microversion: 2.1 time: 0.466112 Jul 02 21:01:06.517934 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 70/146] 10.222.0.43 () {60 vars in 1196 bytes} [Sat Jul 2 21:01:06 2022] POST /compute/v2.1/flavors/132331199/action => generated 21 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 02 21:01:06.528713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d62e39aa-ceed-413a-b9da-608398406939 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:06.529028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:06.529475 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:06.529475 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:06.539389 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38e7ab3e-aab7-46bc-8e09-bed7287d2e26 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.211689 Jul 02 21:01:06.540477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 77/147] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:06 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:06.578483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d62e39aa-ceed-413a-b9da-608398406939 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/132331199" status: 202 len: 0 microversion: 2.1 time: 0.057249 Jul 02 21:01:06.582377 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 71/148] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:01:06 2022] DELETE /compute/v2.1/flavors/132331199 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:06.587738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27ab6195-d876-46c5-9044-33f712416df2 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:06.613633 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27ab6195-d876-46c5-9044-33f712416df2 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029491 Jul 02 21:01:06.624697 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 78/149] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:06.634345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c3283a9-c0ca-4e32-a33f-8b29ff111923 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2098053863", "id": 759052730, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:06.663224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c3283a9-c0ca-4e32-a33f-8b29ff111923 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.033128 Jul 02 21:01:06.664303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 72/150] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:06 2022] POST /compute/v2.1/flavors => generated 436 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:06.678343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-075a9ad2-6d21-4b6d-8c43-c93fa3615e88 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "798845d7ca1f4577ac6ae317a7eece2b"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:06.679606 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:06.679606 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:07.143906 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-075a9ad2-6d21-4b6d-8c43-c93fa3615e88 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] HTTP exception thrown: Flavor access not found for 33 / 798845d7ca1f4577ac6ae317a7eece2b combination. Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-075a9ad2-6d21-4b6d-8c43-c93fa3615e88 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Request method failure captured: Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/flavors/759052730/action HTTP/1.1 Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 70 Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIMsYmQy8LzKTASmtrsxHODhuyEnF-_xEF55ShUFC-X2OAOZlriDuh-L_csajGVCkcyN_xyCXrAYnDzuNV91o4NRkDDFB_X4q5FizQclk-oe3_FciCQh0jOhBe6LwmEe-svkgmUVMZE1ZvVw7rl0R8Gs3ZZmsb1i77eq95B4BRf0xo Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 907d1642a1eb4a68b58522e541f43393 Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:01:07.146145 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/907d1642a1eb4a68b58522e541f43393"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_907d1642a1eb4a68b58522e541f43393", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/907d1642a1eb4a68b58522e541f43393"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/907d1642a1eb4a68b58522e541f43393"}]}] Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 907d1642a1eb4a68b58522e541f43393 Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-931552759 Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 327fa782b7e343269362a697106fa772 Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: {"removeTenantAccess": {"tenant": "798845d7ca1f4577ac6ae317a7eece2b"}} Jul 02 21:01:07.147337 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: exception: Flavor access not found for 33 / 798845d7ca1f4577ac6ae317a7eece2b combination. Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '759052730', 'body': {'removeTenantAccess': {'tenant': '798845d7ca1f4577ac6ae317a7eece2b'}}} Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 02 21:01:07.148513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / 798845d7ca1f4577ac6ae317a7eece2b combination. Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / 798845d7ca1f4577ac6ae317a7eece2b combination. Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:07.149756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / 798845d7ca1f4577ac6ae317a7eece2b combination. Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-075a9ad2-6d21-4b6d-8c43-c93fa3615e88 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Returning 404 to user: Flavor access not found for 33 / 798845d7ca1f4577ac6ae317a7eece2b combination. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-075a9ad2-6d21-4b6d-8c43-c93fa3615e88 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/759052730/action" status: 404 len: 124 microversion: 2.1 time: 0.473663 Jul 02 21:01:07.151820 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 79/151] 10.222.0.43 () {60 vars in 1196 bytes} [Sat Jul 2 21:01:06 2022] POST /compute/v2.1/flavors/759052730/action => generated 124 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:07.166347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed43c5e0-144a-4c15-a1d1-4266554d1c59 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.185058 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed43c5e0-144a-4c15-a1d1-4266554d1c59 tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/759052730" status: 202 len: 0 microversion: 2.1 time: 0.023510 Jul 02 21:01:07.185737 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 73/152] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:01:07 2022] DELETE /compute/v2.1/flavors/759052730 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:07.195748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef5b6449-9c40-4c07-b2b3-0f984d0d885d tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.214619 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef5b6449-9c40-4c07-b2b3-0f984d0d885d tempest-FlavorsAccessNegativeTestJSON-931552759 tempest-FlavorsAccessNegativeTestJSON-931552759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024337 Jul 02 21:01:07.215218 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 80/153] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:07.586922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Calling method '.version_select at 0x7fabe7a48550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.588168 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:07.588168 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:07.589584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.590318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.606388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.607154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.620095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.620723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.627196 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12b3af26-da9a-4986-9777-ca62d581c807 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.272568 Jul 02 21:01:07.628322 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 81/154] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:01:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:01:07.633142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.634578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:07.636258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b2a1ada-ffd9-4fd6-8e32-3107d05191c9 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Action: 'create', calling method: .version_select at 0x7fabe54d28b0>, body: {"keypair": {"name": "tempest-keypair-1275174384", "type": "ssh", "user_id": "5a0772a498774299b2e5b33d42abba78", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEynHFcK1t091ZZbLX6EKA0dB5vBmIlsnhr1JA01A1/qaSjkOE6eh1DZVsyNX3d3atbT3X9k9ES3lDimKuW6Zz0kmGLBDATpbSOMK3tivpyo1kxaXvxTm9ohd1v0A4eyw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:07.642092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.642858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.643820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.644276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.675691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1b2a1ada-ffd9-4fd6-8e32-3107d05191c9 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Getting quotas for project 1da6c0d2bdfd4ddb906ba11f5661118f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:07.682814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1b2a1ada-ffd9-4fd6-8e32-3107d05191c9 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Getting quotas for user 701fc0602de041baa8e03d2f2d2da765 and project 1da6c0d2bdfd4ddb906ba11f5661118f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:07.721663 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b2a1ada-ffd9-4fd6-8e32-3107d05191c9 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.437081 Jul 02 21:01:07.722627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 74/155] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:01:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 439 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:01:07.728264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31ac2848-1d2d-438d-a766-9c2102fc3067 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Calling method '.version_select at 0x7fabe540aca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.729384 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:07.729384 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:07.731112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ac2848-1d2d-438d-a766-9c2102fc3067 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.731891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ac2848-1d2d-438d-a766-9c2102fc3067 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.755464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ac2848-1d2d-438d-a766-9c2102fc3067 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:07.755905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31ac2848-1d2d-438d-a766-9c2102fc3067 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:07.765191 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31ac2848-1d2d-438d-a766-9c2102fc3067 tempest-HypervisorAdminV228Test-880251721 tempest-HypervisorAdminV228Test-880251721-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.040417 Jul 02 21:01:07.766371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 75/156] 10.222.0.43 () {60 vars in 1192 bytes} [Sat Jul 2 21:01:07 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:07.772185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03a55f13-0d72-441b-867f-e3fffe4bd61d tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Action: 'create', calling method: .version_select at 0x7fabe544b700>, body: {"keypair": {"name": "tempest-keypair-260107590", "type": "ssh", "user_id": "5a0772a498774299b2e5b33d42abba78", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPW0+quTBmt0vWRg5tHwqBDDEvimTEsme3ZaeBwabRTycJcRUfKVxxD5c4iCkZOnvcvOKVHk8oqH9sBCmy1JrfYFLJZYXcLJe9JgrZI3tv+lGC7i5Esk+DkRSNclCOINAw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:07.792519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-03a55f13-0d72-441b-867f-e3fffe4bd61d tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Getting quotas for project 1da6c0d2bdfd4ddb906ba11f5661118f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:07.799514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-03a55f13-0d72-441b-867f-e3fffe4bd61d tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Getting quotas for user 701fc0602de041baa8e03d2f2d2da765 and project 1da6c0d2bdfd4ddb906ba11f5661118f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:07.830004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:07.833666 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03a55f13-0d72-441b-867f-e3fffe4bd61d tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.065922 Jul 02 21:01:07.835217 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 76/157] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:01:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:01:07.845417 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba15a0de-b5c0-414e-a82c-a7bb32c5668b tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.215875 Jul 02 21:01:07.846191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3de06488-0940-467c-b77b-2cffe957e8be tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Calling method '.version_select at 0x7fabe54d29d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.856068 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 82/158] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:07 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:07.861253 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3de06488-0940-467c-b77b-2cffe957e8be tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1275174384?user_id=5a0772a498774299b2e5b33d42abba78" status: 200 len: 512 microversion: 2.10 time: 0.019909 Jul 02 21:01:07.862030 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 77/159] 10.222.0.43 () {60 vars in 1339 bytes} [Sat Jul 2 21:01:07 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1275174384?user_id=5a0772a498774299b2e5b33d42abba78 => generated 512 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:01:07.875920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-642d21c3-fcef-48e5-979a-9a8dbe0ae81e tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Action: 'create', calling method: .version_select at 0x7fabe55fe8b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1866929900", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgfVjOpBrdIUeBPHPRPZBPuCXN3SGRmGmRsPHlOBeWhZrfp1rDpvmXLWyQtz6HoDqcujV5j4iHn2GfVq6Je93Vs7Fqw78CT1IAHVH5cvmJcCqRTyX63hiyHXXS2+cXspg=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:07.899549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-642d21c3-fcef-48e5-979a-9a8dbe0ae81e tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Getting quotas for project 1da6c0d2bdfd4ddb906ba11f5661118f. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:07.905512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-642d21c3-fcef-48e5-979a-9a8dbe0ae81e tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Getting quotas for user 701fc0602de041baa8e03d2f2d2da765 and project 1da6c0d2bdfd4ddb906ba11f5661118f. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:07.936395 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-642d21c3-fcef-48e5-979a-9a8dbe0ae81e tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.064882 Jul 02 21:01:07.938032 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 83/160] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:01:07 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:01:07.947496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa326b02-6f3c-4155-80b7-41a9448f76a3 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Calling method '.version_select at 0x7fabe54315e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:07.950013 ncdv-master-1 devstack@n-api.service[131044]: WARNING oslo_db.sqlalchemy.utils [None req-fa326b02-6f3c-4155-80b7-41a9448f76a3 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 02 21:01:07.951547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=81,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:INSERT=7,nova_api:DELETE=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:07.961187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa326b02-6f3c-4155-80b7-41a9448f76a3 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "GET /compute/v2.1/os-keypairs?user_id=5a0772a498774299b2e5b33d42abba78" status: 200 len: 725 microversion: 2.10 time: 0.017436 Jul 02 21:01:07.961766 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 78/161] 10.222.0.43 () {60 vars in 1258 bytes} [Sat Jul 2 21:01:07 2022] GET /compute/v2.1/os-keypairs?user_id=5a0772a498774299b2e5b33d42abba78 => generated 725 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:07.971687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-047e85ad-52a3-40aa-b004-16b044335464 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Calling method '.version_select at 0x7fabe55ea820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:08.002336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-047e85ad-52a3-40aa-b004-16b044335464 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1866929900" status: 204 len: 0 microversion: 2.10 time: 0.034297 Jul 02 21:01:08.002938 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 84/162] 10.222.0.43 () {60 vars in 1324 bytes} [Sat Jul 2 21:01:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1866929900 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:01:08.012945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1b5712a-d12b-4103-9b59-c916b60bc87f tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Calling method '.version_select at 0x7fabe53c3ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:08.041840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1b5712a-d12b-4103-9b59-c916b60bc87f tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-260107590?user_id=5a0772a498774299b2e5b33d42abba78" status: 204 len: 0 microversion: 2.10 time: 0.033622 Jul 02 21:01:08.046472 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 79/163] 10.222.0.43 () {60 vars in 1339 bytes} [Sat Jul 2 21:01:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-260107590?user_id=5a0772a498774299b2e5b33d42abba78 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:01:08.051799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f4824115-0d53-4e87-b6a2-909bed9e0534 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] Calling method '.version_select at 0x7fabe55a60d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:08.074206 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f4824115-0d53-4e87-b6a2-909bed9e0534 tempest-KeyPairsV210TestJSON-972565125 tempest-KeyPairsV210TestJSON-972565125-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275174384?user_id=5a0772a498774299b2e5b33d42abba78" status: 204 len: 0 microversion: 2.10 time: 0.026231 Jul 02 21:01:08.075195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 85/164] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:01:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275174384?user_id=5a0772a498774299b2e5b33d42abba78 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:01:08.823840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:08.864786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:08.866666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:08.882087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:08.882604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:08.883413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:08.883859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:09.191812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:09.199960 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c0a94786-ba8c-4396-8f36-45009d4522a8 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.340393 Jul 02 21:01:09.209438 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 86/165] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:08 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:09.272344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-761cb51c-2923-4fee-a00c-3880f9826284 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Action: 'update', calling method: .version_select at 0x7fabe53c39d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:09.599743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761cb51c-2923-4fee-a00c-3880f9826284 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:09.600625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761cb51c-2923-4fee-a00c-3880f9826284 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:09.602287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761cb51c-2923-4fee-a00c-3880f9826284 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:09.603035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-761cb51c-2923-4fee-a00c-3880f9826284 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:09.686240 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-761cb51c-2923-4fee-a00c-3880f9826284 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3" status: 200 len: 148 microversion: 2.57 time: 0.869969 Jul 02 21:01:09.686862 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 80/166] 10.222.0.43 () {62 vars in 1302 bytes} [Sat Jul 2 21:01:08 2022] PUT /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3 => generated 148 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:09.696880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-182b4593-8aa3-4ae0-8d4c-db8747ac19a3 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Calling method '.version_select at 0x7fabe553e040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:09.974371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:09.986469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-182b4593-8aa3-4ae0-8d4c-db8747ac19a3 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:09.987324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-182b4593-8aa3-4ae0-8d4c-db8747ac19a3 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:09.988807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-182b4593-8aa3-4ae0-8d4c-db8747ac19a3 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:09.989514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-182b4593-8aa3-4ae0-8d4c-db8747ac19a3 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:10.022785 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-182b4593-8aa3-4ae0-8d4c-db8747ac19a3 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3/detail" status: 200 len: 463 microversion: 2.57 time: 0.329671 Jul 02 21:01:10.026975 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 87/167] 10.222.0.43 () {60 vars in 1303 bytes} [Sat Jul 2 21:01:09 2022] GET /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3/detail => generated 463 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:01:10.217446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:10.218192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:10.231696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:10.232179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:10.232964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:10.233391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:10.587025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:10.603401 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15883c81-6f86-4ce5-9e33-8798675e3efc tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.390162 Jul 02 21:01:10.604746 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 81/168] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:10 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:10.778462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Action: 'update', calling method: .version_select at 0x7fabe553eca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:11.207395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:11.208151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:11.211439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:11.212768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:11.270895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:11.271469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:11.272720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:11.273627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:11.351599 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2989392c-b709-49db-b161-e4b4a5f531b8 tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3?user_id=e6941849e83842fd8c46cd7788813dad" status: 200 len: 148 microversion: 2.57 time: 0.577327 Jul 02 21:01:11.356287 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 88/169] 10.222.0.43 () {62 vars in 1383 bytes} [Sat Jul 2 21:01:10 2022] PUT /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3?user_id=e6941849e83842fd8c46cd7788813dad => generated 148 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:11.364622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc249acb-93e7-45b2-a2da-88c17d0c9aba tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] Calling method '.version_select at 0x7fabe544b700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:11.622289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:11.622899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:11.629292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:11.629968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:11.630764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:11.631193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:11.773097 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc249acb-93e7-45b2-a2da-88c17d0c9aba tempest-QuotasAdminTestV257-1699529842 tempest-QuotasAdminTestV257-1699529842-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3?user_id=e6941849e83842fd8c46cd7788813dad" status: 200 len: 190 microversion: 2.57 time: 0.414204 Jul 02 21:01:11.780278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 82/170] 10.222.0.43 () {60 vars in 1363 bytes} [Sat Jul 2 21:01:11 2022] GET /compute/v2.1/os-quota-sets/ef7ac194856345328a65d0f209d5bfd3?user_id=e6941849e83842fd8c46cd7788813dad => generated 190 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:11.792875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:11.802566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e80376d7-86e1-4126-996b-783b5152db55 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.184843 Jul 02 21:01:11.803348 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 89/171] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:11 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:12.820861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:12.822026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:12.839649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:12.840601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:12.842153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:12.843874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:13.242353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3940fef-59ef-4d8a-9a5e-b336dbc5373f tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] Calling method '.version_select at 0x7fabe55a60d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:13.243662 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:13.243662 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:13.279146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:13.282609 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3940fef-59ef-4d8a-9a5e-b336dbc5373f tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.350665 Jul 02 21:01:13.283336 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 90/172] 10.222.0.43 () {60 vars in 1225 bytes} [Sat Jul 2 21:01:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:13.292242 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e469803-05ce-47d3-a11a-6b1c7f4f1983 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.476096 Jul 02 21:01:13.292830 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 83/173] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:12 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:13.307650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d68a445d-74ae-4d29-bf3a-35240728f98d tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] Action: 'update', calling method: .version_select at 0x7fabe55feee0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:13.313561 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:13.313561 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:13.408487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca4e1c76-21b5-4836-879a-8211fbfcd741 tempest-NetworksTest-198729552 tempest-NetworksTest-198729552-project-admin] Calling method '.version_select at 0x7fabe52a7280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:13.494137 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d68a445d-74ae-4d29-bf3a-35240728f98d tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.200760 Jul 02 21:01:13.495719 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 91/174] 10.222.0.43 () {62 vars in 1246 bytes} [Sat Jul 2 21:01:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:13.517481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bccf5f04-ab86-465c-a5b4-7f45f0d97af1 tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] Calling method '.version_select at 0x7fabe555c310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:13.532734 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bccf5f04-ab86-465c-a5b4-7f45f0d97af1 tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.030689 Jul 02 21:01:13.534660 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 92/175] 10.222.0.43 () {60 vars in 1225 bytes} [Sat Jul 2 21:01:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:13.548332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ca91963-80e9-46f7-b1be-24eb88a1f8e5 tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] Action: 'update', calling method: .version_select at 0x7fabe54ee430>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:13.665060 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ca91963-80e9-46f7-b1be-24eb88a1f8e5 tempest-QuotaClassesAdmin257Test-1598472007 tempest-QuotaClassesAdmin257Test-1598472007-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.122694 Jul 02 21:01:13.672436 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 93/176] 10.222.0.43 () {62 vars in 1246 bytes} [Sat Jul 2 21:01:13 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:13.727508 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca4e1c76-21b5-4836-879a-8211fbfcd741 tempest-NetworksTest-198729552 tempest-NetworksTest-198729552-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 2629 microversion: 2.1 time: 0.392225 Jul 02 21:01:13.728205 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 84/177] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:13 2022] GET /compute/v2.1/os-networks => generated 2629 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:13.737090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71eeff9c-99ac-44e8-b58b-13c43dd32c08 tempest-NetworksTest-198729552 tempest-NetworksTest-198729552-project-admin] Calling method '.version_select at 0x7fabe54eee50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:14.028749 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71eeff9c-99ac-44e8-b58b-13c43dd32c08 tempest-NetworksTest-198729552 tempest-NetworksTest-198729552-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks/f531777e-f940-4d67-924e-573dd82b0c42" status: 200 len: 652 microversion: 2.1 time: 0.295809 Jul 02 21:01:14.029610 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 94/178] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:01:13 2022] GET /compute/v2.1/os-networks/f531777e-f940-4d67-924e-573dd82b0c42 => generated 652 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:14.038793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5f311a7-7286-4f94-84c5-fe664d266413 tempest-NetworksTest-198729552 tempest-NetworksTest-198729552-project-admin] Calling method '.version_select at 0x7fabe52a7f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:14.269213 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5f311a7-7286-4f94-84c5-fe664d266413 tempest-NetworksTest-198729552 tempest-NetworksTest-198729552-project-admin] 10.222.0.43 "GET /compute/v2.1/os-networks" status: 200 len: 2629 microversion: 2.1 time: 0.233132 Jul 02 21:01:14.270990 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 85/179] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:14 2022] GET /compute/v2.1/os-networks => generated 2629 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:14.311804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:14.313746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:14.342431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:14.343009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:14.343721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:14.344445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:14.777625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:14.789469 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0df0683a-de9f-4c01-bcb4-1c5a125a6c70 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.483849 Jul 02 21:01:14.790076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 95/180] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:14 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:15.449833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d35d0e3d-ee40-48e5-83b3-66eef0a5d700 req-6561ae9a-d4ec-4b1a-ad8b-5e220c88dace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3342e-3072-4091-856d-3d791e0a46b3", "name": "network-vif-plugged", "status": "completed", "tag": "677e71c2-e786-4fb8-9f12-8357194bf8cd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:15.470817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d35d0e3d-ee40-48e5-83b3-66eef0a5d700 req-6561ae9a-d4ec-4b1a-ad8b-5e220c88dace service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:15.471483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d35d0e3d-ee40-48e5-83b3-66eef0a5d700 req-6561ae9a-d4ec-4b1a-ad8b-5e220c88dace service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:15.505527 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d35d0e3d-ee40-48e5-83b3-66eef0a5d700 req-6561ae9a-d4ec-4b1a-ad8b-5e220c88dace service nova] Creating event network-vif-plugged:677e71c2-e786-4fb8-9f12-8357194bf8cd for instance 15f3342e-3072-4091-856d-3d791e0a46b3 on nch2-master-1 Jul 02 21:01:15.507154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d35d0e3d-ee40-48e5-83b3-66eef0a5d700 req-6561ae9a-d4ec-4b1a-ad8b-5e220c88dace service nova] Acquired lock "compute-rpcapi-router" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:01:15.508748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:15.509402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:15.512944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:15.513564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:15.528938 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.rpcapi [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 02 21:01:15.531328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] Releasing lock "compute-rpcapi-router" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:01:15.551210 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af6e73ef-3b87-4280-8c01-740bc533e538 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270828 Jul 02 21:01:15.552169 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 86/181] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:15.806838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:15.807651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:15.817174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:15.817652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:15.820505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:15.820960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:16.163024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:16.173390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:16.178976 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-951aec0b-3817-47fc-a5f3-29357c44e1c9 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.376124 Jul 02 21:01:16.184632 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 96/182] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:15 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:17.201436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:17.202750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:17.214999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:17.215725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:17.216698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:17.222372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:17.669012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:17.684855 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d3ffc7a-d2c8-40b0-94a0-6a84376f060a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1337 microversion: 2.1 time: 0.486034 Jul 02 21:01:17.686350 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 87/183] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:17 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1337 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:18.703067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:18.703729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:18.713413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:18.713868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:18.716744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:18.718258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:18.943281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:18.958115 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7712778e-83c9-4561-b0ea-1973fe83f309 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1486 microversion: 2.1 time: 0.258429 Jul 02 21:01:18.958678 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 97/184] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:18 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1486 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:18.981441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:18.982903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:18.990176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:18.990638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:18.991391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:18.991827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:19.005224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f4dc4d6-3879-48f3-b1f6-30dacc14b3d2 tempest-TenantUsagesNegativeTestJSON-1273185884 tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-01T21%3A01%3A18.793692&end=2022-07-03T21%3A01%3A18.793692" status: 404 len: 112 microversion: - time: 0.204803 Jul 02 21:01:19.010784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 88/185] 10.222.0.43 () {58 vars in 1315 bytes} [Sat Jul 2 21:01:18 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-01T21%3A01%3A18.793692&end=2022-07-03T21%3A01%3A18.793692 => generated 112 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 02 21:01:19.015682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63da306f-0bc3-4cfd-9c65-32b2182c02a4 tempest-TenantUsagesNegativeTestJSON-1273185884 tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin] Calling method '.version_select at 0x7fabe544bc10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:19.039045 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-63da306f-0bc3-4cfd-9c65-32b2182c02a4 tempest-TenantUsagesNegativeTestJSON-1273185884 tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63da306f-0bc3-4cfd-9c65-32b2182c02a4 tempest-TenantUsagesNegativeTestJSON-1273185884 tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin] Request method failure captured: Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-simple-tenant-usage/618d91601a8c4d7194194033be0be5c6?start=2022-07-03T21%3A01%3A18.793692&end=2022-07-01T21%3A01%3A18.793692 HTTP/1.1 Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIeAo2KVRaMr4ygUJUr1mb_uzLk3X5YtHKF2S9yLvpwqbe6wlvhtgNoiSoOoUT_4B-JNofglVxzG42qFCjH1-pV-jqw0Wgqzl5vOmk_hP2gpo-VAIJWuI6mmgySrmGCRLl2R3EbszBAu4jCAEuUTDxWQSTYzc3oCo1zxdu3ept2Vtg Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d5b549171ddb47118c3c564da1fe6467 Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1273185884 Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:19.049922 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5b549171ddb47118c3c564da1fe6467"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d5b549171ddb47118c3c564da1fe6467", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d5b549171ddb47118c3c564da1fe6467"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d5b549171ddb47118c3c564da1fe6467"}]}] Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1273185884 Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d5b549171ddb47118c3c564da1fe6467 Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1273185884 Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 50d1ebfc28054ff3a3e437666a17be0e Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid start time. The start time cannot occur after the end time. Jul 02 21:01:19.051488 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '618d91601a8c4d7194194033be0be5c6'} Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 02 21:01:19.052320 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:19.053578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63da306f-0bc3-4cfd-9c65-32b2182c02a4 tempest-TenantUsagesNegativeTestJSON-1273185884 tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:19.054831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63da306f-0bc3-4cfd-9c65-32b2182c02a4 tempest-TenantUsagesNegativeTestJSON-1273185884 tempest-TenantUsagesNegativeTestJSON-1273185884-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/618d91601a8c4d7194194033be0be5c6?start=2022-07-03T21%3A01%3A18.793692&end=2022-07-01T21%3A01%3A18.793692" status: 400 len: 111 microversion: 2.1 time: 0.041114 Jul 02 21:01:19.055465 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 89/186] 10.222.0.43 () {58 vars in 1411 bytes} [Sat Jul 2 21:01:19 2022] GET /compute/v2.1/os-simple-tenant-usage/618d91601a8c4d7194194033be0be5c6?start=2022-07-03T21%3A01%3A18.793692&end=2022-07-01T21%3A01%3A18.793692 => generated 111 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:01:19.397536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1114d6ab-b37a-452b-9867-6bf013db45ea tempest-TenantUsagesNegativeTestJSON-1615750826 tempest-TenantUsagesNegativeTestJSON-1615750826-project] Calling method '.version_select at 0x7fabe52d9790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:19.400209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1114d6ab-b37a-452b-9867-6bf013db45ea tempest-TenantUsagesNegativeTestJSON-1615750826 tempest-TenantUsagesNegativeTestJSON-1615750826-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '123d7b542a8443a192f2f89d05cebbb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '618d91601a8c4d7194194033be0be5c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1114d6ab-b37a-452b-9867-6bf013db45ea tempest-TenantUsagesNegativeTestJSON-1615750826 tempest-TenantUsagesNegativeTestJSON-1615750826-project] Request method failure captured: Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-01T21%3A01%3A18.793692&end=2022-07-03T21%3A01%3A18.793692&detailed=1 HTTP/1.1 Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIdu53egBGUNvCfyX7z7D0dIffnYLa620sDoTbzd5OricvvsfNkKR3iv8Yh26YNhhEWhmeGGwE6C3puIgG8e5OjS8_s6CD6KoyPG-baLn4FyAOTBWFl8cOM8OHixp5EUSaC3EYCHr8tNucjEg4XNp1dmdyEX0TcYNYABA7R74rwhbg Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 618d91601a8c4d7194194033be0be5c6 Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1615750826 Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:19.404301 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/618d91601a8c4d7194194033be0be5c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_618d91601a8c4d7194194033be0be5c6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/618d91601a8c4d7194194033be0be5c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/618d91601a8c4d7194194033be0be5c6"}]}] Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1615750826 Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 618d91601a8c4d7194194033be0be5c6 Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1615750826 Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TenantUsagesNegativeTestJSON-1615750826-project Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 123d7b542a8443a192f2f89d05cebbb6 Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1615750826-project Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:01:19.405954 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:19.406986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:19.408423 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:19.409753 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 02 21:01:19.409753 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:19.409753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1114d6ab-b37a-452b-9867-6bf013db45ea tempest-TenantUsagesNegativeTestJSON-1615750826 tempest-TenantUsagesNegativeTestJSON-1615750826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:19.409753 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1114d6ab-b37a-452b-9867-6bf013db45ea tempest-TenantUsagesNegativeTestJSON-1615750826 tempest-TenantUsagesNegativeTestJSON-1615750826-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-01T21%3A01%3A18.793692&end=2022-07-03T21%3A01%3A18.793692&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.346405 Jul 02 21:01:19.418813 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 90/187] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Jul 2 21:01:19 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-01T21%3A01%3A18.793692&end=2022-07-03T21%3A01%3A18.793692&detailed=1 => generated 123 bytes in 352 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:19.523076 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8417c740-154a-4c21-b013-c2fed8f171b6 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1637 microversion: 2.1 time: 0.547168 Jul 02 21:01:19.544349 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 98/188] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:18 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1637 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:19.551335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:19.557010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:19.571559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:19.572015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:19.572848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:19.573242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:19.600447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:01:19.712970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-868ed651-5c29-4ec7-9d99-d18b937f7127 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Calling method '.version_select at 0x7fabe52ca040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:19.745977 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e93fb1d2-00df-4aa2-8657-d4bcb726b55c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "DELETE /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 204 len: 0 microversion: 2.1 time: 0.199867 Jul 02 21:01:19.747862 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 99/189] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:01:19 2022] DELETE /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:01:19.760321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:19.761414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:19.776716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:19.778203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:19.779303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:19.779740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:19.946722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:19.959253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-57fe7493-6694-4a5d-afb8-f41e6d1a3427 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1492 microversion: 2.1 time: 0.205251 Jul 02 21:01:19.960245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 100/190] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:19 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1492 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:20.154294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=67,nova_cell0:UPDATE=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.190257 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-868ed651-5c29-4ec7-9d99-d18b937f7127 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 371 microversion: 2.1 time: 0.651997 Jul 02 21:01:20.193053 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 91/191] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:01:19 2022] GET /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 371 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:20.204640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1653cf8a-ec41-4ec6-a0bc-7d29dc97f233 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Action: 'update', calling method: .version_select at 0x7fabe54d3940>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:20.552479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1653cf8a-ec41-4ec6-a0bc-7d29dc97f233 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:20.553236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1653cf8a-ec41-4ec6-a0bc-7d29dc97f233 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:20.555437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1653cf8a-ec41-4ec6-a0bc-7d29dc97f233 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:20.556157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1653cf8a-ec41-4ec6-a0bc-7d29dc97f233 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:20.566221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.680993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=15 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:20.717656 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1653cf8a-ec41-4ec6-a0bc-7d29dc97f233 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 328 microversion: 2.1 time: 0.517380 Jul 02 21:01:20.719622 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 101/192] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:20 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 328 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:20.979139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:20.980185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:21.000296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:21.001108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:21.002354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:21.002790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:21.066503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1132586248", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:21.176689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:21.566169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:21.577198 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-28834b6f-1d7b-44f5-8f1a-b59a6a98d51a tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1492 microversion: 2.1 time: 0.603772 Jul 02 21:01:21.578431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 102/193] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:20 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1492 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:21.774990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:21.776757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:21.777681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:21.778540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:21.779311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:21.793562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:21.794266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:21.795272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:21.795897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:21.806217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=61 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:21.821190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Getting quotas for project 2f742f03e6c14260b98b00f5c13438f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:21.826980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Getting quotas for user 4ce2e8e17cd74914b0c5391443f6d3ec and project 2f742f03e6c14260b98b00f5c13438f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:21.841898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.utils [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] cores quota exceeded for 2f742f03e6c14260b98b00f5c13438f0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 02 21:01:21.843400 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Request method failure captured: Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 145 Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIdKV_dCWetReXOpBUQpaUGYF3isiXbF8_PcNRczkEqJ4F-uvQnMy6Af4teclST8tNhSSqfJ7zBCe-OWm8tw4xrmiOvo1qH6wdlal1Tmj2dX19vukyWmVkZfdiT0XPNchWF5qItg6tpKTD50_gkDwQs1DhFRsvDNvs4oPkjQkxY0VU Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:21.847749 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f742f03e6c14260b98b00f5c13438f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f742f03e6c14260b98b00f5c13438f0"}]}] Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4ce2e8e17cd74914b0c5391443f6d3ec Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1132586248", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} Jul 02 21:01:21.849019 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1132586248', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452'}}} Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 02 21:01:21.849712 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:21.850701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.851790 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:21.854830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:21.854830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:21.854830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:21.854830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:21.854830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 02 21:01:21.854830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:21.856871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:21.857941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75ed034c-2d0f-46d3-a6ce-1f09ff1fd1e4 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.999106 Jul 02 21:01:21.862636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 92/194] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:20 2022] POST /compute/v2.1/servers => generated 111 bytes in 1004 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:21.876024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9bb7b8a-5e7f-455e-aa1d-e9746bbaf0d7 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Action: 'update', calling method: .version_select at 0x7fabe5507790>, body: {"quota_set": {"cores": 20}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:22.254450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9bb7b8a-5e7f-455e-aa1d-e9746bbaf0d7 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:22.255058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9bb7b8a-5e7f-455e-aa1d-e9746bbaf0d7 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:22.255838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9bb7b8a-5e7f-455e-aa1d-e9746bbaf0d7 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:22.256542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9bb7b8a-5e7f-455e-aa1d-e9746bbaf0d7 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:22.402789 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9bb7b8a-5e7f-455e-aa1d-e9746bbaf0d7 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 329 microversion: 2.1 time: 0.539198 Jul 02 21:01:22.411604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 103/195] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:21 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 329 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:22.430651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de028d29-a282-402f-bdcb-842865c957b9 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Calling method '.version_select at 0x7fabe5259700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:22.483626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d9d9a53d-0619-4aec-baf2-f04364e47353 req-7c10ea9c-0b6f-4791-a77d-0645c57e6738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3342e-3072-4091-856d-3d791e0a46b3", "name": "network-vif-deleted", "tag": "677e71c2-e786-4fb8-9f12-8357194bf8cd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:22.502615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9d9a53d-0619-4aec-baf2-f04364e47353 req-7c10ea9c-0b6f-4791-a77d-0645c57e6738 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:22.503420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9d9a53d-0619-4aec-baf2-f04364e47353 req-7c10ea9c-0b6f-4791-a77d-0645c57e6738 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:22.532825 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d9d9a53d-0619-4aec-baf2-f04364e47353 req-7c10ea9c-0b6f-4791-a77d-0645c57e6738 service nova] Creating event network-vif-deleted:677e71c2-e786-4fb8-9f12-8357194bf8cd for instance 15f3342e-3072-4091-856d-3d791e0a46b3 on nch2-master-1 Jul 02 21:01:22.545383 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d9d9a53d-0619-4aec-baf2-f04364e47353 req-7c10ea9c-0b6f-4791-a77d-0645c57e6738 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065436 Jul 02 21:01:22.548170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 104/196] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:22.606927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:22.609924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:22.621684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:22.623639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:22.625044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:22.625717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:22.754913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b62db007a28947abbb19e137f52472a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347aae622773490aa3e8f0716b37d77e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:22.766334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a061ed05-645c-48f1-97d4-997d5162ba3c tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 200 len: 1322 microversion: 2.1 time: 0.173851 Jul 02 21:01:22.782526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 105/197] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:22 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:23.114824 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de028d29-a282-402f-bdcb-842865c957b9 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 371 microversion: 2.1 time: 0.693162 Jul 02 21:01:23.118744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 93/198] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:01:22 2022] GET /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 371 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:23.129185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24a99681-f07f-4422-a81a-ab56fd999dc8 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Action: 'update', calling method: .version_select at 0x7fabe55a6160>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:23.396966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24a99681-f07f-4422-a81a-ab56fd999dc8 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:23.398115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24a99681-f07f-4422-a81a-ab56fd999dc8 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:23.400873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24a99681-f07f-4422-a81a-ab56fd999dc8 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:23.403208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24a99681-f07f-4422-a81a-ab56fd999dc8 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:23.501889 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-24a99681-f07f-4422-a81a-ab56fd999dc8 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 328 microversion: 2.1 time: 0.377274 Jul 02 21:01:23.506767 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 106/199] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:23 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 328 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:23.773359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2058481", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:23.787372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:23.787957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:23.806239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:23.806762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:23.807600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:23.829675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:23.885536 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] HTTP exception thrown: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:23.888256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Request method failure captured: Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 HTTP/1.1 Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH_ujiS83foIX_caQgfHjYpjfEumgvFTfJHx3qQTUtJoJZROn8IoP6f-yZayJiCuahMYHdnrbni1NFNaoaByfXkrkTElGxFry6_umkstBeMEJqAc-qYlbRwfGL0Je-s9gIu0expD276q5VvIho9UIRnwMIMonYnR6_hh6ku-AKE2k8 Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 347aae622773490aa3e8f0716b37d77e Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:23.901772 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/347aae622773490aa3e8f0716b37d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_347aae622773490aa3e8f0716b37d77e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/347aae622773490aa3e8f0716b37d77e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/347aae622773490aa3e8f0716b37d77e"}]}] Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 347aae622773490aa3e8f0716b37d77e Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminTestJSON-1938743631-project Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b62db007a28947abbb19e137f52472a0 Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminTestJSON-1938743631-project Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:23.903026 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '15f3342e-3072-4091-856d-3d791e0a46b3'} Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:23.903706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:23.904913 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:23.908892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Returning 404 to user: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:23.912536 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-245a1bcf-5c02-48e6-97bf-4da0305ca9bb tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 404 len: 111 microversion: 2.1 time: 0.130953 Jul 02 21:01:23.921385 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 107/200] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:23 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:24.127534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-474a1e3a-2b33-4269-86a0-6a4d12b64aab tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:24.147012 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-474a1e3a-2b33-4269-86a0-6a4d12b64aab tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.219915 Jul 02 21:01:24.156592 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 108/201] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:24.162816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d8451e4-5f44-487c-bda7-8c14b3c04281 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:24.164632 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:24.164632 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:24.185030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d8451e4-5f44-487c-bda7-8c14b3c04281 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:24.185747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d8451e4-5f44-487c-bda7-8c14b3c04281 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:24.455465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:24.457107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:24.459194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:24.460770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:24.462011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:24.483434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:24.484122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:24.484907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:24.488756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:24.516018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Getting quotas for project 2f742f03e6c14260b98b00f5c13438f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:24.522225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Getting quotas for user 4ce2e8e17cd74914b0c5391443f6d3ec and project 2f742f03e6c14260b98b00f5c13438f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:24.550882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.utils [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] instances quota exceeded for 2f742f03e6c14260b98b00f5c13438f0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131044) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 02 21:01:24.551501 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Request method failure captured: Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 142 Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIdKV_dCWetReXOpBUQpaUGYF3isiXbF8_PcNRczkEqJ4F-uvQnMy6Af4teclST8tNhSSqfJ7zBCe-OWm8tw4xrmiOvo1qH6wdlal1Tmj2dX19vukyWmVkZfdiT0XPNchWF5qItg6tpKTD50_gkDwQs1DhFRsvDNvs4oPkjQkxY0VU Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:24.563397 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f742f03e6c14260b98b00f5c13438f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f742f03e6c14260b98b00f5c13438f0"}]}] Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4ce2e8e17cd74914b0c5391443f6d3ec Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2058481", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} Jul 02 21:01:24.564679 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2058481', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452'}}} Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 02 21:01:24.565371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:24.566336 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.568647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f3cb22c-7efa-4a73-8505-f5d81208258a tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.796361 Jul 02 21:01:24.570558 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 94/202] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:23 2022] POST /compute/v2.1/servers => generated 119 bytes in 798 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:24.571767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb5bdf78-1765-4e53-9822-156a328672f8 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:24.610511 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb5bdf78-1765-4e53-9822-156a328672f8 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.040792 Jul 02 21:01:24.620317 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 95/203] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:01:24 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:24.630989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a240bed-65c1-4fce-8baa-9c2f565cd22f tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Action: 'update', calling method: .version_select at 0x7fabe52705e0>, body: {"quota_set": {"instances": 10}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:24.712899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d8451e4-5f44-487c-bda7-8c14b3c04281 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.1 time: 0.554665 Jul 02 21:01:24.713593 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 109/204] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:01:24 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:24.728302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64ea8466-1e11-4e86-9cfe-439890f9cbc8 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:24.749144 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64ea8466-1e11-4e86-9cfe-439890f9cbc8 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033440 Jul 02 21:01:24.749919 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 110/205] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:24.755033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f5209a0-6aa5-4bd5-94bb-29163193d351 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:24.756712 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:24.756712 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:24.798226 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f5209a0-6aa5-4bd5-94bb-29163193d351 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.046407 Jul 02 21:01:24.799399 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 111/206] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:24 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:24.811627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-161a727b-5512-4e07-a56c-5ccdb82d9948 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:24.824128 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-161a727b-5512-4e07-a56c-5ccdb82d9948 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022365 Jul 02 21:01:24.825269 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 112/207] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:24.831544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-74e5565e-5a8a-46fa-950d-57a26b7c4f2d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1349144425"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:24.833441 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:24.833441 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:24.834638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-74e5565e-5a8a-46fa-950d-57a26b7c4f2d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 5f6261d7-7731-4526-bf11-e7df6329c2fc for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:24.873929 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-74e5565e-5a8a-46fa-950d-57a26b7c4f2d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047391 Jul 02 21:01:24.875127 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 113/208] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:24.887151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07137559-4596-4342-ab1a-1acb14fa57e0 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:24.933898 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07137559-4596-4342-ab1a-1acb14fa57e0 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.056585 Jul 02 21:01:24.934501 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 114/209] 10.222.0.43 () {58 vars in 1164 bytes} [Sat Jul 2 21:01:24 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:24.946736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f63c2a31-89f2-4e4a-a02a-4588217bda08 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:24.950038 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:24.950038 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:24.976752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f63c2a31-89f2-4e4a-a02a-4588217bda08 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:24.981557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f63c2a31-89f2-4e4a-a02a-4588217bda08 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:25.042373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a240bed-65c1-4fce-8baa-9c2f565cd22f tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:25.045631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a240bed-65c1-4fce-8baa-9c2f565cd22f tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:25.049264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a240bed-65c1-4fce-8baa-9c2f565cd22f tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:25.049723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a240bed-65c1-4fce-8baa-9c2f565cd22f tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:25.250230 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f63c2a31-89f2-4e4a-a02a-4588217bda08 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.312541 Jul 02 21:01:25.250840 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 115/210] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:01:24 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.256861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c14979df-7d15-4a5a-bae8-d109dc7070c9 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.268747 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a240bed-65c1-4fce-8baa-9c2f565cd22f tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 329 microversion: 2.1 time: 0.643165 Jul 02 21:01:25.280001 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 96/211] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:24 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 329 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.290449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85fce3c7-e3cd-4903-a375-af25305e5a0d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.291871 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:25.291871 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:25.293278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c14979df-7d15-4a5a-bae8-d109dc7070c9 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040040 Jul 02 21:01:25.293867 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 116/212] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.310609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d930a991-f0e6-484d-884f-78b5278ec919 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Calling method '.version_select at 0x7fabe52ea040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.317743 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85fce3c7-e3cd-4903-a375-af25305e5a0d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.033839 Jul 02 21:01:25.321726 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 97/213] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.357119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cfa66fa-b732-4637-87d4-917fa42c6be9 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.454884 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2cfa66fa-b732-4637-87d4-917fa42c6be9 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.131860 Jul 02 21:01:25.464945 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 98/214] 10.222.0.43 () {58 vars in 1168 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:25.472272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c663f0db-4852-4710-861c-de29d8d740c8 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:25.473847 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:25.473847 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:25.492741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c663f0db-4852-4710-861c-de29d8d740c8 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:25.493543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c663f0db-4852-4710-861c-de29d8d740c8 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:25.697667 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c663f0db-4852-4710-861c-de29d8d740c8 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.231135 Jul 02 21:01:25.699722 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 99/215] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:01:25 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.715082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b1607bb-1dc1-4a1e-9110-453599a9ee81 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.752506 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b1607bb-1dc1-4a1e-9110-453599a9ee81 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.051578 Jul 02 21:01:25.755670 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 100/216] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.767909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-726ab4be-7969-4190-a017-b6f64ee42d94 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.770670 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:25.770670 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:25.794961 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d930a991-f0e6-484d-884f-78b5278ec919 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 371 microversion: 2.1 time: 0.494465 Jul 02 21:01:25.795559 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 117/217] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.806194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:25.811851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e40bf82-8480-4b7d-93ae-8eafb48503ed tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:25.825760 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-726ab4be-7969-4190-a017-b6f64ee42d94 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.064291 Jul 02 21:01:25.827782 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 101/218] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:25 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:25.835840 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e40bf82-8480-4b7d-93ae-8eafb48503ed tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035408 Jul 02 21:01:25.842221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7e45922-8186-43a6-8808-097ab564c7e0 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Action: 'update', calling method: .version_select at 0x7fabe5186d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:25.844440 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 118/219] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.852652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83e548fe-1908-4786-bd91-d7ab6f81a910 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-735695826"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:25.860315 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:25.860315 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:25.864022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-83e548fe-1908-4786-bd91-d7ab6f81a910 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 8984958a-d1f4-4097-aca2-faba1c26e701 for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:25.918974 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83e548fe-1908-4786-bd91-d7ab6f81a910 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.073121 Jul 02 21:01:25.920215 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 119/220] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:25 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:25.930687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-35f6a84d-e8bd-4b9b-be58-1bd482d9707b tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.022977 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-35f6a84d-e8bd-4b9b-be58-1bd482d9707b tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.097061 Jul 02 21:01:26.023589 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 120/221] 10.222.0.43 () {58 vars in 1166 bytes} [Sat Jul 2 21:01:25 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:26.056285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a1d9822-6375-4087-b3ab-e7fafc7638fb tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:26.060908 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:26.060908 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:26.074949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a1d9822-6375-4087-b3ab-e7fafc7638fb tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:26.075653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a1d9822-6375-4087-b3ab-e7fafc7638fb tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:26.365298 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a1d9822-6375-4087-b3ab-e7fafc7638fb tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.324738 Jul 02 21:01:26.366408 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 121/222] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:01:26 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.379136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b7bcc330-79ba-45f5-abf6-828e9c992494 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.407126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:26.410396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b7bcc330-79ba-45f5-abf6-828e9c992494 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042319 Jul 02 21:01:26.411773 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 122/223] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.420850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bee83cc0-684c-4d80-9420-e04f3776079d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.422030 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:26.422030 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:26.460882 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bee83cc0-684c-4d80-9420-e04f3776079d tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 244 microversion: 2.1 time: 0.042723 Jul 02 21:01:26.467992 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 123/224] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/os-aggregates => generated 244 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.475983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e45922-8186-43a6-8808-097ab564c7e0 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:26.487241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b2a01c6-8825-4467-8ea0-7da4a60f8632 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.487518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e45922-8186-43a6-8808-097ab564c7e0 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:26.495954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e45922-8186-43a6-8808-097ab564c7e0 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:26.497128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7e45922-8186-43a6-8808-097ab564c7e0 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:26.543718 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b2a01c6-8825-4467-8ea0-7da4a60f8632 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.079453 Jul 02 21:01:26.544619 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 124/225] 10.222.0.43 () {58 vars in 1143 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:26.561272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a96b6bc-3841-4c99-9b1f-1e60b3f24ddc tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:26.564904 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:26.564904 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:26.590655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a96b6bc-3841-4c99-9b1f-1e60b3f24ddc tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:26.599163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a96b6bc-3841-4c99-9b1f-1e60b3f24ddc tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:26.713510 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7e45922-8186-43a6-8808-097ab564c7e0 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 325 microversion: 2.1 time: 0.879518 Jul 02 21:01:26.724107 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 102/226] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:25 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 325 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.731332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c10e9703-3806-4d07-8732-d6ca69d95099 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.750728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c10e9703-3806-4d07-8732-d6ca69d95099 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029038 Jul 02 21:01:26.751526 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 103/227] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.817180 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a96b6bc-3841-4c99-9b1f-1e60b3f24ddc tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.268419 Jul 02 21:01:26.823153 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 125/228] 10.222.0.43 () {60 vars in 1190 bytes} [Sat Jul 2 21:01:26 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.825455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62eb496b-41a3-44b6-bc11-01da2b7514d4 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.877930 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-62eb496b-41a3-44b6-bc11-01da2b7514d4 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.055828 Jul 02 21:01:26.879308 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 126/229] 10.222.0.43 () {58 vars in 1147 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:26.886912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-240cefa5-5cf4-4d9e-a2b3-096cc73ba210 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.891346 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:26.891346 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:26.933999 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-240cefa5-5cf4-4d9e-a2b3-096cc73ba210 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.051266 Jul 02 21:01:26.939895 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 127/230] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:26 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:26.943787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc7b2351-e70f-4235-847f-4a5fca0f6b52 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:26.958807 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc7b2351-e70f-4235-847f-4a5fca0f6b52 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021034 Jul 02 21:01:26.960545 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 128/231] 10.222.0.43 () {58 vars in 1139 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:26.973104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1075740083", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.005329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa6d6144-5b28-4890-9f78-2664ca73cf45 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.006698 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.006698 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:27.007959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6d6144-5b28-4890-9f78-2664ca73cf45 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.008614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6d6144-5b28-4890-9f78-2664ca73cf45 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.009435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6d6144-5b28-4890-9f78-2664ca73cf45 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.009873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6d6144-5b28-4890-9f78-2664ca73cf45 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.058340 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa6d6144-5b28-4890-9f78-2664ca73cf45 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.305564 Jul 02 21:01:27.064908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:27.065873 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 104/232] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:26 2022] GET /compute/v2.1/os-services => generated 947 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.070832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84c50d16-fd7b-48e6-9607-480569717e13 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1922875575"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.073058 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.073058 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:27.074058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-84c50d16-fd7b-48e6-9607-480569717e13 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 460d67fe-6af7-4af2-ae62-8f5102896428 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:27.138649 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84c50d16-fd7b-48e6-9607-480569717e13 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.071483 Jul 02 21:01:27.146735 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 105/233] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.154333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d70e49b6-ad67-486c-81e3-29693ebc39ab tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.172309 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d70e49b6-ad67-486c-81e3-29693ebc39ab tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027783 Jul 02 21:01:27.181281 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 106/234] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.190557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efa3dadd-a804-45df-9205-37086944db2b tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.197044 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.197044 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:27.202235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efa3dadd-a804-45df-9205-37086944db2b tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.203220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efa3dadd-a804-45df-9205-37086944db2b tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.204765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efa3dadd-a804-45df-9205-37086944db2b tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.206525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efa3dadd-a804-45df-9205-37086944db2b tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.251164 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-efa3dadd-a804-45df-9205-37086944db2b tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.068495 Jul 02 21:01:27.251899 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 107/235] 10.222.0.43 () {58 vars in 1173 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.264230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30fad3ec-6a0c-4978-b1d4-d96b956aac25 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.265473 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.265473 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:27.274358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30fad3ec-6a0c-4978-b1d4-d96b956aac25 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.274906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30fad3ec-6a0c-4978-b1d4-d96b956aac25 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.355285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:27.355732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:27.356223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:27.356632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:27.357040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:27.368295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.368743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.370019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.370620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.392899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Getting quotas for project 2f742f03e6c14260b98b00f5c13438f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:27.401073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Getting quotas for user 4ce2e8e17cd74914b0c5391443f6d3ec and project 2f742f03e6c14260b98b00f5c13438f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:27.417751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.utils [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] ram quota exceeded for 2f742f03e6c14260b98b00f5c13438f0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131045) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 02 21:01:27.418811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Request method failure captured: Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 145 Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIdKV_dCWetReXOpBUQpaUGYF3isiXbF8_PcNRczkEqJ4F-uvQnMy6Af4teclST8tNhSSqfJ7zBCe-OWm8tw4xrmiOvo1qH6wdlal1Tmj2dX19vukyWmVkZfdiT0XPNchWF5qItg6tpKTD50_gkDwQs1DhFRsvDNvs4oPkjQkxY0VU Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:27.423299 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f742f03e6c14260b98b00f5c13438f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f742f03e6c14260b98b00f5c13438f0"}]}] Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4ce2e8e17cd74914b0c5391443f6d3ec Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1075740083", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} Jul 02 21:01:27.424738 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1075740083', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452'}}} Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 02 21:01:27.425522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:27.426675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.428072 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:27.429576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:27.429576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:27.429576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:27.429576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:27.429576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 02 21:01:27.429576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.431826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:27.433082 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e5a65aa-ebf6-428a-86e9-0b3ced7b09ef tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.464766 Jul 02 21:01:27.436235 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 129/236] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 475 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:27.448114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e09a2eb-afb2-4a53-9188-3ef68d27e6d9 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.491064 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e09a2eb-afb2-4a53-9188-3ef68d27e6d9 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.051578 Jul 02 21:01:27.493334 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30fad3ec-6a0c-4978-b1d4-d96b956aac25 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.232442 Jul 02 21:01:27.493817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 130/237] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:27.494539 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 108/238] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:27 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.499147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10c3c58c-304b-4539-9fe3-a0f7e3693096 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Action: 'update', calling method: .version_select at 0x7fabe52ca1f0>, body: {"quota_set": {"ram": 51200}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.505473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4406fc20-7798-47bb-b340-01e1a7913c3e tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.507014 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.507014 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:27.514126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4406fc20-7798-47bb-b340-01e1a7913c3e tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.515036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4406fc20-7798-47bb-b340-01e1a7913c3e tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.515656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4406fc20-7798-47bb-b340-01e1a7913c3e tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.517686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4406fc20-7798-47bb-b340-01e1a7913c3e tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.556026 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4406fc20-7798-47bb-b340-01e1a7913c3e tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.061392 Jul 02 21:01:27.557613 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 131/239] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.562531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc4c3af8-97b3-415c-bc01-387651308be3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.564504 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.564504 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:27.575810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc4c3af8-97b3-415c-bc01-387651308be3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.576484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc4c3af8-97b3-415c-bc01-387651308be3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.631280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c3c58c-304b-4539-9fe3-a0f7e3693096 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.631641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c3c58c-304b-4539-9fe3-a0f7e3693096 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.632472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c3c58c-304b-4539-9fe3-a0f7e3693096 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.632906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c3c58c-304b-4539-9fe3-a0f7e3693096 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.753382 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10c3c58c-304b-4539-9fe3-a0f7e3693096 tempest-QuotasAdminNegativeTest-663996727 tempest-QuotasAdminNegativeTest-663996727-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 200 len: 329 microversion: 2.1 time: 0.257557 Jul 02 21:01:27.754295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 109/240] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:27 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 329 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.761335 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc4c3af8-97b3-415c-bc01-387651308be3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.202285 Jul 02 21:01:27.763129 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 132/241] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:27 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.773472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e40f5a3-e234-474e-993f-87896e3d8100 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.775669 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.775669 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:27.777388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e40f5a3-e234-474e-993f-87896e3d8100 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.777987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e40f5a3-e234-474e-993f-87896e3d8100 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.780247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e40f5a3-e234-474e-993f-87896e3d8100 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.780646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be704867-0b6d-496a-8dfe-059935d1a8ee tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.780834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e40f5a3-e234-474e-993f-87896e3d8100 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.830162 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be704867-0b6d-496a-8dfe-059935d1a8ee tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065635 Jul 02 21:01:27.839550 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 110/242] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:27.839721 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e40f5a3-e234-474e-993f-87896e3d8100 tempest-ServicesAdminTestJSON-2033941799 tempest-ServicesAdminTestJSON-2033941799-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.066583 Jul 02 21:01:27.839721 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 133/243] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/os-services => generated 947 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.839721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db4c110b-75f5-491b-b17e-b17cba13f9ed tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.839721 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.839721 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:27.845303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1857015a-5626-4939-b118-6827827fd7f7 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Action: 'update', calling method: .version_select at 0x7fabe5186dc0>, body: {"quota_set": {"ram": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.847699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1857015a-5626-4939-b118-6827827fd7f7 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '4ce2e8e17cd74914b0c5391443f6d3ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f742f03e6c14260b98b00f5c13438f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1857015a-5626-4939-b118-6827827fd7f7 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Request method failure captured: Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 HTTP/1.1 Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 25 Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIdKV_dCWetReXOpBUQpaUGYF3isiXbF8_PcNRczkEqJ4F-uvQnMy6Af4teclST8tNhSSqfJ7zBCe-OWm8tw4xrmiOvo1qH6wdlal1Tmj2dX19vukyWmVkZfdiT0XPNchWF5qItg6tpKTD50_gkDwQs1DhFRsvDNvs4oPkjQkxY0VU Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:27.849724 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2f742f03e6c14260b98b00f5c13438f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2f742f03e6c14260b98b00f5c13438f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2f742f03e6c14260b98b00f5c13438f0"}]}] Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 2f742f03e6c14260b98b00f5c13438f0 Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-842004026 Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4ce2e8e17cd74914b0c5391443f6d3ec Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-QuotasAdminNegativeTest-842004026-project Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: {"quota_set": {"ram": 0}} Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 02 21:01:27.850990 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2f742f03e6c14260b98b00f5c13438f0', 'body': {'quota_set': {'ram': 0}}} Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:27.851830 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.853007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1857015a-5626-4939-b118-6827827fd7f7 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:27.854094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1857015a-5626-4939-b118-6827827fd7f7 tempest-QuotasAdminNegativeTest-842004026 tempest-QuotasAdminNegativeTest-842004026-project] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0" status: 403 len: 116 microversion: 2.1 time: 0.019002 Jul 02 21:01:27.857694 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 111/244] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:27 2022] PUT /compute/v2.1/os-quota-sets/2f742f03e6c14260b98b00f5c13438f0 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:27.863594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0121f6d-3301-4ec6-ba92-edcf22def925 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.875342 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0121f6d-3301-4ec6-ba92-edcf22def925 tempest-FlavorsV2TestJSON-1405267369 tempest-FlavorsV2TestJSON-1405267369-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016481 Jul 02 21:01:27.882332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 112/245] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.882507 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db4c110b-75f5-491b-b17e-b17cba13f9ed tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.045128 Jul 02 21:01:27.882507 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 134/246] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:27 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:27.892141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b84e838-c533-4576-9232-f82f2327ffee tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-29682639"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:27.893609 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.893609 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:27.894540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-7b84e838-c533-4576-9232-f82f2327ffee tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid b8bafac3-95b7-4619-a5c0-3b779f08f0a4 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:27.903166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c1bd2a2-6137-4b69-b18b-e81593ceaffa tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe51f8940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.904411 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.904411 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:27.907301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c1bd2a2-6137-4b69-b18b-e81593ceaffa tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.907640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c1bd2a2-6137-4b69-b18b-e81593ceaffa tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.908499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c1bd2a2-6137-4b69-b18b-e81593ceaffa tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:27.908924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c1bd2a2-6137-4b69-b18b-e81593ceaffa tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:27.940581 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b84e838-c533-4576-9232-f82f2327ffee tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.053023 Jul 02 21:01:27.946849 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 113/247] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.959614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6de88bd-564a-4e93-afbc-2ec5ced2ba6e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:27.960922 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:27.960922 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:27.985218 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c1bd2a2-6137-4b69-b18b-e81593ceaffa tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.088141 Jul 02 21:01:27.986844 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 135/248] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:27.994159 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6de88bd-564a-4e93-afbc-2ec5ced2ba6e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.046015 Jul 02 21:01:27.996116 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 114/249] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:27 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:28.000193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daf045d5-247d-469f-b144-6849493045c0 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe531d280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.001617 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.001617 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.004488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daf045d5-247d-469f-b144-6849493045c0 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.005185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daf045d5-247d-469f-b144-6849493045c0 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.006108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25c1c8e8-2b92-4a1a-aea3-1e1dfd7843f3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.006459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daf045d5-247d-469f-b144-6849493045c0 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.006916 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.006916 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.007427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daf045d5-247d-469f-b144-6849493045c0 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.026671 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-25c1c8e8-2b92-4a1a-aea3-1e1dfd7843f3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25c1c8e8-2b92-4a1a-aea3-1e1dfd7843f3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Request method failure captured: Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB1BgvygRRWmy2-dPilYfvKkgLwBXNany7-M6in1HMrX0wG-uuCGYvVhupQfyB7l1t8W51KGXpqGSUyvVuC0hIODeNAkO-NqDejInoLloYkCfym5KDixQ01s8Yd2FN6x8rGHm07o3el76G-BRthkgI_baq64Iyo_-O9mjMasV2zks Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:28.031122 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a51f57a3bff440d3995b73b10d26ba63", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a51f57a3bff440d3995b73b10d26ba63"}]}] Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 387ec92e4d4f4d909cd222a3d7070d0a Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: exception: Aggregate 11 could not be found. Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '11'} Jul 02 21:01:28.032429 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.033260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Jul 02 21:01:28.034313 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.035269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25c1c8e8-2b92-4a1a-aea3-1e1dfd7843f3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:28.035269 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25c1c8e8-2b92-4a1a-aea3-1e1dfd7843f3 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.035428 Jul 02 21:01:28.043254 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 115/250] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:01:28.050691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bcb997a-314a-4744-a664-d2e0401f3775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.051783 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-daf045d5-247d-469f-b144-6849493045c0 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.049525 Jul 02 21:01:28.059240 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 136/251] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:27 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.065199 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.065199 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.065567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d67882c3-51e9-4480-a8ca-844f7ae5994e tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe51f8b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.066785 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.066785 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.067955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67882c3-51e9-4480-a8ca-844f7ae5994e tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.068424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67882c3-51e9-4480-a8ca-844f7ae5994e tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.070478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67882c3-51e9-4480-a8ca-844f7ae5994e tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.071789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67882c3-51e9-4480-a8ca-844f7ae5994e tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.083731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4bcb997a-314a-4744-a664-d2e0401f3775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bcb997a-314a-4744-a664-d2e0401f3775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Request method failure captured: Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB1BgvygRRWmy2-dPilYfvKkgLwBXNany7-M6in1HMrX0wG-uuCGYvVhupQfyB7l1t8W51KGXpqGSUyvVuC0hIODeNAkO-NqDejInoLloYkCfym5KDixQ01s8Yd2FN6x8rGHm07o3el76G-BRthkgI_baq64Iyo_-O9mjMasV2zks Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:28.088580 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a51f57a3bff440d3995b73b10d26ba63", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a51f57a3bff440d3995b73b10d26ba63"}]}] Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 387ec92e4d4f4d909cd222a3d7070d0a Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: exception: Aggregate 11 could not be found. Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '11'} Jul 02 21:01:28.089822 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:28.090544 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.091606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.092775 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.092775 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:28.092775 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:28.092775 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Jul 02 21:01:28.092775 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.094898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bcb997a-314a-4744-a664-d2e0401f3775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:28.099422 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4bcb997a-314a-4744-a664-d2e0401f3775 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.054629 Jul 02 21:01:28.102324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 116/252] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:28 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:01:28.109444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60e1e0f4-38be-48dd-a588-4c711e7d72dd tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1727820293"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.111478 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.111478 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.112692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-60e1e0f4-38be-48dd-a588-4c711e7d72dd tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Generated uuid fe77a65e-cc9e-43ee-9725-352b2850acab for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:28.129501 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d67882c3-51e9-4480-a8ca-844f7ae5994e tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.068707 Jul 02 21:01:28.137171 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 137/253] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.139718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-412ded30-fa31-4af1-93a7-783cbb597e64 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-72016081", "name": "tempest-test_aggregate-315666053"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.151314 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60e1e0f4-38be-48dd-a588-4c711e7d72dd tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.047538 Jul 02 21:01:28.153823 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 117/254] 10.222.0.43 () {62 vars in 1204 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:28.159628 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.159628 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.160498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548d8803-83f2-4fc0-9a20-e19be31afc92 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe5186d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.160896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-412ded30-fa31-4af1-93a7-783cbb597e64 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 9d1d0387-12fa-4b69-ae64-6ac7ff704c2e for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:28.168592 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.168592 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.179347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548d8803-83f2-4fc0-9a20-e19be31afc92 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.180185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548d8803-83f2-4fc0-9a20-e19be31afc92 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.209340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548d8803-83f2-4fc0-9a20-e19be31afc92 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.210083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548d8803-83f2-4fc0-9a20-e19be31afc92 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.210771 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-412ded30-fa31-4af1-93a7-783cbb597e64 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.076395 Jul 02 21:01:28.211521 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 138/255] 10.222.0.43 () {60 vars in 1164 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.217072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-751cf10e-434e-4b30-93f3-8b9e83622eec tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-91415966"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.267591 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-548d8803-83f2-4fc0-9a20-e19be31afc92 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 332 microversion: 2.1 time: 0.112244 Jul 02 21:01:28.273208 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 118/256] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.282042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef60a356-88b3-4a21-9dd1-d5e323296d71 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.286435 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.286435 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.313939 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.313939 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.336573 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef60a356-88b3-4a21-9dd1-d5e323296d71 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.061803 Jul 02 21:01:28.337628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 119/257] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:28 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:28.353627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0460a727-dd96-47a9-9747-a64bae5191a6 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Calling method '.version_select at 0x7fabe51869d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.358502 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.358502 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.367199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0460a727-dd96-47a9-9747-a64bae5191a6 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.372453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0460a727-dd96-47a9-9747-a64bae5191a6 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.397450 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-751cf10e-434e-4b30-93f3-8b9e83622eec tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 298 microversion: 2.41 time: 0.184323 Jul 02 21:01:28.399430 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 139/258] 10.222.0.43 () {62 vars in 1212 bytes} [Sat Jul 2 21:01:28 2022] PUT /compute/v2.1/os-aggregates/12 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:28.408916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0460a727-dd96-47a9-9747-a64bae5191a6 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.408916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0460a727-dd96-47a9-9747-a64bae5191a6 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.417978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf61d139-d623-4acb-8d6f-326006a9ffb9 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.421230 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.421230 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.434590 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-bf61d139-d623-4acb-8d6f-326006a9ffb9 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 02 21:01:28.439002 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0460a727-dd96-47a9-9747-a64bae5191a6 tempest-HostsAdminTestJSON-303870477 tempest-HostsAdminTestJSON-303870477-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 332 microversion: 2.1 time: 0.100172 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf61d139-d623-4acb-8d6f-326006a9ffb9 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Request method failure captured: Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIB1BgvygRRWmy2-dPilYfvKkgLwBXNany7-M6in1HMrX0wG-uuCGYvVhupQfyB7l1t8W51KGXpqGSUyvVuC0hIODeNAkO-NqDejInoLloYkCfym5KDixQ01s8Yd2FN6x8rGHm07o3el76G-BRthkgI_baq64Iyo_-O9mjMasV2zks Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:01:28.444433 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a51f57a3bff440d3995b73b10d26ba63", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a51f57a3bff440d3995b73b10d26ba63"}]}] Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 387ec92e4d4f4d909cd222a3d7070d0a Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: exception: Aggregate 13 could not be found. Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '13'} Jul 02 21:01:28.445876 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.446628 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 02 21:01:28.447841 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.449246 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 120/259] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.449322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf61d139-d623-4acb-8d6f-326006a9ffb9 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:28.449322 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf61d139-d623-4acb-8d6f-326006a9ffb9 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.043574 Jul 02 21:01:28.449322 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 140/260] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:01:28.456362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33bde6be-32cc-43fb-a3e9-4e5265ad09de tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.457117 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.457117 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.462924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-710237b6-d4e7-42f5-b523-8d3f355f4ad4 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.467987 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.467987 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.489514 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-710237b6-d4e7-42f5-b523-8d3f355f4ad4 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 298 microversion: 2.41 time: 0.030324 Jul 02 21:01:28.493364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 121/261] 10.222.0.43 () {60 vars in 1192 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-aggregates/12 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:28.504287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-33bde6be-32cc-43fb-a3e9-4e5265ad09de tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33bde6be-32cc-43fb-a3e9-4e5265ad09de tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Request method failure captured: Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIB1BgvygRRWmy2-dPilYfvKkgLwBXNany7-M6in1HMrX0wG-uuCGYvVhupQfyB7l1t8W51KGXpqGSUyvVuC0hIODeNAkO-NqDejInoLloYkCfym5KDixQ01s8Yd2FN6x8rGHm07o3el76G-BRthkgI_baq64Iyo_-O9mjMasV2zks Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:01:28.506179 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a51f57a3bff440d3995b73b10d26ba63", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a51f57a3bff440d3995b73b10d26ba63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a51f57a3bff440d3995b73b10d26ba63"}]}] Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a51f57a3bff440d3995b73b10d26ba63 Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-505074922 Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 387ec92e4d4f4d909cd222a3d7070d0a Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminTestJSON-505074922-project-admin Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: exception: Aggregate 13 could not be found. Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '13'} Jul 02 21:01:28.507644 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:28.508516 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:28.509591 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33bde6be-32cc-43fb-a3e9-4e5265ad09de tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:28.510737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33bde6be-32cc-43fb-a3e9-4e5265ad09de tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.055020 Jul 02 21:01:28.512379 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 141/262] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:28 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:01:28.512685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc9a6697-0877-4819-97eb-842eb88d8d85 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.515141 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.515141 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.523526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c93ce268-04c8-4f5f-bf63-2266fdc1b629 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1447687198"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.531729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc9a6697-0877-4819-97eb-842eb88d8d85 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.532670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc9a6697-0877-4819-97eb-842eb88d8d85 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.533150 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.533150 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.534344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-c93ce268-04c8-4f5f-bf63-2266fdc1b629 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 9c3d4955-9430-46c2-b1ef-f562f9a3e820 for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:28.570521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:28.572959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c93ce268-04c8-4f5f-bf63-2266fdc1b629 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.059332 Jul 02 21:01:28.578541 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 142/263] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.589118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38711562-c7aa-43da-95d4-aaef45485b96 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.592478 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.592478 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.621839 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38711562-c7aa-43da-95d4-aaef45485b96 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.036704 Jul 02 21:01:28.630299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 143/264] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:28.639473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79c5afcf-f037-47dd-be60-e08550f9538e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.645808 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.645808 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.692755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79c5afcf-f037-47dd-be60-e08550f9538e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.056739 Jul 02 21:01:28.693988 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 144/265] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.709476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b113a5a-f3a7-43f6-a559-f81fac2a7dbf tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.713070 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.713070 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.730395 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b113a5a-f3a7-43f6-a559-f81fac2a7dbf tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.030008 Jul 02 21:01:28.737674 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 145/266] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:28 2022] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.742968 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc9a6697-0877-4819-97eb-842eb88d8d85 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 313 microversion: 2.41 time: 0.240409 Jul 02 21:01:28.744168 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 122/267] 10.222.0.43 () {62 vars in 1234 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates/12/action => generated 313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:28.753727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb66c913-2176-4e55-ad75-7d64a1958f43 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:28.756234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0edf4f96-db90-48ac-b294-d76887c83e00 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.757456 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.757456 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.757843 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.757843 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:28.763825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:28.807458 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb66c913-2176-4e55-ad75-7d64a1958f43 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.066262 Jul 02 21:01:28.808737 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 146/268] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:28 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:28.812283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0edf4f96-db90-48ac-b294-d76887c83e00 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.813136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0edf4f96-db90-48ac-b294-d76887c83e00 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:28.819838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93b16a69-0e4b-405a-9c9f-f65a03b529aa tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-312595428", "availability_zone": "tempest-test_az-1171693171"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.826154 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.826154 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.828358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-93b16a69-0e4b-405a-9c9f-f65a03b529aa tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 3b403b00-bf56-4f47-af89-1be30267e119 for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:28.900738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93b16a69-0e4b-405a-9c9f-f65a03b529aa tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.086332 Jul 02 21:01:28.902405 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 147/269] 10.222.0.43 () {60 vars in 1164 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:28.914862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1020fe9-27e9-4696-9934-668d5f31657f tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-312595428_new", "availability_zone": "tempest-test_az-1171693171_new"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:28.916593 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:28.916593 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:28.978034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1020fe9-27e9-4696-9934-668d5f31657f tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:28.978495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1020fe9-27e9-4696-9934-668d5f31657f tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.029206 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1020fe9-27e9-4696-9934-668d5f31657f tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/15" status: 200 len: 336 microversion: 2.1 time: 0.119938 Jul 02 21:01:29.030174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 148/270] 10.222.0.43 () {60 vars in 1172 bytes} [Sat Jul 2 21:01:28 2022] PUT /compute/v2.1/os-aggregates/15 => generated 336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:29.039881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ec38eb40-d025-4b0d-af6c-6f3a81b36a5b tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.040682 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.040682 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:29.050270 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ec38eb40-d025-4b0d-af6c-6f3a81b36a5b tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 591 microversion: 2.1 time: 0.014109 Jul 02 21:01:29.051241 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 149/271] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:01:29 2022] GET /compute/v2.1/os-aggregates => generated 591 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.062735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d25b5ce8-96d6-4a73-a9f3-a5be43b0710e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.064149 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.064149 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:29.089064 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0edf4f96-db90-48ac-b294-d76887c83e00 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 298 microversion: 2.41 time: 0.337634 Jul 02 21:01:29.091818 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 123/272] 10.222.0.43 () {62 vars in 1234 bytes} [Sat Jul 2 21:01:28 2022] POST /compute/v2.1/os-aggregates/12/action => generated 298 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:29.100898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c08b160-dfcc-4df2-a736-9f199e49b7e5 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.101685 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.101685 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.110522 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d25b5ce8-96d6-4a73-a9f3-a5be43b0710e tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.051970 Jul 02 21:01:29.112553 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 150/273] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:29.127016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5615c426-aebd-4c31-b143-8cb498b658c2 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-490949801"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:29.128492 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.128492 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:29.132103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-5615c426-aebd-4c31-b143-8cb498b658c2 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Generated uuid 20022f70-6ffc-4c06-8d64-b0467703681e for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:29.158713 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c08b160-dfcc-4df2-a736-9f199e49b7e5 tempest-AggregatesAdminTestV241-514240350 tempest-AggregatesAdminTestV241-514240350-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.061339 Jul 02 21:01:29.159640 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 124/274] 10.222.0.43 () {60 vars in 1195 bytes} [Sat Jul 2 21:01:29 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.181248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5615c426-aebd-4c31-b143-8cb498b658c2 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064110 Jul 02 21:01:29.182692 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 151/275] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.193858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97d0a596-9e0a-40d4-9952-5c3066bdaf64 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.194734 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.194734 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.208839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97d0a596-9e0a-40d4-9952-5c3066bdaf64 tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.018980 Jul 02 21:01:29.210172 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 125/276] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:01:29 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.220962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca24c899-4ccc-474b-9075-d8862a58301f tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.221708 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.221708 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:29.263692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11cc86ef-b6e2-4f02-8cda-12e4acb01b5c tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-52061139"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:29.274610 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca24c899-4ccc-474b-9075-d8862a58301f tempest-AggregatesAdminTestJSON-505074922 tempest-AggregatesAdminTestJSON-505074922-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.057405 Jul 02 21:01:29.276206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 152/277] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:29 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:29.276358 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.276358 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.277675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-11cc86ef-b6e2-4f02-8cda-12e4acb01b5c tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid 525c342a-53f4-4d54-b24e-a33cc5ed25dc for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:29.293795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.294458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:29.324700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:29.325157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.331795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:29.335939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.347291 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11cc86ef-b6e2-4f02-8cda-12e4acb01b5c tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.087655 Jul 02 21:01:29.349473 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 126/278] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.368468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ab1e7c7-b2e2-49a3-9da5-5dad736d9033 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:29.370281 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.370281 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.393273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab1e7c7-b2e2-49a3-9da5-5dad736d9033 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:29.393727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ab1e7c7-b2e2-49a3-9da5-5dad736d9033 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.396214 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] HTTP exception thrown: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Request method failure captured: Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 HTTP/1.1 Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH_ujiS83foIX_caQgfHjYpjfEumgvFTfJHx3qQTUtJoJZROn8IoP6f-yZayJiCuahMYHdnrbni1NFNaoaByfXkrkTElGxFry6_umkstBeMEJqAc-qYlbRwfGL0Je-s9gIu0expD276q5VvIho9UIRnwMIMonYnR6_hh6ku-AKE2k8 Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 347aae622773490aa3e8f0716b37d77e Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:29.408003 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/347aae622773490aa3e8f0716b37d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_347aae622773490aa3e8f0716b37d77e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/347aae622773490aa3e8f0716b37d77e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/347aae622773490aa3e8f0716b37d77e"}]}] Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 347aae622773490aa3e8f0716b37d77e Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminTestJSON-1938743631-project Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b62db007a28947abbb19e137f52472a0 Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminTestJSON-1938743631-project Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.409540 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '15f3342e-3072-4091-856d-3d791e0a46b3'} Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:29.410230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.411476 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.412579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Returning 404 to user: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:29.413221 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-91b81edf-393c-44a7-8acb-ae81c9d39f7f tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "DELETE /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 404 len: 111 microversion: 2.1 time: 0.131293 Jul 02 21:01:29.413802 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 153/279] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:01:29 2022] DELETE /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:29.429509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.430247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] [instance: 15f3342e-3072-4091-856d-3d791e0a46b3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:29.450997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:29.451761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.453687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:29.455901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.508348 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] HTTP exception thrown: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Request method failure captured: Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 HTTP/1.1 Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH_ujiS83foIX_caQgfHjYpjfEumgvFTfJHx3qQTUtJoJZROn8IoP6f-yZayJiCuahMYHdnrbni1NFNaoaByfXkrkTElGxFry6_umkstBeMEJqAc-qYlbRwfGL0Je-s9gIu0expD276q5VvIho9UIRnwMIMonYnR6_hh6ku-AKE2k8 Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 347aae622773490aa3e8f0716b37d77e Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:29.509898 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/347aae622773490aa3e8f0716b37d77e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_347aae622773490aa3e8f0716b37d77e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/347aae622773490aa3e8f0716b37d77e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/347aae622773490aa3e8f0716b37d77e"}]}] Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 347aae622773490aa3e8f0716b37d77e Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1938743631 Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminTestJSON-1938743631-project Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b62db007a28947abbb19e137f52472a0 Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminTestJSON-1938743631-project Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.511286 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '15f3342e-3072-4091-856d-3d791e0a46b3'} Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:29.512174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. Jul 02 21:01:29.513478 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.514784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] Returning 404 to user: Instance 15f3342e-3072-4091-856d-3d791e0a46b3 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:29.521872 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9a996930-a409-4054-9205-d77491d9b3f4 tempest-AggregatesAdminTestJSON-1938743631 tempest-AggregatesAdminTestJSON-1938743631-project] 10.222.0.43 "GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3" status: 404 len: 111 microversion: 2.1 time: 0.103103 Jul 02 21:01:29.523972 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 154/280] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:29 2022] GET /compute/v2.1/servers/15f3342e-3072-4091-856d-3d791e0a46b3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:29.607656 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ab1e7c7-b2e2-49a3-9da5-5dad736d9033 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 241 microversion: 2.1 time: 0.250656 Jul 02 21:01:29.609651 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 127/281] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 241 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.621035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29d02f78-e45f-46ef-a4f9-1649532b4b8b tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:29.622954 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.622954 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:29.624839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-29d02f78-e45f-46ef-a4f9-1649532b4b8b tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '8f03e55928514c9c99289d5002af5349', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60101912b2e94f7485de6b7adc5642c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29d02f78-e45f-46ef-a4f9-1649532b4b8b tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Request method failure captured: Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 42 Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLH-Fk87FS4yz5vfUorSugZTmoNDJjvej7W_dEcXDtfV0ViSyDoGDGhC671IxaV0ueJoUfeAbvJTF2_5hJhhMS7RyH9akp_4EnV92kLlfSDMRvqkBTF0OPw8LD2jCgxKqc9c7hEZozjlC2fAaOTmRVxtLdtYQ0x8xB4DnlEtYjoHT8c Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:29.628871 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_60101912b2e94f7485de6b7adc5642c9", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/60101912b2e94f7485de6b7adc5642c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/60101912b2e94f7485de6b7adc5642c9"}]}] Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 60101912b2e94f7485de6b7adc5642c9 Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-38090218 Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8f03e55928514c9c99289d5002af5349 Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-38090218-project Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: {"remove_host": {"host": "nch2-master-1"}} Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:01:29.630087 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:29.630840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 02 21:01:29.631887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:29.635611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29d02f78-e45f-46ef-a4f9-1649532b4b8b tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:29.636811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-29d02f78-e45f-46ef-a4f9-1649532b4b8b tempest-AggregatesAdminNegativeTestJSON-38090218 tempest-AggregatesAdminNegativeTestJSON-38090218-project] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021034 Jul 02 21:01:29.637638 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 155/282] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:29.646019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d257ac65-5ee3-444a-8edc-4027b22fbec8 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:29.647891 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.647891 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.668195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d257ac65-5ee3-444a-8edc-4027b22fbec8 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:29.668663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d257ac65-5ee3-444a-8edc-4027b22fbec8 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:29.888801 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d257ac65-5ee3-444a-8edc-4027b22fbec8 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 226 microversion: 2.1 time: 0.245615 Jul 02 21:01:29.888801 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 128/283] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/os-aggregates/17/action => generated 226 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:29.901009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28fe2c03-8b13-444b-b0af-4ffcb33947f0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:29.901822 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.901822 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.960529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28fe2c03-8b13-444b-b0af-4ffcb33947f0 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.064738 Jul 02 21:01:29.961476 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 129/284] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:29 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 02 21:01:29.976448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7303984-3b39-4243-b038-183d3c4122ae tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1978252944"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:29.978133 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:29.978133 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:29.980076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.aggregate [None req-c7303984-3b39-4243-b038-183d3c4122ae tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Generated uuid dafe23db-5985-42d8-8545-495ec96e3c43 for aggregate {{(pid=131044) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:01:30.015870 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7303984-3b39-4243-b038-183d3c4122ae tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.046625 Jul 02 21:01:30.021413 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 130/285] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:30.034416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:30.037137 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:30.037137 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:30.058974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:30.059433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:30.076010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:30.076561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:30.095039 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.compute.aggregates [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 02 21:01:30.095445 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Request method failure captured: Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 42 Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIB_Zssp7KvlO7i8R3XfsxK9kMEiPddOqUT2Kzuvaz23sTADHKM-f0Ndiokpe4_o91qVSmgkNvpjwAjateiR7pIDlmxslVHaufdqGgCpkkyEKcJwoatFRWw10SqKlk9-phhFKF_L9dvdpjpPg2Q3lrVENDQFa3DGBxNljpy1T8rHQU Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:30.105421 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6d7d23bdd8554a3da2d3aebc900f105a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6d7d23bdd8554a3da2d3aebc900f105a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6d7d23bdd8554a3da2d3aebc900f105a"}]}] Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6d7d23bdd8554a3da2d3aebc900f105a Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796 Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 439030a81af2433b99277ebe210a0a9f Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: {"remove_host": {"host": "nonexist_host"}} Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:01:30.106743 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot remove host nonexist_host in aggregate 18 Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 02 21:01:30.107506 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 02 21:01:30.108619 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.110289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e45bbfc-e1ae-4bb5-89d0-3f18f6ffbdf5 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.083143 Jul 02 21:01:30.113280 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 131/286] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:01:30 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:01:30.117231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95755468-9a7f-4a70-811b-985195f1d2a2 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:30.117783 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:30.117783 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:30.181164 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95755468-9a7f-4a70-811b-985195f1d2a2 tempest-AggregatesAdminNegativeTestJSON-2076464796 tempest-AggregatesAdminNegativeTestJSON-2076464796-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.068143 Jul 02 21:01:30.182389 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 132/287] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:01:30 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:30.448490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1293131638", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f62f5bc7-af47-49bf-8b23-df56ea5c37d7"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:30.525346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] validate_networks() for [('f62f5bc7-af47-49bf-8b23-df56ea5c37d7', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:32.899273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:32.900315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:32.900790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:32.901741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:32.902270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:32.923055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:32.923534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:32.924438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:32.925052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:32.948919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:32.955087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for user f3287fb85c2343d686718d3c4aaa5c00 and project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:32.974037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:01:32.979628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:01:33.055079 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9e7ffd5-6ee0-4c4e-919c-09c1980e6371 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.300319 Jul 02 21:01:33.056712 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 156/288] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:01:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3303 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:01:33.070798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f44311b9-e7ab-4a12-a9e6-ebd7fec3596c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:33.071992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f44311b9-e7ab-4a12-a9e6-ebd7fec3596c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:33.279294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f44311b9-e7ab-4a12-a9e6-ebd7fec3596c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:33.292164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f44311b9-e7ab-4a12-a9e6-ebd7fec3596c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:33.297636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f44311b9-e7ab-4a12-a9e6-ebd7fec3596c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:33.301349 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f44311b9-e7ab-4a12-a9e6-ebd7fec3596c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1262 microversion: 2.25 time: 0.233580 Jul 02 21:01:33.302240 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 133/289] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:33 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1262 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:34.320740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:34.321367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:34.332349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:34.351000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:34.352597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:34.354139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:34.394846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:34.479812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:34.501753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:34.503630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:34.504874 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a45d0c2-9d44-45f1-b7d3-48215ac8773e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1266 microversion: 2.25 time: 0.188929 Jul 02 21:01:34.505617 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 157/290] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:34 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:01:35.523985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:35.524681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:35.533356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:35.533870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:35.535804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:35.541311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:35.801385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:35.814210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:35.815728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:35.821248 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38d2d081-d555-4b96-97ee-402023cc8f09 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1320 microversion: 2.25 time: 0.301651 Jul 02 21:01:35.833347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 134/291] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:35 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1320 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:36.842920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:36.844027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:36.851265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:36.851960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:36.853054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:36.853501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:37.035904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:37.047689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:37.050052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:37.051184 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1fa41fa5-a393-4cce-8f01-ec037c3ba059 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.214010 Jul 02 21:01:37.052152 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 158/292] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:36 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:37.355765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25ae092b-6093-4ac8-b564-6ffc69ab7ff4 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe5186a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:37.415125 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25ae092b-6093-4ac8-b564-6ffc69ab7ff4 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511" status: 200 len: 636 microversion: 2.1 time: 0.069771 Jul 02 21:01:37.415743 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 135/293] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:01:37 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511 => generated 636 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:37.429034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb82499c-0ad9-4aef-bfe7-dccbfae71997 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe51c4d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:37.505939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=71,nova_cell0:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:37.509855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-eb82499c-0ad9-4aef-bfe7-dccbfae71997 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:37.520023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-eb82499c-0ad9-4aef-bfe7-dccbfae71997 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:38.072393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:38.073079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:38.074370 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb82499c-0ad9-4aef-bfe7-dccbfae71997 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.649583 Jul 02 21:01:38.086599 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 159/294] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:37 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 02 21:01:38.089894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:38.091235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:38.093476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:38.095097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:38.096923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-39631f8f-4e10-4200-8d90-fde99a057c32 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe51dbe50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:38.693547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:38.702835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:38.704493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:38.705698 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b32183a6-32ea-476e-8819-76d03eccac4f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.639752 Jul 02 21:01:38.716468 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 136/295] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:38 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:01:38.750602 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-39631f8f-4e10-4200-8d90-fde99a057c32 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "DELETE /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.658140 Jul 02 21:01:38.751423 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 160/296] 10.222.0.43 () {58 vars in 1295 bytes} [Sat Jul 2 21:01:38 2022] DELETE /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata/os_version => generated 0 bytes in 660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:01:38.759561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b420f9d-e568-4a50-b2ea-a6c87dab9add tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe51860d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:38.834295 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b420f9d-e568-4a50-b2ea-a6c87dab9add tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 37 microversion: 2.1 time: 0.071705 Jul 02 21:01:38.834295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 137/297] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:01:38 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 37 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:38.840219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e411b41f-fb42-407a-869f-5eb91ee495ef tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe51284c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:38.905621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e411b41f-fb42-407a-869f-5eb91ee495ef tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:38.922820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e411b41f-fb42-407a-869f-5eb91ee495ef tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:39.342992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e411b41f-fb42-407a-869f-5eb91ee495ef tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.506618 Jul 02 21:01:39.348845 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 161/298] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:38 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:39.353834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7c25275-7345-4041-aa36-66fbd7c790f1 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe5186430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:39.423119 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7c25275-7345-4041-aa36-66fbd7c790f1 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.073277 Jul 02 21:01:39.423723 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 138/299] 10.222.0.43 () {58 vars in 1289 bytes} [Sat Jul 2 21:01:39 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata/os_distro => generated 33 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 02 21:01:39.435461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8496eac4-d7bc-408a-a919-0aef8747c034 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe51db670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:39.527448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8496eac4-d7bc-408a-a919-0aef8747c034 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:39.534076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8496eac4-d7bc-408a-a919-0aef8747c034 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:39.908927 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8496eac4-d7bc-408a-a919-0aef8747c034 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.478727 Jul 02 21:01:39.909824 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 162/300] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:39 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:39.915194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:39.916094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:39.928129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:39.928583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:39.929486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:39.929925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:40.068451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:40.169406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-66646904", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:40.250651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:40.407139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:40.421059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:40.424656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:40.427491 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac3a1f00-8d3a-42b3-a88b-7b7d63549603 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.516412 Jul 02 21:01:40.429558 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 163/301] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:39 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:40.441270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59d84d4f-b980-49f3-a454-5683df2f2e6a tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe5214940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:40.527547 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59d84d4f-b980-49f3-a454-5683df2f2e6a tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.095008 Jul 02 21:01:40.530262 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 164/302] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:01:40 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:40.696495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:40.697146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:40.697945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:40.698510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:40.700072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:40.712998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:40.713656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:40.714625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:40.715213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:40.761231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:40.778963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:40.824276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:01:40.827253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:01:40.859514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8a71be5-e314-4087-b308-ae50538f3c11 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Calling method '.version_select at 0x7fabe51c45e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:40.860764 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:40.860764 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:40.862531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e8a71be5-e314-4087-b308-ae50538f3c11 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'ee6053c662e94292a110de1b2b1b943d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c4b2443f764da8beae86f4c9f393b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8a71be5-e314-4087-b308-ae50538f3c11 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Request method failure captured: Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIw_wJsxAYbzJe8R9Ew7XYnEKFCn4vret9LjdysPyNFGjQQnIIUuYEm8T3QlLsHEOHnqbduF3ovxGw5O1GasuEKR2GhpteZeoWRpT_pFrhqv9ls8-6PiofRSpVEmPYg4czE6Zf0RSFgP5nGUDFls7rVinGrMMQ_Drz4awHYXK4bTrQ Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:40.867856 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c4b2443f764da8beae86f4c9f393b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c4b2443f764da8beae86f4c9f393b5"}]}] Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ee6053c662e94292a110de1b2b1b943d Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: action_args: {} Jul 02 21:01:40.869438 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:40.870366 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 02 21:01:40.871671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:40.873767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8a71be5-e314-4087-b308-ae50538f3c11 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:40.877171 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8a71be5-e314-4087-b308-ae50538f3c11 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.345854 Jul 02 21:01:40.880355 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 165/303] 10.222.0.43 () {58 vars in 1166 bytes} [Sat Jul 2 21:01:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 349 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:40.897703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d2c63593-c2a9-4938-919c-cb412b6b5a58 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe531dee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:40.936148 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f4c1021-c383-4cbe-9af5-f90864ab7f83 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464056 Jul 02 21:01:40.937545 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 139/304] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:01:41.038350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d2c63593-c2a9-4938-919c-cb412b6b5a58 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:41.050923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d2c63593-c2a9-4938-919c-cb412b6b5a58 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:41.095837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1993332871", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:41.204498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:41.476987 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d2c63593-c2a9-4938-919c-cb412b6b5a58 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.595231 Jul 02 21:01:41.482457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 166/305] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:40 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:41.491804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b99c7375-76da-4778-ace4-1cd0da552fd7 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Calling method '.version_select at 0x7fabe5214e50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:41.494404 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:41.494404 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:41.496470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b99c7375-76da-4778-ace4-1cd0da552fd7 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'ee6053c662e94292a110de1b2b1b943d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c4b2443f764da8beae86f4c9f393b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b99c7375-76da-4778-ace4-1cd0da552fd7 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Request method failure captured: Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIw_wJsxAYbzJe8R9Ew7XYnEKFCn4vret9LjdysPyNFGjQQnIIUuYEm8T3QlLsHEOHnqbduF3ovxGw5O1GasuEKR2GhpteZeoWRpT_pFrhqv9ls8-6PiofRSpVEmPYg4czE6Zf0RSFgP5nGUDFls7rVinGrMMQ_Drz4awHYXK4bTrQ Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:41.498408 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c4b2443f764da8beae86f4c9f393b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c4b2443f764da8beae86f4c9f393b5"}]}] Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ee6053c662e94292a110de1b2b1b943d Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: action_args: {} Jul 02 21:01:41.499777 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:41.500636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 02 21:01:41.501837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:41.503135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b99c7375-76da-4778-ace4-1cd0da552fd7 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:41.503135 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b99c7375-76da-4778-ace4-1cd0da552fd7 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.016094 Jul 02 21:01:41.503135 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 167/306] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:41 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:41.513715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-08ca976f-1dde-4139-ac85-357aeb7ef44e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:41.514429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-08ca976f-1dde-4139-ac85-357aeb7ef44e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:41.521539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:41.639427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:41.640177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:41.640902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:41.641490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:41.642145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:41.661752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:41.663737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:41.671361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:41.673435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:41.717267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Getting quotas for project 8ae5fa728db84608bfaa558277a90b34. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:41.723161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-08ca976f-1dde-4139-ac85-357aeb7ef44e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:41.724894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Getting quotas for user fe262620110042f6baacf06dd51e0ddc and project 8ae5fa728db84608bfaa558277a90b34. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:41.744235 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-08ca976f-1dde-4139-ac85-357aeb7ef44e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1215 microversion: 2.1 time: 0.242745 Jul 02 21:01:41.746707 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 168/307] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:41 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:41.758642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:01:41.761578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:01:41.828715 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e460c47-5b91-42f5-9e35-d9b1f2df7829 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.889725 Jul 02 21:01:41.830047 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 140/308] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:01:41.835303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:41.836172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:41.846644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:41.847593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:41.850223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:41.851848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:42.089911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:42.098606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:42.100028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:42.101214 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ce7d76c-4f5a-49f9-a92f-e9e8bb056ef0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.270100 Jul 02 21:01:42.119874 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 141/309] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:41 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:42.131290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb90aead-9cf5-4d43-be7f-92ea5c34a316 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe515b040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:42.247072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fb90aead-9cf5-4d43-be7f-92ea5c34a316 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:42.254738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fb90aead-9cf5-4d43-be7f-92ea5c34a316 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:42.274853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=8,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:42.475845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee2568f3-9443-47ca-9e36-cba4a2ee8d3b tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1026948900", "id": 2015627687, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:42.477901 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:42.477901 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:42.531455 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ee2568f3-9443-47ca-9e36-cba4a2ee8d3b tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.783380 Jul 02 21:01:42.532807 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 169/310] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:01:41 2022] POST /compute/v2.1/flavors => generated 471 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:01:42.540512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-802de679-c96b-4c75-b54b-d5000663c3f0 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Calling method '.version_select at 0x7fabe51f8a60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:42.541670 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:42.541670 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:42.544228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-802de679-c96b-4c75-b54b-d5000663c3f0 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'ee6053c662e94292a110de1b2b1b943d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c4b2443f764da8beae86f4c9f393b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-802de679-c96b-4c75-b54b-d5000663c3f0 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Request method failure captured: Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIw_wJsxAYbzJe8R9Ew7XYnEKFCn4vret9LjdysPyNFGjQQnIIUuYEm8T3QlLsHEOHnqbduF3ovxGw5O1GasuEKR2GhpteZeoWRpT_pFrhqv9ls8-6PiofRSpVEmPYg4czE6Zf0RSFgP5nGUDFls7rVinGrMMQ_Drz4awHYXK4bTrQ Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:42.549549 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c4b2443f764da8beae86f4c9f393b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c4b2443f764da8beae86f4c9f393b5"}]}] Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ee6053c662e94292a110de1b2b1b943d Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: action_args: {} Jul 02 21:01:42.551060 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:42.551922 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 02 21:01:42.553166 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:42.558771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-802de679-c96b-4c75-b54b-d5000663c3f0 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:42.561450 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-802de679-c96b-4c75-b54b-d5000663c3f0 tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027072 Jul 02 21:01:42.562296 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 170/311] 10.222.0.43 () {58 vars in 1178 bytes} [Sat Jul 2 21:01:42 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:42.576472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-99b9eab1-da80-4d18-8eb8-fe45df0c38b5 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:42.577475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-99b9eab1-da80-4d18-8eb8-fe45df0c38b5 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:42.727972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-99b9eab1-da80-4d18-8eb8-fe45df0c38b5 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:42.739438 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-99b9eab1-da80-4d18-8eb8-fe45df0c38b5 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1220 microversion: 2.1 time: 0.171151 Jul 02 21:01:42.753634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 171/312] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:42 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:42.763856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed9eba9c-0f34-4f95-a048-a358cbc23448 tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:42.768701 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:42.768701 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:43.136440 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb90aead-9cf5-4d43-be7f-92ea5c34a316 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 64 microversion: 2.1 time: 1.015330 Jul 02 21:01:43.137315 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 142/313] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:42 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 64 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:43.183545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=19 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:43.281248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed9eba9c-0f34-4f95-a048-a358cbc23448 tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/2015627687/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.525953 Jul 02 21:01:43.286882 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 172/314] 10.222.0.43 () {62 vars in 1264 bytes} [Sat Jul 2 21:01:42 2022] POST /compute/v2.1/flavors/2015627687/os-extra_specs => generated 62 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:43.293326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:43.293895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:43.303497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.304117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.304805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.311681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.659456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Calling method '.version_select at 0x7fabe5270d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:43.664222 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:43.664222 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:43.666656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.667900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.685405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:43.703435 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f89446e0-50ce-4712-a0be-68c773789328 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1273 microversion: 2.1 time: 0.414140 Jul 02 21:01:43.706645 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 173/315] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:43 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1273 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:43.714217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.727842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.734455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:43.736485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:43.753513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.754879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.758827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.761243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.763900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.767325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.783952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9fc2a3c-85cd-4480-addc-3df27114afe4 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.645209 Jul 02 21:01:43.784826 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 143/316] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:43.794579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73a0a921-32e8-43c7-be03-655270eabd98 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe515b700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:43.869099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73a0a921-32e8-43c7-be03-655270eabd98 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 64 microversion: 2.1 time: 0.082967 Jul 02 21:01:43.869815 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 144/317] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:01:43 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 64 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:43.876832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e996937-ca73-4dbd-8287-d30ba883ba15 tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:43.877948 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:43.877948 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:43.901202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e996937-ca73-4dbd-8287-d30ba883ba15 tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2015627687" status: 202 len: 0 microversion: 2.86 time: 0.030107 Jul 02 21:01:43.902235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 145/318] 10.222.0.43 () {60 vars in 1201 bytes} [Sat Jul 2 21:01:43 2022] DELETE /compute/v2.1/flavors/2015627687 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:01:43.908811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:43.909729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:43.939128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.940910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:43.942528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:43.943310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:44.408995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:44.419179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7383da79-e3eb-47bf-94bd-97c2c1ac77a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1280 microversion: 2.1 time: 0.514788 Jul 02 21:01:44.429617 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 146/319] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:43 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1280 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:44.435031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cf67d4e-5567-44c0-952b-dc1d358a97ba tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Calling method '.version_select at 0x7fabe515b820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:44.435846 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:44.435846 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:44.436971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cf67d4e-5567-44c0-952b-dc1d358a97ba tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'ee6053c662e94292a110de1b2b1b943d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c4b2443f764da8beae86f4c9f393b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cf67d4e-5567-44c0-952b-dc1d358a97ba tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Request method failure captured: Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIw_wJsxAYbzJe8R9Ew7XYnEKFCn4vret9LjdysPyNFGjQQnIIUuYEm8T3QlLsHEOHnqbduF3ovxGw5O1GasuEKR2GhpteZeoWRpT_pFrhqv9ls8-6PiofRSpVEmPYg4czE6Zf0RSFgP5nGUDFls7rVinGrMMQ_Drz4awHYXK4bTrQ Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:44.438836 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c4b2443f764da8beae86f4c9f393b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c4b2443f764da8beae86f4c9f393b5"}]}] Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: ee6053c662e94292a110de1b2b1b943d Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1'} Jul 02 21:01:44.440404 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:44.441309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 02 21:01:44.442566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.443756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cf67d4e-5567-44c0-952b-dc1d358a97ba tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:44.443756 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2cf67d4e-5567-44c0-952b-dc1d358a97ba tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.009358 Jul 02 21:01:44.447092 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 147/320] 10.222.0.43 () {58 vars in 1172 bytes} [Sat Jul 2 21:01:44 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:44.452071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7eac07ba-443d-4160-a914-71eb76e97651 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe513cc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:44.505725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7eac07ba-443d-4160-a914-71eb76e97651 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:44.511304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7eac07ba-443d-4160-a914-71eb76e97651 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:44.664566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:44.678444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:44.684884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:44.686080 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a03a1c76-6f71-4fc9-99ef-605e924666ab tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.978098 Jul 02 21:01:44.686663 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 174/321] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:43 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:44.700556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e080fe2-f6ba-47ee-abaa-ace9041eaac6 tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:44.733781 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e080fe2-f6ba-47ee-abaa-ace9041eaac6 tempest-FlavorMetadataValidation-1781264480 tempest-FlavorMetadataValidation-1781264480-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.045879 Jul 02 21:01:44.735363 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 175/322] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:01:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:44.741411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b5ff313-7719-4d05-8cee-5afff38e2b35 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Calling method '.version_select at 0x7fabe514b790>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:44.742245 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:44.742245 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:44.743139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-3b5ff313-7719-4d05-8cee-5afff38e2b35 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] HTTP exception thrown: Hypervisor with ID '04ce8065-58c7-491c-a4cd-55a48b5b5a49' could not be found. Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b5ff313-7719-4d05-8cee-5afff38e2b35 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Request method failure captured: Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hypervisors/04ce8065-58c7-491c-a4cd-55a48b5b5a49/uptime HTTP/1.1 Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLI0IG7CnofyRGluYlROqvl44tJnBCCHlWQepni-UAIC0Pli68NBx_za-y7zBXsflDZaLG25NVk2Zv4fiGd1st4gw-niOsWKyCpFWsn6ZHKnG0CujhN8kh9pps9YVSqGFD_FL6WfTT_i6dvxKj5tDStsal6fOCkqSQ9dRgdPS1KB2Fs Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f024a13edfe44741b289a28f8c20ef33 Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1787647304 Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:01:44.767537 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f024a13edfe44741b289a28f8c20ef33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f024a13edfe44741b289a28f8c20ef33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f024a13edfe44741b289a28f8c20ef33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f024a13edfe44741b289a28f8c20ef33"}]}] Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1787647304 Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f024a13edfe44741b289a28f8c20ef33 Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1787647304 Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: bcab9436967748519726af2bb6321864 Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: exception: Hypervisor with ID '04ce8065-58c7-491c-a4cd-55a48b5b5a49' could not be found. Jul 02 21:01:44.769631 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '04ce8065-58c7-491c-a4cd-55a48b5b5a49'} Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '04ce8065-58c7-491c-a4cd-55a48b5b5a49' Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 02 21:01:44.770408 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '04ce8065-58c7-491c-a4cd-55a48b5b5a49' could not be found. Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:44.771652 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '04ce8065-58c7-491c-a4cd-55a48b5b5a49' could not be found. Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b5ff313-7719-4d05-8cee-5afff38e2b35 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Returning 404 to user: Hypervisor with ID '04ce8065-58c7-491c-a4cd-55a48b5b5a49' could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:44.774066 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b5ff313-7719-4d05-8cee-5afff38e2b35 tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/04ce8065-58c7-491c-a4cd-55a48b5b5a49/uptime" status: 404 len: 123 microversion: 2.1 time: 0.036941 Jul 02 21:01:44.795246 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 176/323] 10.222.0.43 () {58 vars in 1277 bytes} [Sat Jul 2 21:01:44 2022] GET /compute/v2.1/os-hypervisors/04ce8065-58c7-491c-a4cd-55a48b5b5a49/uptime => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:44.808760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:44.811594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:44.837945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:44.838561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:44.839521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:44.839971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:45.118511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:45.122971 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7eac07ba-443d-4160-a914-71eb76e97651 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.674674 Jul 02 21:01:45.128590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 148/324] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:44 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:45.134723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Calling method '.version_select at 0x7fabe513cb80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:45.139654 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:45.139654 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:45.141129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:45.141592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:45.143117 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f699edfa-3203-4bf8-b3cc-e5aeb760b464 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1273 microversion: 2.1 time: 0.350369 Jul 02 21:01:45.144818 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 177/325] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:44 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:45.159365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-982370ba-31c3-4bb2-9878-90b34fc64a0a tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update', calling method: .version_select at 0x7fabe514b430>, body: {"meta": {"os_version": "alt"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:45.199534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:45.203307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:45.240675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:45.241160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:45.261136 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f71286a-cc71-49fb-874d-16b2ef175c0b tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.128551 Jul 02 21:01:45.264594 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 149/326] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:45.280665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-982370ba-31c3-4bb2-9878-90b34fc64a0a tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:45.289974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-982370ba-31c3-4bb2-9878-90b34fc64a0a tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:45.293425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10dc11dd-a906-4aa5-801d-501cf5de817c tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Calling method '.version_select at 0x7fabe515b160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:45.294254 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:45.294254 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:45.307867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10dc11dd-a906-4aa5-801d-501cf5de817c tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'ee6053c662e94292a110de1b2b1b943d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c4b2443f764da8beae86f4c9f393b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10dc11dd-a906-4aa5-801d-501cf5de817c tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Request method failure captured: Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIw_wJsxAYbzJe8R9Ew7XYnEKFCn4vret9LjdysPyNFGjQQnIIUuYEm8T3QlLsHEOHnqbduF3ovxGw5O1GasuEKR2GhpteZeoWRpT_pFrhqv9ls8-6PiofRSpVEmPYg4czE6Zf0RSFgP5nGUDFls7rVinGrMMQ_Drz4awHYXK4bTrQ Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:01:45.318079 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c4b2443f764da8beae86f4c9f393b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c4b2443f764da8beae86f4c9f393b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c4b2443f764da8beae86f4c9f393b5"}]}] Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a0c4b2443f764da8beae86f4c9f393b5 Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420 Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: ee6053c662e94292a110de1b2b1b943d Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2051886420-project Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1'} Jul 02 21:01:45.319434 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:01:45.321196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 02 21:01:45.322232 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.324555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10dc11dd-a906-4aa5-801d-501cf5de817c tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:45.324555 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10dc11dd-a906-4aa5-801d-501cf5de817c tempest-HypervisorAdminNegativeTestJSON-2051886420 tempest-HypervisorAdminNegativeTestJSON-2051886420-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.051748 Jul 02 21:01:45.324555 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 150/327] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:01:45 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 53 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:45.349428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2114726-0dd8-4bb8-b0bf-66834191a33a tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Calling method '.version_select at 0x7fabe5259d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:45.351276 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f2114726-0dd8-4bb8-b0bf-66834191a33a tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] HTTP exception thrown: Hypervisor with ID '82b23442-ec9e-4a3b-972a-aab437f5485f' could not be found. Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2114726-0dd8-4bb8-b0bf-66834191a33a tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Request method failure captured: Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/82b23442-ec9e-4a3b-972a-aab437f5485f HTTP/1.1 Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLI0IG7CnofyRGluYlROqvl44tJnBCCHlWQepni-UAIC0Pli68NBx_za-y7zBXsflDZaLG25NVk2Zv4fiGd1st4gw-niOsWKyCpFWsn6ZHKnG0CujhN8kh9pps9YVSqGFD_FL6WfTT_i6dvxKj5tDStsal6fOCkqSQ9dRgdPS1KB2Fs Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f024a13edfe44741b289a28f8c20ef33 Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1787647304 Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:01:45.356239 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f024a13edfe44741b289a28f8c20ef33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f024a13edfe44741b289a28f8c20ef33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f024a13edfe44741b289a28f8c20ef33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f024a13edfe44741b289a28f8c20ef33"}]}] Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1787647304 Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f024a13edfe44741b289a28f8c20ef33 Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1787647304 Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: bcab9436967748519726af2bb6321864 Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: exception: Hypervisor with ID '82b23442-ec9e-4a3b-972a-aab437f5485f' could not be found. Jul 02 21:01:45.358376 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '82b23442-ec9e-4a3b-972a-aab437f5485f'} Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '82b23442-ec9e-4a3b-972a-aab437f5485f' Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 02 21:01:45.359519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:01:45.362751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '82b23442-ec9e-4a3b-972a-aab437f5485f' could not be found. Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '82b23442-ec9e-4a3b-972a-aab437f5485f' could not be found. Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:01:45.364730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2114726-0dd8-4bb8-b0bf-66834191a33a tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] Returning 404 to user: Hypervisor with ID '82b23442-ec9e-4a3b-972a-aab437f5485f' could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:45.368555 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2114726-0dd8-4bb8-b0bf-66834191a33a tempest-HypervisorAdminNegativeTestJSON-1787647304 tempest-HypervisorAdminNegativeTestJSON-1787647304-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/82b23442-ec9e-4a3b-972a-aab437f5485f" status: 404 len: 123 microversion: 2.1 time: 0.025917 Jul 02 21:01:45.369582 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 151/328] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:01:45 2022] GET /compute/v2.1/os-hypervisors/82b23442-ec9e-4a3b-972a-aab437f5485f => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:45.438648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:45.440143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:45.463120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:45.463586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:45.464384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:45.464813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:46.121939 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-982370ba-31c3-4bb2-9878-90b34fc64a0a tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.973398 Jul 02 21:01:46.122425 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 178/329] 10.222.0.43 () {60 vars in 1312 bytes} [Sat Jul 2 21:01:45 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata/os_version => generated 31 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:46.132416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:46.134229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:46.140246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:46.153081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:46.155375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:46.155375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:46.156287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1aa6f1b3-cf93-41bd-940b-cc2d6b61e319 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1278 microversion: 2.1 time: 0.721859 Jul 02 21:01:46.158394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:46.159529 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 152/330] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:45 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1278 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:46.349963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78853a1d-0cf6-480f-b101-ddd4d507da99 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Calling method '.version_select at 0x7fabe513ce50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:46.532278 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78853a1d-0cf6-480f-b101-ddd4d507da99 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.369361 Jul 02 21:01:46.532278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 153/331] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:01:46 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:46.542809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7076d536-417f-4097-b6bb-2b8a3dcb2fde tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe50cc040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:46.595518 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7076d536-417f-4097-b6bb-2b8a3dcb2fde tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 58 microversion: 2.1 time: 0.058638 Jul 02 21:01:46.601575 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 154/332] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:01:46 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 58 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:46.607005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:46.607867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:46.616086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:46.616877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:46.617854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:46.618495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:47.060863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:47.073848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:47.080985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:47.082528 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-65358222-c720-49ff-8703-4a8151aaa560 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.954756 Jul 02 21:01:47.083787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 179/333] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:46 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:47.088855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d5d2a79-45d9-4b2b-94b1-65d1b4c71f79 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Action: 'create', calling method: .version_select at 0x7fabe50c4280>, body: {"pool": "non_exist_pool"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:47.266033 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1d5d2a79-45d9-4b2b-94b1-65d1b4c71f79 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] HTTP exception thrown: Floating IP pool not found. Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d5d2a79-45d9-4b2b-94b1-65d1b4c71f79 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Request method failure captured: Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 26 Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLI51e30lK6tg86Sw_9kVMSoHjDiZzciy-3x5D3fI3peFcBPu76iKSKQU8pleE-BdH13EDMQzNdWJ4nTlOk5xCX3QEOHW6rNKmdTi2jkKrQpn4iyHGiXjz5Eppu_Zv62YhOEa5yOnb7MyXXQbTm2C6MwDUX5CS2mK2NxbqNagrRvd2Q Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: eba90f0c20674772824b3286c46941d2 Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-158482403 Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:47.269256 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eba90f0c20674772824b3286c46941d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eba90f0c20674772824b3286c46941d2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eba90f0c20674772824b3286c46941d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eba90f0c20674772824b3286c46941d2"}]}] Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-158482403 Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: eba90f0c20674772824b3286c46941d2 Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-158482403 Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FloatingIPsNegativeTestJSON-158482403-project Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 10cba2186f6343d98d0d69822ab8640b Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-158482403-project Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: {"pool": "non_exist_pool"} Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: exception: Floating IP pool not found. Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 02 21:01:47.270752 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:47.271826 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d5d2a79-45d9-4b2b-94b1-65d1b4c71f79 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Returning 404 to user: Floating IP pool not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:47.273420 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d5d2a79-45d9-4b2b-94b1-65d1b4c71f79 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.185775 Jul 02 21:01:47.276379 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 180/334] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:01:47 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:01:47.283900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1df34dda-e2d1-463d-bc4b-84323b4d43c2 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'update_all', calling method: .version_select at 0x7fabe509ef70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:47.343925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:47.361548 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5aa7b310-3175-4179-8f44-a0731ac884e2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 0.756639 Jul 02 21:01:47.374372 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 155/335] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:46 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:47.404473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1df34dda-e2d1-463d-bc4b-84323b4d43c2 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:47.414667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1df34dda-e2d1-463d-bc4b-84323b4d43c2 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:47.702097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7d6d4b22-3d0b-4263-93cc-d8299477300d req-be825f04-26b9-41fe-9da3-0f795f26241e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1aece9-4d7e-4240-9645-4ff29fa23d8c", "tag": "97d0372f-9d42-420d-83a4-f34986f4a07d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:47.711372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7d6d4b22-3d0b-4263-93cc-d8299477300d req-be825f04-26b9-41fe-9da3-0f795f26241e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:47.711848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7d6d4b22-3d0b-4263-93cc-d8299477300d req-be825f04-26b9-41fe-9da3-0f795f26241e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:47.716858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:47.727534 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7d6d4b22-3d0b-4263-93cc-d8299477300d req-be825f04-26b9-41fe-9da3-0f795f26241e service nova] Creating event network-changed:97d0372f-9d42-420d-83a4-f34986f4a07d for instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c on nch1-master-1 Jul 02 21:01:47.733621 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7d6d4b22-3d0b-4263-93cc-d8299477300d req-be825f04-26b9-41fe-9da3-0f795f26241e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356614 Jul 02 21:01:47.734718 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 156/336] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:47.740449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:47.741747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:47.753645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:47.754490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:47.756450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:47.757291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:48.003597 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1df34dda-e2d1-463d-bc4b-84323b4d43c2 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 61 microversion: 2.1 time: 0.726024 Jul 02 21:01:48.005529 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 181/337] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:01:47 2022] PUT /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 61 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:48.013545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a644277a-8aef-4f96-889c-a02091d2be55 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Calling method '.version_select at 0x7fabe50c4280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:48.303463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:48.316393 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be8c9787-71da-49e1-867f-a424f9ee95cf tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1278 microversion: 2.1 time: 0.579792 Jul 02 21:01:48.317012 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 157/338] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:47 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1278 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:48.340659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-afdfa506-d67d-4ca3-a2d3-f78910611e26 req-f2d392bf-fa18-487a-8929-702b5726e6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899cd575-ce36-4ba9-b0a3-5d4704088bf1", "tag": "e65b2ade-ed92-4c7c-a3c0-c39004944454"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:48.363571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-afdfa506-d67d-4ca3-a2d3-f78910611e26 req-f2d392bf-fa18-487a-8929-702b5726e6c2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:48.364550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-afdfa506-d67d-4ca3-a2d3-f78910611e26 req-f2d392bf-fa18-487a-8929-702b5726e6c2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:48.391575 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-afdfa506-d67d-4ca3-a2d3-f78910611e26 req-f2d392bf-fa18-487a-8929-702b5726e6c2 service nova] Creating event network-changed:e65b2ade-ed92-4c7c-a3c0-c39004944454 for instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 on nch2-master-1 Jul 02 21:01:48.409050 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-afdfa506-d67d-4ca3-a2d3-f78910611e26 req-f2d392bf-fa18-487a-8929-702b5726e6c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076456 Jul 02 21:01:48.411038 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 158/339] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:48.427323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b59f5bda-b8b8-4704-8f5e-bca1fb477f6f tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Action: 'create', calling method: .version_select at 0x7fabe50ccd30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:48.506529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-a644277a-8aef-4f96-889c-a02091d2be55 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3bfbe4ba-c759-460c-b945-652f617b77c4 could not be found", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:01:48.507255 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a644277a-8aef-4f96-889c-a02091d2be55 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] HTTP exception thrown: Floating IP not found for ID 3bfbe4ba-c759-460c-b945-652f617b77c4 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a644277a-8aef-4f96-889c-a02091d2be55 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Request method failure captured: Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-floating-ips/3bfbe4ba-c759-460c-b945-652f617b77c4 HTTP/1.1 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLI51e30lK6tg86Sw_9kVMSoHjDiZzciy-3x5D3fI3peFcBPu76iKSKQU8pleE-BdH13EDMQzNdWJ4nTlOk5xCX3QEOHW6rNKmdTi2jkKrQpn4iyHGiXjz5Eppu_Zv62YhOEa5yOnb7MyXXQbTm2C6MwDUX5CS2mK2NxbqNagrRvd2Q Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: eba90f0c20674772824b3286c46941d2 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-158482403 Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:01:48.523297 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eba90f0c20674772824b3286c46941d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_eba90f0c20674772824b3286c46941d2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/eba90f0c20674772824b3286c46941d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/eba90f0c20674772824b3286c46941d2"}]}] Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-158482403 Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: eba90f0c20674772824b3286c46941d2 Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-158482403 Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FloatingIPsNegativeTestJSON-158482403-project Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 10cba2186f6343d98d0d69822ab8640b Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-158482403-project Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: exception: Floating IP not found for ID 3bfbe4ba-c759-460c-b945-652f617b77c4 Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '3bfbe4ba-c759-460c-b945-652f617b77c4'} Jul 02 21:01:48.525114 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:01:48.526017 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3bfbe4ba-c759-460c-b945-652f617b77c4 could not be found Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-74f0aca5-84c8-42cd-9624-800e0b990625'] Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3bfbe4ba-c759-460c-b945-652f617b77c4. Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:48.527303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3bfbe4ba-c759-460c-b945-652f617b77c4 Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:01:48.528949 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:01:48.530340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3bfbe4ba-c759-460c-b945-652f617b77c4 Jul 02 21:01:48.530340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:01:48.530340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a644277a-8aef-4f96-889c-a02091d2be55 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] Returning 404 to user: Floating IP not found for ID 3bfbe4ba-c759-460c-b945-652f617b77c4 {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:01:48.530340 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a644277a-8aef-4f96-889c-a02091d2be55 tempest-FloatingIPsNegativeTestJSON-158482403 tempest-FloatingIPsNegativeTestJSON-158482403-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/3bfbe4ba-c759-460c-b945-652f617b77c4" status: 404 len: 111 microversion: 2.1 time: 0.519057 Jul 02 21:01:48.530340 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 182/340] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:01:48 2022] DELETE /compute/v2.1/os-floating-ips/3bfbe4ba-c759-460c-b945-652f617b77c4 => generated 111 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:01:48.535921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b59f5bda-b8b8-4704-8f5e-bca1fb477f6f tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:48.540650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:48.543390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:48.552210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b59f5bda-b8b8-4704-8f5e-bca1fb477f6f tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Getting quotas for user a8ae594a351c42d7a790c76efd50e305 and project 753c958df79645c09e5b6e12fdc8b454. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:48.557498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:48.558016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:48.559056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:48.559844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:49.222452 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b59f5bda-b8b8-4704-8f5e-bca1fb477f6f tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "POST /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 85 microversion: 2.1 time: 0.807585 Jul 02 21:01:49.228830 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 159/341] 10.222.0.43 () {60 vars in 1280 bytes} [Sat Jul 2 21:01:48 2022] POST /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 85 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:49.234659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:49.239221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:49.279084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:49.281007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:49.282052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:49.294512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:49.347090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:49.366754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:49.370017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:49.375666 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-89f28205-9b08-4b1a-9a7d-f0639297bc81 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.845308 Jul 02 21:01:49.377678 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 183/342] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:48 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:49.390114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54c17045-0882-4dc6-91c3-eccdbe4ba0d1 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] Calling method '.version_select at 0x7fabe5037c10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:49.454008 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54c17045-0882-4dc6-91c3-eccdbe4ba0d1 tempest-ImagesMetadataTestJSON-555571985 tempest-ImagesMetadataTestJSON-555571985-project] 10.222.0.43 "GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata" status: 200 len: 85 microversion: 2.1 time: 0.074713 Jul 02 21:01:49.455371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 184/343] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:01:49 2022] GET /compute/v2.1/images/df54f13d-c4af-4b8b-a4ef-ae75e6814511/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:49.465492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:49.466542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:49.482933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:49.484181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:49.486792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:49.487996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:49.974346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:49.988766 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19cc5135-7a3e-403b-979e-ba26325f772c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 0.758656 Jul 02 21:01:49.989341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 160/344] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:49 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:50.096901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:50.109817 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e36001b-760d-4b57-9dae-33bb9dbbd4cc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 0.651924 Jul 02 21:01:50.112522 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 185/345] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:49 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:50.395306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:50.396024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:50.403945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:50.405757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:50.406639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:50.408409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:50.991299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:51.008655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:51.010048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:51.023167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:51.025151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:51.029794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:51.030288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:51.031106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:51.031542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:51.035587 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da5e0a9b-e99a-495d-beec-e74354d2c135 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.644772 Jul 02 21:01:51.036201 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 161/346] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:50 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:51.136636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:51.137594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:51.150898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:51.151635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:51.152723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:51.153581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:51.695797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:52.968519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:52.977825 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4cc6def9-a088-4ffb-a05b-cd889215c0a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 1.974183 Jul 02 21:01:52.987621 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 186/347] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:51 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:52.992790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:52.993395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:53.014217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:53.015007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:53.020844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:53.021522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:53.136882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:53.157454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a63066b2-9bd6-43c4-bf3d-37274033c3ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 2.030708 Jul 02 21:01:53.159958 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 162/348] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:51 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:53.847773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1842647376", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:53.860684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:53.879755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:53.885296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:53.895570 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-87932cd1-7758-4da7-9459-e823175474e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.900929 Jul 02 21:01:53.909272 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 187/349] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:52 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:53.933145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:01:54.027121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3cebcdfc-1cc7-4003-ad09-7db97da97014 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-633121065", "ram": 512, "vcpus": 1, "disk": 10, "id": 602727717, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:54.071798 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:54.071798 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:54.116574 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3cebcdfc-1cc7-4003-ad09-7db97da97014 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.205784 Jul 02 21:01:54.117545 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 188/350] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:53 2022] POST /compute/v2.1/flavors => generated 412 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:54.127999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:54.131662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:54.155215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:54.156030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:54.157073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:54.157736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.088580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:55.102657 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-448a33fa-8b6d-4049-9e5e-5a81cd857fa5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 0.983319 Jul 02 21:01:55.103613 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 189/351] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:54 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:55.113804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d790dfeb-faef-4125-bd20-b24b742fcd6e tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:55.115210 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:55.115210 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:55.171960 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d790dfeb-faef-4125-bd20-b24b742fcd6e tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067164 Jul 02 21:01:55.172846 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 190/352] 10.222.0.43 () {60 vars in 1220 bytes} [Sat Jul 2 21:01:55 2022] POST /compute/v2.1/flavors/602727717/os-extra_specs => generated 66 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:55.180995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:55.181613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:55.197856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.198701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.199667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.200294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.274298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:01:55.274795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:01:55.275376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:01:55.276068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:01:55.276591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:01:55.283695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=66 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:55.287714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.288794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.290480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.291160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.316401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:55.323394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for user 592e8c2ad31f459fa0b37f219cc4f84c and project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:55.350236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:01:55.354585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:01:55.458298 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9987f14-c7c6-45e9-b669-c9e873f98cb9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062607 Jul 02 21:01:55.459526 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 163/353] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:01:55.464749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-766d36a3-a431-4139-8c80-828474b88592 req-0780a674-e8fe-43eb-9b27-8cb10096353d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c62d127-b0f0-46b8-a871-189a1b7cb318", "tag": "7858a005-485f-44b4-bb30-51746869e7f9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:55.486237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-766d36a3-a431-4139-8c80-828474b88592 req-0780a674-e8fe-43eb-9b27-8cb10096353d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.487087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-766d36a3-a431-4139-8c80-828474b88592 req-0780a674-e8fe-43eb-9b27-8cb10096353d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.509239 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-766d36a3-a431-4139-8c80-828474b88592 req-0780a674-e8fe-43eb-9b27-8cb10096353d service nova] Creating event network-changed:7858a005-485f-44b4-bb30-51746869e7f9 for instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 on nch2-master-1 Jul 02 21:01:55.521960 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-766d36a3-a431-4139-8c80-828474b88592 req-0780a674-e8fe-43eb-9b27-8cb10096353d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060725 Jul 02 21:01:55.522739 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 164/354] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:55.736997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3af8a911-0dce-4cc4-baa0-af9206ea94c8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Action: 'create', calling method: .version_select at 0x7fabe506a9d0>, body: {"keypair": {"name": "tempest-keypair-1713137201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQAEHfklFvOOhl8hnM3CvoqMwcwxpA4+dQKq95UEnWz+ajNhDTDbbtoKJ6bJI9Wn+6iZU112UtmBYKX4gsCejbuXOkjTg91bLRdI1dGNzcik1q930hgTSOFqViy22tgSg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:55.770528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3af8a911-0dce-4cc4-baa0-af9206ea94c8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:55.777112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:55.784392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3af8a911-0dce-4cc4-baa0-af9206ea94c8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for user aeca74e8f34544b49f4276aff011a596 and project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:55.791392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0fc69048-8524-4161-9b88-4b05672ddf9d tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 0.615904 Jul 02 21:01:55.791940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 191/355] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:55 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:55.812485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:55.813279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:55.834077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.834538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.835329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:55.835780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:55.888151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3af8a911-0dce-4cc4-baa0-af9206ea94c8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.363487 Jul 02 21:01:55.889353 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 165/356] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:01:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:56.082785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26286884-fad8-4d62-a682-06f278e0e9e8 tempest-FlavorsExtraSpecsTestJSON-146844421 tempest-FlavorsExtraSpecsTestJSON-146844421-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.095812 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26286884-fad8-4d62-a682-06f278e0e9e8 tempest-FlavorsExtraSpecsTestJSON-146844421 tempest-FlavorsExtraSpecsTestJSON-146844421-project] 10.222.0.43 "GET /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.204927 Jul 02 21:01:56.103523 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 166/357] 10.222.0.43 () {58 vars in 1199 bytes} [Sat Jul 2 21:01:55 2022] GET /compute/v2.1/flavors/602727717/os-extra_specs => generated 66 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:56.118020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-305dade2-8772-4bcc-86ca-e01b880863a8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.119260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-305dade2-8772-4bcc-86ca-e01b880863a8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:56.423965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-305dade2-8772-4bcc-86ca-e01b880863a8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:56.432887 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-305dade2-8772-4bcc-86ca-e01b880863a8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1213 microversion: 2.1 time: 0.327674 Jul 02 21:01:56.439816 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 167/358] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:56 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1213 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:56.454052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70eb0997-2aef-4373-b04d-7ea085a847af tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe51865e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.469200 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70eb0997-2aef-4373-b04d-7ea085a847af tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-1713137201" status: 200 len: 497 microversion: 2.1 time: 0.027972 Jul 02 21:01:56.472554 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 168/359] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:01:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1713137201 => generated 497 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:56.483164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4e27d721-2482-4ac8-b115-e2fff3ddc434 req-4d93fd77-2c49-4b2c-b96d-4ca3ec64f63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1aece9-4d7e-4240-9645-4ff29fa23d8c", "name": "network-vif-plugged", "status": "completed", "tag": "97d0372f-9d42-420d-83a4-f34986f4a07d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:56.505733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4e27d721-2482-4ac8-b115-e2fff3ddc434 req-4d93fd77-2c49-4b2c-b96d-4ca3ec64f63e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:56.508948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4e27d721-2482-4ac8-b115-e2fff3ddc434 req-4d93fd77-2c49-4b2c-b96d-4ca3ec64f63e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:56.537337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4e27d721-2482-4ac8-b115-e2fff3ddc434 req-4d93fd77-2c49-4b2c-b96d-4ca3ec64f63e service nova] Creating event network-vif-plugged:97d0372f-9d42-420d-83a4-f34986f4a07d for instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c on nch1-master-1 Jul 02 21:01:56.553934 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4e27d721-2482-4ac8-b115-e2fff3ddc434 req-4d93fd77-2c49-4b2c-b96d-4ca3ec64f63e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079510 Jul 02 21:01:56.554361 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 169/360] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:56.564923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80324828-6e20-43bd-860a-7f95e80e504c tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:56.585667 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:56.585667 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:01:56.658745 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80324828-6e20-43bd-860a-7f95e80e504c tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.101402 Jul 02 21:01:56.662671 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 170/361] 10.222.0.43 () {60 vars in 1220 bytes} [Sat Jul 2 21:01:56 2022] POST /compute/v2.1/flavors/602727717/os-extra_specs => generated 66 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:56.671985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.673123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:56.675624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:56.682858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:56.683615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:56.684675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:56.688876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:56.697625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:56.719553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:56.726283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:56.731395 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac0a98e2-569e-424b-bcec-65c97c0695ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 0.927767 Jul 02 21:01:56.733657 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 192/362] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:55 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:56.758216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03608926-3430-4062-a016-59c506b80a3a tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe50000d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.813533 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03608926-3430-4062-a016-59c506b80a3a tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713137201" status: 202 len: 0 microversion: 2.1 time: 0.078458 Jul 02 21:01:56.814157 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 193/363] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:01:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1713137201 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:56.841031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-753d9237-3f21-4a29-a1c7-84bf424adff3 tempest-FlavorsExtraSpecsTestJSON-146844421 tempest-FlavorsExtraSpecsTestJSON-146844421-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.872410 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-753d9237-3f21-4a29-a1c7-84bf424adff3 tempest-FlavorsExtraSpecsTestJSON-146844421 tempest-FlavorsExtraSpecsTestJSON-146844421-project] 10.222.0.43 "GET /compute/v2.1/flavors/602727717/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.057005 Jul 02 21:01:56.873281 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 194/364] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:01:56 2022] GET /compute/v2.1/flavors/602727717/os-extra_specs/hw:numa_nodes => generated 22 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:56.880528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:56.881423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:56.889969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:56.891096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:56.892602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:56.893684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:57.138728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:57.150627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2083e6f8-110b-407f-8f9f-945d5955cd51 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 0.486601 Jul 02 21:01:57.153088 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 171/365] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:56 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:57.167183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9652b1c1-dc1f-45c7-a4dc-8d275029cc07 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Action: 'create', calling method: .version_select at 0x7fabe506aca0>, body: {"keypair": {"name": "tempest-keypair-657521142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtSRTQHTTfAWH4N9mMoJfC3TPVIHijDu+IcXGGQdYe9CV900b2xAaXlq7D7WU+6fKeCzOMOJJZqNbTLhiHlg9aQDU3OzmXk5Kx2Zy97Q+jrlUAeHOQoh0da5lVAR+W2tg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.199850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9652b1c1-dc1f-45c7-a4dc-8d275029cc07 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:57.200164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:57.210065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9652b1c1-dc1f-45c7-a4dc-8d275029cc07 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for user aeca74e8f34544b49f4276aff011a596 and project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:57.210860 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccffa5b8-30eb-49ea-b454-4dacdc7dc003 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 0.336297 Jul 02 21:01:57.211619 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 195/366] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:56 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:57.230083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb30204c-cb70-4ffd-936a-b8ffe1b21444 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.233103 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:57.233103 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:57.255345 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9652b1c1-dc1f-45c7-a4dc-8d275029cc07 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.101030 Jul 02 21:01:57.257060 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 172/367] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:01:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:57.270352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c50f731-16f7-466e-b901-745a4dbd0348 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe50cc820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.284636 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb30204c-cb70-4ffd-936a-b8ffe1b21444 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072046 Jul 02 21:01:57.285236 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 196/368] 10.222.0.43 () {60 vars in 1220 bytes} [Sat Jul 2 21:01:57 2022] POST /compute/v2.1/flavors/602727717/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:57.308407 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c50f731-16f7-466e-b901-745a4dbd0348 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657521142" status: 202 len: 0 microversion: 2.1 time: 0.044776 Jul 02 21:01:57.309368 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 173/369] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657521142 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:57.311279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bcb94d4d-e87c-4f0a-96ef-d5d7274999c5 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.321657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd03503f-451a-4332-964f-dc82d37d2338 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Action: 'create', calling method: .version_select at 0x7fabe5076820>, body: {"keypair": {"name": "tempest-keypair-1900521450", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.322533 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bcb94d4d-e87c-4f0a-96ef-d5d7274999c5 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029624 Jul 02 21:01:57.323422 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 197/370] 10.222.0.43 () {58 vars in 1199 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/flavors/602727717/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:57.332885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ea4f9531-2dd8-471c-a68c-313bbb9881ec tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.334418 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:57.334418 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:57.339645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:57.358775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bd03503f-451a-4332-964f-dc82d37d2338 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:57.368760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bd03503f-451a-4332-964f-dc82d37d2338 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for user aeca74e8f34544b49f4276aff011a596 and project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:57.391074 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ea4f9531-2dd8-471c-a68c-313bbb9881ec tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "PUT /compute/v2.1/flavors/602727717/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.062557 Jul 02 21:01:57.391861 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 198/371] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:01:57 2022] PUT /compute/v2.1/flavors/602727717/os-extra_specs/hw:numa_nodes => generated 22 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 02 21:01:57.406199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ad89a63-0dfc-4192-bcc7-78f0af3564e7 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.411832 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd03503f-451a-4332-964f-dc82d37d2338 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.096805 Jul 02 21:01:57.414699 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 174/372] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:01:57 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:57.426049 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ad89a63-0dfc-4192-bcc7-78f0af3564e7 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027912 Jul 02 21:01:57.427141 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 199/373] 10.222.0.43 () {58 vars in 1199 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/flavors/602727717/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:57.429217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6bc0faa-eccd-442e-924f-800f578788ec tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe50760d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.437262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b705631-c7c6-4620-96a3-c1dd9c931758 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.438427 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:57.438427 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:57.447010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=27 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:01:57.469370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6bc0faa-eccd-442e-924f-800f578788ec tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900521450" status: 202 len: 0 microversion: 2.1 time: 0.046561 Jul 02 21:01:57.469946 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 175/374] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900521450 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:57.475160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.475787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:57.486980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:57.487500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:57.487973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b705631-c7c6-4620-96a3-c1dd9c931758 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/602727717/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.054657 Jul 02 21:01:57.488277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:57.488715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:57.496188 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 200/375] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/flavors/602727717/os-extra_specs/hw:numa_nodes => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:57.505500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ee96585-7329-454b-aeab-49de288d49d8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Action: 'create', calling method: .version_select at 0x7fabe50c4f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-217072518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt4NR6EKWByp2rH2MSEcDECGKLObRDrdBDjLaryhKamX7qmKAstZfTsEfcfLoPDDn24KLgvgNkIqB7hDUm5j8rSmKPGFojTWKsXydjRhMZryKi/1m+iLXwn8TDKMs1fkA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.533132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-2ee96585-7329-454b-aeab-49de288d49d8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:57.539066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-2ee96585-7329-454b-aeab-49de288d49d8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for user aeca74e8f34544b49f4276aff011a596 and project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:57.571833 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ee96585-7329-454b-aeab-49de288d49d8 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.074692 Jul 02 21:01:57.572949 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 201/376] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:01:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:57.577727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7721a87d-9b22-4dbc-ad04-969c3adf32c7 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.605162 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7721a87d-9b22-4dbc-ad04-969c3adf32c7 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/602727717/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.028853 Jul 02 21:01:57.606045 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 202/377] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/flavors/602727717/os-extra_specs/hw:cpu_policy => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:01:57.611000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1d7a23b-452b-4ae2-b7f8-5d94f1c61ee6 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Action: 'create', calling method: .version_select at 0x7fabe50c48b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1286411983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5e3JrKGTADO1t4RBwU/C5RXidzY7EwEYr36CInW4VtrFdhMEH2Yb+KhAuxwk/phf8qiaf4eWKNmsh4Yl8LJhyOM+sv8eF+nFRUflII5s8DA/fa6lcyICqVbwBGjRC2RA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.627325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f1d7a23b-452b-4ae2-b7f8-5d94f1c61ee6 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:57.634358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f1d7a23b-452b-4ae2-b7f8-5d94f1c61ee6 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for user aeca74e8f34544b49f4276aff011a596 and project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:57.665297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:57.679247 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df0f62db-ebba-4f03-a80e-6db4718d4b34 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1273 microversion: 2.1 time: 0.207878 Jul 02 21:01:57.680181 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f1d7a23b-452b-4ae2-b7f8-5d94f1c61ee6 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.071078 Jul 02 21:01:57.681070 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 176/378] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:57.681680 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 203/379] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:01:57 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:57.686873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fbd38976-b9fb-4f25-ba73-2702503d0022 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.705205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1db09eaa-5eaa-4601-a09d-00772739d2ca tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Action: 'create', calling method: .version_select at 0x7fabe506a940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-239431343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzvMNq7ZErgPE8PKSLKLRg/NrCXLesScfm1QPvRZn2U3VNweiJl7RUgwzfOIdhDyAr6wkYy+1e0tgO3laNRwrZF30/o1XXFrQVpYbQEGoI311+yqX94moMGfNKJDKKDUw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:57.714308 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fbd38976-b9fb-4f25-ba73-2702503d0022 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/602727717/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031299 Jul 02 21:01:57.714895 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 204/380] 10.222.0.43 () {58 vars in 1199 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/flavors/602727717/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:01:57.729222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f02c7bc-d2df-4407-a988-c2c8641a9f53 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.730182 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:01:57.730182 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:01:57.742252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1db09eaa-5eaa-4601-a09d-00772739d2ca tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:01:57.774660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1db09eaa-5eaa-4601-a09d-00772739d2ca tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Getting quotas for user aeca74e8f34544b49f4276aff011a596 and project cf58f8d6d237407ca69b667e089ef5e5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:01:57.775351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f02c7bc-d2df-4407-a988-c2c8641a9f53 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/602727717" status: 202 len: 0 microversion: 2.1 time: 0.049969 Jul 02 21:01:57.776316 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 205/381] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/flavors/602727717 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:57.781649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.782534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:57.797533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:57.798237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:57.799208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:57.800680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:57.842476 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1db09eaa-5eaa-4601-a09d-00772739d2ca tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.140767 Jul 02 21:01:57.847377 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 177/382] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:01:57 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:01:57.854957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22c90539-66a4-4952-b341-2e0d3f907b51 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.878265 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22c90539-66a4-4952-b341-2e0d3f907b51 tempest-FlavorsExtraSpecsTestJSON-1455725078 tempest-FlavorsExtraSpecsTestJSON-1455725078-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033567 Jul 02 21:01:57.892625 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 178/383] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:57.901313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e2550d5-7e33-4365-9f5e-fa0634c58485 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe50cc040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.904794 ncdv-master-1 devstack@n-api.service[131044]: WARNING oslo_db.sqlalchemy.utils [None req-0e2550d5-7e33-4365-9f5e-fa0634c58485 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 02 21:01:57.911360 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e2550d5-7e33-4365-9f5e-fa0634c58485 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.017441 Jul 02 21:01:57.912024 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 179/384] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:01:57.924411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9460f527-4297-4244-8444-4032629a91ba tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe506a430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.946767 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9460f527-4297-4244-8444-4032629a91ba tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-239431343" status: 202 len: 0 microversion: 2.1 time: 0.028118 Jul 02 21:01:57.951941 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 180/385] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-239431343 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:57.958182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c106e22-d2e5-4743-9b2e-1b670e2a9289 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe513c940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:57.987529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c106e22-d2e5-4743-9b2e-1b670e2a9289 tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1286411983" status: 202 len: 0 microversion: 2.1 time: 0.034083 Jul 02 21:01:57.988313 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 181/386] 10.222.0.43 () {58 vars in 1277 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1286411983 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:57.998231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-472f5c23-dc4c-4be5-b87d-4b9b2e487f6c tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] Calling method '.version_select at 0x7fabe5076940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:58.029211 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-472f5c23-dc4c-4be5-b87d-4b9b2e487f6c tempest-KeyPairsV2TestJSON-1077448554 tempest-KeyPairsV2TestJSON-1077448554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-217072518" status: 202 len: 0 microversion: 2.1 time: 0.033224 Jul 02 21:01:58.042074 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 182/387] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-217072518 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:01:58.172178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:58.173101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:58.189512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:58.189972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:58.196566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:58.197214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:58.954169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:58.963559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:58.965134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:58.966276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fb0bec5f-5d33-474a-b0f5-55a71ed63983 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1362 microversion: 2.25 time: 1.188950 Jul 02 21:01:58.973994 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 206/388] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:01:57 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1362 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:01:58.984074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:58.985005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:59.002075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:59.002732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:59.003783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:59.004400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:59.605729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:01:59.618992 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a9eaa6e-633b-4388-adf5-bbd4c72f7ba1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 1.453022 Jul 02 21:01:59.621526 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 183/389] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:58 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:01:59.626556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0c9cec92-13c0-4ba4-861d-b16ac9c57a26 req-b74d999e-d9fd-4ec5-9585-bc2d2790ff07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899cd575-ce36-4ba9-b0a3-5d4704088bf1", "name": "network-vif-plugged", "status": "completed", "tag": "e65b2ade-ed92-4c7c-a3c0-c39004944454"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:01:59.672009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c9cec92-13c0-4ba4-861d-b16ac9c57a26 req-b74d999e-d9fd-4ec5-9585-bc2d2790ff07 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:59.673569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c9cec92-13c0-4ba4-861d-b16ac9c57a26 req-b74d999e-d9fd-4ec5-9585-bc2d2790ff07 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:59.705080 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c9cec92-13c0-4ba4-861d-b16ac9c57a26 req-b74d999e-d9fd-4ec5-9585-bc2d2790ff07 service nova] Creating event network-vif-plugged:e65b2ade-ed92-4c7c-a3c0-c39004944454 for instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 on nch2-master-1 Jul 02 21:01:59.730750 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0c9cec92-13c0-4ba4-861d-b16ac9c57a26 req-b74d999e-d9fd-4ec5-9585-bc2d2790ff07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103622 Jul 02 21:01:59.734096 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 184/390] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:01:59.785451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:01:59.788714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:01:59.853769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:59.860570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:01:59.864031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:01:59.867209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:00.207220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:00.217160 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12322cf2-49fb-451f-81cb-45a1bb062e9d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1271 microversion: 2.1 time: 0.455531 Jul 02 21:02:00.230363 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 185/391] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:59 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1271 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:00.236436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:00.237345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:00.243991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:00.244785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:00.245815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:00.246485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:00.266129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:00.281027 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ea223b7-d4ca-47de-8324-e5b4c43bff50 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 1.305383 Jul 02 21:02:00.290753 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 207/392] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:01:58 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:00.637294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:00.637912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:00.653278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:00.654539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:00.657588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:00.658798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:00.726463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:01.345299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:01.362866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:01.365881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:01.370404 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67571e0e-1eab-4384-baa5-814e507528b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1558 microversion: 2.25 time: 1.137580 Jul 02 21:02:01.372077 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 186/393] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:00 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1558 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:01.662598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:01.677327 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf6277cf-9ce0-44b4-92ba-fbc6fd673f32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1315 microversion: 2.1 time: 1.044690 Jul 02 21:02:01.677969 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 208/394] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:00 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:01.687259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:01.687812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:01.711825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:01.715022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:01.716740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:01.724976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:01.961609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a56b543-2238-4523-aabf-942095078239 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe513ca60>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdaJLdnFYunkWu0zspbGZrSs1MqGHzgB/h2i3If/Ph4aibFAirlZNEPWFaH3QObW8KE16rpu1OIwKyOZdwemiu1WybuhCBEe+05jiXPT4MkBm9oYVGEz+MD/Hwtnko+cg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:01.971142 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8a56b543-2238-4523-aabf-942095078239 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a56b543-2238-4523-aabf-942095078239 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 257 Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:01.976877 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdaJLdnFYunkWu0zspbGZrSs1MqGHzgB/h2i3If/Ph4aibFAirlZNEPWFaH3QObW8KE16rpu1OIwKyOZdwemiu1WybuhCBEe+05jiXPT4MkBm9oYVGEz+MD/Hwtnko+cg=="}} Jul 02 21:02:01.978222 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdaJLdnFYunkWu0zspbGZrSs1MqGHzgB/h2i3If/Ph4aibFAirlZNEPWFaH3QObW8KE16rpu1OIwKyOZdwemiu1WybuhCBEe+05jiXPT4MkBm9oYVGEz+MD/Hwtnko+cg=='}}} Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 02 21:02:01.978918 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 02 21:02:01.979923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 02 21:02:01.981727 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:01.984272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a56b543-2238-4523-aabf-942095078239 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:01.985337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a56b543-2238-4523-aabf-942095078239 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.612043 Jul 02 21:02:01.990960 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 187/395] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:01 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 618 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:02:01.997042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:01.998045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:02.007779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:02.008619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:02.009646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:02.010290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:02.046354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:02.059559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e02b2797-c857-4c24-ba10-c84d80ef1654 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1271 microversion: 2.1 time: 0.380405 Jul 02 21:02:02.060381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 209/396] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:01 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1271 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:02.299510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:02.300203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:02.311633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:02.312810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:02.314241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:02.315588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.204284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:03.212253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid cb1aece9-4d7e-4240-9645-4ff29fa23d8c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:03.220171 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52c97009-62a7-4b62-b12d-cfc65cb8caad tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 1.224979 Jul 02 21:02:03.233867 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 188/397] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:01 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:03.260643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe50cc1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1167990742", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:03.289802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe360938-7241-44e3-b292-2a200a9b75ef tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 2051 microversion: 2.25 time: 1.219058 Jul 02 21:02:03.290274 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 210/398] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:02 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 2051 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:03.302890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:03.304260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:03.313048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:03.313818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.315352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:03.315999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.329571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:03.347498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for user f946f72c764940c5818854d5a6323f3f and project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:03.407326 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 2167 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1167990742", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:03.425038 ncdv-master-1 devstack@n-api.service[131044]: exception: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1167990742', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:03.427446 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:03.430453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:03.436102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:03.437178 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8091d0c9-e0a9-4658-b95f-e9cb702d4cdc tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.201697 Jul 02 21:02:03.438282 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 189/399] 10.222.0.43 () {60 vars in 1159 bytes} [Sat Jul 2 21:02:03 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:03.452871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:03.455089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:03.467067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:03.467558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.468443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:03.472590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.613653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:03.669903 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32fcfa34-5d74-455e-b625-114db29d0489 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1464 microversion: 2.1 time: 0.376321 Jul 02 21:02:03.673393 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 211/400] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:03 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1464 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:03.682526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:03.686838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:03.699582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:03.703244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.704288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:03.705342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:03.719075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:03.730310 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7efae40-4da7-49e0-a7bc-7b999e6919e2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1271 microversion: 2.1 time: 0.289054 Jul 02 21:02:03.733622 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 190/401] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:03 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:03.755860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d59f003a-6bc2-4b52-8468-86b294386766 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe513c1f0>, body: {"keypair": {"name": "tempest-keypair-384289979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4BzjPf3m8jvPrVA1uA8W95/9s8l8mQA8dwiBbWZvz8Tz6WL7uMty9zzJhpBcvg1veyOQO2x7d1Zu/vPtqr1rt1EfBCDRMRJKfYTh5jZpItXuDAzcjRxXMWFn6tncbJTg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:03.790911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d59f003a-6bc2-4b52-8468-86b294386766 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:03.797847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d59f003a-6bc2-4b52-8468-86b294386766 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for user f946f72c764940c5818854d5a6323f3f and project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:03.831556 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d59f003a-6bc2-4b52-8468-86b294386766 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087255 Jul 02 21:02:03.833595 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 191/402] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:04.102886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid cb1aece9-4d7e-4240-9645-4ff29fa23d8c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:04.137128 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-518faa87-9953-4a8b-8aaf-9b10a18e81de tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 2051 microversion: 2.25 time: 0.460994 Jul 02 21:02:04.153581 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 212/403] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:03 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 2051 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:04.163717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe5037430>, body: {"keypair": {"name": "tempest-keypair-384289979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVPLOs9HsV8qIZ6YSoks6XWk7mnUy6u4QlLsK+pqrVlKHN/AnJvE0IToEhFYsIz1MQfgARaEvsfoM5kzbPBJxLlNC0is9JtoNbsIrJL9eGY5zkPOlnjitUVlYzxYz12OA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:04.204544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:04.214942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for user f946f72c764940c5818854d5a6323f3f and project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:04.255745 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] HTTP exception thrown: Key pair 'tempest-keypair-384289979' already exists. Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 272 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: {"keypair": {"name": "tempest-keypair-384289979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVPLOs9HsV8qIZ6YSoks6XWk7mnUy6u4QlLsK+pqrVlKHN/AnJvE0IToEhFYsIz1MQfgARaEvsfoM5kzbPBJxLlNC0is9JtoNbsIrJL9eGY5zkPOlnjitUVlYzxYz12OA=="}} Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: exception: Key pair 'tempest-keypair-384289979' already exists. Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-384289979', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVPLOs9HsV8qIZ6YSoks6XWk7mnUy6u4QlLsK+pqrVlKHN/AnJvE0IToEhFYsIz1MQfgARaEvsfoM5kzbPBJxLlNC0is9JtoNbsIrJL9eGY5zkPOlnjitUVlYzxYz12OA=='}}} Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result.read() Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f946f72c764940c5818854d5a6323f3f-tempest-keypair-384289979' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 02 21:02:04.272201 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi session.flush() Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result.read() Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 02 21:02:04.276779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f946f72c764940c5818854d5a6323f3f-tempest-keypair-384289979' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 2, 21, 2, 4, 242727), 'updated_at': None, 'name': 'tempest-keypair-384289979', 'user_id': 'f946f72c764940c5818854d5a6323f3f', 'fingerprint': '93:d4:ec:d6:b1:f3:96:73:c0:1e:34:0d:28:85:f3:b5', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVPLOs9HsV8qIZ6YSoks6XWk7mnUy6u4QlLsK+pqrVlKHN/AnJvE0IToEhFYsIz1MQfgARaEvsfoM5kzbPBJxLlNC0is9JtoNbsIrJL9eGY5zkPOlnjitUVlYzxYz12OA==', 'type': 'ssh'}] Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi keypair.create() Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._create() Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-384289979' already exists. Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 02 21:02:04.283162 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-384289979' already exists. Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-384289979' already exists. Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:04.291752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 409 to user: Key pair 'tempest-keypair-384289979' already exists. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:04.294170 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4fa08fa9-b33c-4d80-b733-03ae43e4609a tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.138986 Jul 02 21:02:04.295358 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 213/404] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:04 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:02:04.311343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a48456f7-b2df-4c6b-9491-e2d01d744a2a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:04.316820 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:04.316820 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:02:04.322213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48456f7-b2df-4c6b-9491-e2d01d744a2a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:04.323093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48456f7-b2df-4c6b-9491-e2d01d744a2a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:04.325527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48456f7-b2df-4c6b-9491-e2d01d744a2a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:04.326222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48456f7-b2df-4c6b-9491-e2d01d744a2a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:04.409134 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a48456f7-b2df-4c6b-9491-e2d01d744a2a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.112358 Jul 02 21:02:04.411336 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 214/405] 10.222.0.43 () {60 vars in 1216 bytes} [Sat Jul 2 21:02:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:02:04.427576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:04.430599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:04.455619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:04.457395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:04.461163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:04.463742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:04.564365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:04.566059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:04.579145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:04.586690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:04.587788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:04.589675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:05.129110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:05.141438 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-026383c4-f6a8-4d79-bc36-b8298ab9d8b3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 0.727080 Jul 02 21:02:05.142606 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 215/406] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:04 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:05.149118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-43f42bdc-6c04-437e-9fa9-982f9562a114 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Calling method '.version_select at 0x7fabe4db0430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:05.182698 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-43f42bdc-6c04-437e-9fa9-982f9562a114 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-384289979" status: 202 len: 0 microversion: 2.1 time: 0.038374 Jul 02 21:02:05.184084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 216/407] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:02:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-384289979 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:02:05.185581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-43f42bdc-6c04-437e-9fa9-982f9562a114 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:05.186743 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-43f42bdc-6c04-437e-9fa9-982f9562a114 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001316 Jul 02 21:02:05.187550 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 217/408] 10.222.0.43 () {56 vars in 885 bytes} [Sat Jul 2 21:02:05 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 02 21:02:05.197426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:05.205967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:05.231053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:05.232500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:05.233552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:05.234268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:05.306392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:05.459791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'flavor' on Instance uuid cb1aece9-4d7e-4240-9645-4ff29fa23d8c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:05.571133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Going to try to live migrate instance to nch2-master-1 {{(pid=131045) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:02:05.613352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=84,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=6,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:05.659694 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24684111-a630-478f-a8c9-f80d1cf29ff3 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1615 microversion: 2.1 time: 1.824478 Jul 02 21:02:05.673314 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 192/409] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:03 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1615 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:05.680543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:05.681836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:05.685848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:05.695425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:05.696515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:05.697829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:05.698548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:06.283907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:06.297676 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4537332-0f5c-46b5-ac6c-c60503b14795 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1313 microversion: 2.1 time: 0.622721 Jul 02 21:02:06.302527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 193/410] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:05 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1313 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:06.320373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0646a306-1334-4b11-a12f-37615a62dae1 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe513ce50>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5mduQgyRGgM4EACkC7cOHMUKs+saR+oRzZNq0VgLBrTgU80EKRKUuuvPh33VWoPLcRBw8ocBPNnQTXX/ZGjAxPjfWZkGn7GbFhNTp8tr4XYKK1pkUYb3Ar2SfolRAuig=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0646a306-1334-4b11-a12f-37615a62dae1 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 247 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5mduQgyRGgM4EACkC7cOHMUKs+saR+oRzZNq0VgLBrTgU80EKRKUuuvPh33VWoPLcRBw8ocBPNnQTXX/ZGjAxPjfWZkGn7GbFhNTp8tr4XYKK1pkUYb3Ar2SfolRAuig=="}} Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG5mduQgyRGgM4EACkC7cOHMUKs+saR+oRzZNq0VgLBrTgU80EKRKUuuvPh33VWoPLcRBw8ocBPNnQTXX/ZGjAxPjfWZkGn7GbFhNTp8tr4XYKK1pkUYb3Ar2SfolRAuig=='}}} Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '' Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:02:06.323275 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:02:06.327022 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:06.330257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0646a306-1334-4b11-a12f-37615a62dae1 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:06.331394 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0646a306-1334-4b11-a12f-37615a62dae1 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017395 Jul 02 21:02:06.333113 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 194/411] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:06 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:02:06.340680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a074dfe0-41d7-4bb4-8772-0d637dc42306 req-27a59d63-ed15-4ab1-8080-032b0deade61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c62d127-b0f0-46b8-a871-189a1b7cb318", "name": "network-vif-plugged", "status": "completed", "tag": "7858a005-485f-44b4-bb30-51746869e7f9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:06.354850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a074dfe0-41d7-4bb4-8772-0d637dc42306 req-27a59d63-ed15-4ab1-8080-032b0deade61 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:06.355614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a074dfe0-41d7-4bb4-8772-0d637dc42306 req-27a59d63-ed15-4ab1-8080-032b0deade61 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:06.370718 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a074dfe0-41d7-4bb4-8772-0d637dc42306 req-27a59d63-ed15-4ab1-8080-032b0deade61 service nova] Creating event network-vif-plugged:7858a005-485f-44b4-bb30-51746869e7f9 for instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 on nch2-master-1 Jul 02 21:02:06.384088 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a074dfe0-41d7-4bb4-8772-0d637dc42306 req-27a59d63-ed15-4ab1-8080-032b0deade61 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048805 Jul 02 21:02:06.385563 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 195/412] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:06.393267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74342325-7686-4aad-886e-a5c2c8e8570c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: .version_select at 0x7fabe515b3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-214793032", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:06.419184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-74342325-7686-4aad-886e-a5c2c8e8570c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:06.434734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-74342325-7686-4aad-886e-a5c2c8e8570c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:06.563291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-74342325-7686-4aad-886e-a5c2c8e8570c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:06.577875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-74342325-7686-4aad-886e-a5c2c8e8570c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:06.606539 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74342325-7686-4aad-886e-a5c2c8e8570c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.219341 Jul 02 21:02:06.616966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 196/413] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:02:06 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:06.641300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a0fb628b-ff2f-4fca-a3e2-8619f51898e3 req-87f44eec-cecb-4295-b9bb-9869ebea5366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80f49de-27ea-4b1a-ad57-fec4b4c03605", "tag": "09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:06.678273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a0fb628b-ff2f-4fca-a3e2-8619f51898e3 req-87f44eec-cecb-4295-b9bb-9869ebea5366 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:06.693413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a0fb628b-ff2f-4fca-a3e2-8619f51898e3 req-87f44eec-cecb-4295-b9bb-9869ebea5366 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:06.724105 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a0fb628b-ff2f-4fca-a3e2-8619f51898e3 req-87f44eec-cecb-4295-b9bb-9869ebea5366 service nova] Creating event network-changed:09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009 for instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 on nch1-master-1 Jul 02 21:02:06.732600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a0fb628b-ff2f-4fca-a3e2-8619f51898e3 req-87f44eec-cecb-4295-b9bb-9869ebea5366 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123759 Jul 02 21:02:06.742607 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 197/414] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:06.754457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:06.759003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:06.775880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:06.781631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:06.785225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:06.785872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:07.402653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:07.416276 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1dcb4a3-d227-4979-8fde-44af56040726 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1320 microversion: 2.1 time: 0.670343 Jul 02 21:02:07.418961 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 198/415] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:06 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1320 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:07.435866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe5076d30>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1755091150", "public_key": " "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:07.513070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:07.526996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for user f946f72c764940c5818854d5a6323f3f and project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:07.563082 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 95 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1755091150", "public_key": " "}} Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: exception: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1755091150', 'public_key': ' '}}} Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:07.566929 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:07.571138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:07.591788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:07.594385 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b07dfa50-8aee-41a1-90f0-3fd29d7c72a8 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.172997 Jul 02 21:02:07.597428 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 199/416] 10.222.0.43 () {60 vars in 1157 bytes} [Sat Jul 2 21:02:07 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:07.610896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-912852208", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8d8c9511-c757-4e45-bacd-ad2cf311eef3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:07.708087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:02:08.111176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:08.111560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:08.112399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:08.112821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:08.113537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:08.169034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:08.169834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:08.170788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:08.171390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:08.195148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:08.208963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:08.214985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:08.232683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Going to run 2 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:02:08.235247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:08.275884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131044) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 02 21:02:08.298728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:08.309839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:08.377073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:08.385924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:08.416131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=927b6d45-bb13-4123-80c2-dfc0f800e76d,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:08.486134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:08.491661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:08.494210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:08.536779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:08.542556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:08.583113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-424a1530-5497-4b60-a6e0-e8fae8baf3c0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.982575 Jul 02 21:02:08.584103 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 200/417] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:02:08.588779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:08.589382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:08.596075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:08.596531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:08.597305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:08.597733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:08.856220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:08.869730 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28d4453f-59df-4721-9740-c0314b1bdefe tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1313 microversion: 2.1 time: 0.284431 Jul 02 21:02:08.871086 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 201/418] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:08 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:09.491241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0de68b97-3c3f-4ca8-853d-fde3fbb974e8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:09.504020 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0de68b97-3c3f-4ca8-853d-fde3fbb974e8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.631680 Jul 02 21:02:09.532796 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 202/419] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:02:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:09.546171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2473fa87-6f7e-4c79-8dad-ecbc9648b0d4 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe4fb11f0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpiSzC/Hpav79jNgEO7BMymHs3eXFRzon6WalKmdg7FGOBeOafEkK1Plw4Wnx/7GsLhzr/zLYDP8DTFF3rhSuoCyC9kQW9/UIY12BVv45xM/IFNJAkFtnC1eyBZVp3OoQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2473fa87-6f7e-4c79-8dad-ecbc9648b0d4 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 507 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpiSzC/Hpav79jNgEO7BMymHs3eXFRzon6WalKmdg7FGOBeOafEkK1Plw4Wnx/7GsLhzr/zLYDP8DTFF3rhSuoCyC9kQW9/UIY12BVv45xM/IFNJAkFtnC1eyBZVp3OoQ=="}} Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpiSzC/Hpav79jNgEO7BMymHs3eXFRzon6WalKmdg7FGOBeOafEkK1Plw4Wnx/7GsLhzr/zLYDP8DTFF3rhSuoCyC9kQW9/UIY12BVv45xM/IFNJAkFtnC1eyBZVp3OoQ=='}}} Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 02 21:02:09.554810 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2473fa87-6f7e-4c79-8dad-ecbc9648b0d4 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2473fa87-6f7e-4c79-8dad-ecbc9648b0d4 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.022224 Jul 02 21:02:09.558485 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 203/420] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:09 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:02:09.582277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:09.588452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:09.605352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:09.606052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:09.613797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:09.614690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:10.629310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:10.665170 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4da26f8c-a2bd-42c1-8e30-666d975f98a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1469 microversion: 2.1 time: 1.083583 Jul 02 21:02:10.678466 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 204/421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:09 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1469 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:10.703791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:10.716290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:10.717493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Searching by: {'deleted': False, 'project_id': '065f852898294f2c8a154eb8d5f498f0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:02:10.748127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:10.749286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:10.750297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:10.750929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:10.886853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:02:11.107230 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f72722b-5a29-4d39-800a-1ec3489ff8d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.427184 Jul 02 21:02:11.107826 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 205/422] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:02:10 2022] GET /compute/v2.1/servers => generated 1000 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:11.291624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4c5ad0c-d2dc-4b5f-ac31-1a514250dea8 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1809202296", "id": 1875449373, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:11.293444 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:11.293444 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:02:11.315314 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4c5ad0c-d2dc-4b5f-ac31-1a514250dea8 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.201697 Jul 02 21:02:11.315919 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 206/423] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:11 2022] POST /compute/v2.1/flavors => generated 425 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:11.333234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Action: 'create', calling method: .version_select at 0x7fabe4f8a940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1765036282", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:11.351087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:11.360542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Getting quotas for user f946f72c764940c5818854d5a6323f3f and project 072e342f5fb4457f9051c6e61aff4725. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:11.386432 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 118 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1765036282", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: exception: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1765036282', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 02 21:02:11.388539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 02 21:02:11.392101 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:11.395741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:11.396930 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8a12a8e-737c-4b59-9eed-8c0f1f1f58f7 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.079421 Jul 02 21:02:11.398055 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 207/424] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:02:11.404969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:11.406289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:11.414670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:11.415373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:11.416499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:11.417650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:11.979396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07ca94fc-d7d6-47be-aeab-6d6c53df4d56 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c/action" status: 202 len: 0 microversion: 2.25 time: 6.790220 Jul 02 21:02:11.980604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 218/425] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:02:05 2022] POST /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c/action => generated 0 bytes in 6792 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:02:12.030020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:12.045323 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb38b785-691c-4cb8-a24f-5a86cf060b97 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1313 microversion: 2.1 time: 0.645777 Jul 02 21:02:12.048712 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 208/426] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:11 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:12.061398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:12.062029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:12.087846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.099200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.100011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.107552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.282264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:12.283112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:12.296559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.297304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.298396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.299138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.339747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:02:12.346315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:12.355323 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe44904e-ca31-4d1f-af65-55fe84748e37 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1276 microversion: 2.1 time: 0.305309 Jul 02 21:02:12.373082 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 209/427] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:12 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1276 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:12.378228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ecaccde0-f1b6-42e4-adc7-885dcefd114a tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:12.405170 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ecaccde0-f1b6-42e4-adc7-885dcefd114a tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029881 Jul 02 21:02:12.412859 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 210/428] 10.222.0.43 () {58 vars in 1181 bytes} [Sat Jul 2 21:02:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:02:12.421030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98c96f3c-f48b-42a4-b05f-15fd7fee1535 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Calling method '.version_select at 0x7fabe4eb3af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:12.436359 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-98c96f3c-f48b-42a4-b05f-15fd7fee1535 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1792709417 not found for user f946f72c764940c5818854d5a6323f3f Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98c96f3c-f48b-42a4-b05f-15fd7fee1535 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Request method failure captured: Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1792709417 HTTP/1.1 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJIJ8BZTSA-gHFW-_oIFnxkgEB-tOBkSmePloE_vG7pq-CvxbFu7yqYFOt7FFEKr8pLYbASXR1qh5fccFZ_wBUwSdyEpwsYQY52-_Ea9IWWZZJsL64GxHVVIMG2ckcs3Jdx3X63rAbwIr3prfDT-3Axmd3qnw1yhyH6kUBdW9Y9Eak Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_072e342f5fb4457f9051c6e61aff4725", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/072e342f5fb4457f9051c6e61aff4725"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/072e342f5fb4457f9051c6e61aff4725"}]}] Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 072e342f5fb4457f9051c6e61aff4725 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2055864579 Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f946f72c764940c5818854d5a6323f3f Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2055864579-project Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: exception: Keypair tempest-keypair-non-existent-1792709417 not found for user f946f72c764940c5818854d5a6323f3f Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'tempest-keypair-non-existent-1792709417'} Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1792709417 not found for user f946f72c764940c5818854d5a6323f3f Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:12.439668 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1792709417 not found for user f946f72c764940c5818854d5a6323f3f Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1792709417 not found for user f946f72c764940c5818854d5a6323f3f Jul 02 21:02:12.445621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:12.455300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98c96f3c-f48b-42a4-b05f-15fd7fee1535 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1792709417 not found for user f946f72c764940c5818854d5a6323f3f {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:12.456533 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98c96f3c-f48b-42a4-b05f-15fd7fee1535 tempest-KeyPairsNegativeTestJSON-2055864579 tempest-KeyPairsNegativeTestJSON-2055864579-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1792709417" status: 404 len: 145 microversion: 2.1 time: 0.042413 Jul 02 21:02:12.463468 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 211/429] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:02:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1792709417 => generated 145 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:12.472891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:12.473984 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-061c3e04-3c13-4f22-81c6-1a5edda4914e tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 204 len: 0 microversion: 2.1 time: 0.490981 Jul 02 21:02:12.474874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:12.478673 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 219/430] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:02:11 2022] DELETE /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:02:12.489178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cf6bee66-c43a-46c6-87a6-c7b412441be2 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1840089196", "id": 616433894, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:12.490448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.491015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.493025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.493930 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:12.493930 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:02:12.494715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.533268 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cf6bee66-c43a-46c6-87a6-c7b412441be2 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.052055 Jul 02 21:02:12.536122 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 220/431] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:12 2022] POST /compute/v2.1/flavors => generated 422 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:12.548511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:12.551428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:12.558606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.559464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:12.560728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:12.561449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:14.022182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:14.044127 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4261543c-7182-497d-a08f-9457818670ca tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1475 microversion: 2.1 time: 1.506374 Jul 02 21:02:14.045277 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 221/432] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:12 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1475 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:14.051228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d2c72a99-99b6-4e9d-87dc-bba8b36dc522 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:14.072169 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d2c72a99-99b6-4e9d-87dc-bba8b36dc522 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025586 Jul 02 21:02:14.078868 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 222/433] 10.222.0.43 () {58 vars in 1181 bytes} [Sat Jul 2 21:02:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:02:14.091585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:14.092506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:14.106967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:14.108892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:14.110234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:14.112871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:14.119753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:14.131931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:14.136419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:14.137883 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c13c7a89-0c4d-4111-acd1-a6ccee7cc260 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 1.671927 Jul 02 21:02:14.141346 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 212/434] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:12 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:14.155817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d09c7c9a-4ab6-448c-a39d-d46c0966c3a2 req-1ac4f58c-8b9f-412f-a12a-42f6351559ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80f49de-27ea-4b1a-ad57-fec4b4c03605", "name": "network-vif-plugged", "status": "completed", "tag": "09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:14.164743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d09c7c9a-4ab6-448c-a39d-d46c0966c3a2 req-1ac4f58c-8b9f-412f-a12a-42f6351559ae service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:14.165486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d09c7c9a-4ab6-448c-a39d-d46c0966c3a2 req-1ac4f58c-8b9f-412f-a12a-42f6351559ae service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:14.179198 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d09c7c9a-4ab6-448c-a39d-d46c0966c3a2 req-1ac4f58c-8b9f-412f-a12a-42f6351559ae service nova] Creating event network-vif-plugged:09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009 for instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 on nch1-master-1 Jul 02 21:02:14.187708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d09c7c9a-4ab6-448c-a39d-d46c0966c3a2 req-1ac4f58c-8b9f-412f-a12a-42f6351559ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044884 Jul 02 21:02:14.188886 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 213/435] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:14.194609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:14.195707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:14.204005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:14.204763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:14.213641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:14.214304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:14.230572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=12 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:14.349023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:15.179826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:15.189076 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c7f785ec-64ad-43c9-bc5b-921fdf5ae6c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1313 microversion: 2.1 time: 1.108767 Jul 02 21:02:15.190817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 223/436] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:14 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1313 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:15.202289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ef90a32-c14a-4036-916a-d0a905220f62 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Action: 'create', calling method: .version_select at 0x7fabe4d09700>, body: {"keypair": {"name": "tempest-keypair-614579100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOtHRNUQxUFRh8/UadjqEA75RDfmjfWRBwjiy6nTjZUOUjHOgcyxtMSWfgbmUxxqDoG8VJu9FdYvGKhsQKhvEe/2n8T9/9E+RiSS276RO9LIbPQchjhiUFtj92URLfu3w=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:15.238681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3ef90a32-c14a-4036-916a-d0a905220f62 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Getting quotas for project f8920bed46d34026a06fedf429e5cca4. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:15.249118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3ef90a32-c14a-4036-916a-d0a905220f62 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Getting quotas for user a60bf5141fea499abb9b22658e56c944 and project f8920bed46d34026a06fedf429e5cca4. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:15.300918 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ef90a32-c14a-4036-916a-d0a905220f62 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.108044 Jul 02 21:02:15.302066 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 224/437] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:02:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:15.306555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:15.308912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:15.309813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:15.318377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:15.319120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:15.320460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:15.321049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:15.322916 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f27bb1b-f1b2-446a-b3e5-9a603d6b1361 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 1.132591 Jul 02 21:02:15.325491 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 214/438] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:14 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:15.351943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:15.352757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:15.363588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:15.368010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:15.370523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:15.374838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:16.301968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:16.316470 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b52039cb-7737-4000-953a-c0753d03abd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1475 microversion: 2.1 time: 1.012784 Jul 02 21:02:16.328405 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 225/439] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:15 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1475 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:16.334832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:16.335452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:16.356826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:16.357566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:16.358685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:16.361804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:16.471672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:16.494462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:16.496270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:16.497488 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e30cb6d5-cec7-4cbd-9fca-6530ad490e1b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 1.158489 Jul 02 21:02:16.498054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 215/440] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:15 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:16.517114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:16.521518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:16.533432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:16.534143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:16.535308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:16.535940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:17.404257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:17.411512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:17.415514 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae49478d-5f3f-4e48-bc72-9df32717f47e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 0.900310 Jul 02 21:02:17.418528 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 216/441] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:16 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:17.434817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:17.438416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:17.443843 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-24bbd428-cede-4280-8ad0-81799e650469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1313 microversion: 2.1 time: 1.112751 Jul 02 21:02:17.459871 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 226/442] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:16 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1313 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:17.467764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:17.470496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:17.474740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:17.475335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:17.488182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7e333ed4-c43d-44ef-8aa4-cc15ad37381c req-6ef3f465-bd0a-4e62-ad93-3872ed7b90dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927b6d45-bb13-4123-80c2-dfc0f800e76d", "tag": "ba68e899-968d-4623-8c74-12e2f2939804"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:17.519103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7e333ed4-c43d-44ef-8aa4-cc15ad37381c req-6ef3f465-bd0a-4e62-ad93-3872ed7b90dc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:17.520729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7e333ed4-c43d-44ef-8aa4-cc15ad37381c req-6ef3f465-bd0a-4e62-ad93-3872ed7b90dc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:17.535093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:17.537913 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7e333ed4-c43d-44ef-8aa4-cc15ad37381c req-6ef3f465-bd0a-4e62-ad93-3872ed7b90dc service nova] Creating event network-changed:ba68e899-968d-4623-8c74-12e2f2939804 for instance 927b6d45-bb13-4123-80c2-dfc0f800e76d on nch1-master-1 Jul 02 21:02:17.545006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7e333ed4-c43d-44ef-8aa4-cc15ad37381c req-6ef3f465-bd0a-4e62-ad93-3872ed7b90dc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067251 Jul 02 21:02:17.546032 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 227/443] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:17.557645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:17.558924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:17.568601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:17.569514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:17.572630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:17.574426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:18.153609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:18.175899 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1a7c2a1-f850-4b09-86dc-954780c6ffd0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 200 len: 1433 microversion: 2.1 time: 0.755962 Jul 02 21:02:18.188411 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 217/444] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:17 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 1433 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:18.208535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1ca940b6-b6c8-4863-a20a-bb0445d2a89e req-d6a66dc9-194a-4598-a250-84785e25d498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1aece9-4d7e-4240-9645-4ff29fa23d8c", "name": "network-vif-unplugged", "status": "completed", "tag": "97d0372f-9d42-420d-83a4-f34986f4a07d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:18.242872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1ca940b6-b6c8-4863-a20a-bb0445d2a89e req-d6a66dc9-194a-4598-a250-84785e25d498 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:18.253803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1ca940b6-b6c8-4863-a20a-bb0445d2a89e req-d6a66dc9-194a-4598-a250-84785e25d498 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:18.297363 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1ca940b6-b6c8-4863-a20a-bb0445d2a89e req-d6a66dc9-194a-4598-a250-84785e25d498 service nova] Creating event network-vif-unplugged:97d0372f-9d42-420d-83a4-f34986f4a07d for instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c on nch1-master-1 Jul 02 21:02:18.311978 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1ca940b6-b6c8-4863-a20a-bb0445d2a89e req-d6a66dc9-194a-4598-a250-84785e25d498 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125033 Jul 02 21:02:18.314889 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 218/445] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:18.342518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:18.354393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:18.357898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:18.362532 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26954a14-01fb-47e9-a308-884e35ece33e tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 0.815083 Jul 02 21:02:18.365015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 228/446] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:17 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:18.436908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:18.437629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:18.449075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:18.449526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:18.450326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:18.450752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:18.464891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:18.468589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:18.488971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:18.490214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:18.491082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:18.491519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:19.170920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:19.183171 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fcee0eba-de43-44be-b0c4-816a031de90d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1462 microversion: 2.1 time: 0.723482 Jul 02 21:02:19.184431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 229/447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:18 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1462 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:19.197161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:19.198139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:19.215966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:19.216756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:19.217854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:19.218499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:19.248475 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] HTTP exception thrown: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:19.248698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Request method failure captured: Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 HTTP/1.1 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIxupTgcTcdQkUc4LDOjhd12z2YLy71myxFAlvCDOBQGenNWXKt7EMZak7emTnRGzPRUBdU31hyq0A4psGhylbS0GHJNjD0hYyQfw6Al2-KmVRRqLrPRV1P3rG2rKuPidyvjbSYea531EnuYatOlZdNaHUwgczfPeQcTUiMWCJG0U8 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ae5fa728db84608bfaa558277a90b34", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ae5fa728db84608bfaa558277a90b34"}]}] Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fe262620110042f6baacf06dd51e0ddc Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9c62d127-b0f0-46b8-a871-189a1b7cb318'} Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:19.251195 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:19.255877 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:19.259171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Returning 404 to user: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:19.261968 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51059325-fb08-408e-b2b5-9440627197dc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 404 len: 111 microversion: 2.1 time: 0.069386 Jul 02 21:02:19.263337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bafd6bb9-c8d3-4a57-9318-08955b8a1fee tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 0.829127 Jul 02 21:02:19.265528 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 219/448] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:18 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:19.266035 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 230/449] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:19 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:19.393049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:19.395112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:19.422222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:19.425267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:19.428178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:19.429746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:19.852940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:19.853769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:19.862763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:19.863540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:19.864828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:19.865505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:20.268961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:20.278700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:20.286510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:20.294502 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d8abd7dd-037c-474f-91ce-838ece117569 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 0.914660 Jul 02 21:02:20.300486 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 231/450] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:19 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:20.317710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-523802107", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:20.437503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:02:20.809552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:21.282253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:21.283679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:21.285680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:21.286521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:21.287574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:21.304879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.305642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.306459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.306892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.331003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Getting quotas for project 8ae5fa728db84608bfaa558277a90b34. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:21.347092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Getting quotas for user fe262620110042f6baacf06dd51e0ddc and project 8ae5fa728db84608bfaa558277a90b34. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:21.367094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:02:21.371642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:21.374800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=69 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:21.408128 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0e6785d-c317-48b3-8676-d0e46758c3cf tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1613 microversion: 2.1 time: 2.140310 Jul 02 21:02:21.409237 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 220/451] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:19 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1613 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:21.426231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8eeb886f-01ab-4438-89b8-d9d68da5647b req-07644f19-e0f6-4df5-a34e-c13579dc088f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c62d127-b0f0-46b8-a871-189a1b7cb318", "name": "network-vif-deleted", "tag": "7858a005-485f-44b4-bb30-51746869e7f9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:21.470916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8eeb886f-01ab-4438-89b8-d9d68da5647b req-07644f19-e0f6-4df5-a34e-c13579dc088f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.471361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8eeb886f-01ab-4438-89b8-d9d68da5647b req-07644f19-e0f6-4df5-a34e-c13579dc088f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.521870 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8eeb886f-01ab-4438-89b8-d9d68da5647b req-07644f19-e0f6-4df5-a34e-c13579dc088f service nova] Creating event network-vif-deleted:7858a005-485f-44b4-bb30-51746869e7f9 for instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 on nch2-master-1 Jul 02 21:02:21.534099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8eeb886f-01ab-4438-89b8-d9d68da5647b req-07644f19-e0f6-4df5-a34e-c13579dc088f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119153 Jul 02 21:02:21.539820 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 221/452] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:21.556717 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49759e69-fcc7-4e57-a404-2f9b560c651c tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249691 Jul 02 21:02:21.559808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:21.560724 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 232/453] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:02:21.563501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:21.573614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5f850936-b4da-4d67-be47-fd7d53e0a0e0 req-b65a2247-073d-4911-bfa0-c34c4031f1ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb1aece9-4d7e-4240-9645-4ff29fa23d8c", "tag": "97d0372f-9d42-420d-83a4-f34986f4a07d"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:21.580122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.584352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.587106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.588671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.598955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5f850936-b4da-4d67-be47-fd7d53e0a0e0 req-b65a2247-073d-4911-bfa0-c34c4031f1ba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.600855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5f850936-b4da-4d67-be47-fd7d53e0a0e0 req-b65a2247-073d-4911-bfa0-c34c4031f1ba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.664503 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5f850936-b4da-4d67-be47-fd7d53e0a0e0 req-b65a2247-073d-4911-bfa0-c34c4031f1ba service nova] Creating event network-changed:97d0372f-9d42-420d-83a4-f34986f4a07d for instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c on nch1-master-1 Jul 02 21:02:21.675244 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5f850936-b4da-4d67-be47-fd7d53e0a0e0 req-b65a2247-073d-4911-bfa0-c34c4031f1ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111581 Jul 02 21:02:21.678145 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 233/454] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:21.690301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:21.692536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:21.713361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.713818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:21.715131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:21.715700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:22.350520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:22.360143 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d2d2127-6a38-4398-92dd-cf8ca18778ab tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 0.818318 Jul 02 21:02:22.372216 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 222/455] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:21 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:22.377692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:22.378867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:22.395025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:22.395802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:22.396840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:22.397855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:22.900152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:22.917414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:22.918953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:22.920226 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e11b5084-5c56-4d71-9146-5deb24074046 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 1.238937 Jul 02 21:02:22.920806 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 234/456] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:21 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:22.925642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:22.926254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:22.947087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:22.947542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:22.948451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:22.948817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:23.065175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1068ef10c5ca46619e6280360e5a0930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aacdf1893ae44e383bfc224b1e78784', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:23.065758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] flavor_id is None. Assuming migration. {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 02 21:02:23.066260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:02:23.491626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:23.505263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-36600835-506c-489a-9430-87d3c4c37853 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1271 microversion: 2.1 time: 0.583172 Jul 02 21:02:23.505822 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 235/457] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:22 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1271 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:23.600493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1169921132", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "49cbb4f5-eef9-4fda-a4e0-d3a303af09da"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:23.681914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] validate_networks() for [('49cbb4f5-eef9-4fda-a4e0-d3a303af09da', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:02:23.782160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:23.841015 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b4bef73-53e0-4a02-b08e-628a6f60bbc1 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605/action" status: 202 len: 0 microversion: 2.1 time: 1.465808 Jul 02 21:02:23.846922 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 223/458] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:02:22 2022] POST /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605/action => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:02:23.856245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:23.857311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:23.866268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:23.867077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:23.868185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:23.868778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:25.786208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:25.796614 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dc9f424-b93f-4509-9978-9ba9af914810 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 1.948004 Jul 02 21:02:25.800700 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 224/459] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:23 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:25.813199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9811b777-b68e-41eb-9af3-1a7f15c796af req-c412a1ae-3ff4-49dd-9840-94995e0645a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32b58f76-ef9b-4a64-aeb6-fac9c5f571c1", "tag": "a975ae6d-9495-4dca-883a-bab061d51fcd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:25.837246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9811b777-b68e-41eb-9af3-1a7f15c796af req-c412a1ae-3ff4-49dd-9840-94995e0645a9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:25.839196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9811b777-b68e-41eb-9af3-1a7f15c796af req-c412a1ae-3ff4-49dd-9840-94995e0645a9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:25.871518 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9811b777-b68e-41eb-9af3-1a7f15c796af req-c412a1ae-3ff4-49dd-9840-94995e0645a9 service nova] Creating event network-changed:a975ae6d-9495-4dca-883a-bab061d51fcd for instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 on nch1-master-1 Jul 02 21:02:25.883887 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9811b777-b68e-41eb-9af3-1a7f15c796af req-c412a1ae-3ff4-49dd-9840-94995e0645a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074515 Jul 02 21:02:25.884618 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 225/460] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:25.904971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:25.906391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:25.942920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:25.943581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:25.944575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:25.945174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:27.210104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:27.211090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:27.211719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:27.212460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:27.213458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:27.226050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:27.226815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:27.227937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:27.228607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:27.315187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Getting quotas for project 4c4a0acce7ef425b93c417e1a8fccf78. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:27.332866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Getting quotas for user b16a9c9e35954d579536375f7eab1c9b and project 4c4a0acce7ef425b93c417e1a8fccf78. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:27.362223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:02:27.369218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:27.490700 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93c3ca3c-ad68-4137-a5c3-298785385a93 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.983586 Jul 02 21:02:27.491655 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 236/461] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:02:27.505416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:27.513659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:27.522866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:27.523688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:27.526033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:27.526745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:28.029589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:28.046837 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f6f9701-8d12-4c3a-ad02-624e85bad076 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1471 microversion: 2.1 time: 2.149928 Jul 02 21:02:28.057044 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 226/462] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:25 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1471 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:28.065432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:28.066970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:28.090411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:28.092067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:28.094384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:28.095063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:28.404404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:28.418675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-766900b7-d559-45d1-9039-4528a26dbc66 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1277 microversion: 2.1 time: 0.366585 Jul 02 21:02:28.419276 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 227/463] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:28 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1277 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:28.451221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-802245316", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "616433894", "adminPass": "***", "networks": [{"uuid": "c25ea663-5e9a-4916-94b7-43938648177b"}], "security_groups": [{"name": "tempest-securitygroup--1606372305"}], "key_name": "tempest-keypair-614579100", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:28.558834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:28.592228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:28.605569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:28.608564 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55506403-82a8-4f8b-8727-50552ce16f07 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 1.107269 Jul 02 21:02:28.611778 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 237/464] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:27 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:28.644358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:28.649666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:28.660786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:28.661581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:28.673322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:28.674212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:28.899904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] validate_networks() for [('c25ea663-5e9a-4916-94b7-43938648177b', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:02:29.803876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:29.815890 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75e4948f-7f4d-448a-8b69-6bea622df042 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 1.202443 Jul 02 21:02:29.818751 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 238/465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:28 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:29.841740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:29.842865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:29.858403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:29.859163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:29.860144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:29.860743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:30.027170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:30.038987 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-52cb8aaa-9b44-4dbe-b1c6-317400b0c4da tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1276 microversion: 2.1 time: 0.218460 Jul 02 21:02:30.040669 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 239/466] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:29 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1276 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:30.046914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:30.047839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:30.057251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:30.058135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:30.060389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:30.062999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:30.686097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:30.700234 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-531498ec-baee-47a8-9f0c-b1a7c2d4e2b9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1471 microversion: 2.1 time: 0.657058 Jul 02 21:02:30.702276 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 240/467] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:30 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1471 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:30.719597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:30.722230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:30.782063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:30.786123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:30.789381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:30.790053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.451363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:31.462080 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b196d87-3cfc-4eff-b52c-2ee095bfc7a8 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.754921 Jul 02 21:02:31.471218 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 241/468] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:30 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:31.478084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:31.478915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:31.492883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.495053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.496144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.500751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.510951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:31.511481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:31.512006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:31.512596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:31.513112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:31.549482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.550172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.551259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.551921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.618837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Getting quotas for project f8920bed46d34026a06fedf429e5cca4. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:31.631472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Getting quotas for user a60bf5141fea499abb9b22658e56c944 and project f8920bed46d34026a06fedf429e5cca4. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:31.666182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:02:31.669173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:31.782521 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-774d4450-b221-4ef2-8fc0-5ac150688cad tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.351626 Jul 02 21:02:31.783929 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 228/469] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 3354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:02:31.791244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-47e4a3e7-3187-46f5-9f65-e82fcb0ff439 req-01e80d96-2d0e-4ce2-acc3-5899a0fdb170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927b6d45-bb13-4123-80c2-dfc0f800e76d", "name": "network-vif-plugged", "status": "completed", "tag": "ba68e899-968d-4623-8c74-12e2f2939804"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:31.802188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:31.804639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-47e4a3e7-3187-46f5-9f65-e82fcb0ff439 req-01e80d96-2d0e-4ce2-acc3-5899a0fdb170 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.806055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-47e4a3e7-3187-46f5-9f65-e82fcb0ff439 req-01e80d96-2d0e-4ce2-acc3-5899a0fdb170 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.843903 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-47e4a3e7-3187-46f5-9f65-e82fcb0ff439 req-01e80d96-2d0e-4ce2-acc3-5899a0fdb170 service nova] Creating event network-vif-plugged:ba68e899-968d-4623-8c74-12e2f2939804 for instance 927b6d45-bb13-4123-80c2-dfc0f800e76d on nch1-master-1 Jul 02 21:02:31.852928 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-47e4a3e7-3187-46f5-9f65-e82fcb0ff439 req-01e80d96-2d0e-4ce2-acc3-5899a0fdb170 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066950 Jul 02 21:02:31.857748 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 229/470] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:31.870079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:31.870951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:31.920672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.923724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:31.925141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:31.926671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:32.071631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:32.097319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:32.102934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:32.108285 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-10b9c3a8-a9a2-4692-a570-1a5b93d962e8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 0.634557 Jul 02 21:02:32.112918 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 242/471] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:31 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:32.129600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-59e2c478-c54a-43fd-b139-d0918fb1c568 req-d59f25f8-95a3-447d-8753-f743278dab66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1aece9-4d7e-4240-9645-4ff29fa23d8c", "name": "network-vif-unplugged", "status": "completed", "tag": "97d0372f-9d42-420d-83a4-f34986f4a07d"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:32.167075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-59e2c478-c54a-43fd-b139-d0918fb1c568 req-d59f25f8-95a3-447d-8753-f743278dab66 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:32.168073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-59e2c478-c54a-43fd-b139-d0918fb1c568 req-d59f25f8-95a3-447d-8753-f743278dab66 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:32.196770 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-59e2c478-c54a-43fd-b139-d0918fb1c568 req-d59f25f8-95a3-447d-8753-f743278dab66 service nova] Creating event network-vif-unplugged:97d0372f-9d42-420d-83a4-f34986f4a07d for instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c on nch1-master-1 Jul 02 21:02:32.211066 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-59e2c478-c54a-43fd-b139-d0918fb1c568 req-d59f25f8-95a3-447d-8753-f743278dab66 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096263 Jul 02 21:02:32.212609 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 243/472] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:32.242490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:32.245268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:32.267964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:32.273804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:32.276905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:32.286147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:32.972906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:32.981688 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-150dd2f9-ab36-46aa-80e6-1aba35879809 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 1.118463 Jul 02 21:02:32.986146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 230/473] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:31 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:33.010449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:33.011656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:33.031277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:33.035103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:33.036616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:33.037308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:33.846985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:33.863357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:33.872331 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae5cd616-d63d-4da7-85a2-a8d469637851 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.871501 Jul 02 21:02:33.878916 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 231/474] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:32 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:33.884848 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0e4ff650-3136-40e7-ad71-d846ab1faccf tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 1.664577 Jul 02 21:02:33.892579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:33.893533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:33.898677 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 244/475] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:32 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:33.911648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:33.912675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:33.913478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:33.913990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:33.928510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:33.929531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:33.939181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:33.947266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:33.950207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:33.951263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:33.951927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.244079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:34.271980 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d5c7323-2053-4d62-a1ed-28683e47880a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1331 microversion: 2.1 time: 0.391217 Jul 02 21:02:34.274690 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 232/476] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:33 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1331 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:34.288262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:34.288900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:34.306655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.307669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.310055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.311228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.598753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:34.615465 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-391a2837-d145-4bf0-8137-c273099ef8e0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.712009 Jul 02 21:02:34.616094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 245/477] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:33 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:34.620601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-faef2815-83c2-4496-b3cd-14032b08ae6b req-67a4ab7a-a864-4065-abf9-d5140133b138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb52bf54-97d9-40ca-be9f-9364c1651840", "tag": "121cccd1-2079-4696-978f-3fff93643a1c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:34.637252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-faef2815-83c2-4496-b3cd-14032b08ae6b req-67a4ab7a-a864-4065-abf9-d5140133b138 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.637703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-faef2815-83c2-4496-b3cd-14032b08ae6b req-67a4ab7a-a864-4065-abf9-d5140133b138 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.670509 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-faef2815-83c2-4496-b3cd-14032b08ae6b req-67a4ab7a-a864-4065-abf9-d5140133b138 service nova] Creating event network-changed:121cccd1-2079-4696-978f-3fff93643a1c for instance cb52bf54-97d9-40ca-be9f-9364c1651840 on nch2-master-1 Jul 02 21:02:34.679864 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-faef2815-83c2-4496-b3cd-14032b08ae6b req-67a4ab7a-a864-4065-abf9-d5140133b138 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062473 Jul 02 21:02:34.681076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 246/478] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:34.691803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:34.695361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:34.709526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.710241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.711244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.711873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.829345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:34.841392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:34.843207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:34.846395 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0151d2f-1c50-487b-b899-5b20f5a8dde9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 0.569010 Jul 02 21:02:34.848728 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 233/479] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:34 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:34.863232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ef4489ee-49c6-49b7-a4bd-835e7e182103 req-bcaaba58-9811-4e19-a69c-0cdea71d1538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b58f76-ef9b-4a64-aeb6-fac9c5f571c1", "name": "network-vif-plugged", "status": "completed", "tag": "a975ae6d-9495-4dca-883a-bab061d51fcd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:34.873342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef4489ee-49c6-49b7-a4bd-835e7e182103 req-bcaaba58-9811-4e19-a69c-0cdea71d1538 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.874170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef4489ee-49c6-49b7-a4bd-835e7e182103 req-bcaaba58-9811-4e19-a69c-0cdea71d1538 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.899758 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ef4489ee-49c6-49b7-a4bd-835e7e182103 req-bcaaba58-9811-4e19-a69c-0cdea71d1538 service nova] Creating event network-vif-plugged:a975ae6d-9495-4dca-883a-bab061d51fcd for instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 on nch1-master-1 Jul 02 21:02:34.910231 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ef4489ee-49c6-49b7-a4bd-835e7e182103 req-bcaaba58-9811-4e19-a69c-0cdea71d1538 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055681 Jul 02 21:02:34.911471 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 234/480] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:34.919152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:34.920439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:34.935352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.936218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:34.937429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:34.938111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.269485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:35.307824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f233bf9-fad6-4e27-8f59-244c02d87948 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 0.621697 Jul 02 21:02:35.310963 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 247/481] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:34 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:35.329672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:35.343400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:35.359599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.360503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.363721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.364495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.418386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:35.487615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:35.497970 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dacaa6e4-3e0c-4897-9ec8-8cdd14554fd0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.584938 Jul 02 21:02:35.502903 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 235/482] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:34 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:35.512732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:35.513357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:35.525265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.545647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.546776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.547376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.728792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:35.759529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:35.765731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-034a15d5-4730-4393-866e-7cd01e6ed721 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1319 microversion: 2.1 time: 0.255490 Jul 02 21:02:35.766935 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 236/483] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:35 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:35.772674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:35.773386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:35.774015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ea9a816b-a255-46d0-a8e5-6b8fcb1e5bf6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.459362 Jul 02 21:02:35.775129 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 248/484] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:35 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:35.793553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.794485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.795261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.797160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.871298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:35.872138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:35.878512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.878967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:35.880196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:35.880669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:36.270400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:36.286204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:36.287881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:36.289134 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-25b1b73a-2adb-423e-85de-b08fec38c6a4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 0.427439 Jul 02 21:02:36.294240 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 249/485] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:35 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:02:36.295182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:36.312814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71c471d5-8aa7-4392-a94f-8a3b5000b378 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.539800 Jul 02 21:02:36.315359 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 237/486] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:35 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:36.327889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:36.328592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:36.337864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:36.338581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:36.339897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:36.340605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:36.519319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:36.519940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:36.527158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:36.527985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:36.529050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:36.529634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:36.633193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:36.646599 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f0af17b5-ca0b-4d18-98d4-766c9bf02df9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 0.323213 Jul 02 21:02:36.647206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 250/487] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:36 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:36.783135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:36.784418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:36.791809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:36.792541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:36.800240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:36.801202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.169060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:37.177688 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03dbd512-baa0-4f50-ad86-6d17a0d1b456 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1319 microversion: 2.1 time: 0.398168 Jul 02 21:02:37.187124 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 251/488] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:36 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1319 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:37.187124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:37.187124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:37.191338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.191880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.192917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.193424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.262150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:37.263115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:37.274027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21519286-2ad3-41cd-9c6a-a30abd006337 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.758948 Jul 02 21:02:37.275224 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 238/489] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:36 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:37.311758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:37.312751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:37.319728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.320459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.326671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.327574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.350262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:37.723766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:37.736700 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d366ca4-402e-40e4-a412-c7efd7423e4e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.556544 Jul 02 21:02:37.737355 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 252/490] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:37 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:37.765917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:37.766925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:37.794092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.794546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.822710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.825205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:37.828944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.843212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:37.845177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:37.854153 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51920c68-fdc2-4e86-b864-c964f7be1638 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1568 microversion: 2.25 time: 0.545174 Jul 02 21:02:37.855530 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 239/491] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:37 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1568 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:02:37.865617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d8e2d16a-e07e-44e7-9856-db4c44d66442 req-f48dec33-9c47-4555-83f6-73f7e1180c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca237da0-7482-4d58-bf6d-9195648cc8cf", "tag": "a89fc1f6-7e9e-4891-a0dd-90d0e71479fd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:37.892235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8e2d16a-e07e-44e7-9856-db4c44d66442 req-f48dec33-9c47-4555-83f6-73f7e1180c0d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:37.894228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8e2d16a-e07e-44e7-9856-db4c44d66442 req-f48dec33-9c47-4555-83f6-73f7e1180c0d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:37.939669 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d8e2d16a-e07e-44e7-9856-db4c44d66442 req-f48dec33-9c47-4555-83f6-73f7e1180c0d service nova] Creating event network-changed:a89fc1f6-7e9e-4891-a0dd-90d0e71479fd for instance ca237da0-7482-4d58-bf6d-9195648cc8cf on nch2-master-1 Jul 02 21:02:37.953619 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d8e2d16a-e07e-44e7-9856-db4c44d66442 req-f48dec33-9c47-4555-83f6-73f7e1180c0d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096268 Jul 02 21:02:37.961351 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 240/492] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:37.979173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:37.984670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:38.011851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:38.012502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:38.013214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:38.013643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:38.552755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:38.571312 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e4d9c418-2c1c-40fd-9587-e8b42192b8b7 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.832840 Jul 02 21:02:38.572190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:38.574950 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 253/493] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:37 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:38.582038 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adceced6-9252-45ae-b5f1-8dde4dd2b697 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1318 microversion: 2.1 time: 0.618665 Jul 02 21:02:38.582269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:38.583582 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 241/494] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:37 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:38.587072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:38.589525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:38.590444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:38.598977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:38.599431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:38.600257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:38.600857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:38.610707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:38.611466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:38.612542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:38.615493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.112911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:39.128218 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8bf8dfb-6477-4677-9370-8355b908f3d1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.538608 Jul 02 21:02:39.142314 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 242/495] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:38 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:39.155689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:39.156377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:39.173873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.179665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.181085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.183635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.192713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:39.203238 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83879595-12fd-4b95-964c-ba9b0144ef85 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.626849 Jul 02 21:02:39.208312 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 254/496] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:38 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:39.226112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:39.233728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:39.235871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:39.253597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.257737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.259012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.261867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.631678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:39.642968 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10791c0e-5a06-4867-98dc-2dedcaa8392c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.499249 Jul 02 21:02:39.643750 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 243/497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:39 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:39.699624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:39.718172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:39.719731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:39.726312 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5432af24-4c32-43a4-b91a-03aaa4b660c1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1558 microversion: 2.25 time: 0.516241 Jul 02 21:02:39.726926 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 255/498] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:39 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1558 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:39.735560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Calling method '.version_select at 0x7fabe4dee160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:39.746131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:39.746773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:39.763644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.768639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.769724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.770488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.781449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:02:39.782228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Neutron security group 6122b530-adb8-4f54-abbe-69213c22a85c not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:02:39.782823 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] HTTP exception thrown: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.782823 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Request method failure captured: Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/6122b530-adb8-4f54-abbe-69213c22a85c HTTP/1.1 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJvere3xcUJKCvp45D6zON3cUlJhNHn88KeTbYko0X1BjfR41jVg9eCBH7vJ_k9orppjkfh0IWw-9JAj0taOcJ7Xi9jFVjt9f_8cgbUrIaBgGMZED4Y6al4xR7NCwQg0I_15YbZ8fxk1DzWpSGDe5do82uL7FyXngGv3nUO3yQY8rc Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_83e6c81cb2214f458e3a20263c279b0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/83e6c81cb2214f458e3a20263c279b0e"}]}] Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e0cd53711ee245648bd3a2dc2c623cec Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '6122b530-adb8-4f54-abbe-69213c22a85c'} Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:02:39.788008 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Returning 404 to user: Security group 6122b530-adb8-4f54-abbe-69213c22a85c does not exist Jul 02 21:02:39.791913 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-cc612a43-0188-40e4-b477-cb70389bf6ba'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:39.794492 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7dfc0d15-20b2-402d-a465-186af0007f83 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6122b530-adb8-4f54-abbe-69213c22a85c" status: 404 len: 194 microversion: 2.1 time: 0.144809 Jul 02 21:02:39.794492 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 244/499] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:02:39 2022] DELETE /compute/v2.1/os-security-groups/6122b530-adb8-4f54-abbe-69213c22a85c => generated 194 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:39.802963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:39.806149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:39.826849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.833815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:39.835241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:39.838558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.061257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:40.069453 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ced3832-33ec-4ee9-beac-486c806c5734 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.336115 Jul 02 21:02:40.071243 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 256/500] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:39 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:40.080106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d837ff2c-9154-4f78-8583-b86418d9c7f9 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '.version_select at 0x7fabe4da0dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.084307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d837ff2c-9154-4f78-8583-b86418d9c7f9 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.085512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d837ff2c-9154-4f78-8583-b86418d9c7f9 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.103766 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d837ff2c-9154-4f78-8583-b86418d9c7f9 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 860 microversion: 2.25 time: 0.031056 Jul 02 21:02:40.104948 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 257/501] 10.222.0.43 () {60 vars in 1183 bytes} [Sat Jul 2 21:02:40 2022] GET /compute/v2.1/os-migrations => generated 860 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:02:40.111693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f3899b6-1be6-4b34-9e0c-e603d7e32ef0 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004944 Jul 02 21:02:40.112833 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 258/502] 10.222.0.43 () {58 vars in 1163 bytes} [Sat Jul 2 21:02:40 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 02 21:02:40.120705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.121830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:40.128489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.129020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.130024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.130461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.131025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:40.141340 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ded5467-537d-44f8-afc4-1413d7e59bd4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1468 microversion: 2.1 time: 0.344142 Jul 02 21:02:40.142306 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 245/503] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:39 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1468 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:40.147932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ba35dce-4436-49a3-9047-9647f6ef13b1 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Calling method '.version_select at 0x7fabe4ce3b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.337361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid cb1aece9-4d7e-4240-9645-4ff29fa23d8c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:40.352856 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c50baeb-56cc-4d83-abbf-7afbce000c59 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 2051 microversion: 2.25 time: 0.238605 Jul 02 21:02:40.366188 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 259/504] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:40 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 2051 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:40.391897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ba35dce-4436-49a3-9047-9647f6ef13b1 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.241490 Jul 02 21:02:40.391897 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 246/505] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:02:40 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:40.393320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.393320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:40.402589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.403167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.405877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.405877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.410378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.411013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:40.421711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.422175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.422963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.423403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.767564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:40.775200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:40.798854 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e8c5ff6-9c38-485c-981f-15b6ddc6d292 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.431471 Jul 02 21:02:40.799506 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bbe641c-b2a6-4dff-a6ca-40d71c598936 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1468 microversion: 2.1 time: 0.406025 Jul 02 21:02:40.811284 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 247/506] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:40 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1468 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:40.811920 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 260/507] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:40 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:40.817405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.824588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a48cb55-5eb4-48ba-b46e-13fbfc5951a7 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Calling method '.version_select at 0x7fabe4deee50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:40.828983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:40.835459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.835918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:40.836752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:40.837190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:41.090134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-9a48cb55-5eb4-48ba-b46e-13fbfc5951a7 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:02:41.091725 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9a48cb55-5eb4-48ba-b46e-13fbfc5951a7 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 02 21:02:41.091725 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a48cb55-5eb4-48ba-b46e-13fbfc5951a7 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Request method failure captured: Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/4b37e210-017c-414e-a8a0-665551ad7d64 HTTP/1.1 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJvere3xcUJKCvp45D6zON3cUlJhNHn88KeTbYko0X1BjfR41jVg9eCBH7vJ_k9orppjkfh0IWw-9JAj0taOcJ7Xi9jFVjt9f_8cgbUrIaBgGMZED4Y6al4xR7NCwQg0I_15YbZ8fxk1DzWpSGDe5do82uL7FyXngGv3nUO3yQY8rc Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_83e6c81cb2214f458e3a20263c279b0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/83e6c81cb2214f458e3a20263c279b0e"}]}] Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e0cd53711ee245648bd3a2dc2c623cec Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: exception: Insufficient rights for removing default security group. Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '4b37e210-017c-414e-a8a0-665551ad7d64'} Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:02:41.093992 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] Jul 02 21:02:41.098360 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:41.103418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a48cb55-5eb4-48ba-b46e-13fbfc5951a7 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 02 21:02:41.103418 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-ed108fed-fa7c-49a3-95c0-19f05f5538cb'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:41.104701 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a48cb55-5eb4-48ba-b46e-13fbfc5951a7 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/4b37e210-017c-414e-a8a0-665551ad7d64" status: 400 len: 182 microversion: 2.1 time: 0.286117 Jul 02 21:02:41.105458 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 248/508] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:02:40 2022] DELETE /compute/v2.1/os-security-groups/4b37e210-017c-414e-a8a0-665551ad7d64 => generated 182 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:02:41.110497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2059171192", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f62f5bc7-af47-49bf-8b23-df56ea5c37d7"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:41.135107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:41.147053 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11dc45ae-f116-4ac1-af0d-ac4722aa702f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.332509 Jul 02 21:02:41.160688 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 261/509] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:40 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:41.173685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:41.178219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:41.191502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:41.192380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:41.193347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:41.193953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:41.237615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] validate_networks() for [('f62f5bc7-af47-49bf-8b23-df56ea5c37d7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:02:41.591975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:41.604526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:41.616346 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4228d705-866b-4df9-9541-95a1148eb5d4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.454180 Jul 02 21:02:41.619333 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 262/510] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:41 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:41.631703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:41.643195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:41.649906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Searching by: {'reservation_id': 'r-c9j9zl5c', 'deleted': False, 'project_id': '065f852898294f2c8a154eb8d5f498f0'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:02:41.659883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:41.680484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:41.680937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:41.683963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:41.684453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:41.980935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:02:42.129901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:42.130339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:42.130818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:42.131247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:42.131642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:42.145392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.146231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.147033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.154388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.182991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:42.184500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:42.189279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for user f3287fb85c2343d686718d3c4aaa5c00 and project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:42.204342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.204936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.207686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:02:42.211534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:42.316590 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ee76229-63e2-4aaf-a687-b38f5e49f95a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.205242 Jul 02 21:02:42.320699 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 249/511] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:02:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:02:42.341313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:42.344964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:42.389109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.390948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.397737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.400150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.536222 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cbe0612a-d6b8-4e52-9a8d-0a1f25a48586 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-c9j9zl5c" status: 200 len: 2929 microversion: 2.1 time: 0.913777 Jul 02 21:02:42.537566 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 263/512] 10.222.0.43 () {58 vars in 1196 bytes} [Sat Jul 2 21:02:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-c9j9zl5c => generated 2929 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:42.542906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Calling method '.version_select at 0x7fabe4c8fdc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:42.609803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:02:42.610524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Neutron security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:02:42.611622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] HTTP exception thrown: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.611622 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Request method failure captured: Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-security-groups/70cd927c-2777-4e29-bdd5-5d607cdb3524 HTTP/1.1 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJvere3xcUJKCvp45D6zON3cUlJhNHn88KeTbYko0X1BjfR41jVg9eCBH7vJ_k9orppjkfh0IWw-9JAj0taOcJ7Xi9jFVjt9f_8cgbUrIaBgGMZED4Y6al4xR7NCwQg0I_15YbZ8fxk1DzWpSGDe5do82uL7FyXngGv3nUO3yQY8rc Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_83e6c81cb2214f458e3a20263c279b0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/83e6c81cb2214f458e3a20263c279b0e"}]}] Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: e0cd53711ee245648bd3a2dc2c623cec Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '70cd927c-2777-4e29-bdd5-5d607cdb3524'} Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:02:42.615616 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] Jul 02 21:02:42.619823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:42.623480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Returning 404 to user: Security group 70cd927c-2777-4e29-bdd5-5d607cdb3524 does not exist Jul 02 21:02:42.623480 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-b6b1495f-5690-447f-9325-c3050c77e752'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:42.624945 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8efcd67a-a1bd-4ca9-8b8f-408240c86da9 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/70cd927c-2777-4e29-bdd5-5d607cdb3524" status: 404 len: 194 microversion: 2.1 time: 0.086113 Jul 02 21:02:42.632991 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 264/513] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:02:42 2022] GET /compute/v2.1/os-security-groups/70cd927c-2777-4e29-bdd5-5d607cdb3524 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:42.673603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a4ac0b67-44e7-4fa7-b868-588f29a3ad52 req-96d0eb33-8d6a-4d0a-8326-20e39cfcfbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb52bf54-97d9-40ca-be9f-9364c1651840", "name": "network-vif-plugged", "status": "completed", "tag": "121cccd1-2079-4696-978f-3fff93643a1c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:42.701156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a4ac0b67-44e7-4fa7-b868-588f29a3ad52 req-96d0eb33-8d6a-4d0a-8326-20e39cfcfbc2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.703067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a4ac0b67-44e7-4fa7-b868-588f29a3ad52 req-96d0eb33-8d6a-4d0a-8326-20e39cfcfbc2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.738548 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a4ac0b67-44e7-4fa7-b868-588f29a3ad52 req-96d0eb33-8d6a-4d0a-8326-20e39cfcfbc2 service nova] Creating event network-vif-plugged:121cccd1-2079-4696-978f-3fff93643a1c for instance cb52bf54-97d9-40ca-be9f-9364c1651840 on nch2-master-1 Jul 02 21:02:42.751102 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a4ac0b67-44e7-4fa7-b868-588f29a3ad52 req-96d0eb33-8d6a-4d0a-8326-20e39cfcfbc2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115753 Jul 02 21:02:42.756454 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 265/514] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:42.767384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-15c7e474-bed0-47e2-b3fd-adc8a192ce22 req-218652fa-a14c-40f8-9497-5c2b22083f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981", "tag": "4d73663b-0a79-411c-970e-bff04af29e1a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:42.800425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-15c7e474-bed0-47e2-b3fd-adc8a192ce22 req-218652fa-a14c-40f8-9497-5c2b22083f5b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.803674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-15c7e474-bed0-47e2-b3fd-adc8a192ce22 req-218652fa-a14c-40f8-9497-5c2b22083f5b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.831487 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-15c7e474-bed0-47e2-b3fd-adc8a192ce22 req-218652fa-a14c-40f8-9497-5c2b22083f5b service nova] Creating event network-changed:4d73663b-0a79-411c-970e-bff04af29e1a for instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 on nch2-master-1 Jul 02 21:02:42.845127 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-15c7e474-bed0-47e2-b3fd-adc8a192ce22 req-218652fa-a14c-40f8-9497-5c2b22083f5b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086698 Jul 02 21:02:42.845780 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 266/515] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:42.853961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:42.854683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:42.863441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:42.874330 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52ba10cc-2dd9-459b-a33a-b68a1d1120d0 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.551093 Jul 02 21:02:42.879694 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 250/516] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:42 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:42.898163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.898775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.901858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:42.902490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:42.904334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.907455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.915544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.920080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:42.921262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:42.921711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.340328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:43.352390 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a67a011e-6127-4156-8580-32513b6605ca tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.460989 Jul 02 21:02:43.352995 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 251/517] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:42 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:43.363966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:43.365670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:43.376764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.380220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.383280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.386439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.445738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:43.455830 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7e83696a-c187-4f1b-aacf-6d0ac97fa06b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.608542 Jul 02 21:02:43.465575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 267/518] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:42 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:43.465575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f01df59-64e3-4a04-be7d-7275e98587a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:43.531945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:43.537373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.compute.server_groups [None req-4f01df59-64e3-4a04-be7d-7275e98587a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Querying cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) for 2 instances {{(pid=131045) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 02 21:02:43.538187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f01df59-64e3-4a04-be7d-7275e98587a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.538935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f01df59-64e3-4a04-be7d-7275e98587a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.548933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:43.552986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:43.556227 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4745803-7f37-4dfe-bfac-50a2258327d4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1266 microversion: 2.25 time: 0.202220 Jul 02 21:02:43.556811 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 252/519] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:43 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:43.566274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Action: 'update', calling method: .version_select at 0x7fabe4bf4550>, body: {"security_group": {"name": "tempest-sg-1087624772", "description": "tempest-description-1812871466"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:43.577377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:43.601904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:02:43.602500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Neutron security group 608a7e81-3835-453f-ae89-d5789375010f not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:02:43.603027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] HTTP exception thrown: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.603027 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Request method failure captured: Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-security-groups/608a7e81-3835-453f-ae89-d5789375010f HTTP/1.1 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 102 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJvere3xcUJKCvp45D6zON3cUlJhNHn88KeTbYko0X1BjfR41jVg9eCBH7vJ_k9orppjkfh0IWw-9JAj0taOcJ7Xi9jFVjt9f_8cgbUrIaBgGMZED4Y6al4xR7NCwQg0I_15YbZ8fxk1DzWpSGDe5do82uL7FyXngGv3nUO3yQY8rc Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_83e6c81cb2214f458e3a20263c279b0e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/83e6c81cb2214f458e3a20263c279b0e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/83e6c81cb2214f458e3a20263c279b0e"}]}] Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 83e6c81cb2214f458e3a20263c279b0e Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-355447608 Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e0cd53711ee245648bd3a2dc2c623cec Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-355447608-project Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: {"security_group": {"name": "tempest-sg-1087624772", "description": "tempest-description-1812871466"}} Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '608a7e81-3835-453f-ae89-d5789375010f', 'body': {'security_group': {'name': 'tempest-sg-1087624772', 'description': 'tempest-description-1812871466'}}} Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:02:43.605195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] Jul 02 21:02:43.609043 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:43.613299 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f01df59-64e3-4a04-be7d-7275e98587a2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/8d8c9511-c757-4e45-bacd-ad2cf311eef3" status: 200 len: 265 microversion: 2.1 time: 0.147977 Jul 02 21:02:43.624528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] Returning 404 to user: Security group 608a7e81-3835-453f-ae89-d5789375010f does not exist Jul 02 21:02:43.624528 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-b675f11d-fa3b-44ca-b87e-c7c7e7744e21'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:43.625743 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 268/520] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:02:43 2022] GET /compute/v2.1/os-server-groups/8d8c9511-c757-4e45-bacd-ad2cf311eef3 => generated 265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:43.629715 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36342404-01ed-4844-b3d2-67ddb333c094 tempest-SecurityGroupsNegativeTestJSON-355447608 tempest-SecurityGroupsNegativeTestJSON-355447608-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/608a7e81-3835-453f-ae89-d5789375010f" status: 404 len: 194 microversion: 2.1 time: 0.067840 Jul 02 21:02:43.630776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:43.631398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:43.632244 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 253/521] 10.222.0.43 () {60 vars in 1289 bytes} [Sat Jul 2 21:02:43 2022] PUT /compute/v2.1/os-security-groups/608a7e81-3835-453f-ae89-d5789375010f => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:43.653376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:43.654386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:43.655266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.655728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.656560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.657048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.663705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.664756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.665757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:43.666380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:43.996961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:44.007521 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ea866987-5cc0-442b-b2ed-b51a1a8e1c44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.380527 Jul 02 21:02:44.010423 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 269/522] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:43 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:44.013699 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51bd6821-d930-4231-9982-242a09337840 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1619 microversion: 2.1 time: 0.372184 Jul 02 21:02:44.016519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:44.017581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 254/523] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:43 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1619 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:44.018181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:44.027055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.027932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.030134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.030755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.040331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:44.041361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:44.053935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.054386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.055191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.055626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.346301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:44.371404 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0d8cb2be-9a86-429b-ba68-094eb63667ee tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1319 microversion: 2.1 time: 0.359655 Jul 02 21:02:44.377381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 270/524] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:44 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:44.384283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:44.385297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:44.416310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.429909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.431105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.437679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.485982 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa6c87f9-657a-403f-a2cb-018ee37803d9 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1619 microversion: 2.1 time: 0.448749 Jul 02 21:02:44.488944 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 255/525] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:44 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1619 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:44.500378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:44.501861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:44.523686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.524609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.527736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.529911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.843454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:44.853313 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-08170562-60c1-4a15-89db-008732e1eaf8 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.474145 Jul 02 21:02:44.858486 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 271/526] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:44 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:44.867109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-74045d44-dfd9-4c39-a45b-4bff0582a0a8 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: .version_select at 0x7fabe4af44c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-408475541", "policies": ["anti-affinity"]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:44.891803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-74045d44-dfd9-4c39-a45b-4bff0582a0a8 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:44.898639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-74045d44-dfd9-4c39-a45b-4bff0582a0a8 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:44.909219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:44.919189 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9f22cf4-e14f-4486-8d3e-770f3986c7f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.427925 Jul 02 21:02:44.920518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 256/527] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:44 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:44.926453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:44.927784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:44.935192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.935891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.936773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:44.937289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:44.957162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-74045d44-dfd9-4c39-a45b-4bff0582a0a8 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:44.962906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-74045d44-dfd9-4c39-a45b-4bff0582a0a8 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_groups'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:44.976915 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-74045d44-dfd9-4c39-a45b-4bff0582a0a8 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.117026 Jul 02 21:02:44.992538 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 272/528] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:02:44 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:45.030878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:45.032381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:45.047790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:45.049815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.050542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.051517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.052334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.076415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:45.087263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:45.091299 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b903dfb-948d-48da-83e9-74d2c367df49 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1320 microversion: 2.25 time: 0.169451 Jul 02 21:02:45.094110 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 257/529] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:44 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:45.167997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1563694719", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "63fb177a-a5e8-4f64-be23-2e9155fbd294"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:45.214802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:45.223524 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6207418-c3aa-491d-b253-34834b447895 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.200791 Jul 02 21:02:45.224685 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 273/530] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:45 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:45.228413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:02:45.401746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:45.402734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:45.412873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.413489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.414388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.414980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.749222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:45.763650 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8203c0be-f604-4936-a39e-d659c3d28afc tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1469 microversion: 2.1 time: 0.369304 Jul 02 21:02:45.765562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 274/531] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:45 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:45.781561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:45.782674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:45.792377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.794123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.795599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.795731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.824954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:45.825459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:45.825845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:45.826257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:45.826674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:45.863632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.864108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.864924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.865379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.890875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:45.899965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:45.907696 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0de2acb1-6c5d-4002-b806-a525e7a286be tempest-DeleteServersAdminTestJSON-599682669 tempest-DeleteServersAdminTestJSON-599682669-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840/action" status: 202 len: 0 microversion: 2.1 time: 0.129980 Jul 02 21:02:45.912107 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 275/532] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:02:45 2022] POST /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:02:45.917850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Going to run 2 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:02:45.918017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:45.918605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:45.921243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:45.926461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.926847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.927750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:45.928220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:45.979617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:45.996493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:46.055889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:46.058907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:46.063436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:46.079696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=5f771465-f947-4a4e-8ff7-f88831cd0858,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:02:46.087809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.099174 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d0fbd48-9456-49a1-9d52-250af41986a6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.185091 Jul 02 21:02:46.099984 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 276/533] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:45 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:46.105141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:46.105756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:46.112870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.113312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.114076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.114613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.149859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:46.155459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.156982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:46.157736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.158473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lazy-loading 'fault' on Instance uuid cb52bf54-97d9-40ca-be9f-9364c1651840 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:46.206674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:02:46.214053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:02:46.257534 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b8df843-3df5-4d3c-aa11-9fd8e0bfc155 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.093914 Jul 02 21:02:46.258548 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 258/534] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:45 2022] POST /compute/v2.1/servers => generated 32 bytes in 1095 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:02:46.263820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:46.264832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:46.274656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.275136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.276180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.277235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.340519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.349007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c135371-3f9d-4829-9cd8-66a49f449800 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1452 microversion: 2.1 time: 0.248148 Jul 02 21:02:46.370449 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 277/535] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:46 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1452 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:46.375880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:46.376134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:46.392761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.395087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.396499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.397083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.494633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.511212 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b235e99d-58fa-45b7-9ea0-c443acd65144 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.251151 Jul 02 21:02:46.522232 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 259/536] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:46 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:46.530569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:46.532719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:46.541783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.543140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.544699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.545150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.835652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.847091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.849682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.852983 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-41720b8a-7ee7-47ab-b264-b0f23c5b1afe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1320 microversion: 2.25 time: 0.479840 Jul 02 21:02:46.853827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 278/537] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:46 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:46.860217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:46.867904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.869308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Searching by: {'deleted': False, 'project_id': '065f852898294f2c8a154eb8d5f498f0'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:02:46.869919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:46.879789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8bb2cb53-da41-4ca7-bd2f-48ae1aa2ec7e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.356137 Jul 02 21:02:46.884995 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 260/538] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:46 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:46.896439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:46.897240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:46.902556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.903353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.904508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.905198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.913358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.916075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.917041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:46.919663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:46.967682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:02:47.086412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Listed batch of 4 results from cell out of 998 limit. Returned 4 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:02:47.256460 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c4465e54-887f-4afa-ab06-a06ef79057f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.394914 Jul 02 21:02:47.257167 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 279/539] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:02:46 2022] GET /compute/v2.1/servers => generated 1662 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:47.268564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:47.269203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:47.276998 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-637bf2ee-cfa4-4244-a742-f3096f47183e tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 204 len: 0 microversion: 2.1 time: 0.389457 Jul 02 21:02:47.278275 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 261/540] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:02:46 2022] DELETE /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:02:47.288927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b486168-62cf-4d2c-84c6-cca7b5a68d31 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:47.290056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b486168-62cf-4d2c-84c6-cca7b5a68d31 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:47.297454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.297928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.298882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.299236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.527596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b486168-62cf-4d2c-84c6-cca7b5a68d31 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:47.539246 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b486168-62cf-4d2c-84c6-cca7b5a68d31 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1219 microversion: 2.1 time: 0.258584 Jul 02 21:02:47.541260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 262/541] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:47 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1219 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:47.551428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:47.551975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:47.569406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.572351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.575712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.577268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.634249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.635084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.635855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lazy-loading 'fault' on Instance uuid cb52bf54-97d9-40ca-be9f-9364c1651840 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:47.685275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:47.694168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ea8a751-2629-4cc5-8cce-ea3d80a2c176 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.429725 Jul 02 21:02:47.695305 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 280/542] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:47 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:47.701309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:47.702102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:47.708791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.709469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.710549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:47.711133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:47.999483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.001903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.013010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f7db13b-464c-49a1-998c-e917805fb73b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1476 microversion: 2.1 time: 0.315422 Jul 02 21:02:48.013897 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 281/543] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:47 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:48.019847 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06982e45-7016-4fc7-bb3c-d86501e9f673 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1458 microversion: 2.1 time: 0.477459 Jul 02 21:02:48.020813 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 263/544] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:47 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1458 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:48.023473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-22d42691-fe40-4fd9-a211-661fc9c53abe req-ad3ad9e5-1095-4604-980e-fa90d6f12068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca237da0-7482-4d58-bf6d-9195648cc8cf", "name": "network-vif-plugged", "status": "completed", "tag": "a89fc1f6-7e9e-4891-a0dd-90d0e71479fd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:48.046750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-22d42691-fe40-4fd9-a211-661fc9c53abe req-ad3ad9e5-1095-4604-980e-fa90d6f12068 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.047617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-22d42691-fe40-4fd9-a211-661fc9c53abe req-ad3ad9e5-1095-4604-980e-fa90d6f12068 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.050058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:48.050928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:48.061992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-22d42691-fe40-4fd9-a211-661fc9c53abe req-ad3ad9e5-1095-4604-980e-fa90d6f12068 service nova] Creating event network-vif-plugged:a89fc1f6-7e9e-4891-a0dd-90d0e71479fd for instance ca237da0-7482-4d58-bf6d-9195648cc8cf on nch2-master-1 Jul 02 21:02:48.069532 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-22d42691-fe40-4fd9-a211-661fc9c53abe req-ad3ad9e5-1095-4604-980e-fa90d6f12068 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050300 Jul 02 21:02:48.070894 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 282/545] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:48.078452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.081382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:48.082207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.083236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.084535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.085456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:48.103290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:48.112830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.115170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.117756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.118439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.149895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:48.560834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.580978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.590257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.592934 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8be45a3-1efc-4a0d-ba83-a3fdeb00cdf4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.571062 Jul 02 21:02:48.597419 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 264/546] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:48 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:48.609140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:48.614309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:48.624889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.628850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.630556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.631529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.846605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.856967 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-001480fe-b18c-4637-b857-a57db8a56d5a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.782208 Jul 02 21:02:48.858381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 283/547] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:48 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:48.861452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:48.865029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:48.865897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:48.873108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.873724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3aa192e-ffdb-4209-87bb-f772d5aedb84 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1215 microversion: 2.1 time: 0.271730 Jul 02 21:02:48.874063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.874356 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 265/548] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:48 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:48.876178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:48.876981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:48.917073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:49.032175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:49.032862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:49.042884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.043686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.044780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.045425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.339784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:49.367783 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b30eef5-b092-401c-9389-5302f65dd4f5 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.499336 Jul 02 21:02:49.386511 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 284/549] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:48 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:49.392307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:49.401282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:49.415842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.419006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.420098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.422452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.474523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.475869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.476566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lazy-loading 'fault' on Instance uuid cb52bf54-97d9-40ca-be9f-9364c1651840 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:49.687202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:49.708820 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a2add02-a58a-4beb-bb86-5a2336349df3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1475 microversion: 2.1 time: 0.673790 Jul 02 21:02:49.716817 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 266/550] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:49 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1475 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:49.728463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d761100a-e575-4ef7-9c80-1994c9fcb190 req-34372107-66ec-47ff-ae6f-ea7c43cb1dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da121054-2171-4d59-953b-a32b36cb4f58", "tag": "c5028830-52b6-4ff4-903e-dd2f1b7d3876"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:49.781120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d761100a-e575-4ef7-9c80-1994c9fcb190 req-34372107-66ec-47ff-ae6f-ea7c43cb1dd6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.785256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d761100a-e575-4ef7-9c80-1994c9fcb190 req-34372107-66ec-47ff-ae6f-ea7c43cb1dd6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.829587 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d761100a-e575-4ef7-9c80-1994c9fcb190 req-34372107-66ec-47ff-ae6f-ea7c43cb1dd6 service nova] Creating event network-changed:c5028830-52b6-4ff4-903e-dd2f1b7d3876 for instance da121054-2171-4d59-953b-a32b36cb4f58 on nch1-master-1 Jul 02 21:02:49.868191 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d761100a-e575-4ef7-9c80-1994c9fcb190 req-34372107-66ec-47ff-ae6f-ea7c43cb1dd6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136425 Jul 02 21:02:49.870084 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 267/551] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:49.878613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:49.879635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:49.891714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.892613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:49.894112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:49.895933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:50.266228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:50.276281 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f1034045-0757-49d5-81b5-9b382b7c782b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1458 microversion: 2.1 time: 0.888198 Jul 02 21:02:50.286634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 285/552] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:49 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1458 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:50.292589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:50.293562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:50.301883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:50.302504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:50.303450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:50.304030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:50.679160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:50.703136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:50.707626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:50.709755 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3b7dbdb-d379-425f-b0cf-7df616f77f8f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.837405 Jul 02 21:02:50.726653 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 268/553] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:49 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:50.737161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:50.738086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:50.753485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:50.755669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:50.756559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:50.760135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:50.839717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:50.850146 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-50c57f4b-0c8c-4f16-acf0-6644aac91119 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1318 microversion: 2.1 time: 0.561754 Jul 02 21:02:50.855743 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 286/554] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:50 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1318 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:50.861000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:50.869219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:50.881535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:50.882876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:50.883928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:50.884758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.076078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:51.086816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f242e9ca-7bb9-4680-acf3-aa856ec4f075 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1277 microversion: 2.1 time: 0.358696 Jul 02 21:02:51.087402 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 269/555] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:50 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1277 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:51.101267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:51.101873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:51.121102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.121553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.122335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.122762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.280566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:51.321528 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-56ac7bf7-203a-475c-b4ce-214c62241044 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.464214 Jul 02 21:02:51.326653 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 287/556] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:50 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:51.338539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c150c20f-8ce7-491d-bdcd-324f1194bbc6 req-51bcaec0-afa7-4219-b7f8-a74dcaf28e06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981", "name": "network-vif-plugged", "status": "completed", "tag": "4d73663b-0a79-411c-970e-bff04af29e1a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:51.359694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c150c20f-8ce7-491d-bdcd-324f1194bbc6 req-51bcaec0-afa7-4219-b7f8-a74dcaf28e06 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.360596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c150c20f-8ce7-491d-bdcd-324f1194bbc6 req-51bcaec0-afa7-4219-b7f8-a74dcaf28e06 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.381693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c150c20f-8ce7-491d-bdcd-324f1194bbc6 req-51bcaec0-afa7-4219-b7f8-a74dcaf28e06 service nova] Creating event network-vif-plugged:4d73663b-0a79-411c-970e-bff04af29e1a for instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 on nch2-master-1 Jul 02 21:02:51.404948 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c150c20f-8ce7-491d-bdcd-324f1194bbc6 req-51bcaec0-afa7-4219-b7f8-a74dcaf28e06 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076291 Jul 02 21:02:51.406396 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 288/557] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:51.461374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:51.462447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:51.478424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.481939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.483240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.484579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.620662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.621157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.621698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lazy-loading 'fault' on Instance uuid cb52bf54-97d9-40ca-be9f-9364c1651840 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:02:51.681676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe262620110042f6baacf06dd51e0ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ae5fa728db84608bfaa558277a90b34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:51.713625 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0044e349-382c-49c1-b5dd-65d937f8afa1 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 200 len: 1416 microversion: 2.1 time: 0.303000 Jul 02 21:02:51.716316 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 289/558] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:51 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 1416 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:51.727079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:51.743501 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b610a34-7c8a-4e17-a18b-9f00aab442b5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1475 microversion: 2.1 time: 0.645992 Jul 02 21:02:51.750710 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 270/559] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:51 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1475 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:51.756696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-548b6b02-7e11-497b-89a7-810d21771335 req-d8028bf7-5aec-4f2e-b977-c4d1a6b47e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb52bf54-97d9-40ca-be9f-9364c1651840", "name": "network-vif-deleted", "tag": "121cccd1-2079-4696-978f-3fff93643a1c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:51.763492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:51.769777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:51.783155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-548b6b02-7e11-497b-89a7-810d21771335 req-d8028bf7-5aec-4f2e-b977-c4d1a6b47e27 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.784436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-548b6b02-7e11-497b-89a7-810d21771335 req-d8028bf7-5aec-4f2e-b977-c4d1a6b47e27 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.798387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.799312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.809302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.811224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.813359 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-548b6b02-7e11-497b-89a7-810d21771335 req-d8028bf7-5aec-4f2e-b977-c4d1a6b47e27 service nova] Creating event network-vif-deleted:121cccd1-2079-4696-978f-3fff93643a1c for instance cb52bf54-97d9-40ca-be9f-9364c1651840 on nch2-master-1 Jul 02 21:02:51.827237 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-548b6b02-7e11-497b-89a7-810d21771335 req-d8028bf7-5aec-4f2e-b977-c4d1a6b47e27 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106256 Jul 02 21:02:51.829229 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 290/560] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:51.874113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:51.874840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:51.889480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.889955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:51.899885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:51.900417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.275187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.289209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.290714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.291847 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c2dd37e-851e-4e86-a6ea-9aa84c535661 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.539783 Jul 02 21:02:52.292728 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 271/561] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:51 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:52.302821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:52.316138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:52.323450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.324186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.325114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.325694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.347693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.356297 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e216e3b-b7f7-4217-83b5-33603b29b2fe tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1507 microversion: 2.1 time: 0.488044 Jul 02 21:02:52.367963 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 291/562] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:51 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:52.375866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:52.378687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:52.401010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.405244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.406328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.408375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.473219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.489944 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-780743a1-718a-41dc-b32b-a81c246176fc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1277 microversion: 2.1 time: 0.191409 Jul 02 21:02:52.490842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 272/563] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:52 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:52.497960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:52.502538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:52.516687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.517673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.519907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.521339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.812508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.833295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bd52bcad-dfb6-4a5b-acd2-88dfa46cc4ef tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1387 microversion: 2.1 time: 0.463873 Jul 02 21:02:52.835957 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 292/564] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:52 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1387 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:52.842120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2ecbf0e8-c5dd-4f79-8743-14223fb161d8 req-b2160cd2-fe1c-4919-b309-b077516b8862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80f49de-27ea-4b1a-ad57-fec4b4c03605", "name": "network-vif-unplugged", "status": "completed", "tag": "09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:52.856696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:52.870508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2ecbf0e8-c5dd-4f79-8743-14223fb161d8 req-b2160cd2-fe1c-4919-b309-b077516b8862 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.870789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2deef04f-8971-49c4-b669-bb429e68fc31 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1507 microversion: 2.1 time: 0.376643 Jul 02 21:02:52.870929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2ecbf0e8-c5dd-4f79-8743-14223fb161d8 req-b2160cd2-fe1c-4919-b309-b077516b8862 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.884880 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 273/565] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:52 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1507 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:52.896204 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2ecbf0e8-c5dd-4f79-8743-14223fb161d8 req-b2160cd2-fe1c-4919-b309-b077516b8862 service nova] Creating event network-vif-unplugged:09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009 for instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 on nch2-master-1 Jul 02 21:02:52.918185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-2ecbf0e8-c5dd-4f79-8743-14223fb161d8 req-b2160cd2-fe1c-4919-b309-b077516b8862 service nova] Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:02:52.919309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:52.923245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:52.937798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.938356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.939386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.939907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.944139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2ecbf0e8-c5dd-4f79-8743-14223fb161d8 req-b2160cd2-fe1c-4919-b309-b077516b8862 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106601 Jul 02 21:02:52.944883 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 293/566] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:52.954879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:52.955591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:52.960357 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] HTTP exception thrown: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Request method failure captured: Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 HTTP/1.1 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIxupTgcTcdQkUc4LDOjhd12z2YLy71myxFAlvCDOBQGenNWXKt7EMZak7emTnRGzPRUBdU31hyq0A4psGhylbS0GHJNjD0hYyQfw6Al2-KmVRRqLrPRV1P3rG2rKuPidyvjbSYea531EnuYatOlZdNaHUwgczfPeQcTUiMWCJG0U8 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ae5fa728db84608bfaa558277a90b34", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ae5fa728db84608bfaa558277a90b34"}]}] Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fe262620110042f6baacf06dd51e0ddc Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'cb52bf54-97d9-40ca-be9f-9364c1651840'} Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:52.962371 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Returning 404 to user: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:52.966231 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-189f5db1-1c84-4d85-9898-a7dc532ade34 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 404 len: 111 microversion: 2.1 time: 0.079106 Jul 02 21:02:52.967693 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 274/567] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:52 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:52.978992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.979439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.980254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:52.980689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:52.988857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:52.990690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.015027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.015808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.017001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.017666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.192977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:02:53.193717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:02:53.194455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:02:53.195101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:02:53.195585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:02:53.326374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:53.334989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.350824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab1aae43-62cd-4d08-86ac-5c59841d08aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1475 microversion: 2.1 time: 0.399470 Jul 02 21:02:53.351092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.354218 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 294/568] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:52 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1475 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:53.358525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.359426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.359873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.366235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:53.376190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.398323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.403084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.404090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.407808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.425509 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48970164-f05b-413c-869b-e8291292edae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "POST /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf/action" status: 202 len: 1109 microversion: 2.1 time: 0.456706 Jul 02 21:02:53.426834 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 275/569] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:02:52 2022] POST /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf/action => generated 1109 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 02 21:02:53.431829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:53.432710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.441247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.442053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.443081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.443740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.460454 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] HTTP exception thrown: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Request method failure captured: Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 HTTP/1.1 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIxupTgcTcdQkUc4LDOjhd12z2YLy71myxFAlvCDOBQGenNWXKt7EMZak7emTnRGzPRUBdU31hyq0A4psGhylbS0GHJNjD0hYyQfw6Al2-KmVRRqLrPRV1P3rG2rKuPidyvjbSYea531EnuYatOlZdNaHUwgczfPeQcTUiMWCJG0U8 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ae5fa728db84608bfaa558277a90b34", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ae5fa728db84608bfaa558277a90b34"}]}] Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fe262620110042f6baacf06dd51e0ddc Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cb52bf54-97d9-40ca-be9f-9364c1651840'} Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:02:53.462135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:53.465764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Returning 404 to user: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:53.466937 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-00a7af03-dd65-4c42-ace8-ecc96bd25877 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 404 len: 111 microversion: 2.1 time: 0.110727 Jul 02 21:02:53.466937 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 295/570] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:02:53 2022] DELETE /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:53.487970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:53.488798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.501977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.502771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.503746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.507513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.958309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:53.960012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:53.968666 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80735bbd-0ac8-4948-8af4-d7b8466c8958 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.492778 Jul 02 21:02:53.970071 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 296/571] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:53 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:53.974889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:53.975786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: cb52bf54-97d9-40ca-be9f-9364c1651840] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.976638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:53.978736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:53.980161 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b49db8c-853c-4949-85e5-6dca92374305 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.552144 Jul 02 21:02:53.981221 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 276/572] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:53 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:53.986542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:53.987395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:53.992447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.993100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.994064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.994640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.994788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.995444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:53.996659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:53.997390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.011169 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] HTTP exception thrown: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Request method failure captured: Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 HTTP/1.1 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIxupTgcTcdQkUc4LDOjhd12z2YLy71myxFAlvCDOBQGenNWXKt7EMZak7emTnRGzPRUBdU31hyq0A4psGhylbS0GHJNjD0hYyQfw6Al2-KmVRRqLrPRV1P3rG2rKuPidyvjbSYea531EnuYatOlZdNaHUwgczfPeQcTUiMWCJG0U8 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ae5fa728db84608bfaa558277a90b34", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ae5fa728db84608bfaa558277a90b34"}]}] Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fe262620110042f6baacf06dd51e0ddc Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cb52bf54-97d9-40ca-be9f-9364c1651840'} Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:54.012991 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. Jul 02 21:02:54.016779 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.018908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Returning 404 to user: Instance cb52bf54-97d9-40ca-be9f-9364c1651840 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:54.020344 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4bdf3a16-665e-47a1-ac5f-14476909bc37 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840" status: 404 len: 111 microversion: 2.1 time: 0.048847 Jul 02 21:02:54.021399 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 297/573] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:53 2022] GET /compute/v2.1/servers/cb52bf54-97d9-40ca-be9f-9364c1651840 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:54.026099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:54.026936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:54.033336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.034020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.034982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.035627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.237481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:54.248608 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0245ed0a-368a-4f0b-ae52-b0a9d4acf73c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.265739 Jul 02 21:02:54.249817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:54.250483 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 277/574] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:53 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:54.257660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:54.258399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:54.259290 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d17e3874-c828-4a7d-aea0-399f1f95f776 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1586 microversion: 2.1 time: 0.236649 Jul 02 21:02:54.260073 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 298/575] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:54 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1586 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:54.266676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.267245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.268175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.268675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.278207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:54.279108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:54.285938 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] HTTP exception thrown: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Request method failure captured: Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 HTTP/1.1 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIxupTgcTcdQkUc4LDOjhd12z2YLy71myxFAlvCDOBQGenNWXKt7EMZak7emTnRGzPRUBdU31hyq0A4psGhylbS0GHJNjD0hYyQfw6Al2-KmVRRqLrPRV1P3rG2rKuPidyvjbSYea531EnuYatOlZdNaHUwgczfPeQcTUiMWCJG0U8 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ae5fa728db84608bfaa558277a90b34", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ae5fa728db84608bfaa558277a90b34"}]}] Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fe262620110042f6baacf06dd51e0ddc Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9c62d127-b0f0-46b8-a871-189a1b7cb318'} Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:02:54.287660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Returning 404 to user: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:54.291392 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c51260b3-f491-49bb-a464-e629a592dfd3 tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 404 len: 111 microversion: 2.1 time: 0.037208 Jul 02 21:02:54.292213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.292213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.292213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.293378 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 278/576] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:02:54 2022] DELETE /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:54.293568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.299978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:54.300637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] [instance: 9c62d127-b0f0-46b8-a871-189a1b7cb318] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:54.308814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.309637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.310631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.311291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.329955 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] HTTP exception thrown: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Request method failure captured: Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 HTTP/1.1 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIxupTgcTcdQkUc4LDOjhd12z2YLy71myxFAlvCDOBQGenNWXKt7EMZak7emTnRGzPRUBdU31hyq0A4psGhylbS0GHJNjD0hYyQfw6Al2-KmVRRqLrPRV1P3rG2rKuPidyvjbSYea531EnuYatOlZdNaHUwgczfPeQcTUiMWCJG0U8 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8ae5fa728db84608bfaa558277a90b34", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8ae5fa728db84608bfaa558277a90b34"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8ae5fa728db84608bfaa558277a90b34"}]}] Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8ae5fa728db84608bfaa558277a90b34 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-900224192 Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fe262620110042f6baacf06dd51e0ddc Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersAdminTestJSON-900224192-project Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9c62d127-b0f0-46b8-a871-189a1b7cb318'} Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:02:54.332377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. Jul 02 21:02:54.337154 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:02:54.340724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] Returning 404 to user: Instance 9c62d127-b0f0-46b8-a871-189a1b7cb318 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:02:54.342010 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdb195e4-a251-424f-b9c8-5d49d5f0515b tempest-DeleteServersAdminTestJSON-900224192 tempest-DeleteServersAdminTestJSON-900224192-project] 10.222.0.43 "GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318" status: 404 len: 111 microversion: 2.1 time: 0.046492 Jul 02 21:02:54.343168 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 279/577] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:54 2022] GET /compute/v2.1/servers/9c62d127-b0f0-46b8-a871-189a1b7cb318 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:02:54.369463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:54.370431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:54.385938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.388177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.389318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:54.390936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:54.560999 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b1f3b59f-9b2a-42a9-a503-b3644309d38b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.287405 Jul 02 21:02:54.562656 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 299/578] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:02:54 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981/os-interface => generated 284 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:54.755811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:54.770783 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7964da9-4c22-45b9-881b-7ccbcd54fa3b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1475 microversion: 2.1 time: 0.404366 Jul 02 21:02:54.777613 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 280/579] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:54 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1475 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:54.972731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:54.986548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:54.987274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:55.001230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-11abbb2e-cd02-4d4a-aea4-d1ccbe7ccf04 req-e3cc2e80-f2d0-4e1e-a33c-630e246d4661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80f49de-27ea-4b1a-ad57-fec4b4c03605", "tag": "09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:55.007168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.007627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.009227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.011102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.013963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-11abbb2e-cd02-4d4a-aea4-d1ccbe7ccf04 req-e3cc2e80-f2d0-4e1e-a33c-630e246d4661 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.014488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-11abbb2e-cd02-4d4a-aea4-d1ccbe7ccf04 req-e3cc2e80-f2d0-4e1e-a33c-630e246d4661 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.029337 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-11abbb2e-cd02-4d4a-aea4-d1ccbe7ccf04 req-e3cc2e80-f2d0-4e1e-a33c-630e246d4661 service nova] Creating event network-changed:09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009 for instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 on nch2-master-1 Jul 02 21:02:55.036236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-11abbb2e-cd02-4d4a-aea4-d1ccbe7ccf04 req-e3cc2e80-f2d0-4e1e-a33c-630e246d4661 service nova] Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:02:55.062807 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-11abbb2e-cd02-4d4a-aea4-d1ccbe7ccf04 req-e3cc2e80-f2d0-4e1e-a33c-630e246d4661 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090381 Jul 02 21:02:55.064786 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 300/580] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:02:55.071608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:55.072522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:55.082459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.082952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.083763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.084302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.623109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:55.625597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:55.632541 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f63ea371-862f-4870-990f-a5aa0769c5cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.649735 Jul 02 21:02:55.642195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:55.643270 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 281/581] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:54 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:55.649738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:55.650683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:55.657898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.658668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.659688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.660379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.669562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:55.671791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:55.674219 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ab38cb7-7988-4608-a662-5b0be34331b3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.607713 Jul 02 21:02:55.678553 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 301/582] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:55 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:55.800134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:55.801019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:55.830782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.831310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.832032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:55.832503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:55.877793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:55.947649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:55.955317 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c97fcf5-502d-442a-b849-6df3c1b4a6a0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.310830 Jul 02 21:02:55.965590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 282/583] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:55 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:56.203158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:56.221801 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-30e194c7-db9d-4de1-a889-9a5f17f7e8d5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1475 microversion: 2.1 time: 0.437435 Jul 02 21:02:56.232564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 302/584] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:55 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1475 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:56.652420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:56.653244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:56.661153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:56.661542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:56.662326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:56.662718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:56.694182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:56.695654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:56.704945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:56.705712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:56.706935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:56.708414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:56.964837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:56.996145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:57.006055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:57.011728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:57.015042 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6307c633-95ba-4414-91a9-daf1501400e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.326170 Jul 02 21:02:57.018769 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 303/585] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:56 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:02:57.025457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:57.029033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:57.039517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:57.041862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:57.042384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:57.043227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:57.043892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:57.049502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:57.069869 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf643fe1-97d4-4229-82b0-ee02a90e6722 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.422658 Jul 02 21:02:57.071374 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 283/586] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:56 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:57.241482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:57.242342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:57.249749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:57.251147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:57.252066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:57.253000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:57.322095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:57.331466 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fe05bef-805d-41be-8576-25933f317618 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.311297 Jul 02 21:02:57.335690 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 304/587] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:57 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:57.484897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:57.494043 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a205d270-c030-4c41-8b12-ad12363d3fad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1475 microversion: 2.1 time: 0.257284 Jul 02 21:02:57.495218 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 284/588] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:57 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1475 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:57.746813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-142e481e-9fd1-45f5-9c14-0b9af813fd85 req-4b7b9798-40eb-4b8d-b864-9fbd48304ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da121054-2171-4d59-953b-a32b36cb4f58", "name": "network-vif-plugged", "status": "completed", "tag": "c5028830-52b6-4ff4-903e-dd2f1b7d3876"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:57.759014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-142e481e-9fd1-45f5-9c14-0b9af813fd85 req-4b7b9798-40eb-4b8d-b864-9fbd48304ecb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:57.759820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-142e481e-9fd1-45f5-9c14-0b9af813fd85 req-4b7b9798-40eb-4b8d-b864-9fbd48304ecb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:57.791642 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-142e481e-9fd1-45f5-9c14-0b9af813fd85 req-4b7b9798-40eb-4b8d-b864-9fbd48304ecb service nova] Creating event network-vif-plugged:c5028830-52b6-4ff4-903e-dd2f1b7d3876 for instance da121054-2171-4d59-953b-a32b36cb4f58 on nch1-master-1 Jul 02 21:02:57.797693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-142e481e-9fd1-45f5-9c14-0b9af813fd85 req-4b7b9798-40eb-4b8d-b864-9fbd48304ecb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056238 Jul 02 21:02:57.799585 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 305/589] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:58.037824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:58.038312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:58.040241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=30 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:58.042470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:02:58.046999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.047775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.048767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.049292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.108830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:58.109611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:58.126024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.126703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.127648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.128283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.365982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:58.369010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:58.377683 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-297ad740-d69b-4e28-9e4b-13e2fb4a30c3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.289304 Jul 02 21:02:58.377823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:58.378282 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 306/590] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:58 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:58.379294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:58.380606 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fd9e3eb-c3d4-4fe4-b3b0-d736adcc9393 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.348680 Jul 02 21:02:58.391140 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 285/591] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:58 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:58.392062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-828da913-76b0-4138-bd86-70e48c33a7d9 req-a3f41889-32a6-4dfc-b2ae-93989691457a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f771465-f947-4a4e-8ff7-f88831cd0858", "tag": "e76f51ad-e581-4220-b761-e5ee3b284d81"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:58.396895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:58.397737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:58.401744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-828da913-76b0-4138-bd86-70e48c33a7d9 req-a3f41889-32a6-4dfc-b2ae-93989691457a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.402432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-828da913-76b0-4138-bd86-70e48c33a7d9 req-a3f41889-32a6-4dfc-b2ae-93989691457a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.412593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.413044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.413830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.414261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.415823 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-828da913-76b0-4138-bd86-70e48c33a7d9 req-a3f41889-32a6-4dfc-b2ae-93989691457a service nova] Creating event network-changed:e76f51ad-e581-4220-b761-e5ee3b284d81 for instance 5f771465-f947-4a4e-8ff7-f88831cd0858 on nch1-master-1 Jul 02 21:02:58.423024 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-828da913-76b0-4138-bd86-70e48c33a7d9 req-a3f41889-32a6-4dfc-b2ae-93989691457a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041221 Jul 02 21:02:58.424387 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 307/592] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:58.587087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:58.601793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ea59213-1a25-40b3-bb51-7bce40c45525 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-636826714", "id": 1207031574, "os-flavor-access:is_public": "False"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:58.603403 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:58.603403 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:02:58.608892 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a2f8858-a31a-4a2e-84a4-ed17c7a94dd6 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.216254 Jul 02 21:02:58.609635 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 286/593] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:58 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:58.624474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:58.625563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:58.626601 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ea59213-1a25-40b3-bb51-7bce40c45525 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.200799 Jul 02 21:02:58.627230 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 308/594] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:58 2022] POST /compute/v2.1/flavors => generated 430 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:58.639550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6588fb78-cc30-4496-bd7c-b93d0c33cd70 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e9a4ea7457ed4f6f95cfce76fb27e6b9"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:58.640585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.641045 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:58.641045 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:02:58.641658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.642816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:58.643419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:58.735584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6588fb78-cc30-4496-bd7c-b93d0c33cd70 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1207031574/action" status: 200 len: 97 microversion: 2.1 time: 0.100337 Jul 02 21:02:58.738554 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 309/595] 10.222.0.43 () {60 vars in 1199 bytes} [Sat Jul 2 21:02:58 2022] POST /compute/v2.1/flavors/1207031574/action => generated 97 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:02:58.850604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:58.861803 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c42b0f88-be4b-4f73-869a-c86392ba9689 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1473 microversion: 2.1 time: 0.249597 Jul 02 21:02:58.863079 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 287/596] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:58 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1473 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:58.868998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-adbf9505-6100-4b33-b59f-821c1ed771c9 tempest-FlavorsAccessTestJSON-225012918 tempest-FlavorsAccessTestJSON-225012918-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:58.893787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-adbf9505-6100-4b33-b59f-821c1ed771c9 tempest-FlavorsAccessTestJSON-225012918 tempest-FlavorsAccessTestJSON-225012918-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 6238 microversion: 2.1 time: 0.149287 Jul 02 21:02:58.895598 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 310/597] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:02:58 2022] GET /compute/v2.1/flavors/detail => generated 6238 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:58.911207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10b7ef46-fc1a-4c44-92f9-9ef83b1a6c8d tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e9a4ea7457ed4f6f95cfce76fb27e6b9"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:58.912620 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:58.912620 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:02:58.990956 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10b7ef46-fc1a-4c44-92f9-9ef83b1a6c8d tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors/1207031574/action" status: 200 len: 21 microversion: 2.1 time: 0.084057 Jul 02 21:02:58.991644 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 288/598] 10.222.0.43 () {60 vars in 1199 bytes} [Sat Jul 2 21:02:58 2022] POST /compute/v2.1/flavors/1207031574/action => generated 21 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:02:59.001205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-91255fb8-a446-40af-8e92-685c9b27545b tempest-FlavorsAccessTestJSON-225012918 tempest-FlavorsAccessTestJSON-225012918-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.023533 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-91255fb8-a446-40af-8e92-685c9b27545b tempest-FlavorsAccessTestJSON-225012918 tempest-FlavorsAccessTestJSON-225012918-project] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.026284 Jul 02 21:02:59.034057 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 311/599] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:02:58 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:59.045750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7405c78-3224-4abe-9335-2b095e3e856a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.047858 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:59.047858 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:02:59.067949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7405c78-3224-4abe-9335-2b095e3e856a tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1207031574" status: 202 len: 0 microversion: 2.1 time: 0.032406 Jul 02 21:02:59.068808 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 289/600] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:02:59 2022] DELETE /compute/v2.1/flavors/1207031574 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:02:59.082567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05e9ac46-57ba-4f88-937b-b634e2fd5817 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.110923 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-05e9ac46-57ba-4f88-937b-b634e2fd5817 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.037762 Jul 02 21:02:59.111642 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 312/601] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:59.127909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-120bcd8e-915a-4ae0-8c17-5543d7b1d1b9 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1974997237", "id": 2096422007, "os-flavor-access:is_public": "False"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:02:59.130185 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:59.130185 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:02:59.156073 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-120bcd8e-915a-4ae0-8c17-5543d7b1d1b9 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.031512 Jul 02 21:02:59.157360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 290/602] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:02:59 2022] POST /compute/v2.1/flavors => generated 431 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:02:59.167844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe312a45-72ef-4371-80ab-3e675c5ff474 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.169111 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:02:59.169111 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:02:59.192468 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe312a45-72ef-4371-80ab-3e675c5ff474 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/2096422007/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.028174 Jul 02 21:02:59.193664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 313/603] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/flavors/2096422007/os-flavor-access => generated 21 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:02:59.215901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f260919a-2e0f-4d44-bc1b-44119f93c5b2 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.237144 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f260919a-2e0f-4d44-bc1b-44119f93c5b2 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/2096422007" status: 202 len: 0 microversion: 2.1 time: 0.031493 Jul 02 21:02:59.237925 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 291/604] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:02:59 2022] DELETE /compute/v2.1/flavors/2096422007 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:02:59.246672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2c0c85bf-5059-4d44-ae8a-837767aed830 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.268816 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2c0c85bf-5059-4d44-ae8a-837767aed830 tempest-FlavorsAccessTestJSON-259022759 tempest-FlavorsAccessTestJSON-259022759-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.026486 Jul 02 21:02:59.269402 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 314/605] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:02:59.407822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.408614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.409775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:59.410341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:59.426666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.429135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.430240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.430657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.431568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.432850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.433907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.434419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.869107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:59.880470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9ed7cd7-3bfe-4437-a31b-b6b3397acec5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.487502 Jul 02 21:02:59.881347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 292/606] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:02:59.886499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.887113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:59.905311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.906002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.908341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.910431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.921149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:59.930474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:59.935374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:02:59.942831 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64428919-adff-4a8d-83ba-2669667d869d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1362 microversion: 2.25 time: 0.546994 Jul 02 21:02:59.943890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 315/607] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:02:59.958814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:02:59.959548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:02:59.968489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.969653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:02:59.970665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:02:59.971287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.233528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:00.236243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:00.246591 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-50439220-a7a7-42d1-be13-fbaed4d107ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1470 microversion: 2.1 time: 0.301167 Jul 02 21:03:00.253679 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 316/608] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:00.261167 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-142c32a4-dfa1-4459-a649-a9d8d3b49133 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.378463 Jul 02 21:03:00.261892 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 293/609] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:02:59 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:00.266655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:00.267446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:00.280061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.280819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.282125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.283064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.380357 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48c49f25-1bab-41f4-a0da-68a226110b28 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605/action" status: 204 len: 0 microversion: 2.1 time: 0.119081 Jul 02 21:03:00.381179 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 317/610] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:03:00 2022] POST /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605/action => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:03:00.399146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:00.399772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:00.418722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.434233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.435842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.436466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.739306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:00.752461 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e45f43b-ec56-43f5-986f-7e5016d5699c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1470 microversion: 2.1 time: 0.366940 Jul 02 21:03:00.758015 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 294/611] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:00 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1470 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:00.898394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:00.899018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:00.901904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5cfe49a4-67b1-4b94-b653-7727df220fd1 req-f4a653c9-e0a7-46da-9079-93121191dc91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b42683-af40-4a05-bbee-a42d6390363f", "tag": "f19aab95-df94-49dd-bdf0-9864b342ed7c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:00.908922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.915584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.917421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.924831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.925120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5cfe49a4-67b1-4b94-b653-7727df220fd1 req-f4a653c9-e0a7-46da-9079-93121191dc91 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.925785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5cfe49a4-67b1-4b94-b653-7727df220fd1 req-f4a653c9-e0a7-46da-9079-93121191dc91 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.941239 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5cfe49a4-67b1-4b94-b653-7727df220fd1 req-f4a653c9-e0a7-46da-9079-93121191dc91 service nova] Creating event network-changed:f19aab95-df94-49dd-bdf0-9864b342ed7c for instance 21b42683-af40-4a05-bbee-a42d6390363f on nch2-master-1 Jul 02 21:03:00.946885 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5cfe49a4-67b1-4b94-b653-7727df220fd1 req-f4a653c9-e0a7-46da-9079-93121191dc91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058279 Jul 02 21:03:00.947872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 318/612] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:03:00.965309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:00.967362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:00.982734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.988913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:00.989911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:00.991916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.340523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:01.360448 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a87755b9-deee-478d-9f5f-414f68d9c66f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.464268 Jul 02 21:03:01.360982 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 295/613] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:00 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:01.369457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:01.372988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:01.383553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:01.393921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:01.395884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:01.396376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.398482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:01.399223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.400186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:01.402656 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d86726c5-a496-481f-bb5b-a57c6ce27412 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1558 microversion: 2.25 time: 0.444909 Jul 02 21:03:01.403893 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 319/614] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:00 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1558 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:01.431835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:01.433380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:01.446865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:01.447622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.449017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:01.449668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.844590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:01.854157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d60eacfc-697e-412b-82ec-a7b46da4e79f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 200 len: 1586 microversion: 2.1 time: 0.491908 Jul 02 21:03:01.866640 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 296/615] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:01 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 1586 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:01.872179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:01.873384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:01.881622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:01.882247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.883703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:01.884979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:01.977164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:01.990778 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d1e50eff-b695-4cca-bf1d-4df2df5088df tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.579314 Jul 02 21:03:01.991738 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 320/616] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:01 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:02.005279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:02.005610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:02.021243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.028815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.029800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.030273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.219102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:02.260673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:02.271574 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-67d6ec85-fe39-472d-8f80-202f1e2aa31f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1470 microversion: 2.1 time: 0.275066 Jul 02 21:03:02.272765 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 321/617] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:01 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1470 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:02.294470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d3ebde4-2c79-4e70-a994-3a5e0d7c5554 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 2051 microversion: 2.25 time: 0.426321 Jul 02 21:03:02.306543 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 297/618] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:01 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 2051 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:02.311670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:02.312334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:02.319283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.320366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.321752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.321752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.376813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:02.377446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:02.383907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.384629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.385584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.386013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.560187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:02.583637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:02.592296 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97481298-c6c4-4466-9f0c-7c23066536ed tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.219405 Jul 02 21:03:02.593122 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 298/619] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:02 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:02.599786 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c9319d4c-4605-4dbb-b3ea-b5d242685610 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 2051 microversion: 2.25 time: 0.285405 Jul 02 21:03:02.600654 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 322/620] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:02 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 2051 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:02.617343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02fdd453-4734-433e-85c3-903ec962a034 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:02.619133 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:02.619133 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:03:02.620788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02fdd453-4734-433e-85c3-903ec962a034 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.621438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02fdd453-4734-433e-85c3-903ec962a034 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.622740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02fdd453-4734-433e-85c3-903ec962a034 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.623642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02fdd453-4734-433e-85c3-903ec962a034 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.655708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02fdd453-4734-433e-85c3-903ec962a034 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042391 Jul 02 21:03:02.662466 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 299/621] 10.222.0.43 () {60 vars in 1216 bytes} [Sat Jul 2 21:03:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:03:02.667736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:02.668535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:02.676182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.676906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.678083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.679222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.766942 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06b2cb83-1eae-4c01-b938-d4cad497d2ac tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58/action" status: 202 len: 0 microversion: 2.25 time: 0.102933 Jul 02 21:03:02.771106 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 323/622] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:03:02 2022] POST /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:03:02.776382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:02.776988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:02.783309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.784564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:02.785334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:02.785768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.011207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:03.013234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:03.026082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.027214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.030486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.031394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.288265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:03.308327 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-682c4e62-d3e3-4103-ac87-f010db719416 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 2056 microversion: 2.25 time: 0.535196 Jul 02 21:03:03.322292 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 300/623] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:02 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 2056 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:03.328564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6cad6f08-c412-46e8-9893-5547e32a670a req-c8fa6895-c4dd-40ce-91ed-2f3800f28123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981", "tag": "4d73663b-0a79-411c-970e-bff04af29e1a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:03.338846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6cad6f08-c412-46e8-9893-5547e32a670a req-c8fa6895-c4dd-40ce-91ed-2f3800f28123 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.339487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6cad6f08-c412-46e8-9893-5547e32a670a req-c8fa6895-c4dd-40ce-91ed-2f3800f28123 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.360838 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6cad6f08-c412-46e8-9893-5547e32a670a req-c8fa6895-c4dd-40ce-91ed-2f3800f28123 service nova] Creating event network-changed:4d73663b-0a79-411c-970e-bff04af29e1a for instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 on nch2-master-1 Jul 02 21:03:03.381656 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6cad6f08-c412-46e8-9893-5547e32a670a req-c8fa6895-c4dd-40ce-91ed-2f3800f28123 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057073 Jul 02 21:03:03.386071 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 301/624] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:03.395947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:03.397393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:03.414050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.414840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.416033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.416662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.626614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:03.643719 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b602f595-c5ab-41f5-a520-605a7cf4d8f2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.639336 Jul 02 21:03:03.644355 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 324/625] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:03 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:03.649767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b085611b-f546-4e72-a8bd-38bc8a19dc2c req-75878994-dc13-49dc-ab1e-32f51c08e0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80f49de-27ea-4b1a-ad57-fec4b4c03605", "name": "network-vif-plugged", "status": "completed", "tag": "09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:03.668709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b085611b-f546-4e72-a8bd-38bc8a19dc2c req-75878994-dc13-49dc-ab1e-32f51c08e0c1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.669056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b085611b-f546-4e72-a8bd-38bc8a19dc2c req-75878994-dc13-49dc-ab1e-32f51c08e0c1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.703883 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b085611b-f546-4e72-a8bd-38bc8a19dc2c req-75878994-dc13-49dc-ab1e-32f51c08e0c1 service nova] Creating event network-vif-plugged:09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009 for instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 on nch2-master-1 Jul 02 21:03:03.716508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-b085611b-f546-4e72-a8bd-38bc8a19dc2c req-75878994-dc13-49dc-ab1e-32f51c08e0c1 service nova] Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:03:03.731402 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b085611b-f546-4e72-a8bd-38bc8a19dc2c req-75878994-dc13-49dc-ab1e-32f51c08e0c1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085165 Jul 02 21:03:03.733431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 325/626] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:03.745810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:03.746947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:03.755747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.756513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.757617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:03.758766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:03.759465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:03.770875 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fd8d3ce-bc98-4a54-8e56-4e7930bd9abd tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1470 microversion: 2.1 time: 0.383363 Jul 02 21:03:03.773117 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 302/627] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:03 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:04.027749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:04.040637 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e85d20d0-acf4-4cc3-8978-d6d5434eb164 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.300524 Jul 02 21:03:04.053166 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 326/628] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:03 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:04.331785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:04.332771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:04.343504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:04.344513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:04.345848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:04.346440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:04.379455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:04.621027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:04.662429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:04.663580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:04.670900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:04.684392 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4540685d-419a-4653-b890-851483ffcd25 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 2056 microversion: 2.25 time: 0.354877 Jul 02 21:03:04.688331 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 303/629] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:04 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 2056 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:04.688575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:04.689222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:04.690244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:04.692258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:04.789928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:04.790849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:04.800638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:04.811082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:04.812596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:04.813340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:05.094219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:05.104999 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffcb1240-53b5-4ff7-8f6e-e4878a3f9ecb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1470 microversion: 2.1 time: 0.319278 Jul 02 21:03:05.107921 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 304/630] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:04 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1470 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:05.121070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:05.121700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:05.137139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:05.137602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:05.138411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:05.138847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:05.294130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:05.298276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:05.305799 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ced8005-d80d-4016-b6af-4e09c857bd30 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.648124 Jul 02 21:03:05.322422 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 327/631] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:04 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:05.497942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:05.510636 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b89889a-688c-4bc3-adeb-13b333b3cb14 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.401593 Jul 02 21:03:05.511899 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 305/632] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:05 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:05.602146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-863ed9f9-7846-4993-a1a3-4f560efd8a4b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Calling method '.version_select at 0x7fabe50c49d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:05.603617 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:05.603617 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:05.604957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863ed9f9-7846-4993-a1a3-4f560efd8a4b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:05.605468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863ed9f9-7846-4993-a1a3-4f560efd8a4b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:05.606384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863ed9f9-7846-4993-a1a3-4f560efd8a4b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:05.608467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863ed9f9-7846-4993-a1a3-4f560efd8a4b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:05.651298 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-863ed9f9-7846-4993-a1a3-4f560efd8a4b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.327357 Jul 02 21:03:05.656912 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 328/633] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:03:05 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:05.703683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:05.704806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:05.721413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:05.722986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:05.724436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:05.726046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.136590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8f2e35b-3534-49f6-9672-0d8f0230e6a3 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Calling method '.version_select at 0x7fabe4ce3b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:06.141761 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:06.141761 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:03:06.143545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8f2e35b-3534-49f6-9672-0d8f0230e6a3 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '1a33cd6c279a484cb0e1fbb6f5275470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b51168214242c293747b7bf732272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8f2e35b-3534-49f6-9672-0d8f0230e6a3 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Request method failure captured: Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKHGmlXjdK6_mToyS4dWuDQVInPPL4-KcB81NgZvPhdTy4MnkEhoz7TZht-p6a-_GC5ZylDsR74WOi4-JIYm-Q7cdL02aBYeclQ1O_LiIXK9V2i6CP1q95CXrVLTSQIjGK7e8vgtlIbyLSDj0-a5DSx8CjMN8i0-DgZuoeNzIl0aZE Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f5b51168214242c293747b7bf732272d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f5b51168214242c293747b7bf732272d"}]}] Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1a33cd6c279a484cb0e1fbb6f5275470 Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:06.153541 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 02 21:03:06.158894 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.161239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8f2e35b-3534-49f6-9672-0d8f0230e6a3 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:06.162372 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8f2e35b-3534-49f6-9672-0d8f0230e6a3 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] 10.222.0.43 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.501725 Jul 02 21:03:06.163174 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 306/634] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:03:05 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 503 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:06.171754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:06.177969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:06.203746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.204593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.205746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.206154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.420456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:06.450975 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-66f41c3f-dd97-47b3-ba3c-ef09529f3132 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 2036 microversion: 2.25 time: 0.751679 Jul 02 21:03:06.451582 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 329/635] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:05 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 2036 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:03:06.462362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2fd8707-d3a9-4027-9b98-c9e47fe71869 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Calling method '.version_select at 0x7fabe4b078b0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:06.463715 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:06.463715 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:06.465289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c2fd8707-d3a9-4027-9b98-c9e47fe71869 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '1a33cd6c279a484cb0e1fbb6f5275470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b51168214242c293747b7bf732272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2fd8707-d3a9-4027-9b98-c9e47fe71869 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Request method failure captured: Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKHGmlXjdK6_mToyS4dWuDQVInPPL4-KcB81NgZvPhdTy4MnkEhoz7TZht-p6a-_GC5ZylDsR74WOi4-JIYm-Q7cdL02aBYeclQ1O_LiIXK9V2i6CP1q95CXrVLTSQIjGK7e8vgtlIbyLSDj0-a5DSx8CjMN8i0-DgZuoeNzIl0aZE Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f5b51168214242c293747b7bf732272d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f5b51168214242c293747b7bf732272d"}]}] Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1a33cd6c279a484cb0e1fbb6f5275470 Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1'} Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.468334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2fd8707-d3a9-4027-9b98-c9e47fe71869 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c2fd8707-d3a9-4027-9b98-c9e47fe71869 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017340 Jul 02 21:03:06.472738 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 330/636] 10.222.0.43 () {58 vars in 1190 bytes} [Sat Jul 2 21:03:06 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:06.474895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:06.475507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:06.508609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.511181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.512812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.513531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.704242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:06.734005 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bead650b-daf9-46fe-85d7-79ebe8b14da2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1470 microversion: 2.1 time: 0.569339 Jul 02 21:03:06.735839 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 307/637] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:06 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1470 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:06.755640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:06.757743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:06.781853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.782696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.784202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.785141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.798120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:06.806957 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c87ac299-0f45-44fa-be87-a76f01eedc10 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.335413 Jul 02 21:03:06.809963 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 331/638] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:06 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:06.819628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85feea2d-65b0-4a1e-b581-d7248383cc74 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Calling method '.version_select at 0x7fabe4db0550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:06.820736 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:06.820736 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:06.835943 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-85feea2d-65b0-4a1e-b581-d7248383cc74 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85feea2d-65b0-4a1e-b581-d7248383cc74 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'nonexistent_hostname'} Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:06.839775 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:06.844499 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:06.851100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85feea2d-65b0-4a1e-b581-d7248383cc74 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:06.852216 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-85feea2d-65b0-4a1e-b581-d7248383cc74 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.041089 Jul 02 21:03:06.853304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 332/639] 10.222.0.43 () {58 vars in 1211 bytes} [Sat Jul 2 21:03:06 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:06.866025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:06.866918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:06.884453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.885188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.886233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:06.886926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:06.925483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'flavor' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:07.016471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Going to try to live migrate instance to nch2-master-1 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:03:07.280646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:07.296483 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b30e4d05-ba73-407d-842b-b7c39d3e5b45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.437082 Jul 02 21:03:07.298371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 333/640] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:06 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:07.315391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4f02576-de75-47a4-801a-7196651ac635 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Calling method '.version_select at 0x7fabe4be6dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.316342 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:07.316342 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:07.318652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c4f02576-de75-47a4-801a-7196651ac635 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '1a33cd6c279a484cb0e1fbb6f5275470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b51168214242c293747b7bf732272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4f02576-de75-47a4-801a-7196651ac635 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Request method failure captured: Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKHGmlXjdK6_mToyS4dWuDQVInPPL4-KcB81NgZvPhdTy4MnkEhoz7TZht-p6a-_GC5ZylDsR74WOi4-JIYm-Q7cdL02aBYeclQ1O_LiIXK9V2i6CP1q95CXrVLTSQIjGK7e8vgtlIbyLSDj0-a5DSx8CjMN8i0-DgZuoeNzIl0aZE Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f5b51168214242c293747b7bf732272d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f5b51168214242c293747b7bf732272d"}]}] Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1a33cd6c279a484cb0e1fbb6f5275470 Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1'} Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.322546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4f02576-de75-47a4-801a-7196651ac635 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c4f02576-de75-47a4-801a-7196651ac635 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.023201 Jul 02 21:03:07.326468 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 334/641] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:07.338463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-cb9a7537-c3fb-47dd-ad55-9379f055e710 req-11a1153a-d4f2-4065-bdfc-9d2e790a83bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b42683-af40-4a05-bbee-a42d6390363f", "name": "network-vif-plugged", "status": "completed", "tag": "f19aab95-df94-49dd-bdf0-9864b342ed7c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:07.385894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-cb9a7537-c3fb-47dd-ad55-9379f055e710 req-11a1153a-d4f2-4065-bdfc-9d2e790a83bc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:07.386370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-cb9a7537-c3fb-47dd-ad55-9379f055e710 req-11a1153a-d4f2-4065-bdfc-9d2e790a83bc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:07.410911 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-cb9a7537-c3fb-47dd-ad55-9379f055e710 req-11a1153a-d4f2-4065-bdfc-9d2e790a83bc service nova] Creating event network-vif-plugged:f19aab95-df94-49dd-bdf0-9864b342ed7c for instance 21b42683-af40-4a05-bbee-a42d6390363f on nch2-master-1 Jul 02 21:03:07.417453 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-cb9a7537-c3fb-47dd-ad55-9379f055e710 req-11a1153a-d4f2-4065-bdfc-9d2e790a83bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087466 Jul 02 21:03:07.441673 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 335/642] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:07.453779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8961303c-2c81-4069-a9a1-2f7b3f0c38f2 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Calling method '.version_select at 0x7fabe4cbb430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.454697 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:07.454697 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:07.470267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8961303c-2c81-4069-a9a1-2f7b3f0c38f2 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8961303c-2c81-4069-a9a1-2f7b3f0c38f2 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'nonexistent_hostname'} Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.476424 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8961303c-2c81-4069-a9a1-2f7b3f0c38f2 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.480231 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8961303c-2c81-4069-a9a1-2f7b3f0c38f2 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035004 Jul 02 21:03:07.481631 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 336/643] 10.222.0.43 () {58 vars in 1190 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:07.504982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-808f6364-283e-4cee-94e9-c124031db85a tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Calling method '.version_select at 0x7fabe4b07dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.505911 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:07.505911 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:07.514912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-808f6364-283e-4cee-94e9-c124031db85a tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '1a33cd6c279a484cb0e1fbb6f5275470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b51168214242c293747b7bf732272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-808f6364-283e-4cee-94e9-c124031db85a tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Request method failure captured: Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKHGmlXjdK6_mToyS4dWuDQVInPPL4-KcB81NgZvPhdTy4MnkEhoz7TZht-p6a-_GC5ZylDsR74WOi4-JIYm-Q7cdL02aBYeclQ1O_LiIXK9V2i6CP1q95CXrVLTSQIjGK7e8vgtlIbyLSDj0-a5DSx8CjMN8i0-DgZuoeNzIl0aZE Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f5b51168214242c293747b7bf732272d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f5b51168214242c293747b7bf732272d"}]}] Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1a33cd6c279a484cb0e1fbb6f5275470 Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1'} Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.516792 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-808f6364-283e-4cee-94e9-c124031db85a tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.528778 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-808f6364-283e-4cee-94e9-c124031db85a tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.032082 Jul 02 21:03:07.530517 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 337/644] 10.222.0.43 () {58 vars in 1196 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:07.537525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d479f6f-654c-487f-9a7e-0b2d250eefd7 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Calling method '.version_select at 0x7fabe6824310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.567495 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-9d479f6f-654c-487f-9a7e-0b2d250eefd7 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d479f6f-654c-487f-9a7e-0b2d250eefd7 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'nonexistent_hostname'} Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.571513 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d479f6f-654c-487f-9a7e-0b2d250eefd7 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.575295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d479f6f-654c-487f-9a7e-0b2d250eefd7 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.041688 Jul 02 21:03:07.578888 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 338/645] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:07.590256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-589866b2-026c-4ab9-b101-e19b535c2134 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Calling method '.version_select at 0x7fabe4db0310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.590933 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:07.590933 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:07.599886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-589866b2-026c-4ab9-b101-e19b535c2134 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '1a33cd6c279a484cb0e1fbb6f5275470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b51168214242c293747b7bf732272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-589866b2-026c-4ab9-b101-e19b535c2134 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Request method failure captured: Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKHGmlXjdK6_mToyS4dWuDQVInPPL4-KcB81NgZvPhdTy4MnkEhoz7TZht-p6a-_GC5ZylDsR74WOi4-JIYm-Q7cdL02aBYeclQ1O_LiIXK9V2i6CP1q95CXrVLTSQIjGK7e8vgtlIbyLSDj0-a5DSx8CjMN8i0-DgZuoeNzIl0aZE Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f5b51168214242c293747b7bf732272d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f5b51168214242c293747b7bf732272d"}]}] Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1a33cd6c279a484cb0e1fbb6f5275470 Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1'} Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.602097 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.605971 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.605971 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.605971 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:03:07.605971 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:03:07.605971 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 02 21:03:07.605971 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.613525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-589866b2-026c-4ab9-b101-e19b535c2134 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.615068 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-589866b2-026c-4ab9-b101-e19b535c2134 tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] 10.222.0.43 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.028700 Jul 02 21:03:07.616548 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 339/646] 10.222.0.43 () {58 vars in 1193 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:07.628291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daf405a2-0adf-4a4e-be73-9e4f7dc4b01c tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Calling method '.version_select at 0x7fabe4be69d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.646992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-daf405a2-0adf-4a4e-be73-9e4f7dc4b01c tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daf405a2-0adf-4a4e-be73-9e4f7dc4b01c tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'nonexistent_hostname'} Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.650938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:07.655461 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.660188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daf405a2-0adf-4a4e-be73-9e4f7dc4b01c tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.663514 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-daf405a2-0adf-4a4e-be73-9e4f7dc4b01c tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.039135 Jul 02 21:03:07.676820 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 340/647] 10.222.0.43 () {58 vars in 1214 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:07.686238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daa4632a-9485-4804-918d-1b82c0c62011 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Action: 'update', calling method: .version_select at 0x7fabe4db00d0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daa4632a-9485-4804-918d-1b82c0c62011 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 51 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: {"status": "enable", "maintenance_mode": "invalid"} Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'disable', Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'Enable', Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'Disable', Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance: Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'invalid' Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:03:07.699645 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.705471 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.712884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daa4632a-9485-4804-918d-1b82c0c62011 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.713302 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-daa4632a-9485-4804-918d-1b82c0c62011 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.035069 Jul 02 21:03:07.716964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 341/648] 10.222.0.43 () {60 vars in 1189 bytes} [Sat Jul 2 21:03:07 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:03:07.726291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b946b5c-8654-4f47-86a1-81bb7c17e89b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Action: 'update', calling method: .version_select at 0x7fabe53abee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b946b5c-8654-4f47-86a1-81bb7c17e89b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 51 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: {"status": "invalid", "maintenance_mode": "enable"} Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'disable', Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'Enable', Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'Disable', Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance: Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'invalid' Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:03:07.730473 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 02 21:03:07.734587 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.737697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b946b5c-8654-4f47-86a1-81bb7c17e89b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.739379 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b946b5c-8654-4f47-86a1-81bb7c17e89b tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.017510 Jul 02 21:03:07.740558 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 342/649] 10.222.0.43 () {60 vars in 1189 bytes} [Sat Jul 2 21:03:07 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:03:07.769565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aee1a981-a9e9-4d47-8f61-d7c0fabdca1e tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Action: 'update', calling method: .version_select at 0x7fabe4da08b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:07.772921 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:07.772921 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:07.777608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-aee1a981-a9e9-4d47-8f61-d7c0fabdca1e tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '1a33cd6c279a484cb0e1fbb6f5275470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b51168214242c293747b7bf732272d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aee1a981-a9e9-4d47-8f61-d7c0fabdca1e tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Request method failure captured: Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 50 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKHGmlXjdK6_mToyS4dWuDQVInPPL4-KcB81NgZvPhdTy4MnkEhoz7TZht-p6a-_GC5ZylDsR74WOi4-JIYm-Q7cdL02aBYeclQ1O_LiIXK9V2i6CP1q95CXrVLTSQIjGK7e8vgtlIbyLSDj0-a5DSx8CjMN8i0-DgZuoeNzIl0aZE Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f5b51168214242c293747b7bf732272d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f5b51168214242c293747b7bf732272d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f5b51168214242c293747b7bf732272d"}]}] Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f5b51168214242c293747b7bf732272d Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-330774824 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1a33cd6c279a484cb0e1fbb6f5275470 Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-330774824-project Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: {"status": "enable", "maintenance_mode": "enable"} Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 02 21:03:07.779322 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:07.783415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aee1a981-a9e9-4d47-8f61-d7c0fabdca1e tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:07.789084 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aee1a981-a9e9-4d47-8f61-d7c0fabdca1e tempest-HostsAdminNegativeTestJSON-330774824 tempest-HostsAdminNegativeTestJSON-330774824-project] 10.222.0.43 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.038077 Jul 02 21:03:07.794013 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 343/650] 10.222.0.43 () {60 vars in 1189 bytes} [Sat Jul 2 21:03:07 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:07.799124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:07.799892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:07.823465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:07.823953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:07.824839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:07.825300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:08.321696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:08.335380 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b838341f-7ed4-44b4-8d23-b1e0b644e76d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1462 microversion: 2.1 time: 0.540151 Jul 02 21:03:08.337015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 344/651] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:07 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1462 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:08.364947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbe8c128-4b5a-4dd9-b759-6887e7313618 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Action: 'update', calling method: .version_select at 0x7fabe4c8f040>, body: {"status": null, "maintenance_mode": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbe8c128-4b5a-4dd9-b759-6887e7313618 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 42 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: {"status": null, "maintenance_mode": null} Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'disable', Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'Enable', Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'Disable', Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance: Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi None Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:03:08.373866 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbe8c128-4b5a-4dd9-b759-6887e7313618 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:08.382689 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dbe8c128-4b5a-4dd9-b759-6887e7313618 tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.023597 Jul 02 21:03:08.384900 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 345/652] 10.222.0.43 () {60 vars in 1189 bytes} [Sat Jul 2 21:03:08 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:03:08.399745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:08.402076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:08.429097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:08.429585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:08.431516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:08.433973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:08.672442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:08.688733 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9fce86ed-e285-4118-b360-43d0702e2da0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1319 microversion: 2.1 time: 0.303078 Jul 02 21:03:08.698316 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 346/653] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:08 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:08.713655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:08.714874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:08.729689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:08.730154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:08.731106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:08.731488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:08.978968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:08.990879 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44f6bed4-4741-4ea8-a17c-2c212a9d43fb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.295418 Jul 02 21:03:08.991838 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 347/654] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:08 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:08.998935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:08.999552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:09.013004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:09.013838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:09.014233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:09.014668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:09.264156 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a476e1ac-7183-42b1-8765-a9e616a7f839 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1613 microversion: 2.1 time: 0.268669 Jul 02 21:03:09.276065 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 348/655] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:08 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1613 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:09.277530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64fc1995-1ae7-4315-bbca-c7eceb4264da tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Action: 'update', calling method: .version_select at 0x7fabe5507e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:09.280631 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:09.280631 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:09.280631 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.hosts [None req-64fc1995-1ae7-4315-bbca-c7eceb4264da tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Enabling host nonexistent_hostname. Jul 02 21:03:09.303896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-64fc1995-1ae7-4315-bbca-c7eceb4264da tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64fc1995-1ae7-4315-bbca-c7eceb4264da tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Request method failure captured: Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 50 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKJNww7qvwI72M9fuhv57tQddEIJni1DNoAjHj2EQafHuFETH07xUuQFUvhyegHUNEn_KkbA9vzI5SoQJOIXdSPHD1Z14AGBp9xs2oTIv4fRFczdz5Qsnq5ovyshSRDpnx_Oyi-KzlSf6SVLN5mDPjr9DGpB4-NUu2Lqm9dozzuUho Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dfe9fb969f744191b6062e5403c99233", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dfe9fb969f744191b6062e5403c99233"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dfe9fb969f744191b6062e5403c99233"}]}] Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dfe9fb969f744191b6062e5403c99233 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1390217524 Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 30201a4ea6a94c3bb49adccc556159fc Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1390217524-project-admin Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: {"status": "enable", "maintenance_mode": "enable"} Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:09.305671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64fc1995-1ae7-4315-bbca-c7eceb4264da tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64fc1995-1ae7-4315-bbca-c7eceb4264da tempest-HostsAdminNegativeTestJSON-1390217524 tempest-HostsAdminNegativeTestJSON-1390217524-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.041407 Jul 02 21:03:09.309727 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 349/656] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 21:03:09 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:09.316597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-910172a7-9c54-4b5e-9d70-b7fc31657fe2 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '.version_select at 0x7fabe4ad6310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:09.319242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-910172a7-9c54-4b5e-9d70-b7fc31657fe2 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:09.319685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-910172a7-9c54-4b5e-9d70-b7fc31657fe2 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:09.336898 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-910172a7-9c54-4b5e-9d70-b7fc31657fe2 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1130 microversion: 2.1 time: 0.028216 Jul 02 21:03:09.348282 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 350/657] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:03:09 2022] GET /compute/v2.1/os-migrations => generated 1130 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:09.706967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:09.707662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:09.718600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:09.719358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:09.720477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:09.721296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:10.070417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:10.078538 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b0c3b58-c406-42b1-8b9e-8e74ea007469 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1469 microversion: 2.1 time: 0.376242 Jul 02 21:03:10.093485 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 351/658] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:09 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:10.103668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1816943199", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:10.205978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:10.234642 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43a829be-2e67-4374-9722-11d66e5e9802 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58/action" status: 202 len: 0 microversion: 2.25 time: 3.483470 Jul 02 21:03:10.236110 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 308/659] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:03:06 2022] POST /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58/action => generated 0 bytes in 3486 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:03:10.265675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-88875bb4-ad2f-4080-96d6-78b8ed2c5b8e req-d1095fec-d01e-4fa7-905e-15bbdd5f9214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f771465-f947-4a4e-8ff7-f88831cd0858", "name": "network-vif-plugged", "status": "completed", "tag": "e76f51ad-e581-4220-b761-e5ee3b284d81"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:10.287412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88875bb4-ad2f-4080-96d6-78b8ed2c5b8e req-d1095fec-d01e-4fa7-905e-15bbdd5f9214 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:10.288525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88875bb4-ad2f-4080-96d6-78b8ed2c5b8e req-d1095fec-d01e-4fa7-905e-15bbdd5f9214 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:10.311403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-88875bb4-ad2f-4080-96d6-78b8ed2c5b8e req-d1095fec-d01e-4fa7-905e-15bbdd5f9214 service nova] Creating event network-vif-plugged:e76f51ad-e581-4220-b761-e5ee3b284d81 for instance 5f771465-f947-4a4e-8ff7-f88831cd0858 on nch1-master-1 Jul 02 21:03:10.325449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-88875bb4-ad2f-4080-96d6-78b8ed2c5b8e req-d1095fec-d01e-4fa7-905e-15bbdd5f9214 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087645 Jul 02 21:03:10.326378 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 309/660] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:10.334090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:10.335073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:10.342229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:10.342693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:10.343538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:10.345216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:10.833068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:10.854356 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-184837d0-54b1-48fe-9622-bf5e017dcc2e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.524989 Jul 02 21:03:10.856982 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 310/661] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:10 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:10.873252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:10.874221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:10.886670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:10.887545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:10.890630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:10.891368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.038801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:11.039324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:11.039642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:11.041089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:11.041338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:11.057895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:11.058349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.059157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:11.059603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.122694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:11.130249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for user 592e8c2ad31f459fa0b37f219cc4f84c and project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:11.155736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:11.163750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:11.233118 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0986ba02-120b-4a92-96a0-8441b6a71150 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138229 Jul 02 21:03:11.239531 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 352/662] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:11.245335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:11.256853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:11.280761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:11.282300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.283383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:11.284434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.392367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:11.420192 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-132e6019-927a-41fb-b9dc-30d264fa05d0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 200 len: 1319 microversion: 2.1 time: 0.561817 Jul 02 21:03:11.424332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 311/663] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:10 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:11.641298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:11.659431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:11.660279 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-044317f9-1617-48a1-948c-141c1c29fa9b tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] 10.222.0.43 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.224913 Jul 02 21:03:11.660808 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 312/664] 10.222.0.43 () {58 vars in 1127 bytes} [Sat Jul 2 21:03:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 02 21:03:11.661487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:11.666423 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-21106683-7756-4079-999b-728659616a01 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.422456 Jul 02 21:03:11.667400 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 353/665] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:11 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:11.674273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a346e198-7f67-4a7e-9538-98cae3a49a71 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:11.674895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a346e198-7f67-4a7e-9538-98cae3a49a71 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:11.681679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-351836b5-8ef1-40e9-814b-1d4e831caa81 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Calling method '.version_select at 0x7fabe4db0700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:11.770922 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-351836b5-8ef1-40e9-814b-1d4e831caa81 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] HTTP exception thrown: Image not found. Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-351836b5-8ef1-40e9-814b-1d4e831caa81 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Request method failure captured: Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKPRZt6EUxG8T6fSofjja0_R8QgdqqmXnvQCrmNFhyKR7xZCUztBbQm9te8S60U2dhdGFUHtINOAU0jnCbTGgngQh-pr2lXAX3b_YOfTM5j-d2jgOvquX62YDB-Zk4frOrE3fPUB1MqxRHIBrpQ6bAqLcRQzWMbddBE5ylZL0_6rR0 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d9b6d27cc864181b2c9b80cfe70565c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d9b6d27cc864181b2c9b80cfe70565c"}]}] Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: c790cfcf5ebd49358bd53a6baf622b89 Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '-1'} Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.778334 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-351836b5-8ef1-40e9-814b-1d4e831caa81 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-351836b5-8ef1-40e9-814b-1d4e831caa81 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] 10.222.0.43 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.111253 Jul 02 21:03:11.783745 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 354/666] 10.222.0.43 () {58 vars in 1133 bytes} [Sat Jul 2 21:03:11 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:11.796214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b1792f4-0327-4b8a-88c9-411e21be23d9 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Calling method '.version_select at 0x7fabe4b07dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:11.864933 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0b1792f4-0327-4b8a-88c9-411e21be23d9 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] HTTP exception thrown: Image not found. Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b1792f4-0327-4b8a-88c9-411e21be23d9 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Request method failure captured: Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/images/dee64e62-8635-4f75-80f6-e3eef6b2a2cj HTTP/1.1 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKPRZt6EUxG8T6fSofjja0_R8QgdqqmXnvQCrmNFhyKR7xZCUztBbQm9te8S60U2dhdGFUHtINOAU0jnCbTGgngQh-pr2lXAX3b_YOfTM5j-d2jgOvquX62YDB-Zk4frOrE3fPUB1MqxRHIBrpQ6bAqLcRQzWMbddBE5ylZL0_6rR0 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d9b6d27cc864181b2c9b80cfe70565c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d9b6d27cc864181b2c9b80cfe70565c"}]}] Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: c790cfcf5ebd49358bd53a6baf622b89 Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'dee64e62-8635-4f75-80f6-e3eef6b2a2cj'} Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image dee64e62-8635-4f75-80f6-e3eef6b2a2cj to delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image dee64e62-8635-4f75-80f6-e3eef6b2a2cj could not be found. Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:11.867305 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:03:11.872730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:11.876107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b1792f4-0327-4b8a-88c9-411e21be23d9 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:11.877858 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b1792f4-0327-4b8a-88c9-411e21be23d9 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] 10.222.0.43 "DELETE /compute/v2.1/images/dee64e62-8635-4f75-80f6-e3eef6b2a2cj" status: 404 len: 62 microversion: 2.1 time: 0.088110 Jul 02 21:03:11.878613 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 355/667] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:11 2022] DELETE /compute/v2.1/images/dee64e62-8635-4f75-80f6-e3eef6b2a2cj => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:03:11.898805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:11.907323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:11.917298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:11.923500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.924742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:11.927523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:11.988911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a346e198-7f67-4a7e-9538-98cae3a49a71 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:12.003074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a346e198-7f67-4a7e-9538-98cae3a49a71 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1213 microversion: 2.1 time: 0.340538 Jul 02 21:03:12.010155 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 313/668] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:11 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:12.028520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c09c35fe-9bdd-4499-b343-297818f02c01 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Calling method '.version_select at 0x7fabe4dee0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:12.068832 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c09c35fe-9bdd-4499-b343-297818f02c01 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] HTTP exception thrown: Image not found. Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c09c35fe-9bdd-4499-b343-297818f02c01 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Request method failure captured: Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/7fb40a66-9800-4132-9392-2765ef07e8461 HTTP/1.1 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKPRZt6EUxG8T6fSofjja0_R8QgdqqmXnvQCrmNFhyKR7xZCUztBbQm9te8S60U2dhdGFUHtINOAU0jnCbTGgngQh-pr2lXAX3b_YOfTM5j-d2jgOvquX62YDB-Zk4frOrE3fPUB1MqxRHIBrpQ6bAqLcRQzWMbddBE5ylZL0_6rR0 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d9b6d27cc864181b2c9b80cfe70565c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d9b6d27cc864181b2c9b80cfe70565c"}]}] Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: c790cfcf5ebd49358bd53a6baf622b89 Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7fb40a66-9800-4132-9392-2765ef07e8461'} Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7fb40a66-9800-4132-9392-2765ef07e8461 to delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7fb40a66-9800-4132-9392-2765ef07e8461 could not be found. Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.093158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:03:12.099293 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.105990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c09c35fe-9bdd-4499-b343-297818f02c01 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:12.107306 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c09c35fe-9bdd-4499-b343-297818f02c01 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] 10.222.0.43 "DELETE /compute/v2.1/images/7fb40a66-9800-4132-9392-2765ef07e8461" status: 404 len: 62 microversion: 2.1 time: 0.095798 Jul 02 21:03:12.108655 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 314/669] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:03:12 2022] DELETE /compute/v2.1/images/7fb40a66-9800-4132-9392-2765ef07e8461 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:12.115073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-687cee1b-0efa-4c35-9532-f89ef52f67db req-a59658d8-d22d-4826-a684-cb0eec2f30e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da121054-2171-4d59-953b-a32b36cb4f58", "name": "network-vif-unplugged", "status": "completed", "tag": "c5028830-52b6-4ff4-903e-dd2f1b7d3876"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:12.124806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-687cee1b-0efa-4c35-9532-f89ef52f67db req-a59658d8-d22d-4826-a684-cb0eec2f30e8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.125529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-687cee1b-0efa-4c35-9532-f89ef52f67db req-a59658d8-d22d-4826-a684-cb0eec2f30e8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:12.138683 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-687cee1b-0efa-4c35-9532-f89ef52f67db req-a59658d8-d22d-4826-a684-cb0eec2f30e8 service nova] Creating event network-vif-unplugged:c5028830-52b6-4ff4-903e-dd2f1b7d3876 for instance da121054-2171-4d59-953b-a32b36cb4f58 on nch1-master-1 Jul 02 21:03:12.145796 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-687cee1b-0efa-4c35-9532-f89ef52f67db req-a59658d8-d22d-4826-a684-cb0eec2f30e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035716 Jul 02 21:03:12.148406 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 315/670] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:12.155011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d1dd392-a25e-46c8-a457-9ed4ff984262 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Calling method '.version_select at 0x7fabe4bf4dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:12.254049 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3d1dd392-a25e-46c8-a457-9ed4ff984262 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] HTTP exception thrown: Image not found. Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d1dd392-a25e-46c8-a457-9ed4ff984262 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Request method failure captured: Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/tempest-invalid-773987561 HTTP/1.1 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKPRZt6EUxG8T6fSofjja0_R8QgdqqmXnvQCrmNFhyKR7xZCUztBbQm9te8S60U2dhdGFUHtINOAU0jnCbTGgngQh-pr2lXAX3b_YOfTM5j-d2jgOvquX62YDB-Zk4frOrE3fPUB1MqxRHIBrpQ6bAqLcRQzWMbddBE5ylZL0_6rR0 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d9b6d27cc864181b2c9b80cfe70565c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d9b6d27cc864181b2c9b80cfe70565c"}]}] Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: c790cfcf5ebd49358bd53a6baf622b89 Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'tempest-invalid-773987561'} Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-773987561 to delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-773987561 could not be found. Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.258135 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:03:12.262125 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.267158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d1dd392-a25e-46c8-a457-9ed4ff984262 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:12.268502 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d1dd392-a25e-46c8-a457-9ed4ff984262 tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] 10.222.0.43 "DELETE /compute/v2.1/images/tempest-invalid-773987561" status: 404 len: 62 microversion: 2.1 time: 0.118189 Jul 02 21:03:12.274458 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 316/671] 10.222.0.43 () {58 vars in 1202 bytes} [Sat Jul 2 21:03:12 2022] DELETE /compute/v2.1/images/tempest-invalid-773987561 => generated 62 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:12.295480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-931cd2e0-3488-4638-af2f-cb12ae81a92c tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Calling method '.version_select at 0x7fabe4ad4040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:12.325730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:12.334069 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-931cd2e0-3488-4638-af2f-cb12ae81a92c tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] HTTP exception thrown: Image not found. Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-931cd2e0-3488-4638-af2f-cb12ae81a92c tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Request method failure captured: Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/c158385d-a903-4974-b10d-3c013f4a8bbf HTTP/1.1 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKPRZt6EUxG8T6fSofjja0_R8QgdqqmXnvQCrmNFhyKR7xZCUztBbQm9te8S60U2dhdGFUHtINOAU0jnCbTGgngQh-pr2lXAX3b_YOfTM5j-d2jgOvquX62YDB-Zk4frOrE3fPUB1MqxRHIBrpQ6bAqLcRQzWMbddBE5ylZL0_6rR0 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d9b6d27cc864181b2c9b80cfe70565c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d9b6d27cc864181b2c9b80cfe70565c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d9b6d27cc864181b2c9b80cfe70565c"}]}] Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 1d9b6d27cc864181b2c9b80cfe70565c Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-952106362 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: c790cfcf5ebd49358bd53a6baf622b89 Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-952106362-project Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c158385d-a903-4974-b10d-3c013f4a8bbf'} Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c158385d-a903-4974-b10d-3c013f4a8bbf to delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c158385d-a903-4974-b10d-3c013f4a8bbf could not be found. Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.340442 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:03:12.345077 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:03:12.347045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-931cd2e0-3488-4638-af2f-cb12ae81a92c tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:12.349825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-931cd2e0-3488-4638-af2f-cb12ae81a92c tempest-ImagesDeleteNegativeTestJSON-952106362 tempest-ImagesDeleteNegativeTestJSON-952106362-project] 10.222.0.43 "DELETE /compute/v2.1/images/c158385d-a903-4974-b10d-3c013f4a8bbf" status: 404 len: 62 microversion: 2.1 time: 0.066406 Jul 02 21:03:12.356475 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 317/672] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:12 2022] DELETE /compute/v2.1/images/c158385d-a903-4974-b10d-3c013f4a8bbf => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:03:12.361356 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59701ff6-471a-4f88-990f-e4b354d47704 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.480828 Jul 02 21:03:12.362331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 356/673] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:11 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:12.442959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:12.444465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:12.458641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.459264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:12.460094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.463687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:12.632880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:12.687679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:12.688329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:12.702690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.705666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:12.707032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.708915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:12.794572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:12.802783 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d85934ee-4053-45ed-bd8f-a26745cdd84e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 200 len: 1469 microversion: 2.1 time: 0.364730 Jul 02 21:03:12.803557 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 318/674] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:12 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 1469 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:12.819717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:12.823764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:12.832304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Searching by: {'reservation_id': 'r-21tnr4vs', 'deleted': False, 'project_id': '065f852898294f2c8a154eb8d5f498f0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:03:12.838624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.846816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:12.848184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:12.848859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.054723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:03:13.159583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:13.170120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:13.171688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:13.177177 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a689933-562a-4ce0-8271-bddda81410b2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.495898 Jul 02 21:03:13.180838 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 357/675] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:12 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:13.193692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:13.194624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:13.205658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:13.214728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.214937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.215291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.215937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.217108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.221836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.464967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:13.474913 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b01cbe32-c70d-4336-8f77-b5948f86fbe9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1273 microversion: 2.1 time: 0.292312 Jul 02 21:03:13.475515 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 358/676] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:13 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:13.490479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:13.491100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:13.508946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.509651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.510739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.511475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.565349 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-846d8cdc-929e-4b74-b5c2-d0d13ea51e95 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?reservation_id=r-21tnr4vs" status: 200 len: 2931 microversion: 2.1 time: 0.749363 Jul 02 21:03:13.566144 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 319/677] 10.222.0.43 () {58 vars in 1196 bytes} [Sat Jul 2 21:03:12 2022] GET /compute/v2.1/servers/detail?reservation_id=r-21tnr4vs => generated 2931 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:13.585091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f140b1e-e6d8-4434-aa55-eef68fae3589 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:13.646184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-2f140b1e-e6d8-4434-aa55-eef68fae3589 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Querying cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) for 2 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 02 21:03:13.648635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f140b1e-e6d8-4434-aa55-eef68fae3589 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.655563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f140b1e-e6d8-4434-aa55-eef68fae3589 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.737680 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f140b1e-e6d8-4434-aa55-eef68fae3589 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/63fb177a-a5e8-4f64-be23-2e9155fbd294" status: 200 len: 270 microversion: 2.1 time: 0.156847 Jul 02 21:03:13.738775 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 320/678] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:03:13 2022] GET /compute/v2.1/os-server-groups/63fb177a-a5e8-4f64-be23-2e9155fbd294 => generated 270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:13.764540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:13.765711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:13.776264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.780298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.783128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:13.785360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:13.821968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:13.835173 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-233442d0-df94-4f86-9bfd-52f8b2325ff5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.352782 Jul 02 21:03:13.835794 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 359/679] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:13 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:13.994756 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28895073-5d77-4e65-bac4-0f3d8760180c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 200 len: 1620 microversion: 2.1 time: 0.240768 Jul 02 21:03:13.997172 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 321/680] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:13 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 1620 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:14.012140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:14.012763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:14.025662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.026186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.026906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.029025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.204378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:14.208594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:14.232184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.233079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.235081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.235815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.256848 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7f6446ba-c41e-4bea-baa4-3487735c652c tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 200 len: 1620 microversion: 2.1 time: 0.248542 Jul 02 21:03:14.272377 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 360/681] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:14 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 1620 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:14.291285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-33df99d8-e649-4eb8-80f5-f8715ddbd569 req-7d5fba60-6481-4d1e-b751-b7e3a204b292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da121054-2171-4d59-953b-a32b36cb4f58", "tag": "c5028830-52b6-4ff4-903e-dd2f1b7d3876"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:14.300666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-33df99d8-e649-4eb8-80f5-f8715ddbd569 req-7d5fba60-6481-4d1e-b751-b7e3a204b292 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.301386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-33df99d8-e649-4eb8-80f5-f8715ddbd569 req-7d5fba60-6481-4d1e-b751-b7e3a204b292 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.315802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-33df99d8-e649-4eb8-80f5-f8715ddbd569 req-7d5fba60-6481-4d1e-b751-b7e3a204b292 service nova] Creating event network-changed:c5028830-52b6-4ff4-903e-dd2f1b7d3876 for instance da121054-2171-4d59-953b-a32b36cb4f58 on nch1-master-1 Jul 02 21:03:14.322889 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-33df99d8-e649-4eb8-80f5-f8715ddbd569 req-7d5fba60-6481-4d1e-b751-b7e3a204b292 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049099 Jul 02 21:03:14.324102 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 361/682] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:14.462030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-57287522", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "899cd575-ce36-4ba9-b0a3-5d4704088bf1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:14.543269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:14.599536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:14.614850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:14.620516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:14.621785 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6cc88d5-383e-4ad8-b25d-32f1d2361f06 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.427425 Jul 02 21:03:14.625141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 322/683] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:14 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:14.630105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:14.636907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:14.651376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.652986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.656914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.657524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.813602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:14.821251 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f218b182-c09a-4eb3-bcb7-8746e3fea6a4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1271 microversion: 2.1 time: 0.194757 Jul 02 21:03:14.825020 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 323/684] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:14 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1271 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:14.853136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:14.853758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:14.868413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.868843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.869632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:14.870242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:14.921385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:15.091364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:15.092263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:15.092959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:15.094145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:15.095369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:15.113243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:15.114130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:15.115401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:15.116212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:15.162045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:15.177192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:15.198320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:15.219548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:15.223812 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-180fde87-4a6e-4b41-ac65-f9ec595ba997 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.375605 Jul 02 21:03:15.226609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:15.240015 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 324/685] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:14 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:15.353142 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e02827ef-9053-4b1d-85fe-fbbcf798e568 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899476 Jul 02 21:03:15.361050 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 362/686] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:15.372925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1626405-9a30-4110-8a26-fc9f5af67837 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:15.373727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1626405-9a30-4110-8a26-fc9f5af67837 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:15.474745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1626405-9a30-4110-8a26-fc9f5af67837 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:15.492978 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1626405-9a30-4110-8a26-fc9f5af67837 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1215 microversion: 2.1 time: 0.125923 Jul 02 21:03:15.498840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 325/687] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:15 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:15.644636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:15.647860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:15.666284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:15.670494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:15.674884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:15.675679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:15.691549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:15.839742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:15.840404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:15.843511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=7,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:15.863763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:15.864365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:15.865232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:15.865689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:16.246232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:16.254388 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff6f397f-bfb3-4875-83e8-0cfde526f6ff tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1271 microversion: 2.1 time: 0.419364 Jul 02 21:03:16.258898 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 326/688] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:15 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1271 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:16.325533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:16.344172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:16.346207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:16.348870 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b45de501-bbdb-4c78-aeae-e9aac4252373 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.709990 Jul 02 21:03:16.353039 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 363/689] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:15 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:16.358375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:16.361769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:16.375912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:16.376817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:16.377835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:16.382932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:16.593791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:16.604196 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f6621bf2-a44a-4d45-bf15-db307e7febbc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.249534 Jul 02 21:03:16.616790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 364/690] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:16 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:16.630378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:16.631121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:16.651084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:16.652349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:16.653270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:16.653789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:16.941724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:16.957460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Calling method '.version_select at 0x7fabe4b2d310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:16.959321 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:16.959321 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:03:16.960280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:16.961299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:16.966339 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e22b5213-1f42-43a6-a812-b9f9aa87f543 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1211 microversion: 2.1 time: 0.339858 Jul 02 21:03:16.969136 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 365/691] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:16 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1211 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:17.027761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.028633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.069143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.069790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.098674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.099135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.167490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.167946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.190193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6aabd840-64c6-4083-b457-c768e84a17a1 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2545 microversion: 2.53 time: 0.930111 Jul 02 21:03:17.197421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 327/692] 10.222.0.43 () {60 vars in 1242 bytes} [Sat Jul 2 21:03:16 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2545 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:17.211685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Calling method '.version_select at 0x7fabe4a7d940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:17.214520 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:17.214520 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:17.217950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.218622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.246137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.250155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.297089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:17.298379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:17.321760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.325922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.334219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.335074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.489028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.492823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.523347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.526340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.626844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.630503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.650858 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d24bf50-7244-477c-b5dd-c46a7f024dcc tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 1239 microversion: 2.53 time: 0.443504 Jul 02 21:03:17.653129 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 366/693] 10.222.0.43 () {60 vars in 1221 bytes} [Sat Jul 2 21:03:17 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 1239 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:03:17.666379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:17.668715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:17.676183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.681327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:17.682444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:17.683071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.159985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:18.181512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:18.183862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:18.186474 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7f39b6b7-3188-44c2-89e5-3427765b9baa tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.528027 Jul 02 21:03:18.189623 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 367/694] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:17 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:18.197088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:18.197933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:18.210796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:18.211533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.216340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:18.216994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.238716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:18.246732 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5821dded-7833-498d-ac24-8480b359d97d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.978690 Jul 02 21:03:18.253304 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 328/695] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:17 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:18.258237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-226c1cd8-08ec-4fc7-91eb-32a0ff461014 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Calling method '.version_select at 0x7fabe4ad4f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:18.270695 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:18.270695 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:03:18.272455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226c1cd8-08ec-4fc7-91eb-32a0ff461014 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:18.273177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226c1cd8-08ec-4fc7-91eb-32a0ff461014 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.328263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226c1cd8-08ec-4fc7-91eb-32a0ff461014 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:18.329095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-226c1cd8-08ec-4fc7-91eb-32a0ff461014 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.340327 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-226c1cd8-08ec-4fc7-91eb-32a0ff461014 tempest-HypervisorAdminV253TestBase-1441701049 tempest-HypervisorAdminV253TestBase-1441701049-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/28b30f45-ce91-48bc-9940-c8278b6a0bbe" status: 200 len: 791 microversion: 2.53 time: 0.085241 Jul 02 21:03:18.342802 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 329/696] 10.222.0.43 () {60 vars in 1297 bytes} [Sat Jul 2 21:03:18 2022] GET /compute/v2.1/os-hypervisors/28b30f45-ce91-48bc-9940-c8278b6a0bbe => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:03:18.351447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:18.353243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:18.360770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:18.361588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.362631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:18.363281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:18.615816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:18.624476 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98e58fa3-5781-4396-90e4-436a01ed4fde tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1273 microversion: 2.1 time: 0.279608 Jul 02 21:03:18.625072 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 330/697] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:18 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1273 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:18.747212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:18.766903 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-639fb283-8c3c-4652-adec-a286119bd4c2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.574021 Jul 02 21:03:18.767922 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 368/698] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:18 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:19.207387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:19.208300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:19.222696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:19.223421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:19.224496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:19.225198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:19.273357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:19.274054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:19.290439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:19.290894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:19.294059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:19.294519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:20.291622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:20.309679 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef17087c-6aa8-4157-94d1-58d4bfc2dd41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 1.043856 Jul 02 21:03:20.315105 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 369/699] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:19 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:20.321313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-90d29498-f498-43c1-9292-948d5850131b req-f8818256-b88d-4a92-9a12-bba9a9050c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f6a822-7105-43d0-b2d3-934f6e737e6e", "tag": "5d1235fa-f55d-444b-99f9-811cc2aa77fe"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:20.338532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:20.349408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-90d29498-f498-43c1-9292-948d5850131b req-f8818256-b88d-4a92-9a12-bba9a9050c56 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:20.358363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-90d29498-f498-43c1-9292-948d5850131b req-f8818256-b88d-4a92-9a12-bba9a9050c56 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:20.371690 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-90d29498-f498-43c1-9292-948d5850131b req-f8818256-b88d-4a92-9a12-bba9a9050c56 service nova] Creating event network-changed:5d1235fa-f55d-444b-99f9-811cc2aa77fe for instance a0f6a822-7105-43d0-b2d3-934f6e737e6e on nch1-master-1 Jul 02 21:03:20.382248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-90d29498-f498-43c1-9292-948d5850131b req-f8818256-b88d-4a92-9a12-bba9a9050c56 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063960 Jul 02 21:03:20.384301 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 370/700] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:20.408910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:20.410041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:20.418694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:20.420175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:20.421906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:20.422563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:20.437723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:20.446108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:20.447719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:20.448929 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e1560ff-4829-452f-ba05-557524244388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 1.245659 Jul 02 21:03:20.461177 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 331/701] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:19 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:20.466323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:20.466952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:20.476492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:20.477181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:20.478117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:20.478700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:21.242886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:21.255838 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74e3ad59-a1f6-457f-987b-30c4ef4e04eb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.793110 Jul 02 21:03:21.257353 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 332/702] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:20 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:21.283171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b70dc554-adae-4f68-8ee7-0964279709c4 req-e8496ff3-2ac3-4fea-92b6-cee414467fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da121054-2171-4d59-953b-a32b36cb4f58", "name": "network-vif-unplugged", "status": "completed", "tag": "c5028830-52b6-4ff4-903e-dd2f1b7d3876"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:21.299755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b70dc554-adae-4f68-8ee7-0964279709c4 req-e8496ff3-2ac3-4fea-92b6-cee414467fe4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:21.300247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b70dc554-adae-4f68-8ee7-0964279709c4 req-e8496ff3-2ac3-4fea-92b6-cee414467fe4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:21.326335 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b70dc554-adae-4f68-8ee7-0964279709c4 req-e8496ff3-2ac3-4fea-92b6-cee414467fe4 service nova] Creating event network-vif-unplugged:c5028830-52b6-4ff4-903e-dd2f1b7d3876 for instance da121054-2171-4d59-953b-a32b36cb4f58 on nch1-master-1 Jul 02 21:03:21.334874 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b70dc554-adae-4f68-8ee7-0964279709c4 req-e8496ff3-2ac3-4fea-92b6-cee414467fe4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059597 Jul 02 21:03:21.335823 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 333/703] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:21.360842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:21.361620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:21.375543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:21.379508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:21.380594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:21.381481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:21.868946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:21.878639 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dabcd382-7396-4868-8fbb-e9d6a27acfd7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 1.475744 Jul 02 21:03:21.883035 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 371/704] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:20 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:21.901750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:21.902985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:21.913152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:21.914259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:21.915819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:21.916780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:22.272085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:22.283345 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a758dce3-85c1-44f0-8412-2cd8d732af3e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.945748 Jul 02 21:03:22.284648 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 334/705] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:21 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:22.293750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:22.294730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:22.302334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:22.302795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:22.303587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:22.304027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:22.539442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:22.562876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:22.564634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:22.565970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e82e0c2e-7a25-4de1-b32b-8e36fd0d7bf9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.670435 Jul 02 21:03:22.567121 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 372/706] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:21 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:22.576613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-502ad520-c546-4135-b573-4b92200acfff req-1afa91e5-c3c1-4015-9fc2-e8e134308041 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e281607-e359-403e-bb39-f07c0da0f9a0", "tag": "ecf19188-5ba0-4a12-80a2-36d614e8002a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:22.600839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-502ad520-c546-4135-b573-4b92200acfff req-1afa91e5-c3c1-4015-9fc2-e8e134308041 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:22.601092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-502ad520-c546-4135-b573-4b92200acfff req-1afa91e5-c3c1-4015-9fc2-e8e134308041 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:22.618432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-502ad520-c546-4135-b573-4b92200acfff req-1afa91e5-c3c1-4015-9fc2-e8e134308041 service nova] Creating event network-changed:ecf19188-5ba0-4a12-80a2-36d614e8002a for instance 1e281607-e359-403e-bb39-f07c0da0f9a0 on nch1-master-1 Jul 02 21:03:22.636824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-502ad520-c546-4135-b573-4b92200acfff req-1afa91e5-c3c1-4015-9fc2-e8e134308041 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068336 Jul 02 21:03:22.637758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 373/707] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:22.888192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:22.898699 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c950a8fe-3ae7-4cc1-a656-8db25bbf0062 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.609339 Jul 02 21:03:22.900811 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 335/708] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:22 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:22.909999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:22.912127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:22.919068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:22.919741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:22.921061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:22.921652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:23.262387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:23.272354 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6887ab00-bcd8-45be-b10b-567bb593224a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.375052 Jul 02 21:03:23.273322 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 374/709] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:22 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:23.301751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:23.302373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:23.305360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:23.312220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:23.312958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:23.313961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:23.314561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:23.583538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:23.584411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:23.595954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:23.596443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:23.599000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:23.599486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:23.931793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:23.945817 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-526d6e01-b858-499e-8bf7-7ccbed4392b2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.649463 Jul 02 21:03:23.947119 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 336/710] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:23 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:24.131752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39a4a6a3-7d85-436d-8a15-2b42cece8f5c tempest-InstanceUsageAuditLogTestJSON-668364957 tempest-InstanceUsageAuditLogTestJSON-668364957-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:24.133417 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:24.133417 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:03:24.160525 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39a4a6a3-7d85-436d-8a15-2b42cece8f5c tempest-InstanceUsageAuditLogTestJSON-668364957 tempest-InstanceUsageAuditLogTestJSON-668364957-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-02 21:03:23" status: 200 len: 318 microversion: 2.1 time: 0.211085 Jul 02 21:03:24.162294 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 337/711] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:03:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-02%2021%3A03%3A23 => generated 318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:24.170549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:24.171744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:24.179221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:24.180074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:24.181113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:24.181894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:24.524205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:24.533943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:24.536993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:24.538191 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f1668277-ce66-46a5-a44f-ec581fde1847 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.958652 Jul 02 21:03:24.538767 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 375/712] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:23 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:03:24.555534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f9437b9-a00a-4ec1-83ca-fb8c9fd88100 tempest-InstanceUsageAuditLogTestJSON-668364957 tempest-InstanceUsageAuditLogTestJSON-668364957-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:24.556348 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:03:24.556348 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:03:24.584864 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f9437b9-a00a-4ec1-83ca-fb8c9fd88100 tempest-InstanceUsageAuditLogTestJSON-668364957 tempest-InstanceUsageAuditLogTestJSON-668364957-project-admin] 10.222.0.43 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.044973 Jul 02 21:03:24.585554 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 376/713] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:03:24 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:24.622598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:24.623392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:24.640726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:24.641503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:24.643651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:24.644388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:24.700404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:24.710656 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e06a11c-96ad-4ade-935f-a1e21fa7bc1c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.547054 Jul 02 21:03:24.712367 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 338/714] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:24 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:24.963533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:24.964599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:24.975308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:24.976259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:24.977373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:24.978022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:25.137526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:25.165031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:25.173629 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-50dff6eb-a7c7-418a-855a-078180e0f4bc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.561375 Jul 02 21:03:25.184095 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 377/715] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:24 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:25.403667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:25.423666 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-240ec5ee-adc1-499b-986c-05bf19de227b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.464120 Jul 02 21:03:25.426718 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 339/716] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:24 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:25.557841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:25.558457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:25.571759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:25.572246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:25.573034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:25.573648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:25.729109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:25.730783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:25.743445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:25.748847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:25.751669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:25.753504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:26.475157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:26.519641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:26.521996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:26.526795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:26.536971 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e35e0131-d3ce-4071-9b30-5594158d222f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1514 microversion: 2.1 time: 0.812003 Jul 02 21:03:26.540382 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 340/717] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:25 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1514 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:26.546972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:26.548098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:26.551017 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a187f55-ba7b-4d4b-828a-d139cc11fb2a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1568 microversion: 2.25 time: 0.997941 Jul 02 21:03:26.555951 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 378/718] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:25 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1568 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:26.563034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:26.565239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:26.576235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:26.576728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:26.577517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:26.578386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:26.580370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:26.581579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:26.584319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:26.585858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:27.028846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:27.038658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d2823fb-e475-4961-9587-0a1fd9e50b36 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.496128 Jul 02 21:03:27.048982 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 341/719] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:26 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:27.067066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:27.080020 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f4b7eddd-59ca-46d5-ae36-161b6e0e3407 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.522586 Jul 02 21:03:27.081506 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 379/720] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:26 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:27.561808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:27.562451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:27.611154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:27.614165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:27.638259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:27.639742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:27.643889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:27.645472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:27.681821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:27.690494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:27.696521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:27.699669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.154046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:28.158298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:28.170842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dae975e3-1103-4e1d-85e2-d3c4d0023960 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1520 microversion: 2.1 time: 0.618174 Jul 02 21:03:28.172173 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 342/721] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:27 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:28.179717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:28.180896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:28.192000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.193004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.194981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.197696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.214041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:28.219898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:28.266522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:28.271557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:28.273144 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4da04e1-d03d-4f2a-b144-4a2c2c698d1c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1543 microversion: 2.25 time: 0.683596 Jul 02 21:03:28.289306 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 380/722] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:27 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1543 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:28.300735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:28.303634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:28.321415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.323335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.325588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.329919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.726713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:28.742867 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5e6919a2-e0a9-4167-a1b5-701026af6b98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.451122 Jul 02 21:03:28.743898 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 381/723] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:28 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:28.761850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-af41f1bf-b945-4932-97a9-86660ac077d7 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '.version_select at 0x7fabe4cb5160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:28.767500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af41f1bf-b945-4932-97a9-86660ac077d7 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.768704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af41f1bf-b945-4932-97a9-86660ac077d7 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.780586 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-af41f1bf-b945-4932-97a9-86660ac077d7 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1524 microversion: 2.25 time: 0.034986 Jul 02 21:03:28.781499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:28.793957 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 382/724] 10.222.0.43 () {60 vars in 1183 bytes} [Sat Jul 2 21:03:28 2022] GET /compute/v2.1/os-migrations => generated 1524 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:28.799324 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95f66235-973c-4602-808b-ba15a86ceef4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.623789 Jul 02 21:03:28.799937 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 343/725] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:28 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:28.804123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:28.804746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:28.811876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.812355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:28.813309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:28.813908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:29.288828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid da121054-2171-4d59-953b-a32b36cb4f58 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:03:29.326639 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1e7af04c-1fd1-4643-8132-63d07d972754 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 2036 microversion: 2.25 time: 0.531366 Jul 02 21:03:29.334019 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 383/726] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:28 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 2036 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:29.353682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:29.356324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:29.387612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:29.389555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:29.393273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:29.394962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:29.429883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-543302896", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "927c611d-f98b-4600-8983-948f75698425"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:29.531121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] validate_networks() for [('927c611d-f98b-4600-8983-948f75698425', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:30.098312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:30.106551 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a46c1861-1cf8-4cd4-8fd8-dd67c1e217d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1520 microversion: 2.1 time: 0.763242 Jul 02 21:03:30.110837 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 384/727] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:29 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1520 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:30.120473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-90d7f960-4e5a-4d99-b0c6-226bec5daddd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Action: 'create', calling method: .version_select at 0x7fabe4b07d30>, body: {"keypair": {"name": "tempest-keypair-1013394427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFi1Nobbqpwj3IapsihEPeFNofhdvx0ZbZjYMvcjmJUXh4Ajr+NF/6RihscqE8oDaQTa0Tpo1c8ChtHs4aKxNKU2NxpQKtRlhVBASCMy0exeeMh/c27uvyteoA87Hl2ruw=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:30.192968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-90d7f960-4e5a-4d99-b0c6-226bec5daddd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:30.229391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-90d7f960-4e5a-4d99-b0c6-226bec5daddd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for user f3287fb85c2343d686718d3c4aaa5c00 and project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:30.289257 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-90d7f960-4e5a-4d99-b0c6-226bec5daddd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.172555 Jul 02 21:03:30.297321 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 385/728] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:03:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:03:30.304017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:30.305153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:30.314024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:30.314812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:30.315796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:30.316466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:30.774071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:30.791980 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-60b9d916-0224-4890-b2dc-2bde9bb7fced tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.490033 Jul 02 21:03:30.795052 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 386/729] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:30 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:30.812671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:30.815100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:30.820622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:30.821178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:30.821747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:30.822317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:30.822918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:30.835042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:30.835828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:30.836417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:30.837653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:30.838347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:30.839389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:30.840193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:30.841565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:30.876753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Getting quotas for project ad0b5a189e934370af07b11ee0a9e737. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:30.891553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Getting quotas for user 223fd6f7a4c84114af7a22eb19cc7034 and project ad0b5a189e934370af07b11ee0a9e737. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:30.910127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:30.917193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:31.025261 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63cfbe73-5800-494f-ab42-c000b46c5419 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896073 Jul 02 21:03:31.026823 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 344/730] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:03:31.309937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:31.325789 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb565663-a59f-43fb-9470-cdd782b7548d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.526176 Jul 02 21:03:31.328118 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 387/731] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:30 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:31.352651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76d60ff4-0534-463c-9b17-bea4a9b2eafd tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:31.353500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76d60ff4-0534-463c-9b17-bea4a9b2eafd tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:31.447353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-534428702", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:31.512516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76d60ff4-0534-463c-9b17-bea4a9b2eafd tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:31.523959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76d60ff4-0534-463c-9b17-bea4a9b2eafd tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1215 microversion: 2.1 time: 0.191487 Jul 02 21:03:31.526346 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 388/732] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:31 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1215 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:31.537306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:31.540133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:31.555700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:31.556426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:31.557969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:31.558796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:31.589956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:32.387100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:32.397165 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fbe17bdf-8fd0-467b-8f60-e65cce753a33 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1520 microversion: 2.1 time: 0.868948 Jul 02 21:03:32.410482 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 389/733] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:31 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1520 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:32.429861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:32.435055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:32.467283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.467751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.468617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.472976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.499176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:32.501546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:32.502070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:32.502825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:32.503337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:32.528508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.529527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.530367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.537819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.622680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Getting quotas for project 48b2d24d625d4151b67de30f8fa7b918. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:32.630705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Getting quotas for user 6c9e360aff3b43688e88f739a1723921 and project 48b2d24d625d4151b67de30f8fa7b918. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:32.668288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:32.677481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:32.750742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:32.762632 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e3fbf85-1071-41e5-941e-eeac401368bb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.350928 Jul 02 21:03:32.764333 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 390/734] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:32 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:32.772434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f4542dcd-bb50-4988-b329-a56f6063c2a3 req-bd74b4cc-2bfc-4d77-b647-0de8a42e2072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f6a822-7105-43d0-b2d3-934f6e737e6e", "name": "network-vif-plugged", "status": "completed", "tag": "5d1235fa-f55d-444b-99f9-811cc2aa77fe"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:32.790465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f4542dcd-bb50-4988-b329-a56f6063c2a3 req-bd74b4cc-2bfc-4d77-b647-0de8a42e2072 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.790971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f4542dcd-bb50-4988-b329-a56f6063c2a3 req-bd74b4cc-2bfc-4d77-b647-0de8a42e2072 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.842074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-849e7963-ba75-4cdd-a001-56377fc91ffc tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813680 Jul 02 21:03:32.846472 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 345/735] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:32.853143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:32.860260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:32.875554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.877240 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f4542dcd-bb50-4988-b329-a56f6063c2a3 req-bd74b4cc-2bfc-4d77-b647-0de8a42e2072 service nova] Creating event network-vif-plugged:5d1235fa-f55d-444b-99f9-811cc2aa77fe for instance a0f6a822-7105-43d0-b2d3-934f6e737e6e on nch1-master-1 Jul 02 21:03:32.878365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.879193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.879637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.884824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f4542dcd-bb50-4988-b329-a56f6063c2a3 req-bd74b4cc-2bfc-4d77-b647-0de8a42e2072 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119090 Jul 02 21:03:32.885666 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 391/736] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:32.895557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:32.896797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:32.921891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.922566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:32.923514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:32.924179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:33.105913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:33.115065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26cde8ec-5cf9-44aa-9501-a427c6bfe3a5 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1267 microversion: 2.1 time: 0.227986 Jul 02 21:03:33.115668 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 392/737] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:32 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:33.134746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b1f3928-3af9-4150-8ec2-bb6972b6c7a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:33.135358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b1f3928-3af9-4150-8ec2-bb6972b6c7a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:33.389383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2b1f3928-3af9-4150-8ec2-bb6972b6c7a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:33.399504 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b1f3928-3af9-4150-8ec2-bb6972b6c7a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1221 microversion: 2.1 time: 0.282461 Jul 02 21:03:33.405395 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 393/738] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:33 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:33.418719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:33.424415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:33.447149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:33.448330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:33.451553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:33.452362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.225842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:34.248877 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1a9af7a-5de7-4d6e-a56b-9d519a84fd76 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 1.401193 Jul 02 21:03:34.251586 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 346/739] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:32 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:34.273316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:34.279924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:34.299450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:34.302662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.308502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:34.309422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.352682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:34.363735 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce11bab0-18a4-480e-93a7-1bb3056e0dcc tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1520 microversion: 2.1 time: 0.953420 Jul 02 21:03:34.365576 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 394/740] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:33 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1520 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:34.372765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:34.373707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:34.412993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:34.414741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.417390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:34.418243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.573651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:34.591508 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cafd1447-55cb-48bd-8782-3dd95ec66970 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1273 microversion: 2.1 time: 0.220914 Jul 02 21:03:34.592838 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 395/741] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:34 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1273 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:34.611699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:34.612810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:34.625409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:34.630997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:34.632654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.633726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:34.634676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:34.651991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-726203df-2211-4c59-be92-b11313e20275 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1313 microversion: 2.1 time: 0.395824 Jul 02 21:03:34.655627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 347/742] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:34 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:34.745381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:34.764730 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-065fbfbb-bacb-49ea-b1ef-684fdf553f9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1273 microversion: 2.1 time: 0.169341 Jul 02 21:03:34.766036 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 396/743] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:34 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:34.841182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1931055790", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f62f5bc7-af47-49bf-8b23-df56ea5c37d7"}], "security_groups": [{"name": "tempest-securitygroup--342930240"}], "key_name": "tempest-keypair-1013394427", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:34.983478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2a9f3eb8-9bd3-47fc-a840-eaf6890a7236 req-69509267-5600-4971-ac63-0a0f5ea74c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca237da0-7482-4d58-bf6d-9195648cc8cf", "name": "network-vif-plugged", "status": "completed", "tag": "a89fc1f6-7e9e-4891-a0dd-90d0e71479fd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:35.022669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2a9f3eb8-9bd3-47fc-a840-eaf6890a7236 req-69509267-5600-4971-ac63-0a0f5ea74c43 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:35.023117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2a9f3eb8-9bd3-47fc-a840-eaf6890a7236 req-69509267-5600-4971-ac63-0a0f5ea74c43 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:35.055760 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2a9f3eb8-9bd3-47fc-a840-eaf6890a7236 req-69509267-5600-4971-ac63-0a0f5ea74c43 service nova] Creating event network-vif-plugged:a89fc1f6-7e9e-4891-a0dd-90d0e71479fd for instance ca237da0-7482-4d58-bf6d-9195648cc8cf on nch2-master-1 Jul 02 21:03:35.066981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2a9f3eb8-9bd3-47fc-a840-eaf6890a7236 req-69509267-5600-4971-ac63-0a0f5ea74c43 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089007 Jul 02 21:03:35.070189 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 397/744] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:35.141685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] validate_networks() for [('f62f5bc7-af47-49bf-8b23-df56ea5c37d7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:35.268533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:35.269263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:35.297164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:35.297758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:35.304876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:35.305554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:35.677134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:35.687088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17aff7b0-1d46-4e6e-9070-90ae33dc7c58 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.423863 Jul 02 21:03:35.687679 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 398/745] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:35 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:35.692631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:35.693425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:35.700231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:35.700987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:35.701957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:35.702388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.202163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:36.207762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:36.208793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:36.209502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:36.210136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:36.210773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:36.226235 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-73689ccd-4579-42a3-9a98-76a0e80e97cd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1520 microversion: 2.1 time: 0.537284 Jul 02 21:03:36.227162 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 399/746] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:35 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:36.232273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.235063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:36.236193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.237260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.237937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.241400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:36.253866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.256836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.257947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.259560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.288854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:36.304218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for user f3287fb85c2343d686718d3c4aaa5c00 and project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:36.348000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:36.353704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:36.434853 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5702c1e2-44ad-482f-afd2-819a35f53e2d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.599048 Jul 02 21:03:36.441620 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 348/747] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:03:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:03:36.456164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:36.456989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:36.471192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.475938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.477826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.481764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.527267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:03:36.635145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:36.667244 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5885fda-db1e-48b3-9d01-b3a24b0a1f45 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.437923 Jul 02 21:03:36.673009 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 400/748] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:36 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:36.689209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:36.691401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:36.714604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.716261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.739013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.743169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.786310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:36.804924 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2131e7d4-ad65-45e6-9785-4a8c2df13938 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 204 len: 0 microversion: 2.1 time: 0.361481 Jul 02 21:03:36.805661 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 349/749] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:03:36 2022] DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:03:36.825275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:36.829514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:36.853528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.854202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:36.855738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:36.856462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:37.063023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:37.076203 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21db032b-4b85-45c0-9a99-6c05d30f789d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1279 microversion: 2.1 time: 0.264930 Jul 02 21:03:37.077931 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 350/750] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:36 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:37.101219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3715795-96fc-4b5c-b9ee-ec8d6a0f2231 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:37.101900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3715795-96fc-4b5c-b9ee-ec8d6a0f2231 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:37.149099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:37.161954 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3f0bf7a-af21-4d71-8fa5-bf91311881ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1463 microversion: 2.1 time: 0.487236 Jul 02 21:03:37.162555 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 401/751] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:36 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1463 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:37.186087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:37.186800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:37.205384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:37.205850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:37.218741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:37.219436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:37.264505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3715795-96fc-4b5c-b9ee-ec8d6a0f2231 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:37.279062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3715795-96fc-4b5c-b9ee-ec8d6a0f2231 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:37.280888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3715795-96fc-4b5c-b9ee-ec8d6a0f2231 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:37.285426 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3715795-96fc-4b5c-b9ee-ec8d6a0f2231 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1286 microversion: 2.25 time: 0.206129 Jul 02 21:03:37.286008 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 351/752] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:37 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1286 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:37.301597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:37.305259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1189755101", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "1875449373", "adminPass": "***", "networks": [{"uuid": "c25ea663-5e9a-4916-94b7-43938648177b"}], "security_groups": [{"name": "tempest-securitygroup--1606372305"}], "key_name": "tempest-keypair-614579100", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:37.523291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:37.537659 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54cb2147-9674-442b-91dd-fc83ac18cd88 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.371082 Jul 02 21:03:37.540339 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 402/753] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:37 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:37.559571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6e114018-0310-4d0a-bdb4-97d56e614866 req-6d76b5d3-5b9b-4f53-938f-39c03191682b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e281607-e359-403e-bb39-f07c0da0f9a0", "name": "network-vif-plugged", "status": "completed", "tag": "ecf19188-5ba0-4a12-80a2-36d614e8002a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:37.597610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e114018-0310-4d0a-bdb4-97d56e614866 req-6d76b5d3-5b9b-4f53-938f-39c03191682b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:37.601544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e114018-0310-4d0a-bdb4-97d56e614866 req-6d76b5d3-5b9b-4f53-938f-39c03191682b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:37.639361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] validate_networks() for [('c25ea663-5e9a-4916-94b7-43938648177b', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:37.649765 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6e114018-0310-4d0a-bdb4-97d56e614866 req-6d76b5d3-5b9b-4f53-938f-39c03191682b service nova] Creating event network-vif-plugged:ecf19188-5ba0-4a12-80a2-36d614e8002a for instance 1e281607-e359-403e-bb39-f07c0da0f9a0 on nch1-master-1 Jul 02 21:03:37.672421 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6e114018-0310-4d0a-bdb4-97d56e614866 req-6d76b5d3-5b9b-4f53-938f-39c03191682b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123228 Jul 02 21:03:37.674095 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 403/754] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:37.681348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:37.690281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:37.728101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:37.735018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:37.736997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:37.739680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:37.975503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:38.017208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Old instance type m1.heat2, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:03:38.027265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:38.028403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:38.029650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:38.030867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:38.032726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:38.206635 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-52a8a673-6f0d-4ca0-b8f5-670ec09a4718 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e/action" status: 202 len: 0 microversion: 2.1 time: 0.530198 Jul 02 21:03:38.209897 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 404/755] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:03:37 2022] POST /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:03:38.215000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:38.215761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:38.223804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:38.224413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:38.225294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:38.226502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:38.720178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:38.732609 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6f09ff6e-2dfe-4474-aa6a-55f3bfa004af tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1520 microversion: 2.1 time: 0.521405 Jul 02 21:03:38.742603 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 405/756] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:38 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1520 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:38.742603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:38.742603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:38.752471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:38.753561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:38.755588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:38.756598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.150051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:39.163779 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-98e03aec-0302-469c-af16-a1447f66efb1 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.426481 Jul 02 21:03:39.167473 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 406/757] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:38 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:39.174722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1064c81d-10e6-4324-96fd-fbbb4d181683 req-eda67b87-34e9-4016-8cb9-6bc294851665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3ae6a5-bb89-46b2-81cc-44222bd446a5", "tag": "c13488a0-fcef-4ee3-8f93-74b5e0e0e4d9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:39.188587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1064c81d-10e6-4324-96fd-fbbb4d181683 req-eda67b87-34e9-4016-8cb9-6bc294851665 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.189038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1064c81d-10e6-4324-96fd-fbbb4d181683 req-eda67b87-34e9-4016-8cb9-6bc294851665 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.223411 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1064c81d-10e6-4324-96fd-fbbb4d181683 req-eda67b87-34e9-4016-8cb9-6bc294851665 service nova] Creating event network-changed:c13488a0-fcef-4ee3-8f93-74b5e0e0e4d9 for instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 on nch1-master-1 Jul 02 21:03:39.240078 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1064c81d-10e6-4324-96fd-fbbb4d181683 req-eda67b87-34e9-4016-8cb9-6bc294851665 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070863 Jul 02 21:03:39.240710 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 407/758] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:39.257624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:39.258129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:39.258511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:39.259433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:39.260013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:39.269869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:39.270461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=31 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:39.272576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.274936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.274936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.275152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:39.275288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.298254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Getting quotas for project f8920bed46d34026a06fedf429e5cca4. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:39.307400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.307864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.309411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.309994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.311887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Getting quotas for user a60bf5141fea499abb9b22658e56c944 and project f8920bed46d34026a06fedf429e5cca4. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:39.328151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:39.330678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:39.427938 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e1b12d5-b3eb-421b-b8b6-471c428ee4c1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.138370 Jul 02 21:03:39.428652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 352/759] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:39.450434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:39.452985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:39.465685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.466287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.467221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.467727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.765910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:39.775852 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-930035ed-124b-48fe-ba48-e9cea677bd8f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.520743 Jul 02 21:03:39.777257 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 408/760] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:39 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:39.810858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:39.811774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:39.824135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.824601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:39.833119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:39.835351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.021270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.033449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f1d10af-4209-44a3-8e13-3a0f5a0f8371 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1472 microversion: 2.1 time: 0.603713 Jul 02 21:03:40.039730 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 353/761] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:39 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1472 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:40.055464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:40.059169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:40.077811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.078450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.081609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.084340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.313154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.331956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.366248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.369482 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bdc198f4-696c-40c6-b3f1-1ec8e116ff6c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1338 microversion: 2.25 time: 0.572593 Jul 02 21:03:40.374481 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 409/762] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:39 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1338 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:40.382174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24509670-6e0c-4322-8e24-9227bbfc7d6c tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:40.382910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-24509670-6e0c-4322-8e24-9227bbfc7d6c tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:40.579451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-24509670-6e0c-4322-8e24-9227bbfc7d6c tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.592728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=25 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:40.595202 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-24509670-6e0c-4322-8e24-9227bbfc7d6c tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1264 microversion: 2.1 time: 0.218735 Jul 02 21:03:40.597560 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 410/763] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:40 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:40.605140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:40.605946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:40.613478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.614199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.615192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.615931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.698781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.709078 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f26321b-ee74-4056-aa77-9baf3f0606dd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1315 microversion: 2.1 time: 0.667516 Jul 02 21:03:40.718835 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 354/764] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:40 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:40.724924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:40.725837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:40.735965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.736709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.737694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.738286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.949667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:40.957689 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b76eb7fb-f289-48f2-959f-91a166ef9359 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1505 microversion: 2.1 time: 0.358608 Jul 02 21:03:40.969394 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 411/765] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:40 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:40.974662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:40.975522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:40.978749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:40.982873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.983564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:40.984626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:40.985244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.087806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.114483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adfda0cb-54d6-4ab3-b09e-9acd9b296e47 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.391966 Jul 02 21:03:41.127710 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 355/766] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:40 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:41.138882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:41.140077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:41.151436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.152218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.157920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.159091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.329624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.340086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2cf02ac3-5393-4b6f-9de3-84b1befc7605 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.369460 Jul 02 21:03:41.351189 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 412/767] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:40 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:41.357985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:41.358978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:41.368592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.369456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.370540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.371252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.483697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.501859 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7d75d14-3c14-49a0-9e7f-d449b170313c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 200 len: 1505 microversion: 2.1 time: 0.371384 Jul 02 21:03:41.513653 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 356/768] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:41 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:41.519416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:41.520339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:41.529107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.529873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.530876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.531533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.619472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.635536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.639066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.640542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-638d70b7-ed4c-4378-9eb8-b10f1a39deda tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1344 microversion: 2.25 time: 0.125501 Jul 02 21:03:41.641168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.643320 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 357/769] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:41 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:41.648147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:41.648755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:41.653013 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c2cb67c8-9c55-430d-b717-286af526280c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1472 microversion: 2.1 time: 0.300121 Jul 02 21:03:41.654366 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 413/770] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:41 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:41.659471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.659899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.661270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:41.662173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:41.663215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.663654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.670749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.671719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.673212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.674185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.694481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:03:41.804583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:41.816907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7fdf6cd9-4bab-4d32-9510-7921f82f7cbd tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1268 microversion: 2.1 time: 0.158755 Jul 02 21:03:41.819780 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 414/771] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:41 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:41.829634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:41.830214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:41.843600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.844165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.848267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:41.848729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:41.872619 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8b6e795-f534-4c89-8ba6-6fdaf76b7db6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 204 len: 0 microversion: 2.1 time: 0.227139 Jul 02 21:03:41.873628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 358/772] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:03:41 2022] DELETE /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:03:42.114774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1095795652", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "49cbb4f5-eef9-4fda-a4e0-d3a303af09da"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:42.128539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:42.139736 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e9a79ba-af9b-475c-a69e-57d8ebbaf984 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1464 microversion: 2.1 time: 0.318502 Jul 02 21:03:42.144442 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 415/773] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:41 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:42.151942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:42.152596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:42.187706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:42.188204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:42.189429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:42.189877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:42.257903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] validate_networks() for [('49cbb4f5-eef9-4fda-a4e0-d3a303af09da', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:42.660634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:42.672923 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1185ae26-ea6e-4e68-b3c5-a446487710bf tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.526831 Jul 02 21:03:42.673594 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 416/774] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:42 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:42.687365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:42.687980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:42.721710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:42.731981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:42.734059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:42.734854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:43.738151 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-953f9306-90cf-4f06-ac6d-ca1208f21e72 tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1615 microversion: 2.1 time: 1.054555 Jul 02 21:03:43.756756 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 417/775] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:42 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1615 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:43.775196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-56a3d508-8665-4c8c-a99e-fd6f1c5d04dd req-3e2f10fe-cbf3-459d-ab46-2586a5e449b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981", "name": "network-vif-deleted", "tag": "4d73663b-0a79-411c-970e-bff04af29e1a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:43.803162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-56a3d508-8665-4c8c-a99e-fd6f1c5d04dd req-3e2f10fe-cbf3-459d-ab46-2586a5e449b2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:43.804940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-56a3d508-8665-4c8c-a99e-fd6f1c5d04dd req-3e2f10fe-cbf3-459d-ab46-2586a5e449b2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:43.847885 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-56a3d508-8665-4c8c-a99e-fd6f1c5d04dd req-3e2f10fe-cbf3-459d-ab46-2586a5e449b2 service nova] Creating event network-vif-deleted:4d73663b-0a79-411c-970e-bff04af29e1a for instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 on nch2-master-1 Jul 02 21:03:43.862347 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-56a3d508-8665-4c8c-a99e-fd6f1c5d04dd req-3e2f10fe-cbf3-459d-ab46-2586a5e449b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099610 Jul 02 21:03:43.867122 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 418/776] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:43.877004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:43.882007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:43.914701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:43.914958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:43.921760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:43.922784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:43.992095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:43.993173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:43.993815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:43.994418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:43.994996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:44.013583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:44.015508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:44.016902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:44.019018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:44.074504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Getting quotas for project 4c4a0acce7ef425b93c417e1a8fccf78. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:44.086804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Getting quotas for user b16a9c9e35954d579536375f7eab1c9b and project 4c4a0acce7ef425b93c417e1a8fccf78. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:44.123952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:44.130176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:44.258923 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73c885e8-47d1-4a61-89bd-349a14e7cdf4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.147705 Jul 02 21:03:44.268702 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 359/777] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:44.280173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:44.287047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:44.306085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:44.307886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:44.310400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:44.329311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:44.412544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:44.539101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:44.550430 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c6cd256-4ec9-43ca-a6eb-432ebd508bb7 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.680610 Jul 02 21:03:44.552493 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 419/778] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:43 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:44.566641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:44.568161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:44.579927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:44.582247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:44.583060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:44.583504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:44.619709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:45.167882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:45.183744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:45.185831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:45.193378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7112f360-3099-4a54-b8c2-bc1afe1aeca6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.921866 Jul 02 21:03:45.195659 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 360/779] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:44 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:45.210575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:45.211196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:45.225678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:45.226149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:45.227036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:45.227482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:45.373753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:45.396427 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5687c1b-98fe-48ee-8fc1-ff7893b38e7d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1322 microversion: 2.1 time: 0.196381 Jul 02 21:03:45.397981 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 361/780] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:45 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:45.404787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:45.406636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:45.414100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:45.414871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:45.416327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:45.417082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:45.708119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:45.734227 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1fd03b34-9d7d-41bf-adea-780e865ad50f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1472 microversion: 2.1 time: 1.179487 Jul 02 21:03:45.735588 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 420/781] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:44 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1472 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:45.744914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-248332004", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["899cd575-ce36-4ba9-b0a3-5d4704088bf1"]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:45.833331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:46.005285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:46.013951 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fe0f073-4239-43db-b799-cd3726011c1b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.614693 Jul 02 21:03:46.024151 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 362/782] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:45 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:46.030088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:46.030988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:46.043810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:46.044656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:46.049194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:46.049971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:46.273220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:46.292825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d282d182-2dff-403d-8721-d654897cb2d3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1270 microversion: 2.1 time: 0.266964 Jul 02 21:03:46.305660 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 363/783] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:46 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1270 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:46.313731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:46.325373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:46.335536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:46.335987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:46.336790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:46.337222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:46.835190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:46.850932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e48099af-120e-4101-b512-ea6803b342d5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.541039 Jul 02 21:03:46.852966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 364/784] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:46 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:46.872424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:46.873867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:46.890097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:46.891069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:46.892554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:46.893254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.120775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:47.121291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:47.121901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:47.122517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:47.123016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:47.151598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.157882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.159452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.163306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.217930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:47.233754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:47.249480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:47.259862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:47.265513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:47.269720 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c3fb669-faba-498a-bd4f-9e819fbfb4a5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.414883 Jul 02 21:03:47.276697 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 365/785] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:46 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:47.287453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-84ed3f82-106c-451f-a6df-e97e7da267b4 req-de880daf-7454-4da8-a50f-569bdb2c6cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a995631-3901-42e3-89a3-328543407485", "tag": "cfc2d4ba-b243-4240-a500-6858ed535c9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:47.289371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:47.296634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:47.302482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-84ed3f82-106c-451f-a6df-e97e7da267b4 req-de880daf-7454-4da8-a50f-569bdb2c6cd3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.302932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-84ed3f82-106c-451f-a6df-e97e7da267b4 req-de880daf-7454-4da8-a50f-569bdb2c6cd3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.334556 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-84ed3f82-106c-451f-a6df-e97e7da267b4 req-de880daf-7454-4da8-a50f-569bdb2c6cd3 service nova] Creating event network-changed:cfc2d4ba-b243-4240-a500-6858ed535c9c for instance 0a995631-3901-42e3-89a3-328543407485 on nch2-master-1 Jul 02 21:03:47.347065 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-84ed3f82-106c-451f-a6df-e97e7da267b4 req-de880daf-7454-4da8-a50f-569bdb2c6cd3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067767 Jul 02 21:03:47.349518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 366/786] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:47.359308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:47.361513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:47.377930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.379479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.383275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.384451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.432291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8fa2ce7f-38d2-47b9-8519-7e8005e5d95d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691303 Jul 02 21:03:47.433826 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 421/787] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:47.441951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-41e517c5-7da7-4e47-a5fa-dd6a76ab7d65 req-bf221e5c-2486-4834-a21c-b87b3e6b2a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:47.452831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-41e517c5-7da7-4e47-a5fa-dd6a76ab7d65 req-bf221e5c-2486-4834-a21c-b87b3e6b2a7f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.453535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-41e517c5-7da7-4e47-a5fa-dd6a76ab7d65 req-bf221e5c-2486-4834-a21c-b87b3e6b2a7f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.468245 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-41e517c5-7da7-4e47-a5fa-dd6a76ab7d65 req-bf221e5c-2486-4834-a21c-b87b3e6b2a7f service nova] Creating event network-changed:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch2-master-1 Jul 02 21:03:47.474311 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-41e517c5-7da7-4e47-a5fa-dd6a76ab7d65 req-bf221e5c-2486-4834-a21c-b87b3e6b2a7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038954 Jul 02 21:03:47.475822 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 422/788] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:47.482268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:47.483206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:47.491007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.494713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.495828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.496817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.595336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:47.605832 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b083f3f-a75f-4b93-ba6a-8f8acd9f154d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1322 microversion: 2.1 time: 0.250097 Jul 02 21:03:47.607453 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 367/789] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:47 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:47.615685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:47.618597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:47.631396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.632194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:47.633092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:47.633930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.419612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:48.442978 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80418660-c35f-43f2-98fa-67c3027632e5 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.965449 Jul 02 21:03:48.445805 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 423/790] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:47 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:48.454599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:48.458574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:48.475582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:48.476609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.479485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:48.486959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.519751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:48.548596 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-142f7c4c-5b76-4525-9e5e-dada69c35b38 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.936086 Jul 02 21:03:48.551156 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 368/791] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:47 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:48.569845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:48.573145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:48.595591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:48.598493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.601314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:48.604216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.664970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:48.676876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c95b004-d3cb-449d-8e31-7eee3f361bf0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1276 microversion: 2.1 time: 0.229605 Jul 02 21:03:48.677855 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 424/792] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:48 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:48.683665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:48.684361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:48.704000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:48.704547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.705336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:48.706103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:48.957438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:48.974080 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26b58579-0d5f-41ba-ba9f-e3a39194b026 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1268 microversion: 2.1 time: 0.420129 Jul 02 21:03:48.975966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 369/793] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:48 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1268 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:49.001505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:49.003032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:49.021348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.024348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.027714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.028701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.250835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:49.260787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8d1ec38e-229e-41ff-befe-59097fbe9d9b tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.581767 Jul 02 21:03:49.264775 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 425/794] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:48 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:49.270230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:49.275516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:49.293489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.294235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.295265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.295962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.603548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:49.616595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:49.626804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:49.627991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e395cdb-3e3d-4d30-b662-9d5086363c9f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.640102 Jul 02 21:03:49.628596 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 370/795] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:48 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:49.653519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-89c74a73-cd2e-4db3-b3c5-38233d6d3e90 req-f1e776f8-8351-49ef-85d8-9b0e8bff07eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3ae6a5-bb89-46b2-81cc-44222bd446a5", "name": "network-vif-plugged", "status": "completed", "tag": "c13488a0-fcef-4ee3-8f93-74b5e0e0e4d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:49.662154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89c74a73-cd2e-4db3-b3c5-38233d6d3e90 req-f1e776f8-8351-49ef-85d8-9b0e8bff07eb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.662599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89c74a73-cd2e-4db3-b3c5-38233d6d3e90 req-f1e776f8-8351-49ef-85d8-9b0e8bff07eb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.692910 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-89c74a73-cd2e-4db3-b3c5-38233d6d3e90 req-f1e776f8-8351-49ef-85d8-9b0e8bff07eb service nova] Creating event network-vif-plugged:c13488a0-fcef-4ee3-8f93-74b5e0e0e4d9 for instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 on nch1-master-1 Jul 02 21:03:49.704744 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-89c74a73-cd2e-4db3-b3c5-38233d6d3e90 req-f1e776f8-8351-49ef-85d8-9b0e8bff07eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065028 Jul 02 21:03:49.705504 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 371/796] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:49.712282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4de9be2d-a79c-43f5-b74b-193d514afdeb req-03df861f-bf58-448b-88d5-0930c6962338 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca237da0-7482-4d58-bf6d-9195648cc8cf", "name": "network-vif-deleted", "tag": "a89fc1f6-7e9e-4891-a0dd-90d0e71479fd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:49.727408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4de9be2d-a79c-43f5-b74b-193d514afdeb req-03df861f-bf58-448b-88d5-0930c6962338 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.728129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4de9be2d-a79c-43f5-b74b-193d514afdeb req-03df861f-bf58-448b-88d5-0930c6962338 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.749755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:49.777182 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5654d48c-0e63-49e7-8c46-42b13c553e7b tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.510915 Jul 02 21:03:49.796603 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 426/797] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:49 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:49.819007 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4de9be2d-a79c-43f5-b74b-193d514afdeb req-03df861f-bf58-448b-88d5-0930c6962338 service nova] Creating event network-vif-deleted:a89fc1f6-7e9e-4891-a0dd-90d0e71479fd for instance ca237da0-7482-4d58-bf6d-9195648cc8cf on nch2-master-1 Jul 02 21:03:49.820186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:49.826034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:49.842670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4de9be2d-a79c-43f5-b74b-193d514afdeb req-03df861f-bf58-448b-88d5-0930c6962338 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135565 Jul 02 21:03:49.846733 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 372/798] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:49.848676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.849784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.855580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.857904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.865084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:49.868455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:49.899635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.901534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:49.902539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:49.910704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.421095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:50.429353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:50.435173 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-95870c38-6cd8-4a74-a73b-28062d51dc6d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.633605 Jul 02 21:03:50.437001 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 427/799] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:49 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:50.443685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:50.444246 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-748ecb9c-12ff-4051-bc39-6e11090870a0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.595716 Jul 02 21:03:50.445134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:50.446075 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 373/800] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:49 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:50.455623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.456407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.457851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.458770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.461732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:50.462425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:50.474825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.475406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.476302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.479506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.625171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:50.639268 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c70316c4-9a35-4ce4-b64d-392f235317b9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1274 microversion: 2.1 time: 0.181830 Jul 02 21:03:50.650868 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 374/801] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:50 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:50.656794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:50.660793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:50.675710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.676483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.677724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.678913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.772544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:50.791002 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f23fba9-3809-497e-8f2e-cdb8187d7e44 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.352290 Jul 02 21:03:50.795421 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 428/802] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:50 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:50.808223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:50.815230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:50.821851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.829967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.831230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.831887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:50.964723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:50.977295 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bb3abdd-53d6-4761-9118-5d6f9c961fb8 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.324624 Jul 02 21:03:50.978651 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 375/803] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:50 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:50.988308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:50.989271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:50.998534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:50.999408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.000494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.001454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.042746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:51.057159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:51.058759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:51.059920 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d1d586c-d42d-42f0-a2df-9f04c4bd9b85 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.262694 Jul 02 21:03:51.060525 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 429/804] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:50 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:51.258871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:51.273967 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-252e60ee-3f60-49a3-a1ed-d3d04a8d4465 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.293899 Jul 02 21:03:51.285005 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 376/805] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:50 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:51.342754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-563a40d9-fe05-41e7-84b7-a2e9ebf858a7 req-a911ad82-0d43-4bf2-ae83-27ac2f517513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c074787f-d02a-4e68-a9a2-58442e8fef1c", "tag": "99084601-a941-4aba-b7d7-5df7fa7250c0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:51.360757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-563a40d9-fe05-41e7-84b7-a2e9ebf858a7 req-a911ad82-0d43-4bf2-ae83-27ac2f517513 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.361195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-563a40d9-fe05-41e7-84b7-a2e9ebf858a7 req-a911ad82-0d43-4bf2-ae83-27ac2f517513 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.387173 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-563a40d9-fe05-41e7-84b7-a2e9ebf858a7 req-a911ad82-0d43-4bf2-ae83-27ac2f517513 service nova] Creating event network-changed:99084601-a941-4aba-b7d7-5df7fa7250c0 for instance c074787f-d02a-4e68-a9a2-58442e8fef1c on nch1-master-1 Jul 02 21:03:51.399974 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-563a40d9-fe05-41e7-84b7-a2e9ebf858a7 req-a911ad82-0d43-4bf2-ae83-27ac2f517513 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062003 Jul 02 21:03:51.403605 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 430/806] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:51.468514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:51.470245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:51.475605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:51.476796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:51.489490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.493060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.494084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.495378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.510147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.510730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.512272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.514110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.942732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:51.952235 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-842d8fc1-3127-430f-9b35-dd774c0eaf2d tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1315 microversion: 2.1 time: 0.489424 Jul 02 21:03:51.955755 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 431/807] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:51 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:51.967459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:51.968141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:51.983791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.990897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:51.993674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:51.996502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.023048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:52.036757 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-601e2209-a07c-4d66-95b8-e7c11f3b399d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.584166 Jul 02 21:03:52.037617 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 377/808] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:51 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:52.042238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dc19601f-15b0-4ea0-8b1d-2d75675a1845 req-c4079225-0bc2-4929-90af-c80d43cef030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a995631-3901-42e3-89a3-328543407485", "name": "network-vif-plugged", "status": "completed", "tag": "cfc2d4ba-b243-4240-a500-6858ed535c9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:52.065568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc19601f-15b0-4ea0-8b1d-2d75675a1845 req-c4079225-0bc2-4929-90af-c80d43cef030 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.066294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc19601f-15b0-4ea0-8b1d-2d75675a1845 req-c4079225-0bc2-4929-90af-c80d43cef030 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.118255 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc19601f-15b0-4ea0-8b1d-2d75675a1845 req-c4079225-0bc2-4929-90af-c80d43cef030 service nova] Creating event network-vif-plugged:cfc2d4ba-b243-4240-a500-6858ed535c9c for instance 0a995631-3901-42e3-89a3-328543407485 on nch2-master-1 Jul 02 21:03:52.126353 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dc19601f-15b0-4ea0-8b1d-2d75675a1845 req-c4079225-0bc2-4929-90af-c80d43cef030 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087333 Jul 02 21:03:52.128772 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 378/809] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:52.135224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:52.147076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:52.160751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.173410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.173410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.173410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.525143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:52.536388 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4697d680-0a54-4fd4-ad2e-119d9b55c81b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.574948 Jul 02 21:03:52.548030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:52.550590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:52.563489 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 432/810] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:51 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:52.564664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-783525b7-e579-4440-be27-7c870ce9fd0a tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.428718 Jul 02 21:03:52.566098 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 379/811] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:52 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:52.568357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:52.568992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:52.581748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:52.582930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:52.589237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.593502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.595737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.596494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.597484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:52.599729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.601836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:52.605225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:52.605897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.128645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:53.145603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:53.147572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:53.148935 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da2f8dcd-2693-421d-a716-55c79fb07042 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.581505 Jul 02 21:03:53.160012 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 380/812] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:52 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:53.165736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:53.166538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:53.173020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.173671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.174624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.175224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.258124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:53.268620 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd0fbcc2-d8f2-4504-814b-09477ad02150 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1321 microversion: 2.1 time: 0.712096 Jul 02 21:03:53.272900 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 433/813] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:52 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1321 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:53.279740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:53.285319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:53.297565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.300686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.301801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.312664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.583404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:53.598427 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c07dbcf8-aaf9-4cf6-9fed-a817dbaeecb4 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.436970 Jul 02 21:03:53.599018 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 381/814] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:53 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:53.617857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:53.620445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:53.643514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.644744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.649314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.649830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.656830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:53.667677 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0e75767a-5616-490c-afdd-c8192e72318a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1504 microversion: 2.1 time: 0.393430 Jul 02 21:03:53.685431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 434/815] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:53 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:53.690719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-931e39da-f7e9-4e66-8089-55f3f35027b0 req-9b5681fe-9725-4c28-b642-e0d96a4c1563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b7a681c-3f21-4191-9f0f-993efe27f5a7", "tag": "10736cb7-2590-432b-ac31-c56746a79bb6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:53.716970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-931e39da-f7e9-4e66-8089-55f3f35027b0 req-9b5681fe-9725-4c28-b642-e0d96a4c1563 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.724206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-931e39da-f7e9-4e66-8089-55f3f35027b0 req-9b5681fe-9725-4c28-b642-e0d96a4c1563 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.771200 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-931e39da-f7e9-4e66-8089-55f3f35027b0 req-9b5681fe-9725-4c28-b642-e0d96a4c1563 service nova] Creating event network-changed:10736cb7-2590-432b-ac31-c56746a79bb6 for instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 on nch2-master-1 Jul 02 21:03:53.783095 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-931e39da-f7e9-4e66-8089-55f3f35027b0 req-9b5681fe-9725-4c28-b642-e0d96a4c1563 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094882 Jul 02 21:03:53.785730 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 435/816] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:53.797036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:53.797751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:53.817858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.818631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:53.819643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:53.820331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.045109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:54.075179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.088365 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b84c3ac1-082e-4db8-8c3f-83f70b9e4899 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.487066 Jul 02 21:03:54.095605 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 382/817] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:53 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:54.107588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:54.111596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:54.124691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=11 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:54.142337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.143031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.143559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.144691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.281024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.289332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f6d0d5f-32f3-4fb4-88d3-a98096a7e259 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.502263 Jul 02 21:03:54.289923 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 436/818] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:53 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:54.302852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:54.303600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:54.313098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.313985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.315115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.315721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.390863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:03:54.427617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.437131 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c6ccc82-0257-4500-9db7-b6b87aa9c6ae tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.339919 Jul 02 21:03:54.449014 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 383/819] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:54 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:54.460937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:54.461826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:54.478967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.482483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.483961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.485052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.554844 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f50d5d6-c711-46e4-9a81-d4e2584a5c01 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 204 len: 0 microversion: 2.1 time: 0.255587 Jul 02 21:03:54.556686 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 437/820] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:03:54 2022] DELETE /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:03:54.571486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:54.576874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:54.583907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.584771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.585793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.586410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.592454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:54.818931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.825796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.828081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.829611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:54.830748 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0cc03651-8939-4261-98cf-20ee966d2817 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.373972 Jul 02 21:03:54.831646 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 384/821] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:54 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:54.834304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b8721d0-e688-4ab7-b079-12f785470e3c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1470 microversion: 2.1 time: 0.276391 Jul 02 21:03:54.834941 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 438/822] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:54 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:54.839530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:54.840581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:54.846489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:54.847134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:54.848282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.848795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.849628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.850326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.853658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.854101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:54.854932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:54.855264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.047826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:55.052253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:55.056674 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5cb3d0c2-282c-415f-ac14-eb212d8ce5c7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.220429 Jul 02 21:03:55.057479 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 439/823] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:54 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:55.060457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9705175-7d37-4e06-9cd7-d6879bdeb924 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1510 microversion: 2.1 time: 0.218314 Jul 02 21:03:55.061180 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 385/824] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:54 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:55.112103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:55.112785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:55.119926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.120736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.121659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.122148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.129787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37050141-3fe0-4d75-93f3-d9f87f30e3d3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:55.130851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-37050141-3fe0-4d75-93f3-d9f87f30e3d3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] [instance: 67ad39d3-99d6-4f16-be0b-565452cce50a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:55.136929 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-37050141-3fe0-4d75-93f3-d9f87f30e3d3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] HTTP exception thrown: Instance 67ad39d3-99d6-4f16-be0b-565452cce50a could not be found. Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37050141-3fe0-4d75-93f3-d9f87f30e3d3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Request method failure captured: Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/67ad39d3-99d6-4f16-be0b-565452cce50a/action HTTP/1.1 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 15 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKiFJ-aJyvu5Pf1yPGL7lCdY_n64iJmITns9EWr0DgNr9_yKlr56-Opar1PT8Ah3zPD9jehIjSqpBBJb-rf2AJHuTngydE3H_Tiks5hqBjDBNgJ6y_ll7FJd-ZRr2vVKB1z2j8mtYSbDuLIXa05hXCpeGpQpuY2iia1QjnMf1PXjsg Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9014a6e32f3442ca8336f44a9d311b56", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9014a6e32f3442ca8336f44a9d311b56"}]}] Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 43df10ed0fb64a6e909b08989e0b226d Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: {"migrate": {}} Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 67ad39d3-99d6-4f16-be0b-565452cce50a could not be found. Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '67ad39d3-99d6-4f16-be0b-565452cce50a', 'body': {'migrate': {}}} Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67ad39d3-99d6-4f16-be0b-565452cce50a could not be found. Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67ad39d3-99d6-4f16-be0b-565452cce50a could not be found. Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:55.138999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:03:55.143627 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:03:55.143627 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:03:55.143627 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:03:55.143627 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:03:55.143627 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67ad39d3-99d6-4f16-be0b-565452cce50a could not be found. Jul 02 21:03:55.143627 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:03:55.145259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37050141-3fe0-4d75-93f3-d9f87f30e3d3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Returning 404 to user: Instance 67ad39d3-99d6-4f16-be0b-565452cce50a could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:03:55.146371 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-37050141-3fe0-4d75-93f3-d9f87f30e3d3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/67ad39d3-99d6-4f16-be0b-565452cce50a/action" status: 404 len: 111 microversion: 2.1 time: 0.079343 Jul 02 21:03:55.147196 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 440/825] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:03:55 2022] POST /compute/v2.1/servers/67ad39d3-99d6-4f16-be0b-565452cce50a/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:03:55.203156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-162554237", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:55.277234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:03:55.278354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:55.289567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a059e1f3-37c1-447c-b764-4c0254cae006 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.181197 Jul 02 21:03:55.290476 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 386/826] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:55 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:55.306519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:55.307124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:55.314113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.314779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.315726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.316358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.555059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:55.564489 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5f79378-0e7a-4819-8beb-cde1f5f20a4f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.261643 Jul 02 21:03:55.565357 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 387/827] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:55 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:55.570243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6bbd895c-8098-4c31-a36c-34ef6102b35c req-05af7cae-4a54-4fbc-b7ba-841dd16b8fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "name": "network-vif-plugged", "status": "completed", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:55.579201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6bbd895c-8098-4c31-a36c-34ef6102b35c req-05af7cae-4a54-4fbc-b7ba-841dd16b8fab service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.579646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6bbd895c-8098-4c31-a36c-34ef6102b35c req-05af7cae-4a54-4fbc-b7ba-841dd16b8fab service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.593199 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6bbd895c-8098-4c31-a36c-34ef6102b35c req-05af7cae-4a54-4fbc-b7ba-841dd16b8fab service nova] Creating event network-vif-plugged:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch2-master-1 Jul 02 21:03:55.593731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:03:55.594315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:03:55.594801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:03:55.595215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:03:55.595673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:03:55.598179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6bbd895c-8098-4c31-a36c-34ef6102b35c req-05af7cae-4a54-4fbc-b7ba-841dd16b8fab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031301 Jul 02 21:03:55.599155 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 388/828] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:55.605591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:55.605591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:55.605837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.606392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.607145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.607625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.632783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Getting quotas for project 48b2d24d625d4151b67de30f8fa7b918. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:03:55.638733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.638951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Getting quotas for user 6c9e360aff3b43688e88f739a1723921 and project 48b2d24d625d4151b67de30f8fa7b918. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:03:55.639179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.643620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.643997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.656241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:03:55.658633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:03:55.709773 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6977820a-cf91-4ccd-a39b-a951a640e097 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.511921 Jul 02 21:03:55.710739 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 441/829] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:03:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:03:55.732458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a0e2f93-6940-41a2-b616-59daa5f076da tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:55.733714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5a0e2f93-6940-41a2-b616-59daa5f076da tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:55.826676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5a0e2f93-6940-41a2-b616-59daa5f076da tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:55.836899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5a0e2f93-6940-41a2-b616-59daa5f076da tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1221 microversion: 2.1 time: 0.107444 Jul 02 21:03:55.839528 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 442/830] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:55 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:55.847097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-82d5a257-7fe9-4694-b9a0-66ef15be55fc req-f1f54b8d-80c0-4417-9deb-6db32de0c263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afbe1b3-5af8-44b4-95d1-a4455c8dd66d", "tag": "d09c31e8-e47c-4509-9a70-3e72f9290108"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:55.859060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-82d5a257-7fe9-4694-b9a0-66ef15be55fc req-f1f54b8d-80c0-4417-9deb-6db32de0c263 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.859748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-82d5a257-7fe9-4694-b9a0-66ef15be55fc req-f1f54b8d-80c0-4417-9deb-6db32de0c263 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.868314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:55.876085 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-82d5a257-7fe9-4694-b9a0-66ef15be55fc req-f1f54b8d-80c0-4417-9deb-6db32de0c263 service nova] Creating event network-changed:d09c31e8-e47c-4509-9a70-3e72f9290108 for instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d on nch1-master-1 Jul 02 21:03:55.877764 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-898c2fda-5129-4c43-ab0c-25ad81d52275 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.277557 Jul 02 21:03:55.887573 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 389/831] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:55 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:55.893388 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-82d5a257-7fe9-4694-b9a0-66ef15be55fc req-f1f54b8d-80c0-4417-9deb-6db32de0c263 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052086 Jul 02 21:03:55.894457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 443/832] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:03:55.897906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:55.898533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:55.912028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.912833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:55.914415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:55.915244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.076232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:56.077386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:56.086548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.088174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:56.090598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.091245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.092282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.092910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.107701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.108949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.110122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e47d2ca-1e5f-44e5-b21d-3fff803dde89 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.220935 Jul 02 21:03:56.120119 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 390/833] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:55 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:56.120119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:56.120119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:56.124017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.124602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.125591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.126177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.342866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.356104 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a23c6480-6f77-432c-a02d-9528f4b3f746 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.285831 Jul 02 21:03:56.357933 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 444/834] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:56 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:56.366195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:56.367072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:56.370983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.378098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.379465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.380775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.381832 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d57678c-27a0-46ea-8f88-46802b9f48c0 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1510 microversion: 2.1 time: 0.269712 Jul 02 21:03:56.381982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.393766 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 391/835] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:56 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:56.527886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.535709 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a933751-bbcd-48fe-8692-f49de61d7767 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.176571 Jul 02 21:03:56.545174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 445/836] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:56 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:56.580840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:56.581455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:56.587988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.588503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.589271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.589895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.730607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.739113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae946084-b745-47f8-9769-350386674074 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.162019 Jul 02 21:03:56.739981 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 392/837] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:56 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:56.854932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:56.855653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:56.862451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.862911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.863712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.864441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.899665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:56.902385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:56.914054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.914897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.915915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:56.916607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:56.942847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:56.951772 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-946a4eba-4a94-4a44-9521-bfce04c7f8c5 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1217 microversion: 2.1 time: 0.100761 Jul 02 21:03:56.952946 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 446/838] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:56 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:57.071502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.085777 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14c28b09-5058-454f-8936-568402d3c567 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.193299 Jul 02 21:03:57.086380 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 393/839] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:56 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:57.129513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:57.130236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:57.137772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.138259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.139155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.139799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.294456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.302786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.304335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.305482 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5cb3e61-4c31-45d3-a72c-7f5ef0c29a34 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1411 microversion: 2.25 time: 0.180136 Jul 02 21:03:57.306237 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 447/840] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:57 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1411 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:57.374285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:57.375713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:57.383906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.384615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.385768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.386445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.401807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:57.402821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:57.411749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.412626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.413624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.414333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.655824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.665025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.674538 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-90c898b6-0a32-47e3-81d0-d97fafa8cf3b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1510 microversion: 2.1 time: 0.276955 Jul 02 21:03:57.675032 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b61bd4bd-628e-4e2b-9687-bab8023da7e0 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.304909 Jul 02 21:03:57.675758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 448/841] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:57 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:57.678405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 394/842] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:57 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:57.682967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:57.683882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:57.692735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.693421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.694809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.695525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.763088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:57.764595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:57.779174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.781500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.783943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.784672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.956081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:57.966924 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17183fbe-4c66-4c75-8548-201231610e9e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.286423 Jul 02 21:03:57.967855 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 449/843] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:57 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:57.978962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:57.979595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:57.985774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.986226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:57.987005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:57.987717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.047274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:58.058287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e6b45cb-f830-4e5b-b91f-7b0e1a4c8e16 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.302462 Jul 02 21:03:58.063136 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 395/844] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:57 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:58.066376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:58.074414 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd983f46-cf6f-4640-b9cd-9840d1c0f806 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1279 microversion: 2.1 time: 0.105385 Jul 02 21:03:58.075674 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 450/845] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:57 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:58.103843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:58.104497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:58.111219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.111700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.112524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.112960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.299672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:58.309104 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4d2a6e9-2b90-4897-a760-2e02cca6bbf5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.209117 Jul 02 21:03:58.318545 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 396/846] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:58 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:58.323663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:58.324414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:58.331275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.331725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.332765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.333430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.493811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:58.503318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:58.504880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:58.506280 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c7ebb3d-3fe5-4b84-84bb-8f40343e6595 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1606 microversion: 2.25 time: 0.186769 Jul 02 21:03:58.526399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:58.527609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:58.531630 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 451/847] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:03:58 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1606 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:03:58.535682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.536466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.537463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.538096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.541436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:58.631792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b247cbdc-196b-4af6-924d-97a4a0e125ec tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.109568 Jul 02 21:03:58.639141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 397/848] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:03:58 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:03:58.699329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:58.702730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:58.704777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:58.705958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:58.723526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.724825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.725573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.726636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.728647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.729222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:58.729996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:58.732575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.021449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:59.033747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:59.038215 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9674d9e-1803-4247-bd18-fd48f03dd11a tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1510 microversion: 2.1 time: 0.347614 Jul 02 21:03:59.048073 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 398/849] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:58 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:59.048073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:59.048073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:59.051681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fb67e345-c0ad-42b9-8fdd-823aa001ee42 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.359766 Jul 02 21:03:59.052321 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 452/850] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:58 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:59.058952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.059872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.060909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.061560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.079073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:59.080129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:59.086835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.089157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.090067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.090715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.376934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:59.393135 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-617de73c-2085-4c76-bcb3-1b204c56121c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.315869 Jul 02 21:03:59.395288 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 453/851] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:59 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:03:59.400803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:59.409118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:59.410052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:59.412233 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-941f5961-6079-4739-b479-43439db1415d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.372120 Jul 02 21:03:59.420167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 399/852] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:59 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:59.422151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:03:59.422770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:03:59.430411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.430875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.431492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.431665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.432133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.432472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.433497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.434098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.652800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:59.657273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:03:59.666028 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9c25e03-d59f-4b1d-a361-3083abb02a09 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.250209 Jul 02 21:03:59.666948 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 400/853] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:59 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:59.676768 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9063dbde-fc80-4430-9f4f-83c0e9d0159f tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.264069 Jul 02 21:03:59.678437 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 454/854] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:03:59 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:03:59.688815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-07639928-5a5e-4035-a2df-458cdd3c1a6c req-489fef17-4b22-4b4f-9373-c0b71ec0c7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7a681c-3f21-4191-9f0f-993efe27f5a7", "name": "network-vif-plugged", "status": "completed", "tag": "10736cb7-2590-432b-ac31-c56746a79bb6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:03:59.699235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-07639928-5a5e-4035-a2df-458cdd3c1a6c req-489fef17-4b22-4b4f-9373-c0b71ec0c7af service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:03:59.699680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-07639928-5a5e-4035-a2df-458cdd3c1a6c req-489fef17-4b22-4b4f-9373-c0b71ec0c7af service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:03:59.711546 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-07639928-5a5e-4035-a2df-458cdd3c1a6c req-489fef17-4b22-4b4f-9373-c0b71ec0c7af service nova] Creating event network-vif-plugged:10736cb7-2590-432b-ac31-c56746a79bb6 for instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 on nch2-master-1 Jul 02 21:03:59.727598 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-07639928-5a5e-4035-a2df-458cdd3c1a6c req-489fef17-4b22-4b4f-9373-c0b71ec0c7af service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047511 Jul 02 21:03:59.728469 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 455/855] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:00.055598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:00.056251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:00.069518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.070319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.071019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:00.071831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:00.073102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.084969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.086551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.087216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.088252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.089024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.412677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:00.415776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:00.422863 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59d4fa6a-da01-4259-8b7f-76f810b10ccb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1510 microversion: 2.1 time: 0.371309 Jul 02 21:04:00.425530 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-670460aa-fb2c-4156-a95b-c31a5304e05a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.360177 Jul 02 21:04:00.426452 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 456/856] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:00 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:00.431101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:00.431887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:00.433841 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 401/857] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:00 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:00.445572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:00.447419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:00.477110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.477951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.479948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.480823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.523970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.524968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.538560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.539060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.856760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:00.872872 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c43663a0-db23-4b14-b7b3-6fd152ec990e tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.445261 Jul 02 21:04:00.882664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 457/858] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:00 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:00.889124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4926a49b-7327-448d-8c4f-d5368d2989d6 req-0879dc91-4385-46ff-b39c-1ec414f85487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264aa407-abb8-47d2-a832-f24eb2fbd35b", "tag": "7dea7579-7639-4b60-8610-2b2c1b70eec1"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:00.898742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4926a49b-7327-448d-8c4f-d5368d2989d6 req-0879dc91-4385-46ff-b39c-1ec414f85487 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.899185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4926a49b-7327-448d-8c4f-d5368d2989d6 req-0879dc91-4385-46ff-b39c-1ec414f85487 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.912429 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4926a49b-7327-448d-8c4f-d5368d2989d6 req-0879dc91-4385-46ff-b39c-1ec414f85487 service nova] Creating event network-changed:7dea7579-7639-4b60-8610-2b2c1b70eec1 for instance 264aa407-abb8-47d2-a832-f24eb2fbd35b on nch2-master-1 Jul 02 21:04:00.926105 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4926a49b-7327-448d-8c4f-d5368d2989d6 req-0879dc91-4385-46ff-b39c-1ec414f85487 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041486 Jul 02 21:04:00.927157 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 458/859] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:00.940215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:00.942059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:00.952209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.954159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.955256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:00.956481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:00.969536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:00.981028 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f13fc300-b34b-4056-b46e-14c262214f24 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.545639 Jul 02 21:04:00.983127 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 402/860] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:00 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:00.991888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:00.994671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:00.995341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:01.012527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.013072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.013873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.014312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.263394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:01.273296 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-92b07c6d-4e77-437c-865e-4f23cdeb3981 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1318 microversion: 2.1 time: 0.342477 Jul 02 21:04:01.274561 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 459/861] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:00 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:01.303963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:01.311816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-563c54a5-82b0-4288-8331-4211423c9c05 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.327369 Jul 02 21:04:01.316151 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 403/862] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:00 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:01.443716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:01.446043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:01.451128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:01.451756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:01.461165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.461623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.462418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.462849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.462975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.463313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.464182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.464635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.595381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:01.605236 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4afc61b4-914f-403a-a6cd-5123d14cbed8 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1468 microversion: 2.1 time: 0.158411 Jul 02 21:04:01.607171 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 404/863] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:01 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1468 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:01.621549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b87c65f9-77a6-4e04-9981-a1cc0e00764c req-64922452-274f-4a9d-a600-f00b41cc8454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3ae6a5-bb89-46b2-81cc-44222bd446a5", "name": "network-vif-deleted", "tag": "c13488a0-fcef-4ee3-8f93-74b5e0e0e4d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:01.632295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b87c65f9-77a6-4e04-9981-a1cc0e00764c req-64922452-274f-4a9d-a600-f00b41cc8454 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.633204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b87c65f9-77a6-4e04-9981-a1cc0e00764c req-64922452-274f-4a9d-a600-f00b41cc8454 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.651045 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b87c65f9-77a6-4e04-9981-a1cc0e00764c req-64922452-274f-4a9d-a600-f00b41cc8454 service nova] Creating event network-vif-deleted:c13488a0-fcef-4ee3-8f93-74b5e0e0e4d9 for instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 on nch1-master-1 Jul 02 21:04:01.674685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b87c65f9-77a6-4e04-9981-a1cc0e00764c req-64922452-274f-4a9d-a600-f00b41cc8454 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065898 Jul 02 21:04:01.675905 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 405/864] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:01.703495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:01.713309 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-092f354b-b70e-4dc4-9dee-4c0d59c555c9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.273781 Jul 02 21:04:01.713994 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 460/865] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:01 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:01.893337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:01.894420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:01.901350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.902124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.903036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:01.903478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:01.999331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:01.999947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.006977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.007429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.008317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.008665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.049632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.066685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-585e43eb-9615-41b3-967b-c23e91c07924 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.180505 Jul 02 21:04:02.067405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 406/866] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:01 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:02.163904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.172271 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5abf706-982b-43a0-a9f9-1f5cacf91d98 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.176840 Jul 02 21:04:02.173107 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 461/867] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:01 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:02.291264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:02.291882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.298452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.298898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.299670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.300107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.336696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:02.337469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.343517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.343961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.344789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.345220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.531744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.540257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.558224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86664fd7-b8c1-41bf-8334-99740f82c062 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.229720 Jul 02 21:04:02.559973 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 462/868] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:02 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:02.561532 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7fa50eb6-a0bb-48f7-9f3a-4f04f70bd720 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1507 microversion: 2.1 time: 0.274204 Jul 02 21:04:02.562114 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 407/869] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:02 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:02.578443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:02.579074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.585955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.586406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.587200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.587643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.623676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:02.624494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.631922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.636640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.637687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.638286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.734954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.744015 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5419f5d-c2d1-4e0a-9648-140d0e3b1279 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1468 microversion: 2.1 time: 0.124928 Jul 02 21:04:02.744881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 408/870] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:02 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1468 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:02.752930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:02.753476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.759998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.760761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.767486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.767795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.793375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.802840 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d60ae809-f266-4c16-8e0d-834e3b02f667 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1507 microversion: 2.1 time: 0.228494 Jul 02 21:04:02.803477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 463/871] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:02 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1507 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:02.820381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:02.821617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.828574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.829033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.829825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.830269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.911929 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-664331b8-5ef1-463a-a2f2-3aae2ead6216 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "PUT /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1079 microversion: 2.1 time: 0.095612 Jul 02 21:04:02.913383 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 464/872] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:04:02 2022] PUT /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1079 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:02.930006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:02.931380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:02.934935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:02.945654 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7d3230b-e7f7-4a02-8cac-847428ebc6ae tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.199744 Jul 02 21:04:02.946266 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 409/873] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:02 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:02.954811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.955280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.956114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.956563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.963866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7759ec4c-c9db-427c-aaa8-c6b2d3646a72 req-1e595f02-150c-4441-84df-1684980b3613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:02.973264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7759ec4c-c9db-427c-aaa8-c6b2d3646a72 req-1e595f02-150c-4441-84df-1684980b3613 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:02.974052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7759ec4c-c9db-427c-aaa8-c6b2d3646a72 req-1e595f02-150c-4441-84df-1684980b3613 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:02.986855 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7759ec4c-c9db-427c-aaa8-c6b2d3646a72 req-1e595f02-150c-4441-84df-1684980b3613 service nova] Creating event network-changed:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch2-master-1 Jul 02 21:04:02.993948 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7759ec4c-c9db-427c-aaa8-c6b2d3646a72 req-1e595f02-150c-4441-84df-1684980b3613 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036295 Jul 02 21:04:02.994811 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 410/874] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:03.084337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:03.085128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:03.102845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.107485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.110416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.111072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.209096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:03.217423 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ea73210-dbeb-4213-bff9-1104978ea390 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1505 microversion: 2.1 time: 0.294428 Jul 02 21:04:03.218021 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 465/875] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:02 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:03.223337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:03.224012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:03.236124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.236588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.237374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.237817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.299041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:03.309357 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a70ba00-d021-4e71-9958-8fc2c0cf3b4a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.229955 Jul 02 21:04:03.310398 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 411/876] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:03 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:03.315911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:03.316721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:03.327035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.327582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.328546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.330676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.456864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:03.487474 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c199078-de29-4c8a-89f2-858fe987a9f6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.267710 Jul 02 21:04:03.506916 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 466/877] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:03 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:03.565191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:03.580073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:03.583512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:03.584191 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f9fa31cf-6aa1-4945-b65b-4da1b47575cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1505 microversion: 2.1 time: 0.272193 Jul 02 21:04:03.596732 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 412/878] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:03 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:03.599441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.600312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.604796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.605667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.606373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:03.607963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:03.628527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.629025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.629906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.630423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.798683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:03.803199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:03.805011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:03.805862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:03.806480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:03.886028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:03.907563 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a566d322-2bc7-4c1c-a525-d047091586bf tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.334562 Jul 02 21:04:03.910633 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 467/879] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:03 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:03.932263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:03.933392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:03.943778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.944678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.945836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:03.946741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:03.985832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:04.028389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.028978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.029907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.032305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.059931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:04.124758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:04.137073 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94ffc5c8-4e71-4208-a3e7-12fe3dfb8ede tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1468 microversion: 2.1 time: 0.215294 Jul 02 21:04:04.138575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 468/880] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:03 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1468 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:04.144342 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d945b1f6-6983-4cc5-bef9-5f6fc0421920 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "POST /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7/action" status: 202 len: 1111 microversion: 2.1 time: 0.542153 Jul 02 21:04:04.144888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:04.145287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:04.154721 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 413/881] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:03 2022] POST /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7/action => generated 1111 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 02 21:04:04.154958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.154958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.154958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.155545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.167863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:04.169941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:04.193215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.193817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.197045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.198123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.554972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:04.572453 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3f9c15b-6242-4f25-8f64-f9606dd892fb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.430167 Jul 02 21:04:04.573584 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 469/882] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:04 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:04.582066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:04.583126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:04.592172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.592545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.593973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.594796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.598215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:04.608710 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f82bc651-98ca-4f72-ba23-4ca2e04929d1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.446168 Jul 02 21:04:04.609577 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 414/883] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:04 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:04.623809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:04.624471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:04.630781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.631484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.632445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:04.633030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:04.983402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:04.992202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:04.992897 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-08a26834-657b-4144-9119-90af88d48695 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.416879 Jul 02 21:04:04.993958 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 470/884] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:04 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:04.999166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:04.999869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:05.003130 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-293fd023-1a91-4594-933b-02e53bb07dcf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.383081 Jul 02 21:04:05.003736 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 415/885] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:04 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:05.012660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.013367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.015077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.015546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.157282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:05.158573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:05.169564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.170372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.171607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.172489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.175130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:05.183207 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7de344bc-a580-4011-ae7c-7bda4a9ee07a tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.188165 Jul 02 21:04:05.183995 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 471/886] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:04 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:05.233710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.234476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.235108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lazy-loading 'fault' on Instance uuid 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:05.314777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '223fd6f7a4c84114af7a22eb19cc7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0b5a189e934370af07b11ee0a9e737', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:05.329999 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba5d021c-0c23-4750-b986-b64e6883828f tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 200 len: 1305 microversion: 2.1 time: 0.176674 Jul 02 21:04:05.331396 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 416/887] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:05 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:05.598994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:05.600175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-eeeeb0ce-92df-4535-89ef-953f06e0eda6 req-5ab05f66-7012-43fe-a88e-746541a99b97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c074787f-d02a-4e68-a9a2-58442e8fef1c", "name": "network-vif-plugged", "status": "completed", "tag": "99084601-a941-4aba-b7d7-5df7fa7250c0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:05.602550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:05.619165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:05.639223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.641642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.643007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.644637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.649977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-eeeeb0ce-92df-4535-89ef-953f06e0eda6 req-5ab05f66-7012-43fe-a88e-746541a99b97 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.651138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-eeeeb0ce-92df-4535-89ef-953f06e0eda6 req-5ab05f66-7012-43fe-a88e-746541a99b97 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.681520 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-eeeeb0ce-92df-4535-89ef-953f06e0eda6 req-5ab05f66-7012-43fe-a88e-746541a99b97 service nova] Creating event network-vif-plugged:99084601-a941-4aba-b7d7-5df7fa7250c0 for instance c074787f-d02a-4e68-a9a2-58442e8fef1c on nch1-master-1 Jul 02 21:04:05.687588 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-eeeeb0ce-92df-4535-89ef-953f06e0eda6 req-5ab05f66-7012-43fe-a88e-746541a99b97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101419 Jul 02 21:04:05.690117 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 472/888] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:05.700787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:05.701978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:05.718098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.718478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.719745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:05.720737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:05.840657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=15 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:06.113029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:06.116576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:06.125901 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aaeba172-8b17-478a-a3a3-1c9772b77cbb tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.538085 Jul 02 21:04:06.127179 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 417/889] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:05 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:06.132363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:06.133200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.133830 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f69dfeeb-86ba-4ccd-b34e-cd5b4b42574c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.441705 Jul 02 21:04:06.143792 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 473/890] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:05 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:06.143792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:06.145141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.154362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.154919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.155838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.156570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.157744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.158202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.159005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.159442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.395895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:06.408582 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dac05b2-c187-4e20-b7f7-ab10ed84d734 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.279813 Jul 02 21:04:06.412619 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 418/891] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:06 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:06.421578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:06.421578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.426689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.427341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.428560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.429299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.458810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:06.470700 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b92fc3bf-5cb7-4390-8c13-287a9855251d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.334832 Jul 02 21:04:06.471305 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 474/892] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:06 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:06.480201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:06.480904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.487285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.487798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.488757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.489723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.505986 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 HTTP/1.1 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8a3ae6a5-bb89-46b2-81cc-44222bd446a5'} Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.507420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f7cc70e-0a6d-423e-8d33-460a082b2adb tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 404 len: 111 microversion: 2.1 time: 0.036646 Jul 02 21:04:06.511887 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 475/893] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:06 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:06.521642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-140712601", "metadata": {"image_type": "test"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:06.521642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.529991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.531321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.533385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.534029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.553479 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5/action HTTP/1.1 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 111 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-140712601", "metadata": {"image_type": "test"}}} Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8a3ae6a5-bb89-46b2-81cc-44222bd446a5', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-140712601', 'metadata': {'image_type': 'test'}}}} Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:04:06.555340 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-597b1b83-4317-48ac-97f2-61af5334500b tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "POST /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5/action" status: 404 len: 111 microversion: 2.1 time: 0.042295 Jul 02 21:04:06.560704 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 476/894] 10.222.0.43 () {60 vars in 1278 bytes} [Sat Jul 2 21:04:06 2022] POST /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:06.578365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-252134d8-04ca-4c4c-a8b5-0370936bf337 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-760983431", "metadata": {"image_type": "test"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:06.579548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-252134d8-04ca-4c4c-a8b5-0370936bf337 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Failed to fetch instance by id tempest-invalid-408234217 {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:04:06.581568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-252134d8-04ca-4c4c-a8b5-0370936bf337 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance tempest-invalid-408234217 could not be found. Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-252134d8-04ca-4c4c-a8b5-0370936bf337 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/tempest-invalid-408234217/action HTTP/1.1 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 111 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-760983431", "metadata": {"image_type": "test"}}} Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance tempest-invalid-408234217 could not be found. Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'tempest-invalid-408234217', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-760983431', 'metadata': {'image_type': 'test'}}}} Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-408234217 could not be found. Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.584111 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-408234217 could not be found. Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-408234217 could not be found. Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-252134d8-04ca-4c4c-a8b5-0370936bf337 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance tempest-invalid-408234217 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.591018 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-252134d8-04ca-4c4c-a8b5-0370936bf337 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "POST /compute/v2.1/servers/tempest-invalid-408234217/action" status: 404 len: 100 microversion: 2.1 time: 0.016677 Jul 02 21:04:06.593779 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 477/895] 10.222.0.43 () {60 vars in 1245 bytes} [Sat Jul 2 21:04:06 2022] POST /compute/v2.1/servers/tempest-invalid-408234217/action => generated 100 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:06.603428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d054bb01-65ba-4e82-82af-8fca3e66c884 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-502341760"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:06.604988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d054bb01-65ba-4e82-82af-8fca3e66c884 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:04:06.605520 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d054bb01-65ba-4e82-82af-8fca3e66c884 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d054bb01-65ba-4e82-82af-8fca3e66c884 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 56 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-test-snap-502341760"}} Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-502341760'}}} Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.607238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d054bb01-65ba-4e82-82af-8fca3e66c884 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d054bb01-65ba-4e82-82af-8fca3e66c884 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010635 Jul 02 21:04:06.611546 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 478/896] 10.222.0.43 () {60 vars in 1274 bytes} [Sat Jul 2 21:04:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:06.621357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46420209-d4d5-4210-b71c-b2c470af8d89 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-214563697"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:06.622435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-46420209-d4d5-4210-b71c-b2c470af8d89 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:04:06.622907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-46420209-d4d5-4210-b71c-b2c470af8d89 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46420209-d4d5-4210-b71c-b2c470af8d89 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 56 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-test-snap-214563697"}} Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-214563697'}}} Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.625365 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46420209-d4d5-4210-b71c-b2c470af8d89 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.630254 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-46420209-d4d5-4210-b71c-b2c470af8d89 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.012955 Jul 02 21:04:06.632361 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 479/897] 10.222.0.43 () {60 vars in 1280 bytes} [Sat Jul 2 21:04:06 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:06.640967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:06.641477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.648253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.649164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.650226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.650721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.667698 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 HTTP/1.1 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8a3ae6a5-bb89-46b2-81cc-44222bd446a5'} Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.669603 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-897c3d72-0d1c-4d83-b8d2-24953d099f04 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 404 len: 111 microversion: 2.1 time: 0.034369 Jul 02 21:04:06.685964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 480/898] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:06 2022] DELETE /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:04:06.687257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:06.687960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] [instance: 8a3ae6a5-bb89-46b2-81cc-44222bd446a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:06.690402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:06.695200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.695821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.696950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:06.697497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:06.703096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdf60113-2eb3-42d7-95cb-e2838c92a8a9 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.290941 Jul 02 21:04:06.706753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:06.714172 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 419/899] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:06 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:06.725744 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] HTTP exception thrown: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Request method failure captured: Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 HTTP/1.1 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgb1l0jZV6rIxcjHXrHEfHENa0q8upkHVaLIFippbiLEJjB3r0biKIBoDM_w_Sbf-rT6WxxZXXIhIKtkoV8k2aX9hAGbLUE-RO6t6Wwvg06gC7J0XUk8zOGR1oKBSlh-0IBdfr4A8JxHCIsL1ejBAV7VDtpAX5O8hkIq9tYTeo-w0 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ad0b5a189e934370af07b11ee0a9e737", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ad0b5a189e934370af07b11ee0a9e737"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ad0b5a189e934370af07b11ee0a9e737"}]}] Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ad0b5a189e934370af07b11ee0a9e737 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1983588894 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 223fd6f7a4c84114af7a22eb19cc7034 Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesNegativeTestJSON-1983588894-project Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8a3ae6a5-bb89-46b2-81cc-44222bd446a5'} Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:06.727876 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] Returning 404 to user: Instance 8a3ae6a5-bb89-46b2-81cc-44222bd446a5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8477fadf-38fb-460a-94d2-60b354fe1d63 tempest-ImagesNegativeTestJSON-1983588894 tempest-ImagesNegativeTestJSON-1983588894-project] 10.222.0.43 "GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5" status: 404 len: 111 microversion: 2.1 time: 0.048671 Jul 02 21:04:06.732626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 481/900] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:06 2022] GET /compute/v2.1/servers/8a3ae6a5-bb89-46b2-81cc-44222bd446a5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:07.143586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:07.144240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:07.151911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.153242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.154907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.155670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.165242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:07.166551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:07.190089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.190559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.196618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.197756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.600932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:07.614103 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-141b9121-b2ce-4fbd-8e1f-ac3179c171f9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.465981 Jul 02 21:04:07.614874 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 482/901] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:07 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:07.629132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:07.630171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:07.642475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:07.644382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.645173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.646555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.647250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.654062 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f877ac9-03c6-4882-a5bd-00e09b356b45 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1390 microversion: 2.1 time: 0.514892 Jul 02 21:04:07.658542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 420/902] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:07 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1390 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:07.666600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:07.672963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:07.683899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.684667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:07.686174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:07.686823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.019122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:08.028931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:08.033291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f84ab03-fdeb-4606-9f16-0c608a004a79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.415116 Jul 02 21:04:08.036444 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 483/903] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:07 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:08.039519 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44c59b6c-510c-416b-a308-b78123af1d09 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.379666 Jul 02 21:04:08.041799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:08.042679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:08.048719 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 421/904] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:07 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:08.052710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.053323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.054458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.055043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.069386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a844a1af-2791-4419-ba28-4a91df7e61d8 req-931166bf-5f86-4922-845b-1c0f0ad19cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264aa407-abb8-47d2-a832-f24eb2fbd35b", "name": "network-vif-plugged", "status": "completed", "tag": "7dea7579-7639-4b60-8610-2b2c1b70eec1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:08.091589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a844a1af-2791-4419-ba28-4a91df7e61d8 req-931166bf-5f86-4922-845b-1c0f0ad19cc8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.092666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a844a1af-2791-4419-ba28-4a91df7e61d8 req-931166bf-5f86-4922-845b-1c0f0ad19cc8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.108505 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a844a1af-2791-4419-ba28-4a91df7e61d8 req-931166bf-5f86-4922-845b-1c0f0ad19cc8 service nova] Creating event network-vif-plugged:7dea7579-7639-4b60-8610-2b2c1b70eec1 for instance 264aa407-abb8-47d2-a832-f24eb2fbd35b on nch2-master-1 Jul 02 21:04:08.120141 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a844a1af-2791-4419-ba28-4a91df7e61d8 req-931166bf-5f86-4922-845b-1c0f0ad19cc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069832 Jul 02 21:04:08.123682 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 422/905] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:08.227459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:08.238795 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c54edb5-2e6f-4673-a47b-918583fd2d9d tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.200862 Jul 02 21:04:08.239396 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 484/906] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:08 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:08.633248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:08.634013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:08.641546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.642227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.643132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.643768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.676398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:08.676995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:08.689909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.690698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.691714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.692196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.898355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:08.909562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:08.918737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54986eb1-4c9a-4297-8782-f0712993e6b6 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1590 microversion: 2.1 time: 0.246088 Jul 02 21:04:08.920002 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 485/907] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:08 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1590 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:08.922074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-882e725c-b98f-4359-9bbb-5b4918e78532 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.294862 Jul 02 21:04:08.923303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 423/908] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:08 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:08.935374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:08.935810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:08.941933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.942383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:08.943410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:08.943916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.040888 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-16b21f3f-bb23-46f0-8803-ea0535fea14e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109481 Jul 02 21:04:09.041526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 486/909] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:04:08 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:09.054070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:09.055034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:09.061993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:09.062919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:09.071184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.072020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.073122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.073902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.077728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.078405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.079345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.079941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.327677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:09.338367 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b2e8560-579f-4123-ac5f-84f498a17515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.290272 Jul 02 21:04:09.339141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 424/910] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:09 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:09.342698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:09.351349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:09.351889 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7b27451a-6868-4c63-a76f-82a3878df8e1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.294784 Jul 02 21:04:09.352380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:09.356660 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 487/911] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:09 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:09.359117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.359816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.360841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.361486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.551140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:09.560171 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5856a127-afcb-43d7-aa6c-2a7db99c8b92 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1321 microversion: 2.1 time: 0.219800 Jul 02 21:04:09.560754 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 425/912] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:09 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:09.940714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:09.942005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:09.951788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.952675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:09.954047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:09.954689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.173500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:10.184080 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e36be133-b4d9-465b-805d-1e3adce814e5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.248726 Jul 02 21:04:10.192125 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 488/913] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:09 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:10.194552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-63390c75-9786-4912-8a00-38b454d1cf7a req-05b22fcd-03a9-408e-9660-73f15691ef8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afbe1b3-5af8-44b4-95d1-a4455c8dd66d", "name": "network-vif-plugged", "status": "completed", "tag": "d09c31e8-e47c-4509-9a70-3e72f9290108"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:10.214479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-63390c75-9786-4912-8a00-38b454d1cf7a req-05b22fcd-03a9-408e-9660-73f15691ef8b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.214929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-63390c75-9786-4912-8a00-38b454d1cf7a req-05b22fcd-03a9-408e-9660-73f15691ef8b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.238200 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-63390c75-9786-4912-8a00-38b454d1cf7a req-05b22fcd-03a9-408e-9660-73f15691ef8b service nova] Creating event network-vif-plugged:d09c31e8-e47c-4509-9a70-3e72f9290108 for instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d on nch1-master-1 Jul 02 21:04:10.247999 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-63390c75-9786-4912-8a00-38b454d1cf7a req-05b22fcd-03a9-408e-9660-73f15691ef8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059216 Jul 02 21:04:10.249169 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 426/914] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:04:10.355711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:10.356619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:10.363242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.363858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.364798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.365383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.379859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:10.382808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:10.391883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:10.399997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.402602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.404882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.405619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.627641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:10.636243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:10.636803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8dcd3712-0649-4cdf-bbd0-b7081e65c9d4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.284950 Jul 02 21:04:10.640118 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 489/915] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:10 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:10.642885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:10.643492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:10.647661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d7b46a2-a1b4-484f-83bd-0330e4e3f49f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.278864 Jul 02 21:04:10.648278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 427/916] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:10 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:10.657586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.658109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.658950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.659390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.789427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:10.797248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a18d94c7-6082-4ff9-be5b-d0eefb11bac3 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1470 microversion: 2.1 time: 0.158511 Jul 02 21:04:10.797926 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 490/917] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:10 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:10.817815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:10.817815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:10.824391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.824849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.825639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.826071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.851079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lazy-loading 'flavor' on Instance uuid 264aa407-abb8-47d2-a832-f24eb2fbd35b {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:10.938926 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-487087af-79c9-470a-a4ac-9b5744477b52 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b/action" status: 202 len: 0 microversion: 2.1 time: 0.126176 Jul 02 21:04:10.942681 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 428/918] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:10 2022] POST /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:04:10.953901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:10.953901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:10.964822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.964822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:10.965601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:10.966034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.161419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:11.162332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:11.169905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.170372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.171182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.171620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.199076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:11.410737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:11.444692 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6f1254ca-15f2-41e2-9181-d453bbe81ef7 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1629 microversion: 2.1 time: 0.500777 Jul 02 21:04:11.445044 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14cc4d93-f4c9-46ea-971f-77bdddaae40d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1590 microversion: 2.1 time: 0.276425 Jul 02 21:04:11.445779 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 429/919] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:11 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1590 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:11.450664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 491/920] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:10 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1629 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:11.460607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-62f74b15-6110-4381-b278-80550c30892d req-093b9dfc-8e2c-4b9a-9164-09e36a5c7c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c074787f-d02a-4e68-a9a2-58442e8fef1c", "tag": "99084601-a941-4aba-b7d7-5df7fa7250c0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:11.463385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:11.464081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:11.476956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-62f74b15-6110-4381-b278-80550c30892d req-093b9dfc-8e2c-4b9a-9164-09e36a5c7c50 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.477776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-62f74b15-6110-4381-b278-80550c30892d req-093b9dfc-8e2c-4b9a-9164-09e36a5c7c50 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.492567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.492881 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-62f74b15-6110-4381-b278-80550c30892d req-093b9dfc-8e2c-4b9a-9164-09e36a5c7c50 service nova] Creating event network-changed:99084601-a941-4aba-b7d7-5df7fa7250c0 for instance c074787f-d02a-4e68-a9a2-58442e8fef1c on nch1-master-1 Jul 02 21:04:11.493052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.495108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.495564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.500085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-62f74b15-6110-4381-b278-80550c30892d req-093b9dfc-8e2c-4b9a-9164-09e36a5c7c50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051631 Jul 02 21:04:11.501230 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 430/921] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:11.655114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:11.656016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:11.673260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.673917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.679351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.680229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.796084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:11.806268 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cccb5008-13d9-475d-86a0-c62b84e2f25b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.354280 Jul 02 21:04:11.810726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 492/922] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:11 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:11.825245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:11.826845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:11.841802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.843274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.844903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:11.847962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:11.946807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:11.959811 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f2e8f8e-5396-4caa-87d3-a9ee354cc6d5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.309225 Jul 02 21:04:11.975042 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 431/923] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:11 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:12.135613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:12.150118 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f09cfe2c-2c87-4a20-805c-3538bddcbdf2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1477 microversion: 2.1 time: 0.337162 Jul 02 21:04:12.151310 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 493/924] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:11 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:12.466762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:12.468153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:12.475683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.476148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.476938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.477349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.625302 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e34feb9a-0e87-490e-9e8d-8221c8763ffa tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1612 microversion: 2.1 time: 0.162346 Jul 02 21:04:12.626357 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 432/925] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:12 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1612 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:12.645794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:12.646375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:12.653293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.653790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.654636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.655098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.739747 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] HTTP exception thrown: Cannot 'migrate' instance 264aa407-abb8-47d2-a832-f24eb2fbd35b while it is in vm_state suspended Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Request method failure captured: Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b/action HTTP/1.1 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 15 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKiFJ-aJyvu5Pf1yPGL7lCdY_n64iJmITns9EWr0DgNr9_yKlr56-Opar1PT8Ah3zPD9jehIjSqpBBJb-rf2AJHuTngydE3H_Tiks5hqBjDBNgJ6y_ll7FJd-ZRr2vVKB1z2j8mtYSbDuLIXa05hXCpeGpQpuY2iia1QjnMf1PXjsg Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9014a6e32f3442ca8336f44a9d311b56", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9014a6e32f3442ca8336f44a9d311b56"}]}] Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 43df10ed0fb64a6e909b08989e0b226d Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: {"migrate": {}} Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'migrate' instance 264aa407-abb8-47d2-a832-f24eb2fbd35b while it is in vm_state suspended Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '264aa407-abb8-47d2-a832-f24eb2fbd35b', 'body': {'migrate': {}}} Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b in vm_state suspended. Cannot resize while the instance is in this state. Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:12.742450 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 264aa407-abb8-47d2-a832-f24eb2fbd35b while it is in vm_state suspended Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 264aa407-abb8-47d2-a832-f24eb2fbd35b while it is in vm_state suspended Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Returning 409 to user: Cannot 'migrate' instance 264aa407-abb8-47d2-a832-f24eb2fbd35b while it is in vm_state suspended {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e678030-5ecc-4e18-bf59-3e919c1afab3 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b/action" status: 409 len: 148 microversion: 2.1 time: 0.101956 Jul 02 21:04:12.746644 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 494/926] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:12 2022] POST /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b/action => generated 148 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:04:12.756188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bf43d6e-93d4-4bb5-be1e-aae3c98071f2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bf43d6e-93d4-4bb5-be1e-aae3c98071f2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Request method failure captured: Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485/action HTTP/1.1 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 39 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKiFJ-aJyvu5Pf1yPGL7lCdY_n64iJmITns9EWr0DgNr9_yKlr56-Opar1PT8Ah3zPD9jehIjSqpBBJb-rf2AJHuTngydE3H_Tiks5hqBjDBNgJ6y_ll7FJd-ZRr2vVKB1z2j8mtYSbDuLIXa05hXCpeGpQpuY2iia1QjnMf1PXjsg Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9014a6e32f3442ca8336f44a9d311b56", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9014a6e32f3442ca8336f44a9d311b56"}]}] Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 43df10ed0fb64a6e909b08989e0b226d Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: {"os-resetState": {"state": "invalid"}} Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '0a995631-3901-42e3-89a3-328543407485', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'invalid' Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:04:12.758621 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bf43d6e-93d4-4bb5-be1e-aae3c98071f2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4bf43d6e-93d4-4bb5-be1e-aae3c98071f2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485/action" status: 400 len: 144 microversion: 2.1 time: 0.007803 Jul 02 21:04:12.763025 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 433/927] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:12 2022] POST /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485/action => generated 144 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:04:12.770234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-40bd1577-aa16-4717-8f73-a06eac6ee81e tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-40bd1577-aa16-4717-8f73-a06eac6ee81e tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Request method failure captured: Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485/action HTTP/1.1 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 31 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKiFJ-aJyvu5Pf1yPGL7lCdY_n64iJmITns9EWr0DgNr9_yKlr56-Opar1PT8Ah3zPD9jehIjSqpBBJb-rf2AJHuTngydE3H_Tiks5hqBjDBNgJ6y_ll7FJd-ZRr2vVKB1z2j8mtYSbDuLIXa05hXCpeGpQpuY2iia1QjnMf1PXjsg Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9014a6e32f3442ca8336f44a9d311b56", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9014a6e32f3442ca8336f44a9d311b56"}]}] Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 43df10ed0fb64a6e909b08989e0b226d Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: {"os-resetState": {"state": 1}} Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0a995631-3901-42e3-89a3-328543407485', 'body': {'os-resetState': {'state': 1}}} Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 1 Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 02 21:04:12.772689 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-40bd1577-aa16-4717-8f73-a06eac6ee81e tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-40bd1577-aa16-4717-8f73-a06eac6ee81e tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485/action" status: 400 len: 120 microversion: 2.1 time: 0.007709 Jul 02 21:04:12.777802 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 495/928] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:12 2022] POST /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485/action => generated 120 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:04:12.787058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac4d9c3b-cf34-4fee-b663-f112cb8e1ff2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:12.788899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac4d9c3b-cf34-4fee-b663-f112cb8e1ff2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Failed to fetch instance by id 999 {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:04:12.789996 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ac4d9c3b-cf34-4fee-b663-f112cb8e1ff2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac4d9c3b-cf34-4fee-b663-f112cb8e1ff2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Request method failure captured: Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 37 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKiFJ-aJyvu5Pf1yPGL7lCdY_n64iJmITns9EWr0DgNr9_yKlr56-Opar1PT8Ah3zPD9jehIjSqpBBJb-rf2AJHuTngydE3H_Tiks5hqBjDBNgJ6y_ll7FJd-ZRr2vVKB1z2j8mtYSbDuLIXa05hXCpeGpQpuY2iia1QjnMf1PXjsg Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9014a6e32f3442ca8336f44a9d311b56", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9014a6e32f3442ca8336f44a9d311b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9014a6e32f3442ca8336f44a9d311b56"}]}] Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9014a6e32f3442ca8336f44a9d311b56 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-219810848 Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 43df10ed0fb64a6e909b08989e0b226d Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-219810848-project-admin Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: {"os-resetState": {"state": "error"}} Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 999 could not be found. Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:12.802131 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:12.807001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:12.807001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 02 21:04:12.807001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:12.807001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac4d9c3b-cf34-4fee-b663-f112cb8e1ff2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:12.807001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac4d9c3b-cf34-4fee-b663-f112cb8e1ff2 tempest-ServersAdminNegativeTestJSON-219810848 tempest-ServersAdminNegativeTestJSON-219810848-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.021818 Jul 02 21:04:12.807001 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 434/929] 10.222.0.43 () {60 vars in 1178 bytes} [Sat Jul 2 21:04:12 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:04:12.814228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:12.815669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:12.824803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.825520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.826673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.827297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.829249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:12.830184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:12.842805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.843239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.848564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:12.849296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:12.868559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:13.039934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:13.045481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34eaf45e-76d7-4730-ac66-0ff2f4dda9e4 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "DELETE /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 204 len: 0 microversion: 2.1 time: 0.234492 Jul 02 21:04:13.047009 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 496/930] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:12 2022] DELETE /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:13.056769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:13.058071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:13.066862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:13.067617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:13.069403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:13.071406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:13.160410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:13.173694 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-928c3c6e-91a9-4716-8331-8f01616a24d2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.350755 Jul 02 21:04:13.180890 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 435/931] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:12 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:13.185984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:13.186539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:13.201381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:13.201831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:13.202633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:13.203798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:13.544591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:13.554522 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6cef0884-8f32-4223-879e-251f9350d515 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1316 microversion: 2.1 time: 0.505145 Jul 02 21:04:13.555119 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 497/932] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:13 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:13.567132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:13.567746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:13.588478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:13.589279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:13.590585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:13.591798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:13.644572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:13.650998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:13.659554 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-847139c0-f692-4488-a859-4cefd9fdcd26 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1467 microversion: 2.1 time: 0.477561 Jul 02 21:04:13.660164 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 436/933] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:13 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1467 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:13.953941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:13.964792 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d90501da-3b9a-480a-a373-3029a9d4cec3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1476 microversion: 2.1 time: 0.401284 Jul 02 21:04:13.965604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 498/934] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:13 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:14.197704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:14.198633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:14.204915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.205344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.206323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.206765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.560717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:14.570635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1683ab65-b8f8-49cc-81fd-ddf7f5226280 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.376838 Jul 02 21:04:14.571650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:14.572351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:14.581687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 437/935] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:14 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:14.590127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.590581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.591380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.591826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.678911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:14.680211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:14.693519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.694372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.695948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.696643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.870433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:14.879049 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-00808b27-a947-42bd-8282-bccab234831b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1466 microversion: 2.1 time: 0.311154 Jul 02 21:04:14.880576 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 499/936] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:14 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:14.897357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:14.902721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:14.909706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.910330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:14.911364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:14.912119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:15.052029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:15.061475 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4598880f-3546-4e37-9b5e-4a579267e14e tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1467 microversion: 2.1 time: 0.387674 Jul 02 21:04:15.072507 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 438/937] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:14 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1467 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:15.085306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:15.086454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:15.100611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:15.101529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:15.102681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:15.103218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:15.219591 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-997fa6db-ae91-4af3-bcd9-e00f1461d26e tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1617 microversion: 2.1 time: 0.325683 Jul 02 21:04:15.221700 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 500/938] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:14 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1617 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:15.346095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1770466859", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "899cd575-ce36-4ba9-b0a3-5d4704088bf1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:15.411759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:15.421878 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3b4581e-785a-4ce7-8e36-dfaca4ab19d9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1474 microversion: 2.1 time: 0.347951 Jul 02 21:04:15.422112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:15.429416 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 439/939] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:15 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:15.588268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:15.589282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:15.596342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:15.597172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:15.598190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:15.598834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.113265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:16.174623 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d63ed27-93d1-4547-82f4-cd1ce0024745 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.580133 Jul 02 21:04:16.177453 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 440/940] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:15 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:16.208638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:16.209189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:16.209534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:16.210070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:16.210486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:16.222588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:16.227649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:16.238651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.240942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.241877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.248027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.251908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.254532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.255497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.255944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.345102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:16.359898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.360390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.360789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Getting quotas for user 9ee93cc6740d4e92b231f60d8b9d4450 and project 065f852898294f2c8a154eb8d5f498f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:16.360922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lazy-loading 'fault' on Instance uuid 264aa407-abb8-47d2-a832-f24eb2fbd35b {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:16.379102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:16.382916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:16.451065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f6c46a27-08e4-41a7-8c41-b81b9ab1725b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.110517 Jul 02 21:04:16.455842 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 501/941] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:04:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:04:16.461261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-fd3aaf8a-d394-49ce-964b-c40561061de9 req-a1340c15-7773-4ccb-8cd8-854d668a4762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264aa407-abb8-47d2-a832-f24eb2fbd35b", "name": "network-vif-deleted", "tag": "7dea7579-7639-4b60-8610-2b2c1b70eec1"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:16.472119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fd3aaf8a-d394-49ce-964b-c40561061de9 req-a1340c15-7773-4ccb-8cd8-854d668a4762 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.472879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fd3aaf8a-d394-49ce-964b-c40561061de9 req-a1340c15-7773-4ccb-8cd8-854d668a4762 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.486379 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-fd3aaf8a-d394-49ce-964b-c40561061de9 req-a1340c15-7773-4ccb-8cd8-854d668a4762 service nova] Creating event network-vif-deleted:7dea7579-7639-4b60-8610-2b2c1b70eec1 for instance 264aa407-abb8-47d2-a832-f24eb2fbd35b on nch2-master-1 Jul 02 21:04:16.493753 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-fd3aaf8a-d394-49ce-964b-c40561061de9 req-a1340c15-7773-4ccb-8cd8-854d668a4762 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036366 Jul 02 21:04:16.494996 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 502/942] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:16.506696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:16.514232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6386b1a9-4f68-45b8-9b74-35af45114c9a req-2e77c0a1-041f-4eb7-8e4f-26c2d41ac1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f6a822-7105-43d0-b2d3-934f6e737e6e", "name": "network-vif-unplugged", "status": "completed", "tag": "5d1235fa-f55d-444b-99f9-811cc2aa77fe"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:16.521229 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-035e0c41-3fcc-4803-8a36-e4fe53fc148c tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 200 len: 1311 microversion: 2.1 time: 0.317150 Jul 02 21:04:16.524583 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 441/943] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:16 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 1311 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:16.535597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6386b1a9-4f68-45b8-9b74-35af45114c9a req-2e77c0a1-041f-4eb7-8e4f-26c2d41ac1a3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.542069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6386b1a9-4f68-45b8-9b74-35af45114c9a req-2e77c0a1-041f-4eb7-8e4f-26c2d41ac1a3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.544757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:16.545448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:16.569222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.571943 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6386b1a9-4f68-45b8-9b74-35af45114c9a req-2e77c0a1-041f-4eb7-8e4f-26c2d41ac1a3 service nova] Creating event network-vif-unplugged:5d1235fa-f55d-444b-99f9-811cc2aa77fe for instance a0f6a822-7105-43d0-b2d3-934f6e737e6e on nch1-master-1 Jul 02 21:04:16.572724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.573560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:16.574008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:16.587459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-6386b1a9-4f68-45b8-9b74-35af45114c9a req-2e77c0a1-041f-4eb7-8e4f-26c2d41ac1a3 service nova] Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:04:16.605699 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6386b1a9-4f68-45b8-9b74-35af45114c9a req-2e77c0a1-041f-4eb7-8e4f-26c2d41ac1a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108974 Jul 02 21:04:16.609233 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 503/944] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:16.620594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01218449-7bcd-4c15-85ba-86e32dadb94a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:16.625115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-01218449-7bcd-4c15-85ba-86e32dadb94a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:16.898441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-01218449-7bcd-4c15-85ba-86e32dadb94a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:16.913954 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-01218449-7bcd-4c15-85ba-86e32dadb94a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1217 microversion: 2.1 time: 0.302172 Jul 02 21:04:16.915298 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 504/945] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:16 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:17.029682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:17.041564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f701c17-ef3c-4c4f-88c1-26c4f53698ca tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1474 microversion: 2.1 time: 0.514996 Jul 02 21:04:17.043120 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 442/946] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:16 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1474 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:17.196597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:17.198527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:17.218059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.219479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.222558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.224746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.543770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:17.547977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 264aa407-abb8-47d2-a832-f24eb2fbd35b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:17.597751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.604680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.607004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.608902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.670644 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] HTTP exception thrown: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b could not be found. Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Request method failure captured: Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b HTTP/1.1 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKgnmmIZEOADD8OhUqu3H9dnIVpmYR8AI9i-y0rAJ8q_Jd83_tJHgUdVvUZtbMR1AIpvIyI5LpE8vn3mhL_PxJlckBj01lwfYjp3yYJF7ozDC_VkJcBEiXHLk12tqalbj5KnoKrzh_8VvkIaahepihch6Bo_n4tfKlJOUJrnG8f-OE Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 48b2d24d625d4151b67de30f8fa7b918 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2139288074 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48b2d24d625d4151b67de30f8fa7b918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_48b2d24d625d4151b67de30f8fa7b918", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48b2d24d625d4151b67de30f8fa7b918"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/48b2d24d625d4151b67de30f8fa7b918"}]}] Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2139288074 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 48b2d24d625d4151b67de30f8fa7b918 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2139288074 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-2139288074-project Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 6c9e360aff3b43688e88f739a1723921 Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2139288074-project Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b could not be found. Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '264aa407-abb8-47d2-a832-f24eb2fbd35b'} Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b could not be found. Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b could not be found. Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:17.678118 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b could not be found. Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Returning 404 to user: Instance 264aa407-abb8-47d2-a832-f24eb2fbd35b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00b81c03-50f3-449f-bee6-2d763cd9bb68 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b" status: 404 len: 111 microversion: 2.1 time: 0.142615 Jul 02 21:04:17.683157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 443/947] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:17 2022] GET /compute/v2.1/servers/264aa407-abb8-47d2-a832-f24eb2fbd35b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:17.692386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:17.692896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:17.694395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:17.703007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.703680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.705518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.706125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.720007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b0450f7-8136-4d74-ad6c-38ea0d32a6cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.529148 Jul 02 21:04:17.722370 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 505/948] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:17 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:17.752673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:17.896546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35dd97c2-64e4-4040-a23c-b88fff3f6866 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 204 len: 0 microversion: 2.1 time: 0.210250 Jul 02 21:04:17.903589 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 444/949] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:17 2022] DELETE /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:17.913572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:17.914476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:17.928555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.929667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.930621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.931224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.942990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:17.944009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:17.955219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.955933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:17.957077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:17.957666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:18.153777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:18.162491 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e445ad2f-cd1d-447c-a23d-5ed395329458 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1269 microversion: 2.1 time: 0.234519 Jul 02 21:04:18.180159 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 445/950] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:17 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1269 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:18.191477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:18.193399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:18.201958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:18.202407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:18.203248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:18.204113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:18.307116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:18.322360 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bea9b410-a913-49e4-85b3-0d45e2d522ef tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1476 microversion: 2.1 time: 0.414145 Jul 02 21:04:18.323575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 506/951] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:17 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1476 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:18.503908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:18.517095 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6e525f3-7d65-4331-bd2f-de94262008a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1474 microversion: 2.1 time: 0.335575 Jul 02 21:04:18.517678 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 446/952] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:18 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1474 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:18.741008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:18.742317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:18.753418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:18.754480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:18.755960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:18.756625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.046883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:19.061176 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eaf6ab6a-2719-4513-aed3-e745b9ef8063 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.327529 Jul 02 21:04:19.070978 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 507/953] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:18 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:19.180005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:19.180672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:19.217196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:19.218928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.229687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:19.230631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.307547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:19.339208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:19.339995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:19.355330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:19.355792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.356681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:19.357129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.434494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:19.444027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45d1b040-29da-44e6-9ac3-08b5a5b9f7fd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1277 microversion: 2.1 time: 0.268147 Jul 02 21:04:19.450975 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 447/954] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:19 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:19.534629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:19.535606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:19.545897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:19.549667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.552214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:19.552996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:19.910928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:19.925047 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ae6024c-8e99-4bc5-a216-df18e1deb460 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1476 microversion: 2.1 time: 0.589684 Jul 02 21:04:19.931083 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 508/955] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:19 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1476 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:19.945364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-439b32c7-e805-46c7-9ccf-83be58919247 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Action: 'create', calling method: .version_select at 0x7fabe4a47790>, body: {"keypair": {"name": "tempest-keypair-1018938237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5U3C80x1DZOjUcTrHl/U1e2h2yahOWPeTO6EAxPQ29OTsAZDZO6K6ZHM3k8keBUeZi1EkchEaylcFzjp48eA2EcJny2+nmIs6N3AbCVFZpBKjErLjYFKKlpcQxZ1ugVA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:19.968080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:19.978674 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7283c6b-3e17-48dc-8913-e2b8e9bb2d4f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1471 microversion: 2.1 time: 0.448751 Jul 02 21:04:19.982723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-439b32c7-e805-46c7-9ccf-83be58919247 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Getting quotas for project 63b8773841e44baab20aa0677e027de7. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:19.989620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-439b32c7-e805-46c7-9ccf-83be58919247 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Getting quotas for user 45991293f65c4c22a91afa74cf8179ce and project 63b8773841e44baab20aa0677e027de7. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:19.990636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 448/956] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:19 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1471 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:19.995717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:19.996239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:20.008894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.009308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.010829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.011268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.053631 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-439b32c7-e805-46c7-9ccf-83be58919247 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.120287 Jul 02 21:04:20.060496 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 509/957] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:04:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:04:20.082853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:20.083747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:20.091872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.097366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.098380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.099046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.186003 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8b2898a-3849-4452-97a8-c4caa1a109de tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e/action" status: 204 len: 0 microversion: 2.1 time: 0.189682 Jul 02 21:04:20.188489 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 449/958] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:19 2022] POST /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e/action => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:20.203733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:20.210603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:20.224250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.224995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.225935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.226518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.758605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:20.770779 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32e571fe-2e8a-408c-b78e-8efe1ef98ee3 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.691721 Jul 02 21:04:20.784307 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 510/959] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:20 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:20.789753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:20.797041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:20.816517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.817814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.822583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.825860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.883413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:20.903719 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81a77a01-8a95-476c-b494-e56531de1ff0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1471 microversion: 2.1 time: 0.710216 Jul 02 21:04:20.904658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 450/960] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:20 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1471 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:20.949223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:20.949737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:20.956238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.956690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.957477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:20.958228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:20.999861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:21.020479 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e99d7d21-38e6-4b6c-91be-3a8bff13734a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1275 microversion: 2.1 time: 0.231781 Jul 02 21:04:21.023433 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 511/961] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:20 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1275 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:21.359209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:21.376873 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5168385-ad71-4a7f-a8ac-651a14ef7643 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1476 microversion: 2.1 time: 0.429920 Jul 02 21:04:21.378817 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 451/962] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:20 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:21.799503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:21.800186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:21.825013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:21.825323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:21.826345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:21.826880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:21.924006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:21.924647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:21.947887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:21.957654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:21.959667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:21.960152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:22.110490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:22.119468 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5568e937-d058-4a19-8870-aabb65a1688b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.332433 Jul 02 21:04:22.130381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 512/963] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:21 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:22.135607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:22.136789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:22.143707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:22.144529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:22.145478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:22.146074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:22.178759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:22.200787 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67a5b0aa-26b0-4c29-9222-fd91be3c25e4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1471 microversion: 2.1 time: 0.271034 Jul 02 21:04:22.206184 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 452/964] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:21 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1471 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:22.249234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:22.277262 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b0067b76-7629-475a-9abd-d0ced3cb1cda tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1275 microversion: 2.1 time: 0.144680 Jul 02 21:04:22.278343 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 513/965] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:22 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1275 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:22.370641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4668534b-3432-4e0b-a420-d2e4585e5ae9 req-41369536-9f5a-4280-bcf8-147c614f5e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a995631-3901-42e3-89a3-328543407485", "name": "network-vif-deleted", "tag": "cfc2d4ba-b243-4240-a500-6858ed535c9c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:22.393745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4668534b-3432-4e0b-a420-d2e4585e5ae9 req-41369536-9f5a-4280-bcf8-147c614f5e8f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:22.395108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:22.396025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:22.399572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4668534b-3432-4e0b-a420-d2e4585e5ae9 req-41369536-9f5a-4280-bcf8-147c614f5e8f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:22.409766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:22.410536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:22.415705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:22.418154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:22.432735 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4668534b-3432-4e0b-a420-d2e4585e5ae9 req-41369536-9f5a-4280-bcf8-147c614f5e8f service nova] Creating event network-vif-deleted:cfc2d4ba-b243-4240-a500-6858ed535c9c for instance 0a995631-3901-42e3-89a3-328543407485 on nch2-master-1 Jul 02 21:04:22.439234 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4668534b-3432-4e0b-a420-d2e4585e5ae9 req-41369536-9f5a-4280-bcf8-147c614f5e8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073689 Jul 02 21:04:22.442025 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 453/966] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:22.656291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c9e360aff3b43688e88f739a1723921', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b2d24d625d4151b67de30f8fa7b918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:22.674232 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3fdb23c-745a-4891-9e4c-6c89d2e590ff tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 200 len: 1434 microversion: 2.1 time: 0.282787 Jul 02 21:04:22.674817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 514/967] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:22 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 1434 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:22.849883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1039961602", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:22.947664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:23.149991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:23.151190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:23.168786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:23.169735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:23.170708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:23.175111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:23.552727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:23.564602 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63abfca3-d8b0-4b62-952f-6038271d0869 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.431614 Jul 02 21:04:23.565199 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 515/968] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:23 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:23.571795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:23.575733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:23.594438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:23.600327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:23.601489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:23.607872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.034817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:24.052257 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccd8d862-4c5d-4caa-89f9-ae7dff8681e8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1463 microversion: 2.1 time: 0.477705 Jul 02 21:04:24.068719 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 516/969] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:23 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1463 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:24.074847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:24.075888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:24.087468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.088347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.089407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.090072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.555263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:24.556374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:24.557069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:24.557666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:24.558738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:24.559331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:24.568220 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c09de0c-39aa-463b-828d-0c0ae621b40c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1317 microversion: 2.1 time: 0.497964 Jul 02 21:04:24.571726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 517/970] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:24 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1317 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:24.573407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.574058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.575112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.575751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.576786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:24.577406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] [instance: 0a995631-3901-42e3-89a3-328543407485] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:24.595803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.596326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.597113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.597540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.606943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:24.615200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:24.634081 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] HTTP exception thrown: Instance 0a995631-3901-42e3-89a3-328543407485 could not be found. Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Request method failure captured: Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 HTTP/1.1 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKgnmmIZEOADD8OhUqu3H9dnIVpmYR8AI9i-y0rAJ8q_Jd83_tJHgUdVvUZtbMR1AIpvIyI5LpE8vn3mhL_PxJlckBj01lwfYjp3yYJF7ozDC_VkJcBEiXHLk12tqalbj5KnoKrzh_8VvkIaahepihch6Bo_n4tfKlJOUJrnG8f-OE Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 48b2d24d625d4151b67de30f8fa7b918 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2139288074 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48b2d24d625d4151b67de30f8fa7b918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_48b2d24d625d4151b67de30f8fa7b918", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/48b2d24d625d4151b67de30f8fa7b918"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/48b2d24d625d4151b67de30f8fa7b918"}]}] Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2139288074 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 48b2d24d625d4151b67de30f8fa7b918 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2139288074 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdminNegativeTestJSON-2139288074-project Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 6c9e360aff3b43688e88f739a1723921 Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2139288074-project Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0a995631-3901-42e3-89a3-328543407485 could not be found. Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0a995631-3901-42e3-89a3-328543407485'} Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a995631-3901-42e3-89a3-328543407485 could not be found. Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a995631-3901-42e3-89a3-328543407485 could not be found. Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:24.635796 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a995631-3901-42e3-89a3-328543407485 could not be found. Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] Returning 404 to user: Instance 0a995631-3901-42e3-89a3-328543407485 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:24.640992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f9ac981-b405-4868-a142-6de8bb283039 tempest-ServersAdminNegativeTestJSON-2139288074 tempest-ServersAdminNegativeTestJSON-2139288074-project] 10.222.0.43 "GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485" status: 404 len: 111 microversion: 2.1 time: 0.064497 Jul 02 21:04:24.642133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:24.645288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:24.648080 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 518/971] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:24 2022] GET /compute/v2.1/servers/0a995631-3901-42e3-89a3-328543407485 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:24.658185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:24.658800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:24.678501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.683261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.688142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.688729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.719379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:24.754831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-140d53e1-7166-4fa3-be4d-a9d2d113fb72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.163714 Jul 02 21:04:24.765315 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 454/972] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:04:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:04:24.780630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4f21088e-9e58-4f83-9178-eab1c10a6e5b req-5c3b2873-d7cc-46a9-915e-521ccdc46924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe", "tag": "f8201b5c-1079-4ebe-b5b0-07bc24646060"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:24.803677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4f21088e-9e58-4f83-9178-eab1c10a6e5b req-5c3b2873-d7cc-46a9-915e-521ccdc46924 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.806712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4f21088e-9e58-4f83-9178-eab1c10a6e5b req-5c3b2873-d7cc-46a9-915e-521ccdc46924 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.841501 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4f21088e-9e58-4f83-9178-eab1c10a6e5b req-5c3b2873-d7cc-46a9-915e-521ccdc46924 service nova] Creating event network-changed:f8201b5c-1079-4ebe-b5b0-07bc24646060 for instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe on nch2-master-1 Jul 02 21:04:24.851450 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4f21088e-9e58-4f83-9178-eab1c10a6e5b req-5c3b2873-d7cc-46a9-915e-521ccdc46924 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083037 Jul 02 21:04:24.852124 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 455/973] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:24.866348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:24.876783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:24.885018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.885642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:24.886595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:24.887183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:25.204639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:25.214847 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bd69cdb7-52c8-4907-afd3-8ba1c49414ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1463 microversion: 2.1 time: 0.560521 Jul 02 21:04:25.238769 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 519/974] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:24 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1463 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:25.269737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10804b9-830b-42f8-baa1-8928c8fc306e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:25.270227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:25.270990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f10804b9-830b-42f8-baa1-8928c8fc306e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:25.281853 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8bfd73d5-8e16-4c92-9eab-3ac34b87dc45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.428442 Jul 02 21:04:25.292200 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 456/975] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:24 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:25.297236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0d880027-9fc7-45df-9175-fb9d1f91f23c req-2f31b44e-3645-4f78-bfff-267dc3ebc0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f6a822-7105-43d0-b2d3-934f6e737e6e", "name": "network-vif-plugged", "status": "completed", "tag": "5d1235fa-f55d-444b-99f9-811cc2aa77fe"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:25.316803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0d880027-9fc7-45df-9175-fb9d1f91f23c req-2f31b44e-3645-4f78-bfff-267dc3ebc0a8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:25.317662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0d880027-9fc7-45df-9175-fb9d1f91f23c req-2f31b44e-3645-4f78-bfff-267dc3ebc0a8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:25.338913 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0d880027-9fc7-45df-9175-fb9d1f91f23c req-2f31b44e-3645-4f78-bfff-267dc3ebc0a8 service nova] Creating event network-vif-plugged:5d1235fa-f55d-444b-99f9-811cc2aa77fe for instance a0f6a822-7105-43d0-b2d3-934f6e737e6e on nch1-master-1 Jul 02 21:04:25.353255 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0d880027-9fc7-45df-9175-fb9d1f91f23c req-2f31b44e-3645-4f78-bfff-267dc3ebc0a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059112 Jul 02 21:04:25.356116 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 457/976] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:25.370827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b06e5a7-68e5-4571-a2b6-c24b39a28956 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'create', calling method: .version_select at 0x7fabe48ab310>, body: {"keypair": {"name": "tempest-keypair-25533866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRcEx34wugZl/4/Dd7QkTa0E90JejsvajMsld7f3vOyUK9dUxoLX8kuqP+y+xfR0bkUbpN8Q5a7QUXCRP4NsdvYr/CbdE+3zS/wUaPczxomboJZh/40OGrxNAqtYxONSQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:25.401677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3b06e5a7-68e5-4571-a2b6-c24b39a28956 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:25.414423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3b06e5a7-68e5-4571-a2b6-c24b39a28956 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for user 592e8c2ad31f459fa0b37f219cc4f84c and project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:25.435596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10804b9-830b-42f8-baa1-8928c8fc306e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:25.445588 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f10804b9-830b-42f8-baa1-8928c8fc306e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1215 microversion: 2.1 time: 0.203544 Jul 02 21:04:25.456493 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 520/977] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:25 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:25.457931 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b06e5a7-68e5-4571-a2b6-c24b39a28956 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.099854 Jul 02 21:04:25.458820 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 458/978] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:04:25 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:25.586161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:25.587956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:25.598674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:25.603310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:25.606286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:25.607708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:25.863618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:25.875133 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-52b46961-385e-43d9-968b-4300e50df846 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1317 microversion: 2.1 time: 0.293201 Jul 02 21:04:25.875674 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 521/979] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:25 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:25.947092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-135009158", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bce2ddce-35e2-4853-8635-e21723df171c"}, {"port": "bc0b03a4-a4d1-46a8-bf46-32d0ea2ab69a", "tag": "port-1"}, {"port": "31a0e127-6d14-40ad-9cfc-2d221b2b34f7", "tag": "port-2"}, {"uuid": "a389a2d0-5299-44ab-ac0b-b2a386c1a462", "tag": "net-1"}, {"uuid": "a389a2d0-5299-44ab-ac0b-b2a386c1a462"}, {"uuid": "102533ea-626e-4606-a425-746a8575e262", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "102533ea-626e-4606-a425-746a8575e262", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0fd88419-3147-47fa-bed8-27c867972435", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "6da0916e-d49c-4e14-94a5-3cccd3b7c22c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4af561d5-4d61-49c9-b2df-3812b0172ae2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--20779573"}], "key_name": "tempest-keypair-1018938237", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:26.110618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] validate_networks() for [('bce2ddce-35e2-4853-8635-e21723df171c', None, None, None, None, None), (None, None, 'bc0b03a4-a4d1-46a8-bf46-32d0ea2ab69a', None, None, None), (None, None, '31a0e127-6d14-40ad-9cfc-2d221b2b34f7', None, None, None), ('a389a2d0-5299-44ab-ac0b-b2a386c1a462', None, None, None, None, None), ('a389a2d0-5299-44ab-ac0b-b2a386c1a462', None, None, None, None, None), ('102533ea-626e-4606-a425-746a8575e262', '10.2.2.100', None, None, None, None), ('102533ea-626e-4606-a425-746a8575e262', '10.2.2.200', None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:26.299372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:26.300521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:26.304164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:26.308734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:26.309187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:26.310032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:26.310468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:26.667102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:26.677790 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6d8c8ff-e486-4a84-9af3-c108d21da404 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.382705 Jul 02 21:04:26.680237 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 522/980] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:26 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:26.688760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:26.690127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:26.701434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:26.702332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:26.704608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:26.705221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:26.816742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:26.828977 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0de9c9b2-6bb7-49cf-acdb-aef02a4ddf7e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1273 microversion: 2.1 time: 0.146640 Jul 02 21:04:26.830212 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 523/981] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:26 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:26.892831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:26.893794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:26.902279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:26.902279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:26.903035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:26.903676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:27.351167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:27.364173 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-613304a1-3514-44c9-978e-ae1d3e2703ca tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1317 microversion: 2.1 time: 0.475096 Jul 02 21:04:27.382964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 524/982] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:26 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:27.702514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:27.703908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:27.725873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:27.726802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:27.728863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:27.731190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:28.752498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:28.760622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-748aaaad-b46e-4058-af70-cf19216e3f24 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 1.067178 Jul 02 21:04:28.761211 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 525/983] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:27 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:28.771964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:28.780657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:28.788495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:28.788949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:28.789741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:28.790213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:28.891003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:28.902267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03d43909-e4ec-4c58-9231-4da3eb242a2b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1273 microversion: 2.1 time: 0.135225 Jul 02 21:04:28.905216 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 526/984] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:28 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1273 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:28.914791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3aaa4d6a-572e-4f04-bf8d-8e2091e6b273 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '.version_select at 0x7fabe47ada60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:28.920892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3aaa4d6a-572e-4f04-bf8d-8e2091e6b273 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:28.921375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3aaa4d6a-572e-4f04-bf8d-8e2091e6b273 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:28.933121 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3aaa4d6a-572e-4f04-bf8d-8e2091e6b273 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.026794 Jul 02 21:04:28.934586 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 527/985] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:04:28 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:28.939512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:28.940439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:28.948159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:28.949084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:28.950101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:28.950755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:29.354406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:29.366379 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd823083-71a9-4737-a953-0a11b76ae3c2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1317 microversion: 2.1 time: 0.430328 Jul 02 21:04:29.367537 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 528/986] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:28 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:29.379829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a58fac7a-e150-4136-b359-854f515fc988 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:29.389559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a58fac7a-e150-4136-b359-854f515fc988 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013912 Jul 02 21:04:29.397078 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 529/987] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:04:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:29.403872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94c2b89c-21da-4d8b-a7fb-d5b4c87fa2b4 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-150720612", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:29.417119 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:04:29.417119 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:04:29.443202 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94c2b89c-21da-4d8b-a7fb-d5b4c87fa2b4 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.044828 Jul 02 21:04:29.444901 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 530/988] 10.222.0.43 () {60 vars in 1145 bytes} [Sat Jul 2 21:04:29 2022] POST /compute/v2.1/flavors => generated 498 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:29.458413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4517058c-766b-46a2-afc3-e1254bdf9428 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:29.468785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:29.473120 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4517058c-766b-46a2-afc3-e1254bdf9428 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021574 Jul 02 21:04:29.475099 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 531/989] 10.222.0.43 () {58 vars in 1181 bytes} [Sat Jul 2 21:04:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:04:29.610196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-286822304", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "b17682a8-4235-4b48-adfb-6737e47abf74"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:29.691114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:30.242294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:30.244184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:30.244901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:30.245586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:30.246240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:30.266750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:30.268541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:30.269558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:30.270284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:30.318434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:30.325825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for user 592e8c2ad31f459fa0b37f219cc4f84c and project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:30.342196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:30.347607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:30.449227 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d536261-b663-4be5-be94-1a98aa32f5dc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842955 Jul 02 21:04:30.450785 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 532/990] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:04:30.460487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:30.462448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:30.480258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:30.481205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:30.481498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:30.482214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:30.829110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:30.839548 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1749e10-902d-4ff7-8cc4-104ff4858ec2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.387480 Jul 02 21:04:30.842266 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 533/991] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:30 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:30.858190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:30.860238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:30.886716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:30.887595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:30.889855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:30.890483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:31.413897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:31.437380 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5f47197-1bfe-4ea0-aaf1-669553fc2eb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.592615 Jul 02 21:04:31.437986 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 534/992] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:30 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:31.442882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0aaa00e2-eff3-477d-8d8c-1b3681d20787 req-ffecdd8d-d1e6-40b1-8f01-8dc3f47a0940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe", "name": "network-vif-plugged", "status": "completed", "tag": "f8201b5c-1079-4ebe-b5b0-07bc24646060"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:31.461320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0aaa00e2-eff3-477d-8d8c-1b3681d20787 req-ffecdd8d-d1e6-40b1-8f01-8dc3f47a0940 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:31.461846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0aaa00e2-eff3-477d-8d8c-1b3681d20787 req-ffecdd8d-d1e6-40b1-8f01-8dc3f47a0940 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:31.482373 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0aaa00e2-eff3-477d-8d8c-1b3681d20787 req-ffecdd8d-d1e6-40b1-8f01-8dc3f47a0940 service nova] Creating event network-vif-plugged:f8201b5c-1079-4ebe-b5b0-07bc24646060 for instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe on nch2-master-1 Jul 02 21:04:31.489736 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0aaa00e2-eff3-477d-8d8c-1b3681d20787 req-ffecdd8d-d1e6-40b1-8f01-8dc3f47a0940 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050082 Jul 02 21:04:31.490726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 535/993] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:31.496963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:31.500505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:31.510378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:31.511669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:31.512752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:31.514434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:31.866542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:31.874944 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ed02abb-c9ae-4dd1-906e-509674af3b90 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1317 microversion: 2.1 time: 0.382763 Jul 02 21:04:31.875817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 536/994] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:31 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:31.888731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:31.890013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:31.901875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:31.902731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:31.903760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:31.904567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:31.976067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:31.976613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:31.977147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:31.978246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:31.978739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:32.004618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.005083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.005919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.008621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.029638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:32.042822 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-81eb9e4d-8b4a-4476-a6c0-4be3d92d971e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1330 microversion: 2.1 time: 0.161159 Jul 02 21:04:32.043980 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 537/995] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:31 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1330 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:32.051754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-8e72d4d6-410a-40c9-87f6-16b8a9e63104 req-461edf74-bc37-4b6a-80b2-2cf213f6768c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d209e8-ea3a-4e2f-a8bf-4f55836f8647", "tag": "4a35c1ca-cdbb-40e4-ba0d-ef50c70afea4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:32.056386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Getting quotas for project 63b8773841e44baab20aa0677e027de7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:32.059412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:32.065420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Getting quotas for user 45991293f65c4c22a91afa74cf8179ce and project 63b8773841e44baab20aa0677e027de7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:32.076678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8e72d4d6-410a-40c9-87f6-16b8a9e63104 req-461edf74-bc37-4b6a-80b2-2cf213f6768c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.078612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8e72d4d6-410a-40c9-87f6-16b8a9e63104 req-461edf74-bc37-4b6a-80b2-2cf213f6768c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.112762 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-8e72d4d6-410a-40c9-87f6-16b8a9e63104 req-461edf74-bc37-4b6a-80b2-2cf213f6768c service nova] Creating event network-changed:4a35c1ca-cdbb-40e4-ba0d-ef50c70afea4 for instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 on nch1-master-1 Jul 02 21:04:32.120247 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-8e72d4d6-410a-40c9-87f6-16b8a9e63104 req-461edf74-bc37-4b6a-80b2-2cf213f6768c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073728 Jul 02 21:04:32.121441 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 538/996] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:32.128390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:32.129278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:32.141391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.142112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.143121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.143707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.370912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:32.374032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0fd88419-3147-47fa-bed8-27c867972435',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='6da0916e-d49c-4e14-94a5-3cccd3b7c22c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4af561d5-4d61-49c9-b2df-3812b0172ae2',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:32.830241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:32.847811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6d5899a9-e5b6-477d-b8d8-f306ad62a9d6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.724698 Jul 02 21:04:32.856754 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 539/997] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:32 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:32.862481 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-918a3b6e-874a-4bd5-b9c6-43c50860f4e7 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 6.920195 Jul 02 21:04:32.868607 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 459/998] 10.222.0.43 () {62 vars in 1188 bytes} [Sat Jul 2 21:04:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 6927 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:04:32.872031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:32.872685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:32.876814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f240e0c-9d15-461a-aa8c-505dcd14340c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:32.877726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f240e0c-9d15-461a-aa8c-505dcd14340c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:32.900755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.901272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.904596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:32.905049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:32.970804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f240e0c-9d15-461a-aa8c-505dcd14340c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:32.980536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f240e0c-9d15-461a-aa8c-505dcd14340c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:32.983153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f240e0c-9d15-461a-aa8c-505dcd14340c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:32.984632 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f240e0c-9d15-461a-aa8c-505dcd14340c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1285 microversion: 2.42 time: 0.113870 Jul 02 21:04:32.985501 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 460/999] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:32 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:33.004584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:33.005501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:33.012686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:33.013433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:33.014824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:33.015489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:33.368004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:33.377571 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4169a425-b683-4943-99c9-7c04b6a72ec6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.519380 Jul 02 21:04:33.378109 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 540/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:32 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:33.395036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:33.395661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:33.410022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:33.410710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:33.412849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:33.414656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:33.639814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:33.643211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:33.651980 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68042dd3-3622-4532-93d8-d9df5c4305eb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1317 microversion: 2.1 time: 0.651316 Jul 02 21:04:33.661100 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 461/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:32 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:33.669351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-516265b8-165d-43b3-ac05-193d5e4aae05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1336 microversion: 2.1 time: 0.288873 Jul 02 21:04:33.670878 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 541/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:33 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1336 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:33.879429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:33.884247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:33.904256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:33.908222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:33.909457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:33.911535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.003447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:34.004811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:34.018978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.019539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.020520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.021060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.293974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:34.296588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:34.309353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:34.312413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:34.313878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-172c68ec-3e1f-4018-91a5-5703b4bd99e4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1527 microversion: 2.42 time: 0.314457 Jul 02 21:04:34.315572 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 542/1003] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:33 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1527 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:04:34.394732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:34.396300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:34.397278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:34.405393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.405529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a71b60d1-970e-4898-9320-0f7bca23cfd9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.533302 Jul 02 21:04:34.406433 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 462/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:33 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:34.406836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.407866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.408961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.676754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:34.677376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:34.694647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.695149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.696007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.696472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.734802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:34.757304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d12da3b6-a83c-404f-a2da-fa08257c5e3d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.366090 Jul 02 21:04:34.763169 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 543/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:34 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:34.782123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:34.785309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:34.796221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.799374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:34.808880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:34.811778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.115280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:35.127894 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10fbce52-3893-4be0-8e62-711f7eaf15c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1467 microversion: 2.1 time: 0.454918 Jul 02 21:04:35.140691 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 463/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:34 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1467 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:35.146011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-27d01140-fc69-4c94-a622-9316794210ee req-d9e62aa0-510e-4249-a667-ef7151159798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:35.155145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-27d01140-fc69-4c94-a622-9316794210ee req-d9e62aa0-510e-4249-a667-ef7151159798 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.155978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-27d01140-fc69-4c94-a622-9316794210ee req-d9e62aa0-510e-4249-a667-ef7151159798 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.164879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:35.174876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f2b5a31b-9cdb-42d3-924a-e43a77e8bc20 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.409843 Jul 02 21:04:35.175720 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 544/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:34 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:35.184364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:35.185242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:35.192298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.193045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.193642 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-27d01140-fc69-4c94-a622-9316794210ee req-d9e62aa0-510e-4249-a667-ef7151159798 service nova] Creating event network-changed:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch2-master-1 Jul 02 21:04:35.194189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.194830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.200297 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-27d01140-fc69-4c94-a622-9316794210ee req-d9e62aa0-510e-4249-a667-ef7151159798 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057885 Jul 02 21:04:35.201442 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 464/1008] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:35.336558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:35.337308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:35.359451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.361983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.361983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.361983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.414681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cff23efc-b8a8-4408-8613-608d6b0f080d tempest-ServersOnMultiNodesTest-1266447534 tempest-ServersOnMultiNodesTest-1266447534-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1618 microversion: 2.1 time: 0.237333 Jul 02 21:04:35.428508 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 545/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:35 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1618 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:35.434258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:35.435280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:35.442948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.443743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.444833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.445417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.555821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:35.567003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:35.568803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:35.569952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7bc8392c-2189-446a-ba83-d846af27e2fe tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1527 microversion: 2.42 time: 0.240006 Jul 02 21:04:35.570792 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 465/1010] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:35 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1527 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:35.585206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:35.585712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:35.593353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.593810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.594599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.595030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.634523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:35.705688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:35.714587 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0437700b-f60b-4d48-a2e1-83da9ccec8e8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.284657 Jul 02 21:04:35.715464 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 546/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:35 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:35.735510 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23e2b89e-dc78-43de-ad38-7cb0810108ae tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 204 len: 0 microversion: 2.1 time: 0.161781 Jul 02 21:04:35.736138 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 466/1012] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:35 2022] DELETE /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:35.745088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:35.745870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:35.768697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.769262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.771122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.771708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.781037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:35.782033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:35.794165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.794614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.797630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:35.798275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:35.849057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:36.307742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:36.314369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:36.322891 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ed829e5-1545-4062-afd3-1c7aaadf96d0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.546412 Jul 02 21:04:36.323113 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b0a5dec8-2fb0-4e98-b874-364dcabd3bf2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1473 microversion: 2.1 time: 0.582316 Jul 02 21:04:36.324225 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 547/1013] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:35 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1473 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:36.330041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:36.330656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:36.337749 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 467/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:35 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:36.338279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:36.338942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:36.339963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:36.340468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:36.555217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:36.562944 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dc872850-f6f4-4686-999c-4c6139bedc5f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.237549 Jul 02 21:04:36.563516 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 548/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:36 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:36.588979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:36.589636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:36.595907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:36.596396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:36.597170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:36.597609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:36.664488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:36.678372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:36.681610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:36.683290 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1bd12ea-343c-4d95-9ac0-76b5c5e18aba tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1575 microversion: 2.42 time: 0.098382 Jul 02 21:04:36.695793 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 468/1016] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:36 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1575 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:36.732752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:36.733741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:36.741395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:36.742489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:36.743714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:36.744439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.241346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:37.251811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cbf48be3-8d7c-4530-8753-cb3564034841 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1516 microversion: 2.1 time: 0.523029 Jul 02 21:04:37.259789 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 549/1017] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:36 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1516 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:37.341694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:37.342914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:37.349394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:37.350529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:37.350930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.351611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.353108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.353753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.359527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.360033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.361144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.361591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.728764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:37.739819 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6077ae60-6184-4ae2-809d-aee0eb31a73f tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1473 microversion: 2.1 time: 0.402399 Jul 02 21:04:37.744905 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 469/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:37 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1473 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:37.755945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:37.759121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:37.774084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:37.775234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.775859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.777439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.780580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.783970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-84efd29d-5979-40c7-93df-e98ab7bcf486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.440222 Jul 02 21:04:37.787651 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 550/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:37 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:37.796531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:37.797155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:37.813780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.814234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:37.818081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:37.818729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.233949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 1731cd23-3195-40b5-a9da-1015e9f8b964 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:38.242317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:38.255647 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c84bcafb-2024-41e8-9446-f8ac674b5c0d tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 2344 microversion: 2.25 time: 0.466853 Jul 02 21:04:38.256114 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26c82e1a-04de-4a9d-a044-24414d2bf024 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.509379 Jul 02 21:04:38.258562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 551/1020] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:37 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 2344 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:38.261001 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 470/1021] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:37 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:38.264834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:38.265729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:38.272445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:38.273003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.273158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:38.273997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.275035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.275683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.289204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.296773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.298112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.298771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.376482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:38.394519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:38.399431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:38.403231 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b13726ab-1017-4a3a-8e85-931e55f1f171 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1593 microversion: 2.42 time: 0.143236 Jul 02 21:04:38.403866 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 552/1022] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:38 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1593 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:38.414621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33756c56-c74d-4c27-858c-a07ac1dfda75 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:38.416398 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:04:38.416398 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:04:38.417526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33756c56-c74d-4c27-858c-a07ac1dfda75 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.434180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33756c56-c74d-4c27-858c-a07ac1dfda75 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.440725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33756c56-c74d-4c27-858c-a07ac1dfda75 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.441468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33756c56-c74d-4c27-858c-a07ac1dfda75 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.512773 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33756c56-c74d-4c27-858c-a07ac1dfda75 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.107718 Jul 02 21:04:38.515168 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 553/1023] 10.222.0.43 () {60 vars in 1216 bytes} [Sat Jul 2 21:04:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:04:38.736119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:38.749016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be5c4373-975e-4aec-9a99-c88c624956fd tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.479083 Jul 02 21:04:38.750539 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 471/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:38 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:38.766961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:38.767197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c11940c0-fc77-42e6-b283-e2f79a8f11d7 req-b50dbb52-05a0-4161-a9b9-71bf87459605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d209e8-ea3a-4e2f-a8bf-4f55836f8647", "name": "network-vif-plugged", "status": "completed", "tag": "4a35c1ca-cdbb-40e4-ba0d-ef50c70afea4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:38.768156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:38.778771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.781719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.782836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.784574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.790854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c11940c0-fc77-42e6-b283-e2f79a8f11d7 req-b50dbb52-05a0-4161-a9b9-71bf87459605 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.792438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c11940c0-fc77-42e6-b283-e2f79a8f11d7 req-b50dbb52-05a0-4161-a9b9-71bf87459605 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.822580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c11940c0-fc77-42e6-b283-e2f79a8f11d7 req-b50dbb52-05a0-4161-a9b9-71bf87459605 service nova] Creating event network-vif-plugged:4a35c1ca-cdbb-40e4-ba0d-ef50c70afea4 for instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 on nch1-master-1 Jul 02 21:04:38.832834 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c11940c0-fc77-42e6-b283-e2f79a8f11d7 req-b50dbb52-05a0-4161-a9b9-71bf87459605 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069391 Jul 02 21:04:38.833870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 554/1025] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:38.845438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:38.846196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:38.889695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.890101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:38.890855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:38.891287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:39.405910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:39.417029 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15fba2d9-a7c4-4818-a7c4-6e8e5da30a24 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1473 microversion: 2.1 time: 0.653414 Jul 02 21:04:39.419802 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 472/1026] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:38 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1473 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:39.426396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:39.428317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:39.444913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:39.447096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:39.447970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:39.452617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:39.517804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:39.528343 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-796f4be5-6b71-4eae-bdf4-5fe0df64fccd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.693163 Jul 02 21:04:39.540231 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 555/1027] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:38 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:39.546092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:39.547188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:39.570070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:39.571110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:39.572084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:39.572781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:39.791164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:39.804757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:39.822206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:39.824621 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06b71763-4544-4c3b-8d98-e677e59613a6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1593 microversion: 2.42 time: 0.282982 Jul 02 21:04:39.830057 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 556/1028] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:39 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1593 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:39.853893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:39.856664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:39.878899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:39.880784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:39.881765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:39.885186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.111521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:40.127106 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cff1ef7d-4a16-4415-9c5a-85e2b0a99b93 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.706062 Jul 02 21:04:40.128338 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 473/1029] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:39 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:40.240240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:40.248451 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-716e0dc1-f35f-4d95-bf00-93466986d3a8 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.405275 Jul 02 21:04:40.249640 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 557/1030] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:39 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:40.433229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:40.433751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:40.448136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.448895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.449878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.450530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.508674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=20 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:40.525681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2f38de7f-8140-4190-94c6-9721c7aa3324 req-d2c836c8-87ce-4f22-98cc-c4e8f5c850f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe", "name": "network-vif-deleted", "tag": "f8201b5c-1079-4ebe-b5b0-07bc24646060"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:40.546330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2f38de7f-8140-4190-94c6-9721c7aa3324 req-d2c836c8-87ce-4f22-98cc-c4e8f5c850f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.561459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2f38de7f-8140-4190-94c6-9721c7aa3324 req-d2c836c8-87ce-4f22-98cc-c4e8f5c850f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.606690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:40.610168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2f38de7f-8140-4190-94c6-9721c7aa3324 req-d2c836c8-87ce-4f22-98cc-c4e8f5c850f0 service nova] Creating event network-vif-deleted:f8201b5c-1079-4ebe-b5b0-07bc24646060 for instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe on nch2-master-1 Jul 02 21:04:40.618969 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e087f24-abd9-48f3-bcfa-493b49aadd32 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 200 len: 1431 microversion: 2.1 time: 0.188657 Jul 02 21:04:40.620145 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2f38de7f-8140-4190-94c6-9721c7aa3324 req-d2c836c8-87ce-4f22-98cc-c4e8f5c850f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112025 Jul 02 21:04:40.622605 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 474/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:40 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 1431 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:40.629066 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 558/1032] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:04:40.641018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:40.642042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:40.642390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48d74eca-fcde-4742-9dbc-87d3e9f0e8c2", "device": "/dev/xvdb"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:40.648886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:40.665970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.666789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.668311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.669173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.672973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.676670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.677823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:40.678509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:40.988748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:40.998055 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cf8f7adc-0182-45a8-b5a1-ea583a3e48be tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1315 microversion: 2.1 time: 0.367040 Jul 02 21:04:40.998707 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 559/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:40 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:41.010729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:41.010913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:41.029284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.029755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:41.030565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.031006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:41.203637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:41.215417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:41.240384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:41.242026 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-47c5b116-6693-4b65-94c2-2c2a9d402c83 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1593 microversion: 2.42 time: 0.242268 Jul 02 21:04:41.242629 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 560/1034] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:40 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1593 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:41.265549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0d8187a5-58cc-4955-82e8-91063fd5ee25 req-ca26bf4a-61b0-4e66-a3f9-f2399b0b95ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7a681c-3f21-4191-9f0f-993efe27f5a7", "name": "network-vif-unplugged", "status": "completed", "tag": "10736cb7-2590-432b-ac31-c56746a79bb6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:41.321904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0d8187a5-58cc-4955-82e8-91063fd5ee25 req-ca26bf4a-61b0-4e66-a3f9-f2399b0b95ae service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.324024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0d8187a5-58cc-4955-82e8-91063fd5ee25 req-ca26bf4a-61b0-4e66-a3f9-f2399b0b95ae service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:41.342797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:41.368401 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0d8187a5-58cc-4955-82e8-91063fd5ee25 req-ca26bf4a-61b0-4e66-a3f9-f2399b0b95ae service nova] Creating event network-vif-unplugged:10736cb7-2590-432b-ac31-c56746a79bb6 for instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 on nch2-master-1 Jul 02 21:04:41.382612 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0d8187a5-58cc-4955-82e8-91063fd5ee25 req-ca26bf4a-61b0-4e66-a3f9-f2399b0b95ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138717 Jul 02 21:04:41.390941 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 561/1035] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:41.411909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:41.415744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:41.425724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.426461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:41.427583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.429239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:41.558542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4bd97a87-f2ee-4c50-9ef1-278e75edaafe tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "POST /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.932387 Jul 02 21:04:41.563822 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 475/1036] 10.222.0.43 () {62 vars in 1363 bytes} [Sat Jul 2 21:04:40 2022] POST /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments => generated 194 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:04:41.588208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:41.589065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:41.618559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.620624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:41.621829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:41.624806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.036125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:42.186846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:42.194844 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ee518ba-2fe7-4df8-b713-cf76165a6508 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.801982 Jul 02 21:04:42.195520 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 562/1037] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:41 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:42.204875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:42.212872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:42.221949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.222413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.223211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.223643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.225252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:42.242890 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cc4ae83-734d-4a21-820f-6b134aad03f4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.667535 Jul 02 21:04:42.243554 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 476/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:41 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:42.256411 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe could not be found. Jul 02 21:04:42.258240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:42.258875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe HTTP/1.1 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe could not be found. Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe'} Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe could not be found. Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe could not be found. Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:42.262705 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe could not be found. Jul 02 21:04:42.267418 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:04:42.269380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:42.270462 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-971f957f-2bd0-4e70-89a8-94cd0ab4dddd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe" status: 404 len: 111 microversion: 2.1 time: 0.069342 Jul 02 21:04:42.271221 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 563/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:42 2022] GET /compute/v2.1/servers/da4d445e-3dfd-49c8-bf60-9cfaafc5b2fe => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:42.278618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.279056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.281287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:42.282246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.282637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.293065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:42.300000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.300710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.301714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.302437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.531659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:42.543561 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e266465b-9493-4a1b-8797-549fa686b412 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1501 microversion: 2.1 time: 0.289417 Jul 02 21:04:42.547948 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 477/1040] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:42 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1501 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:42.560015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:42.560690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:42.583589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.584100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.584852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.585280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.650446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:42.697103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:42.707561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:42.716274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:42.717543 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86953447-50a3-4fa3-a2dc-baf672e52f2f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1704 microversion: 2.42 time: 0.444573 Jul 02 21:04:42.735468 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 564/1041] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:42 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1704 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:42.735468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:42.743533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:42.774946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.775608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.777164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.777843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.828132 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19343161-6661-49e8-8e38-3c05d807833a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 204 len: 0 microversion: 2.1 time: 0.278448 Jul 02 21:04:42.831790 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 478/1042] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:42 2022] DELETE /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:42.843130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:42.844052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:42.846674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:42.859802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.860345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.861137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:42.861569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:42.977104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:43.031763 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f1aa1f5-62a4-47b5-aba5-7bea272ef7da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 204 len: 0 microversion: 2.1 time: 0.304173 Jul 02 21:04:43.032446 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 565/1043] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:42 2022] DELETE /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:43.046417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:43.047253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:43.060141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.060678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.061868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.062549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.210146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:43.221885 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01ed3883-4f40-4884-9621-2ec98f04f237 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1472 microversion: 2.1 time: 0.388733 Jul 02 21:04:43.223743 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 479/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:42 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1472 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:43.232518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:43.238288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:43.251177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.251655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.252469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.252894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.297337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:43.322063 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-61e602d5-a417-41fa-8da1-e8c06105d30b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1507 microversion: 2.1 time: 0.283763 Jul 02 21:04:43.334002 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 566/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:43 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:43.339145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:43.340935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:43.360854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.363842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.365209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.366908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.731855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:43.739732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:43.756303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7deff3f7-6ce3-4b14-93fa-8d078e82aa94 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.521585 Jul 02 21:04:43.757371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 480/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:43 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:43.762514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:43.763134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:43.780859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.781349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.782405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:43.782662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:43.855572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:43.867592 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-371742a3-a8b3-43e0-af77-81af9f63e783 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.538000 Jul 02 21:04:43.871534 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 567/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:43 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:44.204390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:44.240816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:44.241598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:44.254293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:44.262680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:44.264979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:44.265444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:44.266246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:44.270192 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72326420-5620-4645-b75e-3a617357312e tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1749 microversion: 2.42 time: 0.505399 Jul 02 21:04:44.270987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:44.286953 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 481/1048] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:43 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1749 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:44.341841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:44.342456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:44.355419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:44.355879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:44.360473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:44.361939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.003437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.017460 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4cc7ccf3-6604-4d2e-81b6-407d1eef8791 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1507 microversion: 2.1 time: 0.679435 Jul 02 21:04:45.019066 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 482/1049] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:44 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1507 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:45.022055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.027174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:45.028156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:45.030451 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b5ea08c9-3d7a-48c4-9860-0b2c6aaabd13 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1472 microversion: 2.1 time: 0.793775 Jul 02 21:04:45.033577 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 568/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:44 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1472 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:45.038622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:45.038992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:45.039214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:45.039859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.041687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:45.042401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.060064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:45.060556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.061364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:45.062368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.330264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.340238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.340829 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12be8a48-2cc0-4145-8b56-5dc7992bf6a3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.319478 Jul 02 21:04:45.341673 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 483/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:45 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:45.347360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:45.348458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:45.353276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7fb4645f-fddd-43ab-8c3b-d8c2f915217f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.318569 Jul 02 21:04:45.357524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:45.358148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.359248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:45.359833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:45.363794 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 569/1052] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:45 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:45.595100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.606440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.608894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:45.611539 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-775ba3ce-c8f3-4689-a0df-0921c41915a1 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1794 microversion: 2.42 time: 0.267970 Jul 02 21:04:45.612265 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 484/1053] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:45 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1794 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:46.034907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:46.035587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:46.037681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:46.048586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:46.049475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:46.054248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.057456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.061852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.062188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.063314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.063491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.065617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.066626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.445825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:46.454206 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f90298c-c672-4009-95f7-139c6d9a9073 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1472 microversion: 2.1 time: 0.411275 Jul 02 21:04:46.461121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 485/1054] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:46 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1472 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:46.471351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:46.472925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:46.473715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:46.484796 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9bbd780a-7495-4099-b412-bbaff08cacad tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1507 microversion: 2.1 time: 0.453664 Jul 02 21:04:46.486041 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 570/1055] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:46 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:46.489351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.490101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.491174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.491826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.497647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:46.498272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:46.522267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.522761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:46.523755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:46.524712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.234180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:47.248109 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74e327fc-cfc9-4f1c-aa87-46ba044ab0a7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.785231 Jul 02 21:04:47.252113 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 486/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:46 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:47.266762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:47.290074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:47.307506 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dbd98666-c57e-4b9a-86b8-4b13331d630c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.820147 Jul 02 21:04:47.309072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:47.311677 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 571/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:46 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:47.337405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4b273f36-57a9-4fee-9e0c-2d48808107b5 req-02e589e3-ddd2-45d8-ae2d-474d91837fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b7a681c-3f21-4191-9f0f-993efe27f5a7", "name": "network-vif-plugged", "status": "completed", "tag": "10736cb7-2590-432b-ac31-c56746a79bb6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:47.340066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.340578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.341372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.345370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.366162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4b273f36-57a9-4fee-9e0c-2d48808107b5 req-02e589e3-ddd2-45d8-ae2d-474d91837fd2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.374453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4b273f36-57a9-4fee-9e0c-2d48808107b5 req-02e589e3-ddd2-45d8-ae2d-474d91837fd2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.419681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4b273f36-57a9-4fee-9e0c-2d48808107b5 req-02e589e3-ddd2-45d8-ae2d-474d91837fd2 service nova] Creating event network-vif-plugged:10736cb7-2590-432b-ac31-c56746a79bb6 for instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 on nch2-master-1 Jul 02 21:04:47.432745 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4b273f36-57a9-4fee-9e0c-2d48808107b5 req-02e589e3-ddd2-45d8-ae2d-474d91837fd2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117627 Jul 02 21:04:47.435321 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 572/1058] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:47.447848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bfae93b0-2880-4401-be79-52b38e899deb req-1e286ed4-b2a8-45b4-835a-4770dcbbf82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afbe1b3-5af8-44b4-95d1-a4455c8dd66d", "name": "network-vif-deleted", "tag": "d09c31e8-e47c-4509-9a70-3e72f9290108"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:47.502580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bfae93b0-2880-4401-be79-52b38e899deb req-1e286ed4-b2a8-45b4-835a-4770dcbbf82e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.503762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bfae93b0-2880-4401-be79-52b38e899deb req-1e286ed4-b2a8-45b4-835a-4770dcbbf82e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.534205 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bfae93b0-2880-4401-be79-52b38e899deb req-1e286ed4-b2a8-45b4-835a-4770dcbbf82e service nova] Creating event network-vif-deleted:d09c31e8-e47c-4509-9a70-3e72f9290108 for instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d on nch1-master-1 Jul 02 21:04:47.546876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bfae93b0-2880-4401-be79-52b38e899deb req-1e286ed4-b2a8-45b4-835a-4770dcbbf82e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107586 Jul 02 21:04:47.550908 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 573/1059] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:47.562429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:47.563047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:47.584971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.587109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.589823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.590305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.636823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.637280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.637745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lazy-loading 'fault' on Instance uuid 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:47.702944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:47.717823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:47.724848 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1342eb67-efb8-4891-a988-60d0d0b46e81 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 200 len: 1306 microversion: 2.1 time: 0.171581 Jul 02 21:04:47.728382 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 574/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:47 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 1306 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:47.731329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:47.735266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:47.737663 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c845e9bd-f80e-4cb6-8ac3-7bacfed9fc57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1794 microversion: 2.42 time: 0.483501 Jul 02 21:04:47.739078 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 487/1061] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:47 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1794 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:47.753840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:47.755105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:47.776724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.777198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:47.781403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:47.782320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.143103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:48.160160 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0206a249-ff56-45d9-b8f8-9c2da37d1d40 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1507 microversion: 2.1 time: 0.413858 Jul 02 21:04:48.161492 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 575/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:47 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:48.267639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:48.269043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:48.279325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.283149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.288765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.289324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.328928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:48.329906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:48.354815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.355880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.356962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.357558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.470191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:48.649578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:48.669618 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06941673-d6eb-402f-9695-1410a2c3ece5 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.343781 Jul 02 21:04:48.671302 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 576/1063] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:48 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:04:48.676482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:48.690136 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a0c9404-39c6-4534-bbfb-6bbcf0e91581 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.426836 Jul 02 21:04:48.691275 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 488/1064] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:48 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:48.692610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:48.694298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:48.702976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.703937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.705117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.705644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.754511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:48.755669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:48.772012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.772680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.773598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.774124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.799782 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d could not be found. Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d HTTP/1.1 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d could not be found. Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1afbe1b3-5af8-44b4-95d1-a4455c8dd66d'} Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d could not be found. Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d could not be found. Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:48.803092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d could not be found. Jul 02 21:04:48.810926 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:48.815399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 1afbe1b3-5af8-44b4-95d1-a4455c8dd66d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:48.817238 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c1e9696-41d3-4149-b455-7e37a514d9a3 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d" status: 404 len: 111 microversion: 2.1 time: 0.068865 Jul 02 21:04:48.821731 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 489/1065] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:48 2022] GET /compute/v2.1/servers/1afbe1b3-5af8-44b4-95d1-a4455c8dd66d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:48.833447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:48.834571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:48.877026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.878272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.882284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.884717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.901997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 1731cd23-3195-40b5-a9da-1015e9f8b964 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:48.917648 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9222bca-5183-462d-9dab-e0572196f00a tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 2422 microversion: 2.25 time: 0.244821 Jul 02 21:04:48.918948 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 577/1066] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:48 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 2422 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:48.923860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:48.924641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:48.931751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.932628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.933614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:48.934274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:48.940587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:48.993218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:49.244462 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-433227f3-7739-4334-83b0-0b3e6f7f8d42 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 204 len: 0 microversion: 2.1 time: 0.323561 Jul 02 21:04:49.248428 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 578/1067] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:48 2022] DELETE /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:49.263897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:49.265898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:49.280766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.281451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.282430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.283977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.296560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:49.310287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:49.312270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:49.319055 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be6ca80d-56e5-4213-92df-71f57d2194e2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1827 microversion: 2.42 time: 0.496005 Jul 02 21:04:49.331160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'flavor' on Instance uuid 1731cd23-3195-40b5-a9da-1015e9f8b964 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:49.332887 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 490/1068] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:48 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1827 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:49.333850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Going to try to live migrate instance to nch1-master-1 {{(pid=131045) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:04:49.338399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b93e5ff4-ead9-4932-ae0a-45121fa6f5e8 req-aa5722a8-62a5-4521-9ba7-54cc6c6979e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d209e8-ea3a-4e2f-a8bf-4f55836f8647", "name": "network-vif-deleted", "tag": "4a35c1ca-cdbb-40e4-ba0d-ef50c70afea4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:49.357261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b93e5ff4-ead9-4932-ae0a-45121fa6f5e8 req-aa5722a8-62a5-4521-9ba7-54cc6c6979e7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.357716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b93e5ff4-ead9-4932-ae0a-45121fa6f5e8 req-aa5722a8-62a5-4521-9ba7-54cc6c6979e7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.387032 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b93e5ff4-ead9-4932-ae0a-45121fa6f5e8 req-aa5722a8-62a5-4521-9ba7-54cc6c6979e7 service nova] Creating event network-vif-deleted:4a35c1ca-cdbb-40e4-ba0d-ef50c70afea4 for instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 on nch1-master-1 Jul 02 21:04:49.394695 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b93e5ff4-ead9-4932-ae0a-45121fa6f5e8 req-aa5722a8-62a5-4521-9ba7-54cc6c6979e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060013 Jul 02 21:04:49.395407 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 491/1069] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:49.400929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:49.402299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:49.409196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.410036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.411003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.411605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.458377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.458842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.459305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lazy-loading 'fault' on Instance uuid 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:49.519299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:49.527837 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dd7ed79-1af5-4f05-8924-501da8f0661d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1305 microversion: 2.1 time: 0.131181 Jul 02 21:04:49.537788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 492/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:49 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:49.545692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:49.561486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:49.578005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.580654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.581994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.582587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.814695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:49.825728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-977b709d-f0b7-48cd-8d43-de8e2b1fb5c5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1470 microversion: 2.1 time: 0.286330 Jul 02 21:04:49.845560 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 493/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:49 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:49.879893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:49.881171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:49.888740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.889469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:49.890786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:49.891800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.229747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:50.242241 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b63222ae-8360-477c-9e65-f74c9987bb0c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1522 microversion: 2.1 time: 0.391924 Jul 02 21:04:50.246005 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 494/1072] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:49 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:50.263200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:50.263960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:50.283155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.283998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.285157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.286089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.551049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:50.581732 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-796eb178-e38e-4a6f-b0d0-b536e266fd86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.330520 Jul 02 21:04:50.591309 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 495/1073] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:50 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:50.591309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-df722edf-410c-4652-b5c5-4cfa0737abeb req-851b05d3-5121-4ebd-a62a-a9268ede6e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "name": "network-vif-plugged", "status": "completed", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:50.598142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-df722edf-410c-4652-b5c5-4cfa0737abeb req-851b05d3-5121-4ebd-a62a-a9268ede6e1d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.598690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-df722edf-410c-4652-b5c5-4cfa0737abeb req-851b05d3-5121-4ebd-a62a-a9268ede6e1d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.630755 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-df722edf-410c-4652-b5c5-4cfa0737abeb req-851b05d3-5121-4ebd-a62a-a9268ede6e1d service nova] Creating event network-vif-plugged:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch2-master-1 Jul 02 21:04:50.643336 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-df722edf-410c-4652-b5c5-4cfa0737abeb req-851b05d3-5121-4ebd-a62a-a9268ede6e1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058245 Jul 02 21:04:50.645346 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 496/1074] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:50.656489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:50.657285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:50.669665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:50.673508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.674146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.675415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.676465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.946533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:50.957528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:50.960183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:50.961356 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f6ec8bd-4da6-45c0-9cfd-02e9b964aad2 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1827 microversion: 2.42 time: 0.314867 Jul 02 21:04:50.962092 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 497/1075] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:50 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1827 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:50.966936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:50.967544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:50.974542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.974992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:50.975773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:50.976713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.009254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.009790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.010245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lazy-loading 'fault' on Instance uuid 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:51.053136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:51.056899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:51.064445 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f349d823-56ea-4ca9-ae63-31c4786d3e6c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 200 len: 1305 microversion: 2.1 time: 0.100993 Jul 02 21:04:51.066257 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 498/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:50 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:51.071035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:51.073995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:51.095811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.096449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.097540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.098055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.250527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:51.261050 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-801a7d9f-1fcb-42a7-94a4-c90aeb389d79 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1470 microversion: 2.1 time: 0.194597 Jul 02 21:04:51.262557 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 499/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:51 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:51.437498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d088845-dee0-4333-aad3-b5fc87ccca03 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Action: 'create', calling method: .version_select at 0x7fabe474d790>, body: {"keypair": {"name": "tempest-keypair-1009706156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlDuLBsImd1dfBPicTLdPnfamDgv2GKGbUmNI06hKN6vXhKyzfu8Gzj3RJbZ3eWtNfRsnwxgW63/niWLh7D/mcmzl/2b6wYfYg01dY8JyRcSmVnwFKeWjBq540Rt77Cfg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:51.453940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5d088845-dee0-4333-aad3-b5fc87ccca03 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Getting quotas for project 4b15f516c6a34343979d19a0938c232b. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:51.459964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5d088845-dee0-4333-aad3-b5fc87ccca03 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Getting quotas for user 1fade188e2a14766ae95fe44143bca97 and project 4b15f516c6a34343979d19a0938c232b. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:51.494129 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d088845-dee0-4333-aad3-b5fc87ccca03 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.230215 Jul 02 21:04:51.494868 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 500/1078] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:04:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:51.499601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:51.503956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:51.513361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.513901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.514794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.515291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.712246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:51.722151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4ac371a-3b7c-4e9d-9be2-222e5142a116 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1507 microversion: 2.1 time: 0.226151 Jul 02 21:04:51.734700 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 501/1079] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:51 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1507 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:51.747147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5c9cd359-6064-4233-9b1b-ff621e102446 req-aca7d8b8-c088-4810-a484-90407073891b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "308385e3-792d-4631-b8d7-c37d0374d7db"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:51.758537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5c9cd359-6064-4233-9b1b-ff621e102446 req-aca7d8b8-c088-4810-a484-90407073891b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.759379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5c9cd359-6064-4233-9b1b-ff621e102446 req-aca7d8b8-c088-4810-a484-90407073891b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.775071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5c9cd359-6064-4233-9b1b-ff621e102446 req-aca7d8b8-c088-4810-a484-90407073891b service nova] Creating event network-changed:308385e3-792d-4631-b8d7-c37d0374d7db for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:04:51.780753 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5c9cd359-6064-4233-9b1b-ff621e102446 req-aca7d8b8-c088-4810-a484-90407073891b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044596 Jul 02 21:04:51.781987 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 502/1080] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:51.798619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:51.799332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:51.807794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.808316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:51.809199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:51.809811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:52.237706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:52.245828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2378941-54a6-401d-8fed-a77de9fefc04 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1378 microversion: 2.1 time: 0.462198 Jul 02 21:04:52.251121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 503/1081] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:51 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1378 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:52.266470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:52.267756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:52.282850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:52.283529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:52.284857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:52.285394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:52.606270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:52.615293 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-845a5818-0848-4057-bbb8-7fcfe3f4cd45 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 200 len: 1507 microversion: 2.1 time: 0.353421 Jul 02 21:04:52.631369 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 504/1082] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:52 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:52.641272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:52.641913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:52.655041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:52.655481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:52.656283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:52.656709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:52.983160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:53.005275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:53.014220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:53.016204 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b413ac3-1817-4475-8327-364cf4e1f841 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1848 microversion: 2.42 time: 0.383036 Jul 02 21:04:53.035352 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 505/1083] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:52 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1848 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:53.040599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:53.041263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:53.065196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.065632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.066418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.066848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.102373 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 HTTP/1.1 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '79d209e8-ea3a-4e2f-a8bf-4f55836f8647'} Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:53.104259 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:53.108840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f846de5-ab04-46a8-8cb2-24f74ad864da tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 404 len: 111 microversion: 2.1 time: 0.068985 Jul 02 21:04:53.114201 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 506/1084] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:53 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:53.134223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:53.147271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:53.179494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.186068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.187111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.188481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.248631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.249942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.252004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lazy-loading 'fault' on Instance uuid 1e281607-e359-403e-bb39-f07c0da0f9a0 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:04:53.346927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:53.357333 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19d05e6a-06fb-4aad-b322-72949e43a2f9 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 200 len: 1305 microversion: 2.1 time: 0.241365 Jul 02 21:04:53.368923 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 507/1085] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:53 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 1305 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:53.383774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:53.385062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:53.409554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.410021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.417488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.417956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.458145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:53.558409 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18f3eb5d-c91d-466a-8bf1-0a18a3029b02 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/action" status: 202 len: 0 microversion: 2.25 time: 4.305599 Jul 02 21:04:53.564048 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 579/1086] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:04:49 2022] POST /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/action => generated 0 bytes in 4315 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:53.573184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:53.576558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:53.609501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.614668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.615965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:53.616663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:53.636427 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dec5ad91-803b-419e-9db9-c52222603585 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 204 len: 0 microversion: 2.1 time: 0.261833 Jul 02 21:04:53.650720 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 508/1087] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:53 2022] DELETE /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:53.666996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-985353231", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:53.784313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:54.030382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:54.040338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-187078b9-1055-4360-a55e-2a72b1c403cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1527 microversion: 2.1 time: 0.474452 Jul 02 21:04:54.044347 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 580/1088] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:53 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1527 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:54.062363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:54.063300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:54.085465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:54.085921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:54.089008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:54.092645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:54.604972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:54.614271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:54.619726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:54.644840 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-68112968-d7b0-4f33-86cb-d702c9e3267a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.575739 Jul 02 21:04:54.645511 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 581/1089] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:54 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:54.650595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e8e456ec-ec6e-4aa1-9a20-f257f101e065 req-fbd8c1a1-3900-4f09-b803-4bd90161b4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e281607-e359-403e-bb39-f07c0da0f9a0", "name": "network-vif-deleted", "tag": "ecf19188-5ba0-4a12-80a2-36d614e8002a"}, {"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "bc0b03a4-a4d1-46a8-bf46-32d0ea2ab69a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:54.674705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e8e456ec-ec6e-4aa1-9a20-f257f101e065 req-fbd8c1a1-3900-4f09-b803-4bd90161b4e2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:54.675073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e8e456ec-ec6e-4aa1-9a20-f257f101e065 req-fbd8c1a1-3900-4f09-b803-4bd90161b4e2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:54.711967 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e8e456ec-ec6e-4aa1-9a20-f257f101e065 req-fbd8c1a1-3900-4f09-b803-4bd90161b4e2 service nova] Creating event network-vif-deleted:ecf19188-5ba0-4a12-80a2-36d614e8002a for instance 1e281607-e359-403e-bb39-f07c0da0f9a0 on nch1-master-1 Jul 02 21:04:54.712925 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e8e456ec-ec6e-4aa1-9a20-f257f101e065 req-fbd8c1a1-3900-4f09-b803-4bd90161b4e2 service nova] Creating event network-changed:bc0b03a4-a4d1-46a8-bf46-32d0ea2ab69a for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:04:54.725129 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e8e456ec-ec6e-4aa1-9a20-f257f101e065 req-fbd8c1a1-3900-4f09-b803-4bd90161b4e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.077848 Jul 02 21:04:54.726385 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 582/1090] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:54.732075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-824867699", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "49cbb4f5-eef9-4fda-a4e0-d3a303af09da"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:54.820698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] validate_networks() for [('49cbb4f5-eef9-4fda-a4e0-d3a303af09da', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:55.289415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:55.291204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:55.291951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:55.292552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:55.293146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:55.317887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:55.319012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:55.320010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:55.320641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:55.346728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:55.352970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:55.367246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:55.371325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:55.458116 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f518bde-0d4b-4364-bd33-4b63ec8a6115 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.810705 Jul 02 21:04:55.459728 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 509/1091] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:04:55.465462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:55.465867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:55.478264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:55.479586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:55.480583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:55.481256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.188319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:56.209536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:56.237105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:56.244029 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c271eb8-f0dd-4c0a-83c5-b90a559aff72 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.780814 Jul 02 21:04:56.250589 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 510/1092] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:55 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:56.271111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:56.281736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:56.295912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.306194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.307436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.308066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.898121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:56.911567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3230edea-e7dd-4e6f-8a54-70ca058cb2ea tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1527 microversion: 2.1 time: 0.656702 Jul 02 21:04:56.914007 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 511/1093] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:56 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1527 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:56.920730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:56.921585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 1e281607-e359-403e-bb39-f07c0da0f9a0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:56.926043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:56.926600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:56.927136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:56.927807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:56.928263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:56.931402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.932491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.933304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.933736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.941487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.942347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.943380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.944102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.950939 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 1e281607-e359-403e-bb39-f07c0da0f9a0 could not be found. Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 HTTP/1.1 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 1e281607-e359-403e-bb39-f07c0da0f9a0 could not be found. Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1e281607-e359-403e-bb39-f07c0da0f9a0'} Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e281607-e359-403e-bb39-f07c0da0f9a0 could not be found. Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e281607-e359-403e-bb39-f07c0da0f9a0 could not be found. Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:04:56.953308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e281607-e359-403e-bb39-f07c0da0f9a0 could not be found. Jul 02 21:04:56.957937 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:04:56.959393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 1e281607-e359-403e-bb39-f07c0da0f9a0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:04:56.961124 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5241cbe-5a21-4176-b951-9a392b2467f5 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0" status: 404 len: 111 microversion: 2.1 time: 0.045765 Jul 02 21:04:56.962248 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 512/1094] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:56 2022] GET /compute/v2.1/servers/1e281607-e359-403e-bb39-f07c0da0f9a0 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:04:56.967348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:56.968257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:56.975951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.976670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.976800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Getting quotas for project 4c4a0acce7ef425b93c417e1a8fccf78. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:56.977718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:56.978922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:56.985833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Getting quotas for user b16a9c9e35954d579536375f7eab1c9b and project 4c4a0acce7ef425b93c417e1a8fccf78. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:57.002147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:57.005154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:57.068415 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9ab3c6c-39a2-42b9-a1e3-a49ab3b3e56e tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.339923 Jul 02 21:04:57.070315 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 583/1095] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:04:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:04:57.078282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:57.090671 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9dc0e8d-3fb3-4003-83e7-407439e43420 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1274 microversion: 2.1 time: 0.127084 Jul 02 21:04:57.091508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2121333690", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e39f0b0f-abc7-4756-8cec-d0a1f8b71f93"}], "security_groups": [{"name": "tempest-securitygroup--1753527405"}], "key_name": "tempest-keypair-1009706156", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:57.094737 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 513/1096] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:56 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:57.107380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:57.109293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:57.135958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:57.136715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:57.139367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:57.140337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:57.424115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] validate_networks() for [('e39f0b0f-abc7-4756-8cec-d0a1f8b71f93', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:04:57.545594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:57.567369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:57.569817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:57.571377 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2b4af57-e89b-43a7-bda0-29da5cf19a71 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.475306 Jul 02 21:04:57.572641 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 514/1097] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:57 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:57.582416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac96a043-5cc3-45e1-8f36-0a9b218bc980 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:57.584229 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:04:57.584229 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:04:57.608125 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac96a043-5cc3-45e1-8f36-0a9b218bc980 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/b17682a8-4235-4b48-adfb-6737e47abf74" status: 202 len: 0 microversion: 2.1 time: 0.033700 Jul 02 21:04:57.609209 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 515/1098] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:57 2022] DELETE /compute/v2.1/flavors/b17682a8-4235-4b48-adfb-6737e47abf74 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:04:57.615603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:57.616542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:57.626346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:57.627193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:57.628687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:57.629399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:57.665668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:57.730996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:04:57.848151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3494304c-f3b5-4716-95c7-218c4f2fcc0b tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 204 len: 0 microversion: 2.1 time: 0.236644 Jul 02 21:04:57.849799 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 516/1099] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:57 2022] DELETE /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:57.864421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "31a0e127-6d14-40ad-9cfc-2d221b2b34f7"}, {"server_uuid": "8b7a681c-3f21-4191-9f0f-993efe27f5a7", "name": "network-vif-deleted", "tag": "10736cb7-2590-432b-ac31-c56746a79bb6"}, {"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "53ab081d-a441-43ec-bea7-7a9b418c3546"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:57.897816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:57.901767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:57.935328 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] Creating event network-changed:31a0e127-6d14-40ad-9cfc-2d221b2b34f7 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:04:57.941905 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] Creating event network-vif-deleted:10736cb7-2590-432b-ac31-c56746a79bb6 for instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 on nch2-master-1 Jul 02 21:04:57.946989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] Creating event network-changed:53ab081d-a441-43ec-bea7-7a9b418c3546 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:04:57.973950 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-83de0f53-710c-4e78-8860-dfdf3da2b87a req-e55fa852-f414-4627-bf3e-7cd943242c25 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.119947 Jul 02 21:04:57.976950 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 517/1100] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:04:57.988770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:57.993144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:58.007115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.007877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.008885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.009485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.156499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.161265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:58.162225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:58.162921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:58.164540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:58.165638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:58.168606 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae7949d6-94f0-47ba-83d3-b522ff353f95 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1213 microversion: 2.1 time: 0.190105 Jul 02 21:04:58.169208 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 518/1101] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:57 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1213 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:58.184215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:58.184845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:58.187644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.188626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.191396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.192396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.193126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.193584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.194468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.194945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.221244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Getting quotas for project 4b15f516c6a34343979d19a0938c232b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:04:58.228646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Getting quotas for user 1fade188e2a14766ae95fe44143bca97 and project 4b15f516c6a34343979d19a0938c232b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:04:58.245091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:04:58.248547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:04:58.305707 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f7244cbe-606d-499f-bc8e-8f4536497335 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.234030 Jul 02 21:04:58.307017 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 584/1102] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:04:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:04:58.316341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-012a9900-36e9-4611-b5b0-34240b720e6b tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:58.342355 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-012a9900-36e9-4611-b5b0-34240b720e6b tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.033748 Jul 02 21:04:58.343901 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 585/1103] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:04:58 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:58.354491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:58.355420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:58.364138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.364778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.365983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.366594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.443039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:04:58.598395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.610190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.611711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.614733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e0ce1ed-d4a2-4e7a-a266-03b563a0ecc9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.434817 Jul 02 21:04:58.626211 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 519/1104] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:58 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:58.639259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:58.640320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:58.651944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.652612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.653393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.653825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.663696 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76d0a6eb-4fd3-4d11-a6ba-fca99bb532f1 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 204 len: 0 microversion: 2.1 time: 0.317893 Jul 02 21:04:58.665098 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 586/1105] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:04:58 2022] DELETE /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:04:58.681557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf5db6ae-d70c-4c9f-bad4-d30850bf4f7b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:58.682528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bf5db6ae-d70c-4c9f-bad4-d30850bf4f7b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:58.780140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bf5db6ae-d70c-4c9f-bad4-d30850bf4f7b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.790926 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf5db6ae-d70c-4c9f-bad4-d30850bf4f7b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1242 microversion: 2.1 time: 0.124121 Jul 02 21:04:58.793539 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 587/1106] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:58 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:58.798792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:04:58.800059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:58.834400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.840327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.842377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:58.843412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:58.917436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.929401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Old instance type tempest-test_resize_flavor_-150720612, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:04:58.940435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:04:58.941956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:04:58.942553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:04:58.943076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:04:58.943908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:04:58.985266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:58.997842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b4563b5-1c39-4c15-a4e5-6b1d83e40290 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.370159 Jul 02 21:04:58.998636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 520/1107] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:58 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:59.014298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:59.018086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:59.031407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.031880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.033890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.036705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.099230 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-62321945-e887-4c45-8342-87b260ef2ab0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df/action" status: 202 len: 0 microversion: 2.1 time: 0.303450 Jul 02 21:04:59.101468 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 588/1108] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:04:58 2022] POST /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:04:59.113964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:59.115363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:59.151338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.152053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.154998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.155804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.553506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:59.563788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:59.568964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:59.590008 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21914cbf-b99a-4b67-bcc0-9d026d500f17 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.589207 Jul 02 21:04:59.590620 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 521/1109] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:04:58 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:04:59.605968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:59.607486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:59.614397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.614921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.616016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.616699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.768407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:04:59.779619 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-abe4d5f8-c67f-4cf2-a5f0-4cfb2b548542 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 200 len: 1475 microversion: 2.1 time: 0.674209 Jul 02 21:04:59.807853 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 589/1110] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:59 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 1475 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:04:59.817557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:04:59.818183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:04:59.844622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.845346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:04:59.846322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:04:59.847972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:00.737100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:00.739611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:00.753149 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5341ee1c-e4da-44ce-8ef3-84919a967245 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1536 microversion: 2.1 time: 1.151525 Jul 02 21:05:00.754061 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 522/1111] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:59 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1536 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:00.758943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:00.759845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:00.774816 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7e0b7620-3491-4de7-9a6a-5595836a8ed6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1277 microversion: 2.1 time: 0.965572 Jul 02 21:05:00.777086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:00.777784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:00.778819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:00.779455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:00.782792 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 590/1112] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:04:59 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1277 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:00.791997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:00.794217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:00.819055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:00.821395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:00.824698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:00.825407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:00.970855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:00.982840 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49799222-c18d-4e44-9852-aa2ba2ea08e0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1294 microversion: 2.1 time: 0.198333 Jul 02 21:05:00.983934 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 591/1113] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:00 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1294 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:01.004354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:01.007363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:01.018770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.021061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:01.022605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.023402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:01.029268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:01.606821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:01.625672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:01.629673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:01.633722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0cb61010-3276-4c48-a91e-4b432fe8d9da tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.876289 Jul 02 21:05:01.657744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 523/1114] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:00 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:01.666851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-64931a10-1b01-43b1-9fd5-45dc9dc12773 req-c91dc04e-efe6-46e1-a148-87ddc0bcf2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "4d668df7-a488-410e-b721-df9a93a7b149"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:01.670003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:01.680283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64931a10-1b01-43b1-9fd5-45dc9dc12773 req-c91dc04e-efe6-46e1-a148-87ddc0bcf2fe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.681084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64931a10-1b01-43b1-9fd5-45dc9dc12773 req-c91dc04e-efe6-46e1-a148-87ddc0bcf2fe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:01.685848 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-615f3434-17ef-45fe-a59c-9aa658e86cdf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.699707 Jul 02 21:05:01.687560 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 592/1115] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:00 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:01.692861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:01.693497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:01.696687 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-64931a10-1b01-43b1-9fd5-45dc9dc12773 req-c91dc04e-efe6-46e1-a148-87ddc0bcf2fe service nova] Creating event network-changed:4d668df7-a488-410e-b721-df9a93a7b149 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:01.704791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-64931a10-1b01-43b1-9fd5-45dc9dc12773 req-c91dc04e-efe6-46e1-a148-87ddc0bcf2fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Jul 02 21:05:01.706080 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 524/1116] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:01.713211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.713675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:01.714201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:01.714468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.714990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:01.716468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:01.759133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:01.785584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.787475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:01.790114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:01.790898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.188104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.199953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.202842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.205164 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6853b745-036c-40ea-b28b-e7885cea3257 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.516031 Jul 02 21:05:02.206421 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 593/1117] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:01 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:02.213020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:02.213978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:02.217985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.227478 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-023ba619-f9e5-400b-a579-ce5c3d29ea0d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 200 len: 1475 microversion: 2.1 time: 0.519890 Jul 02 21:05:02.231652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 525/1118] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:01 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 1475 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:02.235829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:02.237791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.238525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.239516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.240167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.241419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:02.243575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:02.259917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.260386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.261166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.261670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.434434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.444463 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60c4033b-4ba9-441f-af99-566fe207b53b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1275 microversion: 2.1 time: 0.211287 Jul 02 21:05:02.454124 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 526/1119] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:02 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:02.454124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:02.454124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:02.463212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.463732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.464570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.465161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.615562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.631269 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33c1adf7-a6d4-4cff-b170-6ca329cb058d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1300 microversion: 2.1 time: 0.183840 Jul 02 21:05:02.648709 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 527/1120] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:02 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1300 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:02.655742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:02.659290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:02.679147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.679622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.680470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.684597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.796907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:02.811292 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9687a77e-5277-4072-9bc4-3f2f50ef688e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1536 microversion: 2.1 time: 0.603303 Jul 02 21:05:02.812314 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 594/1121] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:02 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1536 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:02.820584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:02.821218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:02.834966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.835429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:02.836264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:02.836712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.175156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.186843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.188394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.189588 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f708854e-4db2-4045-b825-5a1a8661bdc5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.539424 Jul 02 21:05:03.205102 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 528/1122] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:02 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:03.219155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-49daaabc-6da2-41d6-8ced-81006c07e88f req-ed2d2524-2536-4873-b917-3e35e030f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f771465-f947-4a4e-8ff7-f88831cd0858", "name": "network-vif-deleted", "tag": "e76f51ad-e581-4220-b761-e5ee3b284d81"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:03.242882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49daaabc-6da2-41d6-8ced-81006c07e88f req-ed2d2524-2536-4873-b917-3e35e030f625 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.243563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49daaabc-6da2-41d6-8ced-81006c07e88f req-ed2d2524-2536-4873-b917-3e35e030f625 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.274468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-49daaabc-6da2-41d6-8ced-81006c07e88f req-ed2d2524-2536-4873-b917-3e35e030f625 service nova] Creating event network-vif-deleted:e76f51ad-e581-4220-b761-e5ee3b284d81 for instance 5f771465-f947-4a4e-8ff7-f88831cd0858 on nch1-master-1 Jul 02 21:05:03.286286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.299029 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b8c844de-789c-4108-b63f-8b5eccde7f6d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.485516 Jul 02 21:05:03.302935 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 595/1123] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:02 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:03.306448 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-49daaabc-6da2-41d6-8ced-81006c07e88f req-ed2d2524-2536-4873-b917-3e35e030f625 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099720 Jul 02 21:05:03.307055 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 529/1124] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:03.313462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:03.314081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:03.321539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:03.322261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:03.328167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.328637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.329654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.330329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.335278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.335931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.337066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.337676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.394275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.395260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.395921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lazy-loading 'fault' on Instance uuid 5f771465-f947-4a4e-8ff7-f88831cd0858 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:03.528225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.538514 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6802dbe6-af6a-4e31-9ce2-cc95801e448a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 200 len: 1309 microversion: 2.1 time: 0.227335 Jul 02 21:05:03.543621 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 530/1125] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:03 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 1309 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:03.549890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:03.550866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:03.557437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.557962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.558895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.559442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.678020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.691897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.696187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.698844 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-25761162-c4d2-4ba3-9574-6ffa5a5dc3b5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.393711 Jul 02 21:05:03.699493 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 596/1126] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:03 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:03.706375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:03.707327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:03.726134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.728311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.730098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.732176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.913072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.922636 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-82ce75fa-2844-40fc-9cf7-f2d0d47c85f0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1300 microversion: 2.1 time: 0.220815 Jul 02 21:05:03.933209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:03.933831 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 597/1127] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:03 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1300 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:03.939398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:03.940316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:03.942326 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf8f5e65-adec-4e6e-93ac-a9a19173b574 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.395813 Jul 02 21:05:03.945667 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 531/1128] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:03 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:03.948174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.948638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.949508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.949996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.950526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "613c35f3-cde8-4e12-962d-d43f9fed716c", "tag": "760a2034-9f29-4a85-ada6-2c3addbfcb4c"}, {"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "1b833045-67de-490c-a1bc-7322fe6f685a"}, {"server_uuid": "21b42683-af40-4a05-bbee-a42d6390363f", "name": "network-vif-deleted", "tag": "f19aab95-df94-49dd-bdf0-9864b342ed7c"}, {"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "1afd4b1f-b58d-4f5d-a887-dc07fab9afe4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:03.960913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:03.961360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:03.980257 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Creating event network-changed:760a2034-9f29-4a85-ada6-2c3addbfcb4c for instance 613c35f3-cde8-4e12-962d-d43f9fed716c on nch2-master-1 Jul 02 21:05:03.980803 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Creating event network-changed:1b833045-67de-490c-a1bc-7322fe6f685a for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:03.981507 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Creating event network-vif-deleted:f19aab95-df94-49dd-bdf0-9864b342ed7c for instance 21b42683-af40-4a05-bbee-a42d6390363f on nch2-master-1 Jul 02 21:05:03.981998 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] Creating event network-changed:1afd4b1f-b58d-4f5d-a887-dc07fab9afe4 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:03.994207 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4d886b68-d28f-447c-a06e-46e8d71f89b9 req-345ca0b1-d053-4d4f-85be-ca018bb8af75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 684 microversion: 2.1 time: 0.047263 Jul 02 21:05:03.995112 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 532/1129] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 684 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:04.209173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:04.209866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:04.212549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:04.221112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:04.223912 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5350c138-1847-4ebf-bb26-8a05a6b19aa8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1536 microversion: 2.1 time: 0.288784 Jul 02 21:05:04.224079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:04.228449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:04.228906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:04.229641 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 598/1130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:03 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1536 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:04.322935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:04.324949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:04.349754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:04.350225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:04.351033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:04.351479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.096302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.108473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.110648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.111684 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d46ab813-e130-405d-8eb4-38e1af4fa91d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.907098 Jul 02 21:05:05.126475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.134803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-190c40c5-e9fc-4229-b8f2-face9d046fd0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.819057 Jul 02 21:05:05.135386 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 599/1132] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:04 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:05.143022 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 533/1132] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:04 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:05.144364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:05.146298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:05.146917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 5f771465-f947-4a4e-8ff7-f88831cd0858] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:05.148368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:05.159298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.159754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.161552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.162541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.163182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.163791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.164749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.168531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.186994 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 5f771465-f947-4a4e-8ff7-f88831cd0858 could not be found. Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 HTTP/1.1 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 5f771465-f947-4a4e-8ff7-f88831cd0858 could not be found. Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '5f771465-f947-4a4e-8ff7-f88831cd0858'} Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f771465-f947-4a4e-8ff7-f88831cd0858 could not be found. Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f771465-f947-4a4e-8ff7-f88831cd0858 could not be found. Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:05.189236 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f771465-f947-4a4e-8ff7-f88831cd0858 could not be found. Jul 02 21:05:05.193528 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.195567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 5f771465-f947-4a4e-8ff7-f88831cd0858 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:05.196761 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-270a4921-f710-4b83-9915-41271af8f2bb tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858" status: 404 len: 111 microversion: 2.1 time: 0.055840 Jul 02 21:05:05.197842 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 600/1133] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:05 2022] GET /compute/v2.1/servers/5f771465-f947-4a4e-8ff7-f88831cd0858 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:05.204350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:05.205406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:05.213910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.214778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.215906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.216610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.331947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:05.361335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:05.582917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.599783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.601671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.603051 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a46d06c9-dc62-40ff-a814-7a569fe97dc6 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.466351 Jul 02 21:05:05.614200 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 534/1134] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:05 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:05.619495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:05.620356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:05.627142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.627866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.629171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.629749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.654221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:05.741192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.754674 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9ab98f99-0bbd-40ab-b99c-e019ddb83cce tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.555491 Jul 02 21:05:05.755488 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 601/1135] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:05 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:05.761263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:05.762180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 21b42683-af40-4a05-bbee-a42d6390363f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:05.770315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.789617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.790953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.791548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.813078 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 21b42683-af40-4a05-bbee-a42d6390363f could not be found. Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f HTTP/1.1 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 21b42683-af40-4a05-bbee-a42d6390363f could not be found. Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '21b42683-af40-4a05-bbee-a42d6390363f'} Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b42683-af40-4a05-bbee-a42d6390363f could not be found. Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b42683-af40-4a05-bbee-a42d6390363f could not be found. Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:05.814910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b42683-af40-4a05-bbee-a42d6390363f could not be found. Jul 02 21:05:05.819669 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:05.822130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 21b42683-af40-4a05-bbee-a42d6390363f could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:05.823200 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cceb7e06-ccbb-4832-89a0-cc2cb6758192 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f" status: 404 len: 111 microversion: 2.1 time: 0.065758 Jul 02 21:05:05.824497 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 602/1136] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:05 2022] GET /compute/v2.1/servers/21b42683-af40-4a05-bbee-a42d6390363f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:05.829410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:05.830256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:05.837346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.838066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.839048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.839637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.934519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:05.945463 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63a745f4-d218-4514-ab7d-d5aad171f59d tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.329721 Jul 02 21:05:05.947208 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 535/1137] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:05 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:05.953939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-89729786-ecb6-4afb-9011-87a255e95332 req-efbb8172-4d0a-4d65-b882-3ab563c828f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e1556a-3d1a-44b0-8761-df5386dfe109", "tag": "04b93777-00c4-469f-beea-74a97e6f5a06"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:05.963010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89729786-ecb6-4afb-9011-87a255e95332 req-efbb8172-4d0a-4d65-b882-3ab563c828f1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:05.963719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-89729786-ecb6-4afb-9011-87a255e95332 req-efbb8172-4d0a-4d65-b882-3ab563c828f1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:05.976921 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-89729786-ecb6-4afb-9011-87a255e95332 req-efbb8172-4d0a-4d65-b882-3ab563c828f1 service nova] Creating event network-changed:04b93777-00c4-469f-beea-74a97e6f5a06 for instance 52e1556a-3d1a-44b0-8761-df5386dfe109 on nch2-master-1 Jul 02 21:05:05.982274 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-89729786-ecb6-4afb-9011-87a255e95332 req-efbb8172-4d0a-4d65-b882-3ab563c828f1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032735 Jul 02 21:05:05.983067 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 536/1138] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:05.988420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fbd9e90-52a8-419d-8c70-210344b34440 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.026901 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fbd9e90-52a8-419d-8c70-210344b34440 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/63fb177a-a5e8-4f64-be23-2e9155fbd294" status: 204 len: 0 microversion: 2.1 time: 0.042096 Jul 02 21:05:06.031291 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 537/1139] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:05:05 2022] DELETE /compute/v2.1/os-server-groups/63fb177a-a5e8-4f64-be23-2e9155fbd294 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:06.037704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.038466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.045848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.046671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.048308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.049006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.110271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:06.115670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.127859 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b65b492-51eb-45a0-a346-dbd0797926f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.301927 Jul 02 21:05:06.128792 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 603/1140] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:05 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:06.134777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ea79868f-3f19-4a25-9d56-b89cb36edc6d req-eb50b8ca-8f75-4608-96f7-e40706024858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "name": "network-vif-unplugged", "status": "completed", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:06.146425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ea79868f-3f19-4a25-9d56-b89cb36edc6d req-eb50b8ca-8f75-4608-96f7-e40706024858 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.147259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ea79868f-3f19-4a25-9d56-b89cb36edc6d req-eb50b8ca-8f75-4608-96f7-e40706024858 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.166168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ea79868f-3f19-4a25-9d56-b89cb36edc6d req-eb50b8ca-8f75-4608-96f7-e40706024858 service nova] Creating event network-vif-unplugged:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch2-master-1 Jul 02 21:05:06.171551 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ea79868f-3f19-4a25-9d56-b89cb36edc6d req-eb50b8ca-8f75-4608-96f7-e40706024858 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041530 Jul 02 21:05:06.173054 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 604/1141] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:06.181209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.181919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.190093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.190746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.192009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.192607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.247740 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20e96cc7-ec51-482a-b897-7073c1cecd2d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 204 len: 0 microversion: 2.1 time: 0.214266 Jul 02 21:05:06.250439 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 538/1142] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:06 2022] DELETE /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:06.259379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.260617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.267494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.269101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.270344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.270924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.519033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.528728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.530287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.531892 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d44f38dd-3bb3-4da2-88aa-0632f01d1d58 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.357391 Jul 02 21:05:06.544715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 605/1143] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:06 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:06.545820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.550607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.551100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.556313 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-912e4fa5-46a4-4d25-8214-f763c7361566 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.304263 Jul 02 21:05:06.557709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.558160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.558933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.559590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.567465 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 539/1144] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:06 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:06.584551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:06.621768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.622309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.629370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.629823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.630630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.631070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.699126 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b03dc0aa-1ebf-4784-96ee-dbde7bd59773 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 204 len: 0 microversion: 2.1 time: 0.152571 Jul 02 21:05:06.699981 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 606/1145] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:06 2022] DELETE /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:06.710150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.710896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.718421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.718902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.719701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.720168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.877591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.907468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.920388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:06.922030 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ec7c93d-5f8d-4dce-96b5-09354de28994 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.304256 Jul 02 21:05:06.922867 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 540/1146] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:06 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:06.928831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:06.929772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:06.936847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.937392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:06.939205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:06.939636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.054682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.066272 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab24fa2d-8b86-4d0a-a858-a04e7c02c81c tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1474 microversion: 2.1 time: 0.361977 Jul 02 21:05:07.067163 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 607/1147] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:06 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1474 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:07.073404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:07.074024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:07.081265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.084383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.085242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.085679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.118443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.127048 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7f1b74f-faeb-48d8-9e6a-3a503be11a75 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.202816 Jul 02 21:05:07.127707 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 541/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:06 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:07.146176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:07.146793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:07.153186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.153641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.154422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.154859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.294115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.303432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a757656e-2484-43f8-b57f-3ecace8354a1 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.234453 Jul 02 21:05:07.304220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 608/1149] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:07 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:07.325612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.333606 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e771bf66-2c43-4003-ba12-c26b927011cc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.191664 Jul 02 21:05:07.334632 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 542/1150] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:07 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:07.556185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:07.557139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:07.563261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.563712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.564564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.564996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.567938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:07.574401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:07.575764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:07.582900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.583435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.584152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.584778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.824066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.829007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.832001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1f107d6-59bd-47d7-b6e4-80f06c5ead7a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.262227 Jul 02 21:05:07.832611 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 543/1151] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:07 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:07.838811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.840459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:07.841749 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-89d7bd8e-9189-4ac0-9268-55bd083ed4f9 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.293991 Jul 02 21:05:07.842304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 609/1152] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:07 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:07.943070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:07.943806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:07.952350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.952954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:07.953971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:07.954545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.084443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:08.085748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:08.092418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.093116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.094422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.095018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.108559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.118866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.120838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.122309 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4c29bf9-58b0-42f9-97eb-7b99a9724a80 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.184685 Jul 02 21:05:08.123014 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 544/1153] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:07 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:08.144964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:08.145568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:08.151924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.152643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.153627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.154216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.210430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:08.300723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.309304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f98c18b-cf81-4b47-ab8c-a6963d30e8ed tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1474 microversion: 2.1 time: 0.228363 Jul 02 21:05:08.321539 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 610/1154] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:08 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1474 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:08.330534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.334060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d515d7da-89c3-4842-b1ba-247b6d59021f req-41ed5c53-5f8e-441c-ab26-273d3be56400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bc8e287-b938-43c3-8d6d-342220d0319a", "tag": "9483df73-5f9d-4c45-be57-eeb24fa4b6fa"}, {"name": "network-changed", "server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:08.344297 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eaaa039d-cc1d-42e0-b551-653828b7b485 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.203718 Jul 02 21:05:08.345274 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 545/1155] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:08 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:08.354669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:08.355423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:08.356285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d515d7da-89c3-4842-b1ba-247b6d59021f req-41ed5c53-5f8e-441c-ab26-273d3be56400 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.356917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d515d7da-89c3-4842-b1ba-247b6d59021f req-41ed5c53-5f8e-441c-ab26-273d3be56400 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.363331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.364023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.365056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.365711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.371193 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d515d7da-89c3-4842-b1ba-247b6d59021f req-41ed5c53-5f8e-441c-ab26-273d3be56400 service nova] Creating event network-changed:9483df73-5f9d-4c45-be57-eeb24fa4b6fa for instance 1bc8e287-b938-43c3-8d6d-342220d0319a on nch1-master-1 Jul 02 21:05:08.371828 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d515d7da-89c3-4842-b1ba-247b6d59021f req-41ed5c53-5f8e-441c-ab26-273d3be56400 service nova] Creating event network-changed:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch2-master-1 Jul 02 21:05:08.381030 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d515d7da-89c3-4842-b1ba-247b6d59021f req-41ed5c53-5f8e-441c-ab26-273d3be56400 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.057850 Jul 02 21:05:08.382256 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 611/1156] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:08.388890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:08.389887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:08.397685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.398348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.399344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.400031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.747152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.750049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:08.755703 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e134b8eb-b8c2-4878-b61c-b093dc8706ad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.371842 Jul 02 21:05:08.765018 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 612/1157] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:08 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:08.765018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5597049f-0958-44cb-a917-bf021b9e1bd4 req-4d89bf06-11d3-4e8e-aa8b-a34ae27555d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613c35f3-cde8-4e12-962d-d43f9fed716c", "name": "network-vif-plugged", "status": "completed", "tag": "760a2034-9f29-4a85-ada6-2c3addbfcb4c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:08.768533 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19d1c519-51aa-4f8d-a498-2842d7d4e5e7 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.421892 Jul 02 21:05:08.769772 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 546/1158] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:08 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:08.770043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5597049f-0958-44cb-a917-bf021b9e1bd4 req-4d89bf06-11d3-4e8e-aa8b-a34ae27555d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.770560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5597049f-0958-44cb-a917-bf021b9e1bd4 req-4d89bf06-11d3-4e8e-aa8b-a34ae27555d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.782298 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5597049f-0958-44cb-a917-bf021b9e1bd4 req-4d89bf06-11d3-4e8e-aa8b-a34ae27555d0 service nova] Creating event network-vif-plugged:760a2034-9f29-4a85-ada6-2c3addbfcb4c for instance 613c35f3-cde8-4e12-962d-d43f9fed716c on nch2-master-1 Jul 02 21:05:08.787622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5597049f-0958-44cb-a917-bf021b9e1bd4 req-4d89bf06-11d3-4e8e-aa8b-a34ae27555d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029750 Jul 02 21:05:08.788447 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 613/1159] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:08.849291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:08.849910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:08.856864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.857426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.858141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=14 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:08.858280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.858659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.865286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:08.866187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:08.874404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.875314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:08.876079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:08.876704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.259486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.273096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0af857b1-1c2f-4416-9ac2-d4ed42b1a5c5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.427665 Jul 02 21:05:09.275215 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 547/1160] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:08 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:09.288899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:09.289517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:09.295667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.296134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.296922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.297386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.303098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.319891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.323112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.324464 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b4ffb2d1-2dca-461b-b16c-dd8567dbba4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.467737 Jul 02 21:05:09.325285 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 614/1161] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:08 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:09.330498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:09.331107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:09.337514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.337967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.338736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.339364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.688619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.700061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.701974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.704223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3626b6d0-c0ef-4459-959f-f8950d8251c2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.418530 Jul 02 21:05:09.705460 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 548/1162] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:09 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:09.711256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:09.712131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:09.720724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.721843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.724346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.724346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.766332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:09.782540 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f4b6abd3-ddc9-4667-a220-b008ac135012 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1474 microversion: 2.1 time: 0.455953 Jul 02 21:05:09.783144 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 615/1163] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:09 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1474 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:09.803468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:09.804656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:09.816071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.816885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:09.817886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:09.819159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.549578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:10.557870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:10.558702 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c58c8807-a289-4a86-87de-db5508884a39 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.851810 Jul 02 21:05:10.569459 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 549/1164] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:09 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:10.569459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:10.569459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:10.572273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.572777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.573615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.574050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.579499 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c0809b2-12b2-43c8-93da-a73ad92497fb tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.784546 Jul 02 21:05:10.580380 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 616/1165] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:09 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:10.585344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:10.586168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:10.592751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.593264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.594329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.594912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.922279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:10.925422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:10.930315 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f1f6c3f6-7805-4dfb-b8fc-1fe7a6d1851a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1314 microversion: 2.1 time: 0.348744 Jul 02 21:05:10.934157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bd72688-9279-4ec9-b28c-69facd23b1ec tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.372846 Jul 02 21:05:10.934836 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 617/1166] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:10 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:10.937019 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 550/1167] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:10 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:10.943737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:10.943910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-273da8e2-d01c-43c4-9e32-49db9144801e req-953fff26-54bd-4a12-8ab7-548913cb7e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927b6d45-bb13-4123-80c2-dfc0f800e76d", "name": "network-vif-deleted", "tag": "ba68e899-968d-4623-8c74-12e2f2939804"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:10.944808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:10.951559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.952011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.952926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.953366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.953497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-273da8e2-d01c-43c4-9e32-49db9144801e req-953fff26-54bd-4a12-8ab7-548913cb7e76 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.953874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-273da8e2-d01c-43c4-9e32-49db9144801e req-953fff26-54bd-4a12-8ab7-548913cb7e76 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.965698 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-273da8e2-d01c-43c4-9e32-49db9144801e req-953fff26-54bd-4a12-8ab7-548913cb7e76 service nova] Creating event network-vif-deleted:ba68e899-968d-4623-8c74-12e2f2939804 for instance 927b6d45-bb13-4123-80c2-dfc0f800e76d on nch1-master-1 Jul 02 21:05:10.971220 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-273da8e2-d01c-43c4-9e32-49db9144801e req-953fff26-54bd-4a12-8ab7-548913cb7e76 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032883 Jul 02 21:05:10.972078 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 551/1168] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:10.977183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:10.977886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:10.984401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.984855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:10.985633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:10.986077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.213055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.216458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.220294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:11.230474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.232021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.233236 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3fe25642-9092-4ff7-a81a-a8575554dec4 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.260142 Jul 02 21:05:11.233800 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 552/1169] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:10 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:11.241009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:11.241670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:11.248563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.250045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.251233 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ddc96ddb-b194-4783-b4a0-4d0221b03678 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.315108 Jul 02 21:05:11.251806 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 618/1170] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:10 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:11.256375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c80a8deb-967a-4f40-8055-b4323d550c03 req-6cfe8b88-b429-462b-8957-c21f8f0ef6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32b58f76-ef9b-4a64-aeb6-fac9c5f571c1", "name": "network-vif-deleted", "tag": "a975ae6d-9495-4dca-883a-bab061d51fcd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:11.267646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.268127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.268909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c80a8deb-967a-4f40-8055-b4323d550c03 req-6cfe8b88-b429-462b-8957-c21f8f0ef6d9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.269026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.269351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.269491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c80a8deb-967a-4f40-8055-b4323d550c03 req-6cfe8b88-b429-462b-8957-c21f8f0ef6d9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.281847 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c80a8deb-967a-4f40-8055-b4323d550c03 req-6cfe8b88-b429-462b-8957-c21f8f0ef6d9 service nova] Creating event network-vif-deleted:a975ae6d-9495-4dca-883a-bab061d51fcd for instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 on nch1-master-1 Jul 02 21:05:11.286925 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c80a8deb-967a-4f40-8055-b4323d550c03 req-6cfe8b88-b429-462b-8957-c21f8f0ef6d9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033925 Jul 02 21:05:11.287709 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 619/1171] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:11.334029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.341763 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c93c43e4-9d00-45ee-95aa-88acb58bdff2 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1432 microversion: 2.1 time: 0.104449 Jul 02 21:05:11.342334 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 553/1172] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:11 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1432 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:11.581913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:11.583270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:11.594637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.595105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.595905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.596358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.597517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:11.598136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:11.604806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.605255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.606027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.606461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.798555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.801599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:11.806430 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-886a411a-6c96-46fa-ac16-3be93974c6eb tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.232213 Jul 02 21:05:11.807006 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 620/1173] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:11 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:11.809498 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-648bcfb1-7b82-41aa-babc-89bc171253da tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.215778 Jul 02 21:05:11.810064 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 554/1174] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:11 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:11.947979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:11.948645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:11.950939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:11.951711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:11.955875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.956420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.957185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.957625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.958741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.959190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:11.959959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:11.960427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.153050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.156012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.161070 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12255119-4cd6-4503-ac32-69f6ea8777cb tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.214083 Jul 02 21:05:12.161646 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 555/1175] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:11 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:12.164225 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45de6e34-b5fc-4348-a05e-d18a301951cd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1499 microversion: 2.1 time: 0.220223 Jul 02 21:05:12.164787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 621/1176] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:11 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1499 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:12.251534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:12.252169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:12.258614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.259075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.259858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.260353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.269663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:12.270625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:12.277349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.278139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.279212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.279875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.522794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.532364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.533855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.535943 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5078fd67-72e8-485f-a515-ce9e88c9e977 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.288477 Jul 02 21:05:12.537333 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 556/1177] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:12 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:12.542878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:12.543803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:12.551232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.551951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.552769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.553166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.553863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.564692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.566384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.567598 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-617733c1-23b8-4b18-a63a-2ab44180a257 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.301899 Jul 02 21:05:12.568547 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 622/1178] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:12 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:12.573859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-df869f19-17ce-4b5a-86af-b9b3f709927a req-4006a4fe-590a-496b-b9ff-b5869a7a0fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e1556a-3d1a-44b0-8761-df5386dfe109", "name": "network-vif-plugged", "status": "completed", "tag": "04b93777-00c4-469f-beea-74a97e6f5a06"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:12.582415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-df869f19-17ce-4b5a-86af-b9b3f709927a req-4006a4fe-590a-496b-b9ff-b5869a7a0fd5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.583688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-df869f19-17ce-4b5a-86af-b9b3f709927a req-4006a4fe-590a-496b-b9ff-b5869a7a0fd5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.596357 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-df869f19-17ce-4b5a-86af-b9b3f709927a req-4006a4fe-590a-496b-b9ff-b5869a7a0fd5 service nova] Creating event network-vif-plugged:04b93777-00c4-469f-beea-74a97e6f5a06 for instance 52e1556a-3d1a-44b0-8761-df5386dfe109 on nch2-master-1 Jul 02 21:05:12.601523 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-df869f19-17ce-4b5a-86af-b9b3f709927a req-4006a4fe-590a-496b-b9ff-b5869a7a0fd5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031428 Jul 02 21:05:12.602906 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 623/1179] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:12.627291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:12.636346 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-418a866b-ba06-4590-a14d-407cee7215f0 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 200 len: 1432 microversion: 2.1 time: 0.097667 Jul 02 21:05:12.637298 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 557/1180] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:12 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 1432 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:12.824457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:12.825247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:12.826425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:12.827073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:12.832152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.832598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.833364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.833511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.833794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.833965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:12.834653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:12.835249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.031911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.040902 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-655aa174-6f08-4279-822f-bcc97f6c0a62 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.220593 Jul 02 21:05:13.041352 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 624/1181] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:12 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:13.043936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.051910 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c8a4402-b99b-4261-971f-57de552e4241 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.229472 Jul 02 21:05:13.052527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 558/1182] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:12 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:13.180313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:13.181002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:13.188728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.189515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.190294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.190912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.378741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.386493 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ddce55b3-c81d-48b6-b077-7b49bc21e470 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1317 microversion: 2.1 time: 0.210334 Jul 02 21:05:13.387141 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 625/1183] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:13 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:13.554799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:13.555437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:13.563124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.564430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.565413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.566010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.591868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:13.593700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:13.601006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.601491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.602395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.603134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.841149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.861157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.862698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.863911 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbe28685-7076-478d-aa74-7b57d8ecac74 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.313059 Jul 02 21:05:13.875384 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 559/1184] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:13 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:13.881151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2aa26fe-49ef-4733-8bdc-f5d9113ce416"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:13.882277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:13.889002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.889558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.890304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.890850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.945444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.960347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.962711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:13.965313 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11d1f0f1-9627-47f1-bf28-71486a43d296 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.378000 Jul 02 21:05:13.967293 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 626/1185] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:13 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:13.972742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:13.973453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 927b6d45-bb13-4123-80c2-dfc0f800e76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:13.983710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.984166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:13.984946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:13.985372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.013851 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 927b6d45-bb13-4123-80c2-dfc0f800e76d could not be found. Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d HTTP/1.1 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 927b6d45-bb13-4123-80c2-dfc0f800e76d could not be found. Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '927b6d45-bb13-4123-80c2-dfc0f800e76d'} Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927b6d45-bb13-4123-80c2-dfc0f800e76d could not be found. Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927b6d45-bb13-4123-80c2-dfc0f800e76d could not be found. Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:14.015872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927b6d45-bb13-4123-80c2-dfc0f800e76d could not be found. Jul 02 21:05:14.020648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:14.022526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 927b6d45-bb13-4123-80c2-dfc0f800e76d could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:14.023590 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ec34320-bdf4-44fc-bbc8-a169ac38f822 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d" status: 404 len: 111 microversion: 2.1 time: 0.055104 Jul 02 21:05:14.024662 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 627/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:13 2022] GET /compute/v2.1/servers/927b6d45-bb13-4123-80c2-dfc0f800e76d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:14.033215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:14.034099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:14.041307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.042007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.043024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.043713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.082031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.082487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.082943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lazy-loading 'fault' on Instance uuid 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:14.217305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:14.219699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:14.226369 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5a24606-5f9c-4bbe-9f01-3b0aec42c65d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 200 len: 1308 microversion: 2.1 time: 0.197610 Jul 02 21:05:14.235998 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 628/1187] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:14 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:14.235998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:14.235998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:14.238927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.239386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.240152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.240574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.252289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0137a7a4-8454-4d41-9f7c-98b794ec3e2c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375418 Jul 02 21:05:14.257927 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 560/1188] 10.222.0.43 () {60 vars in 1322 bytes} [Sat Jul 2 21:05:13 2022] POST /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:14.258460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:14.259164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:14.267361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.267810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.268976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.269098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.707534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:14.709983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:14.716341 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d245524-f463-49bb-b64a-9188c3f47e95 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.461722 Jul 02 21:05:14.717281 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 561/1189] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:14 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:14.718730 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d83694c2-6e3c-447a-bc34-657c09f9edf8 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.490418 Jul 02 21:05:14.720858 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 629/1190] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:14 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:14.734225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:14.734844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:14.741175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.741626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.742399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.742831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.883665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:14.884331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:14.890861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.891338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:14.892184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:14.892624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.026660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.041956 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-370a8321-4972-4dcf-9d92-57f1d24ad891 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1506 microversion: 2.1 time: 0.323379 Jul 02 21:05:15.042776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 562/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:14 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:15.047307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:15.048130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:15.054989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.055444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.056333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.056788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.488685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.497560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.499326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.500555 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ea0e465-3989-4142-a070-ac76ba203ec2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.622109 Jul 02 21:05:15.501111 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 630/1192] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:14 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:15.505661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:15.506277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:15.512923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.513383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.514162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.514596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.720404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.731911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.733696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.734949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99d223fb-37d3-4fa1-9651-a0948689cc88 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.691436 Jul 02 21:05:15.735603 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 563/1193] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:15 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:15.740334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:15.740957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:15.747642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.748280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.749137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.749653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.763880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 could not be found. Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 HTTP/1.1 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 could not be found. Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '32b58f76-ef9b-4a64-aeb6-fac9c5f571c1'} Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 could not be found. Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 could not be found. Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:15.766533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 could not be found. Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dc1f741-e40c-4125-bdff-77b66e24a9cd tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1" status: 404 len: 111 microversion: 2.1 time: 0.030552 Jul 02 21:05:15.771868 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 564/1194] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:15 2022] GET /compute/v2.1/servers/32b58f76-ef9b-4a64-aeb6-fac9c5f571c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:15.775720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:15.776360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:15.777147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:15.783464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.783464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.784256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.784699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.788329 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8fb6686b-117a-40b0-92c3-293ca6f31ff4 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1506 microversion: 2.1 time: 0.285604 Jul 02 21:05:15.800581 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 631/1195] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:15 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:15.805887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:15.806708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:15.813280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.813731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:15.814512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:15.814959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.110170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.117806 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7bdfc488-6899-4804-86af-99cab36f7ee0 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.315921 Jul 02 21:05:16.118363 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 632/1196] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:15 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:16.120938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.123984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5e16d9fd-0f58-4f81-8e66-085311b147c7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.134070 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf534aa4-bd9d-4d4c-a080-1dab1bcd0353 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.359590 Jul 02 21:05:16.137623 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 565/1197] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:15 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:16.143344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:16.144648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.152830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.153323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.154155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.154630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.159931 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5e16d9fd-0f58-4f81-8e66-085311b147c7 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/8d8c9511-c757-4e45-bacd-ad2cf311eef3" status: 204 len: 0 microversion: 2.1 time: 0.040165 Jul 02 21:05:16.163824 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 633/1198] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:05:16 2022] DELETE /compute/v2.1/os-server-groups/8d8c9511-c757-4e45-bacd-ad2cf311eef3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:16.171002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.171728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.177981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.178429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.179236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.179737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.206438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:16.227494 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52d58fb1-cc2e-4bd4-b2a6-b3f37830e475 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "PUT /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1078 microversion: 2.1 time: 0.088719 Jul 02 21:05:16.237288 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 566/1199] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:05:16 2022] PUT /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1078 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:16.244159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.244768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.251534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.252339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.253206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.253647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.287520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:16.295448 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-df43702e-413f-49dd-b500-9d70c9c6450d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "DELETE /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 204 len: 0 microversion: 2.1 time: 0.129372 Jul 02 21:05:16.296278 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 634/1200] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:16 2022] DELETE /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:16.304974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.305688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.313296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.313747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.314525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.315057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.556449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.565128 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47bf88cc-3be4-46af-8ca7-cc94cae2b986 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1504 microversion: 2.1 time: 0.326415 Jul 02 21:05:16.565942 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 567/1201] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:16 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:16.570231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.570842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.573282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:16.578880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.579352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.580313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.580597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.582380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.587363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:16.592794 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-509480dc-9d8b-4baa-80ae-776fe68a334d tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1470 microversion: 2.1 time: 0.292270 Jul 02 21:05:16.601148 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 635/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:16 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:16.601148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.601148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.605724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.606342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.607578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.608445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.823298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.832211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.833736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.834103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:16.834950 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65b2a324-a72d-4da5-82c8-7ff75b2a4d5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.268330 Jul 02 21:05:16.835519 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 568/1203] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:16 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:16.840105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.840721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.843936 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc49e2d1-afc7-433c-8fa1-ee32e30c6e71 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1504 microversion: 2.1 time: 0.249475 Jul 02 21:05:16.844545 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 636/1204] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:16 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:16.853053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.853053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.853053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.853053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.860332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:16.861546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.867889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.868399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.869211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.869650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.943654 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b18c8431-da72-4d7c-9a6b-703ea14572be tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "PUT /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1080 microversion: 2.1 time: 0.087168 Jul 02 21:05:16.944632 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 637/1205] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:05:16 2022] PUT /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1080 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:16.957712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:16.958327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:16.965260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.965712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:16.966480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:16.966920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.077729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.087681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.089401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.090631 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e15a526-8c83-4a08-ae3a-3a4a09d8866a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.254128 Jul 02 21:05:17.091416 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 569/1206] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:16 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:17.129919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.136386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.137148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.138187 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-31dfcd5d-d079-44c9-8e71-e5225685b933 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1506 microversion: 2.1 time: 0.184121 Jul 02 21:05:17.139033 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 638/1207] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:16 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:17.146407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.146859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.147838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.148308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.159176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.159919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.166452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.166903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.167681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.168144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.348162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.355234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.356269 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36ef0263-9ee4-467d-beb4-fa2c1141ce9c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.224924 Jul 02 21:05:17.356888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 570/1208] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:17 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:17.361916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.362611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.363311 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f417e959-94e1-48a7-a330-270f884ee5b4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.208751 Jul 02 21:05:17.368114 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 639/1209] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:17 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:17.368538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-54a77082-8f82-4269-b18d-405ccaa8e740 req-d4d8056b-1738-43c5-a5fd-c58f3b1b0f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc8e287-b938-43c3-8d6d-342220d0319a", "name": "network-vif-plugged", "status": "completed", "tag": "9483df73-5f9d-4c45-be57-eeb24fa4b6fa"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:17.368889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.369372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.370149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.370578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.376644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-54a77082-8f82-4269-b18d-405ccaa8e740 req-d4d8056b-1738-43c5-a5fd-c58f3b1b0f9d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.377071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-54a77082-8f82-4269-b18d-405ccaa8e740 req-d4d8056b-1738-43c5-a5fd-c58f3b1b0f9d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.390315 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-54a77082-8f82-4269-b18d-405ccaa8e740 req-d4d8056b-1738-43c5-a5fd-c58f3b1b0f9d service nova] Creating event network-vif-plugged:9483df73-5f9d-4c45-be57-eeb24fa4b6fa for instance 1bc8e287-b938-43c3-8d6d-342220d0319a on nch1-master-1 Jul 02 21:05:17.395304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-54a77082-8f82-4269-b18d-405ccaa8e740 req-d4d8056b-1738-43c5-a5fd-c58f3b1b0f9d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030271 Jul 02 21:05:17.396454 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 640/1210] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:17.504992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.513205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c71ff01-cb9e-4c2a-a568-7028898b7aa2 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1506 microversion: 2.1 time: 0.155339 Jul 02 21:05:17.513792 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 571/1211] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:17 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:17.530550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.531145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.537799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.538246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.539005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.539439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.564487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:17.610914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.611436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.618477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.619075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.619866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.620510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.647071 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dfa1f291-831d-43eb-bd1c-01253eaed966 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 204 len: 0 microversion: 2.1 time: 0.120653 Jul 02 21:05:17.647662 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 641/1212] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:17 2022] DELETE /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:17.657688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.658276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.665730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.666204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.666973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.667413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.693378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:17.706147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:17.742020 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.compute.api [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Instance is already in deleting state, ignoring this request Jul 02 21:05:17.742883 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1cad47da-2b9a-4b8b-ac9f-71b01d8848e0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 204 len: 0 microversion: 2.1 time: 0.089380 Jul 02 21:05:17.743825 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 642/1213] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:17 2022] DELETE /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:05:17.752014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.752014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.754028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.758493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.758945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.759712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.760308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.762670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-781084d7-1c67-4a3f-8cf1-e94c1c46511a tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1470 microversion: 2.1 time: 0.155852 Jul 02 21:05:17.763272 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 572/1214] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:17 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:17.853075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:17.853697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:17.860148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.860571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.861626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:17.862243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:17.893412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:17.903162 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-30de686f-fb50-4054-8a84-1c5a8e7bd8c9 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1512 microversion: 2.1 time: 0.155215 Jul 02 21:05:17.903828 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 643/1215] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:17 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:18.002452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.012224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.013724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.015085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-caf48cb3-7c82-4132-a8d5-40fe9e442bfd tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.166168 Jul 02 21:05:18.015687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 573/1216] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:17 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:18.110732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:18.111494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:18.118593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.118986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.119754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.120220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.304775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.316192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.317720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.318878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-50b79faf-bf88-44c4-b00a-1297c049823f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.212436 Jul 02 21:05:18.319446 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 644/1217] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:18 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:18.374681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:18.375225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:18.379830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:18.380515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:18.382359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.382875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.383670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.384133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.387806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.388426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.389236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.389782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.624555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.632577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a781a660-9396-415c-a6fa-980cdb5b02a6 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.261916 Jul 02 21:05:18.642734 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 574/1218] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:18 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:18.667908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.677004 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b36a0bd4-0c28-47c3-a57e-5121fc247fa9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.301270 Jul 02 21:05:18.687550 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 645/1219] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:18 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:18.781244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:18.782108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:18.789241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.789717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.790500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.790936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.922678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:18.923604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:18.930223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.930669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.930851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:18.931449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:18.931887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:18.938822 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6306307d-209b-40f7-b406-76e4a287b444 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1470 microversion: 2.1 time: 0.161550 Jul 02 21:05:18.939411 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 575/1220] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:18 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:19.034189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:19.034813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:19.041202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.041658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.042432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.042869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.067737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.081562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d6d412dc-42a6-4fd8-9725-ac2e3807c6b0 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1512 microversion: 2.1 time: 0.162871 Jul 02 21:05:19.085601 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 646/1221] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:18 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:19.178370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.187211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.188749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.189934 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba3d0805-1b7d-46cf-b05b-c86478bd8fc5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.159813 Jul 02 21:05:19.190502 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 576/1222] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:19 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:19.338029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:19.338680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:19.345850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.346357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.347133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.347577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.621147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.630957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.632489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:19.633683 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a1fe1a72-7691-4391-911f-12e2f6501210 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.299562 Jul 02 21:05:19.634568 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 647/1223] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:19 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:19.652471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:19.653078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:19.667962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.667962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.667962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.667962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.675577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:19.676337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:19.682734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.683441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.684434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.685026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.713735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:19.815266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03013069-a055-419d-90e4-afcf0f722d7b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 204 len: 0 microversion: 2.1 time: 0.142905 Jul 02 21:05:19.821308 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 648/1224] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:19 2022] DELETE /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:19.828197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:19.829141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:19.836085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.836574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.837284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:19.838267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:19.993409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.002612 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6744fba-f5ec-4720-9ce4-c877cbff142c tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.355063 Jul 02 21:05:20.003789 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 577/1225] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:19 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:20.015375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:20.016113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:20.023487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.023943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.024775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.025212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.131254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.169065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9d83230-b79b-4906-9bd5-56b44a10d59d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.337117 Jul 02 21:05:20.170071 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 649/1226] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:19 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:20.175487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:20.176150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:20.184645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.185306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.186262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.186882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.305858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.314253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-245e299d-2d98-4578-b595-f3d4baf21e77 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1428 microversion: 2.1 time: 0.143011 Jul 02 21:05:20.314853 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 650/1227] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:20 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1428 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:20.320609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:20.321224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:20.327821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.328562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.329544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.330149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.331031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.342188 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80cb4c67-170c-41bd-944a-2208ac5f7c22 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1551 microversion: 2.1 time: 0.332294 Jul 02 21:05:20.342773 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 578/1228] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:20 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1551 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:20.347773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:20.348672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:20.356330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.356871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.357744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.359163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.397678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.406141 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a60de1e4-1ad5-4612-a3ca-440862694a52 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1470 microversion: 2.1 time: 0.089560 Jul 02 21:05:20.406732 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 651/1229] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:20 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1470 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:20.412111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ba9ea140-e11c-401a-beda-38d8818bdf3b req-06f7699f-bb58-4c7e-9236-7ae8102d18e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e1556a-3d1a-44b0-8761-df5386dfe109", "name": "network-vif-deleted", "tag": "04b93777-00c4-469f-beea-74a97e6f5a06"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:20.420313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ba9ea140-e11c-401a-beda-38d8818bdf3b req-06f7699f-bb58-4c7e-9236-7ae8102d18e9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.420761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ba9ea140-e11c-401a-beda-38d8818bdf3b req-06f7699f-bb58-4c7e-9236-7ae8102d18e9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.432537 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ba9ea140-e11c-401a-beda-38d8818bdf3b req-06f7699f-bb58-4c7e-9236-7ae8102d18e9 service nova] Creating event network-vif-deleted:04b93777-00c4-469f-beea-74a97e6f5a06 for instance 52e1556a-3d1a-44b0-8761-df5386dfe109 on nch2-master-1 Jul 02 21:05:20.437866 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ba9ea140-e11c-401a-beda-38d8818bdf3b req-06f7699f-bb58-4c7e-9236-7ae8102d18e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029645 Jul 02 21:05:20.438507 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 652/1230] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:20.446929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-25429be8-cf9a-4bf0-ba47-21f07b87ff44 req-4faa7528-8a5b-414e-8765-935617f1a801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899cd575-ce36-4ba9-b0a3-5d4704088bf1", "name": "network-vif-deleted", "tag": "e65b2ade-ed92-4c7c-a3c0-c39004944454"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:20.456161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-25429be8-cf9a-4bf0-ba47-21f07b87ff44 req-4faa7528-8a5b-414e-8765-935617f1a801 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.456798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-25429be8-cf9a-4bf0-ba47-21f07b87ff44 req-4faa7528-8a5b-414e-8765-935617f1a801 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.470135 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-25429be8-cf9a-4bf0-ba47-21f07b87ff44 req-4faa7528-8a5b-414e-8765-935617f1a801 service nova] Creating event network-vif-deleted:e65b2ade-ed92-4c7c-a3c0-c39004944454 for instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 on nch2-master-1 Jul 02 21:05:20.475416 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-25429be8-cf9a-4bf0-ba47-21f07b87ff44 req-4faa7528-8a5b-414e-8765-935617f1a801 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Jul 02 21:05:20.476022 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 653/1231] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:20.545113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.556304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.557787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.558973 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77b0336e-affc-4b27-aaee-6c8b8067421b tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.214958 Jul 02 21:05:20.559874 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 579/1232] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:20 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:20.653779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:20.654540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:20.662491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.663063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.663850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:20.664311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:20.854125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.864786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.866336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:20.867469 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f639d54-c80f-454b-95f3-5df9d1f7fbe3 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.218726 Jul 02 21:05:20.868029 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 654/1233] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:20 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:21.023676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.024529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.034606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.035264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.036432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.037061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.186840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.187459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.194584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.195038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.195807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.196475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.305346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:21.314760 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69ed4a88-8c82-4c70-9b1d-c84cc30dd03e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1368 microversion: 2.1 time: 0.297152 Jul 02 21:05:21.315649 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 580/1234] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:21.330956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.331839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.339165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.339864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.340982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.341665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.394336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.394786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.395241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lazy-loading 'fault' on Instance uuid 899cd575-ce36-4ba9-b0a3-5d4704088bf1 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:21.409266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:21.417436 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-198e3584-920d-4944-a155-ffbe46775bfa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.234481 Jul 02 21:05:21.418827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 655/1235] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:21.424353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.425748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.431958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.432670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.433609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.434205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.441830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ee93cc6740d4e92b231f60d8b9d4450', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065f852898294f2c8a154eb8d5f498f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:21.450797 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53f148a9-a6ea-4758-87bc-49fbb4e99fb4 tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 200 len: 1305 microversion: 2.1 time: 0.123580 Jul 02 21:05:21.451384 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 581/1236] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:21.456405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.457194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.464597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.465175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.466059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.466636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.500379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.500909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.501435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lazy-loading 'fault' on Instance uuid 52e1556a-3d1a-44b0-8761-df5386dfe109 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:21.837098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16a9c9e35954d579536375f7eab1c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c4a0acce7ef425b93c417e1a8fccf78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:21.848457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71aec7c9-7be0-4ae1-b8e2-c21758839939 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 200 len: 1307 microversion: 2.1 time: 0.395276 Jul 02 21:05:21.850499 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 582/1237] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:21.856265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.859863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.867167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.867837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.869064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.869952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.901384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:21.911110 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-abe1cb46-7582-4747-8fd8-ce7cd84ccc0c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1551 microversion: 2.1 time: 0.490962 Jul 02 21:05:21.912308 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 656/1238] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1551 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:21.917349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:21.918140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:21.926489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.927147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:21.927934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:21.928402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.255271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.271512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.272948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.276063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.277609 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7809869b-878c-42e2-85f8-bde656fe6da9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.425911 Jul 02 21:05:22.279153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 583/1239] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:22.284964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.286822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.288663 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4b244d24-dbf4-48a0-8578-f06f5369ade5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.375173 Jul 02 21:05:22.297684 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 657/1240] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:21 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:22.332368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.332997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.339347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.339718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.340526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.340955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.345499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:22.436436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.437484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.444259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.444981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.445931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.446438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.471680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:22.738624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.749704 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3811f5f5-f58f-4823-b70d-e3c407e37008 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1558 microversion: 2.1 time: 0.422592 Jul 02 21:05:22.750975 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 584/1241] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:22 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1558 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:22.757061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-23db17e9-ba11-4456-bf0e-f01e118ff2ae req-6c72f8c5-f9bf-4776-9af2-2f84b5a45337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "name": "network-vif-unplugged", "status": "completed", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:22.767320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-23db17e9-ba11-4456-bf0e-f01e118ff2ae req-6c72f8c5-f9bf-4776-9af2-2f84b5a45337 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.768141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-23db17e9-ba11-4456-bf0e-f01e118ff2ae req-6c72f8c5-f9bf-4776-9af2-2f84b5a45337 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.788208 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-23db17e9-ba11-4456-bf0e-f01e118ff2ae req-6c72f8c5-f9bf-4776-9af2-2f84b5a45337 service nova] Creating event network-vif-unplugged:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch2-master-1 Jul 02 21:05:22.794195 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-23db17e9-ba11-4456-bf0e-f01e118ff2ae req-6c72f8c5-f9bf-4776-9af2-2f84b5a45337 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041694 Jul 02 21:05:22.794816 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 585/1242] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:22.800899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.801786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] [instance: 899cd575-ce36-4ba9-b0a3-5d4704088bf1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.806808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:22.809236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.809863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.810643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.811053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.821060 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-179a30d9-0e38-4aea-b1d6-28c7f3f4ac17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.389089 Jul 02 21:05:22.821878 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 658/1243] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:22 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:22.828869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.829726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.834990 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] HTTP exception thrown: Instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 could not be found. Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Request method failure captured: Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 HTTP/1.1 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIvKx-qmaC8RcdMtYfPnCLI0Y_w9Ba_6zoM-sjVLzFgyeCdQBJf71T2Fl9uER9saAE3V6hWXbWzQVZK_7vS92Lp81jb_XyJtY497_koZrA5Ay5bADpH8mPA1rJax_QBq9rbC8euEycoEjupnVnvue7DfNjcodsl8K2mn5oXlGSpmYM Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_065f852898294f2c8a154eb8d5f498f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/065f852898294f2c8a154eb8d5f498f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/065f852898294f2c8a154eb8d5f498f0"}]}] Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 065f852898294f2c8a154eb8d5f498f0 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-487665068 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9ee93cc6740d4e92b231f60d8b9d4450 Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersOnMultiNodesTest-487665068-project Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 could not be found. Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '899cd575-ce36-4ba9-b0a3-5d4704088bf1'} Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 could not be found. Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 could not be found. Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:22.836867 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 could not be found. Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] Returning 404 to user: Instance 899cd575-ce36-4ba9-b0a3-5d4704088bf1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:22.841801 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-779c484e-09f2-4a7a-8e3e-59f1abcf28cc tempest-ServersOnMultiNodesTest-487665068 tempest-ServersOnMultiNodesTest-487665068-project] 10.222.0.43 "GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1" status: 404 len: 111 microversion: 2.1 time: 0.042380 Jul 02 21:05:22.844737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.845711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.848249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.848455 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 586/1244] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:22 2022] GET /compute/v2.1/servers/899cd575-ce36-4ba9-b0a3-5d4704088bf1 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:22.848877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.867561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.868234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 52e1556a-3d1a-44b0-8761-df5386dfe109] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.876682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.876682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.877635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.878075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.901817 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] HTTP exception thrown: Instance 52e1556a-3d1a-44b0-8761-df5386dfe109 could not be found. Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Request method failure captured: Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 HTTP/1.1 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJfBHl8J4yoQhlGWaYWXWAwBEPc6noNlmU1LUQvnjDZbxJ-DAwrH4NmxSbUxawj49wUz0s_YxokOQvI4bunRuviW5AHr9J97t6IT0drR61u_qgWbQO67LGALnpe7mOtIAz5rgk4uVxGiW4E4KwyT05mFLsPuaY2SPQIuTq1WkPeRBM Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4c4a0acce7ef425b93c417e1a8fccf78", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4c4a0acce7ef425b93c417e1a8fccf78"}]}] Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b16a9c9e35954d579536375f7eab1c9b Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 52e1556a-3d1a-44b0-8761-df5386dfe109 could not be found. Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '52e1556a-3d1a-44b0-8761-df5386dfe109'} Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e1556a-3d1a-44b0-8761-df5386dfe109 could not be found. Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e1556a-3d1a-44b0-8761-df5386dfe109 could not be found. Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:22.903309 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e1556a-3d1a-44b0-8761-df5386dfe109 could not be found. Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Returning 404 to user: Instance 52e1556a-3d1a-44b0-8761-df5386dfe109 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:22.908454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1497021f-0daf-4c8f-8d94-f2735679b1c6 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109" status: 404 len: 111 microversion: 2.1 time: 0.044418 Jul 02 21:05:22.909278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 587/1245] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:22 2022] GET /compute/v2.1/servers/52e1556a-3d1a-44b0-8761-df5386dfe109 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:05:22.925259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.925765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.932019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.944806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.945663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.946100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.961763 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] HTTP exception thrown: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Request method failure captured: Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 HTTP/1.1 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJfBHl8J4yoQhlGWaYWXWAwBEPc6noNlmU1LUQvnjDZbxJ-DAwrH4NmxSbUxawj49wUz0s_YxokOQvI4bunRuviW5AHr9J97t6IT0drR61u_qgWbQO67LGALnpe7mOtIAz5rgk4uVxGiW4E4KwyT05mFLsPuaY2SPQIuTq1WkPeRBM Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4c4a0acce7ef425b93c417e1a8fccf78", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4c4a0acce7ef425b93c417e1a8fccf78"}]}] Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b16a9c9e35954d579536375f7eab1c9b Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8b7a681c-3f21-4191-9f0f-993efe27f5a7'} Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:22.964517 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:22.969365 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:22.971780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Returning 404 to user: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:22.972840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9f80551-d418-4596-95e5-2a83701a4e9b tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 404 len: 111 microversion: 2.1 time: 0.051792 Jul 02 21:05:22.977754 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 588/1246] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:22 2022] DELETE /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:22.983081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:22.984653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:22.993682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.997366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:22.999141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:22.999648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.000394 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a27531ac-3888-4709-9634-6f0d379ed72a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177150 Jul 02 21:05:23.007175 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 659/1247] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:05:22 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:23.017573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:23.018216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: 8b7a681c-3f21-4191-9f0f-993efe27f5a7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:23.028271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.028904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.031002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.033284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.050155 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] HTTP exception thrown: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Request method failure captured: Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 HTTP/1.1 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJfBHl8J4yoQhlGWaYWXWAwBEPc6noNlmU1LUQvnjDZbxJ-DAwrH4NmxSbUxawj49wUz0s_YxokOQvI4bunRuviW5AHr9J97t6IT0drR61u_qgWbQO67LGALnpe7mOtIAz5rgk4uVxGiW4E4KwyT05mFLsPuaY2SPQIuTq1WkPeRBM Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4c4a0acce7ef425b93c417e1a8fccf78", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4c4a0acce7ef425b93c417e1a8fccf78"}]}] Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b16a9c9e35954d579536375f7eab1c9b Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8b7a681c-3f21-4191-9f0f-993efe27f5a7'} Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:23.052371 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. Jul 02 21:05:23.056817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.058908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Returning 404 to user: Instance 8b7a681c-3f21-4191-9f0f-993efe27f5a7 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:23.060006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e01dd582-0bfb-4aac-98cb-8b7869638888 tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7" status: 404 len: 111 microversion: 2.1 time: 0.057221 Jul 02 21:05:23.061170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 660/1248] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:23 2022] GET /compute/v2.1/servers/8b7a681c-3f21-4191-9f0f-993efe27f5a7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:23.069774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:23.071133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:23.079971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.096084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.097383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.098092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.105609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.113907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] HTTP exception thrown: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Request method failure captured: Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf HTTP/1.1 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJfBHl8J4yoQhlGWaYWXWAwBEPc6noNlmU1LUQvnjDZbxJ-DAwrH4NmxSbUxawj49wUz0s_YxokOQvI4bunRuviW5AHr9J97t6IT0drR61u_qgWbQO67LGALnpe7mOtIAz5rgk4uVxGiW4E4KwyT05mFLsPuaY2SPQIuTq1WkPeRBM Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4c4a0acce7ef425b93c417e1a8fccf78", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4c4a0acce7ef425b93c417e1a8fccf78"}]}] Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b16a9c9e35954d579536375f7eab1c9b Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ca237da0-7482-4d58-bf6d-9195648cc8cf'} Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:23.115769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Returning 404 to user: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf0d5b0d-bd83-44ef-8057-dfa75c8b5f9f tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 404 len: 111 microversion: 2.1 time: 0.052078 Jul 02 21:05:23.120420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 661/1249] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:23 2022] DELETE /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:23.125520 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73f49af9-7bb2-49b3-bd59-9ee39d1cb274 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 200 len: 1345 microversion: 2.1 time: 0.145629 Jul 02 21:05:23.126120 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 589/1250] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:22 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 1345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:23.127615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:23.127753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] [instance: ca237da0-7482-4d58-bf6d-9195648cc8cf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:23.135919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.135919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.136892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.137388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.152823 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] HTTP exception thrown: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Request method failure captured: Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf HTTP/1.1 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJfBHl8J4yoQhlGWaYWXWAwBEPc6noNlmU1LUQvnjDZbxJ-DAwrH4NmxSbUxawj49wUz0s_YxokOQvI4bunRuviW5AHr9J97t6IT0drR61u_qgWbQO67LGALnpe7mOtIAz5rgk4uVxGiW4E4KwyT05mFLsPuaY2SPQIuTq1WkPeRBM Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4c4a0acce7ef425b93c417e1a8fccf78", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4c4a0acce7ef425b93c417e1a8fccf78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4c4a0acce7ef425b93c417e1a8fccf78"}]}] Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4c4a0acce7ef425b93c417e1a8fccf78 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219518979 Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b16a9c9e35954d579536375f7eab1c9b Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219518979-project Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ca237da0-7482-4d58-bf6d-9195648cc8cf'} Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:23.154642 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] Returning 404 to user: Instance ca237da0-7482-4d58-bf6d-9195648cc8cf could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-43d4d6d8-b4c6-4f03-b684-9dcb8fde716c tempest-ServerDiskConfigTestJSON-1219518979 tempest-ServerDiskConfigTestJSON-1219518979-project] 10.222.0.43 "GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf" status: 404 len: 111 microversion: 2.1 time: 0.033900 Jul 02 21:05:23.161521 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 662/1251] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:23 2022] GET /compute/v2.1/servers/ca237da0-7482-4d58-bf6d-9195648cc8cf => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:23.297123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:23.297940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:23.304606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.305385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.306406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.306611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:23.307078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.312388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:23.318620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.319601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.321164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.321818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.926344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.938759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.941406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.943412 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c639ea0-355c-4cf4-9b05-2560a4716d22 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.650609 Jul 02 21:05:23.955235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 590/1252] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:23 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:23.959749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.960527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:23.961163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:23.967967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.968860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.969211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.969956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:23.971112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:23.971296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:23.972684 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80d8d459-0116-49d6-9de5-890940d5eb22 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.669963 Jul 02 21:05:23.984547 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 663/1253] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:23 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:24.142672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:24.143581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:24.150760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.151413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:24.152421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.153037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:24.169338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c HTTP/1.1 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '613c35f3-cde8-4e12-962d-d43f9fed716c'} Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:24.171160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-499feb83-a17b-4373-a4fc-a8bd34a85ea8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 404 len: 111 microversion: 2.1 time: 0.034175 Jul 02 21:05:24.178012 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 664/1254] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:24 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:05:24.298336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:24.299623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:24.307562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.308756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:24.309707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.310297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:24.327209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c/os-volume_attachments HTTP/1.1 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'server_id': '613c35f3-cde8-4e12-962d-d43f9fed716c'} Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:24.330244 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:05:24.334512 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:24.337070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:24.338368 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db780e6c-37ae-4490-897b-a65d14c13f72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044142 Jul 02 21:05:24.339196 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 665/1255] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:05:24 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:24.457485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:24.487769 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75f87edf-8ab3-4a63-afd6-54d8c389d011 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.529696 Jul 02 21:05:24.497791 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 591/1256] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:23 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:24.590879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1704221544", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:24.653777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:24.810238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-02dadc54-b37d-4cee-9893-81995c1cad9a req-cc593c62-232b-4326-9e58-d1e1f4753a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "613c35f3-cde8-4e12-962d-d43f9fed716c", "name": "network-vif-deleted", "tag": "760a2034-9f29-4a85-ada6-2c3addbfcb4c"}, {"name": "network-changed", "server_uuid": "1bc8e287-b938-43c3-8d6d-342220d0319a", "tag": "9483df73-5f9d-4c45-be57-eeb24fa4b6fa"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:24.820883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-02dadc54-b37d-4cee-9893-81995c1cad9a req-cc593c62-232b-4326-9e58-d1e1f4753a65 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.821588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-02dadc54-b37d-4cee-9893-81995c1cad9a req-cc593c62-232b-4326-9e58-d1e1f4753a65 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:24.836208 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-02dadc54-b37d-4cee-9893-81995c1cad9a req-cc593c62-232b-4326-9e58-d1e1f4753a65 service nova] Creating event network-vif-deleted:760a2034-9f29-4a85-ada6-2c3addbfcb4c for instance 613c35f3-cde8-4e12-962d-d43f9fed716c on nch2-master-1 Jul 02 21:05:24.836935 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-02dadc54-b37d-4cee-9893-81995c1cad9a req-cc593c62-232b-4326-9e58-d1e1f4753a65 service nova] Creating event network-changed:9483df73-5f9d-4c45-be57-eeb24fa4b6fa for instance 1bc8e287-b938-43c3-8d6d-342220d0319a on nch1-master-1 Jul 02 21:05:24.845708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-02dadc54-b37d-4cee-9893-81995c1cad9a req-cc593c62-232b-4326-9e58-d1e1f4753a65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039111 Jul 02 21:05:24.846930 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 592/1257] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:05:24.964716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:24.965609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:24.972928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.973668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:24.974552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:24.975062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.265590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:25.275057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:25.277064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:25.278534 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8148e87-5718-4d7c-8401-2a401b99b5cc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.319137 Jul 02 21:05:25.279713 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 593/1258] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:24 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:25.285464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:25.286631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:25.293754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:25.294477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.295935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:25.296497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.700231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:25.712253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:25.714045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:25.715228 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-184cc892-466f-4dd0-b656-7430577daee5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.434166 Jul 02 21:05:25.715971 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 594/1259] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:25 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:25.733552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:25.734444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:25.742447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:25.743182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.748137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:25.749092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.801582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:25.802113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:25.803300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:25.803803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:25.804373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:25.817376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:25.817924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.818949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:25.819461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:25.843296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:25.850325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:25.870125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:25.872788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:25.926495 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9245ea60-eec0-4649-9645-7395e45f4406 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339735 Jul 02 21:05:25.927985 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 666/1260] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:25.943720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9a32d36-efad-4110-aecc-badd71a73c9e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:25.944639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9a32d36-efad-4110-aecc-badd71a73c9e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:26.094060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9a32d36-efad-4110-aecc-badd71a73c9e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:26.103146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:26.112954 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9a32d36-efad-4110-aecc-badd71a73c9e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4" status: 200 len: 1215 microversion: 2.1 time: 0.176335 Jul 02 21:05:26.113783 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 667/1261] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:25 2022] GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 => generated 1215 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:26.114053 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-794b8fa9-f705-4c65-99f5-6311269b9469 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1541 microversion: 2.1 time: 0.386394 Jul 02 21:05:26.114777 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 595/1262] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:25 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1541 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:26.129150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7a51a7d-d7d5-41ea-8bc3-aa97790d4e00 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:26.129727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7a51a7d-d7d5-41ea-8bc3-aa97790d4e00 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:26.158506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7a51a7d-d7d5-41ea-8bc3-aa97790d4e00 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:26.163009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:26.298920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:26.300094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:26.312500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:26.318204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:26.322348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:26.323031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:26.614444 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.compute.api [None req-e7a51a7d-d7d5-41ea-8bc3-aa97790d4e00 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Instance Mapping does not exist while attempting local delete cleanup. Jul 02 21:05:26.615454 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7a51a7d-d7d5-41ea-8bc3-aa97790d4e00 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4" status: 204 len: 0 microversion: 2.1 time: 0.490174 Jul 02 21:05:26.616379 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 668/1263] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:26 2022] DELETE /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:26.639471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71510755-f63d-4bf2-aa3a-37c9604728af tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:26.640133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-71510755-f63d-4bf2-aa3a-37c9604728af tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:26.645998 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-71510755-f63d-4bf2-aa3a-37c9604728af tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71510755-f63d-4bf2-aa3a-37c9604728af tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 HTTP/1.1 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4'} Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.654534 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71510755-f63d-4bf2-aa3a-37c9604728af tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71510755-f63d-4bf2-aa3a-37c9604728af tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4" status: 404 len: 111 microversion: 2.1 time: 0.035589 Jul 02 21:05:26.659183 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 669/1264] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:26 2022] GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:26.827260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:26.841785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:26.846208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:26.847433 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1bbc004-1b2e-4d4c-8849-756b98edd823 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1813 microversion: 2.25 time: 0.554085 Jul 02 21:05:26.847995 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 596/1265] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:26 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1813 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:26.862609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:26.863226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:26.874405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:26.875084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:26.876079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:26.876668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:26.896530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Action: 'update', calling method: .version_select at 0x7fabe4616ee0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:26.899308 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:26.899308 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:26.901835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:26.902621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:26.915877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:26.916852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:26.925484 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] HTTP exception thrown: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Request method failure captured: Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 HTTP/1.1 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 56 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLMWuSzyQi1WA8unjHFiD7IqL3aGWzPR3nQR_wKSqCLkttYLNNlWjB4Ua3Mnq3d0VoHDyHCpGF3Fm2O2cZYifXEWs9sdllOTLACeAr_mzzIa1zUjJgpysUSnHnE-8iR3ZfJDKsJCDj3TatKGZJewsk-IKkySKrR23Fr8sd19GodVbpE Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.53 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9321670224b549749cc13233ffbe4c4e Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9321670224b549749cc13233ffbe4c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9321670224b549749cc13233ffbe4c4e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9321670224b549749cc13233ffbe4c4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9321670224b549749cc13233ffbe4c4e"}]}] Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9321670224b549749cc13233ffbe4c4e Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3ffef0a840204a60852740f8e80ddda0 Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: exception: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:05:26.927900 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:26.933051 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:26.935461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Returning 404 to user: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:26.936613 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca967e67-b253-4181-a8b8-1dcf6b042f4e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01" status: 404 len: 110 microversion: 2.53 time: 0.213116 Jul 02 21:05:26.937784 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 670/1266] 10.222.0.43 () {62 vars in 1308 bytes} [Sat Jul 2 21:05:26 2022] PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 => generated 110 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:05:26.945516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1496773875", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:27.009652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:27.268000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:27.286481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:27.288337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:27.290033 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-014a59f4-567c-45c9-a72b-54c0e9942e1d tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.438648 Jul 02 21:05:27.291341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 597/1267] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:26 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:27.297077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Action: 'update', calling method: .version_select at 0x7fabe46564c0>, body: {"status": "disabled"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:27.299427 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:27.299427 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:05:27.301337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:27.302143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:27.313087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:27.314989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:27.327845 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] HTTP exception thrown: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Request method failure captured: Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 HTTP/1.1 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 22 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLMWuSzyQi1WA8unjHFiD7IqL3aGWzPR3nQR_wKSqCLkttYLNNlWjB4Ua3Mnq3d0VoHDyHCpGF3Fm2O2cZYifXEWs9sdllOTLACeAr_mzzIa1zUjJgpysUSnHnE-8iR3ZfJDKsJCDj3TatKGZJewsk-IKkySKrR23Fr8sd19GodVbpE Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.53 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9321670224b549749cc13233ffbe4c4e Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9321670224b549749cc13233ffbe4c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9321670224b549749cc13233ffbe4c4e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9321670224b549749cc13233ffbe4c4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9321670224b549749cc13233ffbe4c4e"}]}] Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9321670224b549749cc13233ffbe4c4e Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3ffef0a840204a60852740f8e80ddda0 Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: {"status": "disabled"} Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: exception: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01', 'body': {'status': 'disabled'}} Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:05:27.331453 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:27.335719 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:27.339688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Returning 404 to user: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:27.342499 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d291ec4-70bb-4488-9648-575c9d0b035f tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01" status: 404 len: 110 microversion: 2.53 time: 0.049788 Jul 02 21:05:27.351034 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 598/1268] 10.222.0.43 () {62 vars in 1308 bytes} [Sat Jul 2 21:05:27 2022] PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 => generated 110 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:05:27.357825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:27.359262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:27.368683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:27.369470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:27.371355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:27.372362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.221259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:28.235089 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df4c88c2-c9dc-40e2-9797-f6e951f9cc53 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1540 microversion: 2.1 time: 0.880967 Jul 02 21:05:28.236717 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 599/1269] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:27 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1540 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:28.248163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Action: 'update', calling method: .version_select at 0x7fabe45e4790>, body: {"status": "enabled"} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:28.250328 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:28.250328 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:05:28.256290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.256843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.272331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.273618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.285054 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] HTTP exception thrown: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Request method failure captured: Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 HTTP/1.1 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 21 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLMWuSzyQi1WA8unjHFiD7IqL3aGWzPR3nQR_wKSqCLkttYLNNlWjB4Ua3Mnq3d0VoHDyHCpGF3Fm2O2cZYifXEWs9sdllOTLACeAr_mzzIa1zUjJgpysUSnHnE-8iR3ZfJDKsJCDj3TatKGZJewsk-IKkySKrR23Fr8sd19GodVbpE Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.53 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9321670224b549749cc13233ffbe4c4e Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9321670224b549749cc13233ffbe4c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9321670224b549749cc13233ffbe4c4e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9321670224b549749cc13233ffbe4c4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9321670224b549749cc13233ffbe4c4e"}]}] Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9321670224b549749cc13233ffbe4c4e Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3ffef0a840204a60852740f8e80ddda0 Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: {"status": "enabled"} Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: exception: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01', 'body': {'status': 'enabled'}} Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:05:28.290170 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. Jul 02 21:05:28.294482 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:28.296748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Returning 404 to user: Service 9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:28.297923 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc2f0769-bbf8-49d5-85d6-0348b7f8652a tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01" status: 404 len: 110 microversion: 2.53 time: 0.060221 Jul 02 21:05:28.299064 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 600/1270] 10.222.0.43 () {62 vars in 1308 bytes} [Sat Jul 2 21:05:28 2022] PUT /compute/v2.1/os-services/9687e4fc-1e7f-44b0-9c2a-f96a1cc73a01 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:05:28.304354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-aa29d3be-c2d1-463d-b890-4de9ac042c45 req-fd20ac35-7ecf-44f2-a3ae-89ca77a596ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "name": "network-vif-unplugged", "status": "completed", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:28.314390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aa29d3be-c2d1-463d-b890-4de9ac042c45 req-fd20ac35-7ecf-44f2-a3ae-89ca77a596ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.315176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aa29d3be-c2d1-463d-b890-4de9ac042c45 req-fd20ac35-7ecf-44f2-a3ae-89ca77a596ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.324101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:28.324764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:28.324972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:28.325707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:28.326286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:28.338953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.339793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.340447 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-aa29d3be-c2d1-463d-b890-4de9ac042c45 req-fd20ac35-7ecf-44f2-a3ae-89ca77a596ce service nova] Creating event network-vif-unplugged:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch1-master-1 Jul 02 21:05:28.341009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.341753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.358095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-aa29d3be-c2d1-463d-b890-4de9ac042c45 req-fd20ac35-7ecf-44f2-a3ae-89ca77a596ce service nova] Instance 2adc9c67-dec2-437a-825d-5bb427ac75df is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:05:28.374955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:28.384089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:28.396120 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-aa29d3be-c2d1-463d-b890-4de9ac042c45 req-fd20ac35-7ecf-44f2-a3ae-89ca77a596ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095225 Jul 02 21:05:28.398579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 601/1271] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:28.403866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:28.406585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:28.409642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:28.414764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:28.431976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.434447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.435377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.436496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.485341 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4eef268d-235a-4901-add6-9cdac29f6186 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.546141 Jul 02 21:05:28.486749 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 671/1272] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:28.493113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:28.494103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:28.502827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.503858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:28.505324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:28.505938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.191116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.205257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.211669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.213064 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-065e0f40-52ab-4a2e-9b54-17006b07f274 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1803 microversion: 2.25 time: 0.810826 Jul 02 21:05:29.216490 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 602/1273] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:28 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1803 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.226088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5282081a-77e5-4a53-93ed-ad81b4f429e8 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.231384 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:29.231384 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:05:29.233657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5282081a-77e5-4a53-93ed-ad81b4f429e8 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.234414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5282081a-77e5-4a53-93ed-ad81b4f429e8 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.235733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5282081a-77e5-4a53-93ed-ad81b4f429e8 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.236597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5282081a-77e5-4a53-93ed-ad81b4f429e8 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.267568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.289693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.290776 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5282081a-77e5-4a53-93ed-ad81b4f429e8 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.073120 Jul 02 21:05:29.292657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 603/1274] 10.222.0.43 () {60 vars in 1177 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.293558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.296965 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b39b5b93-8134-4a7b-9b9c-0cf9fa049084 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.809018 Jul 02 21:05:29.297618 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 672/1275] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:28 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.313687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.314497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-77f5698e-39a6-4874-8ba8-3203c08298dd tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '.version_select at 0x7fabe45cde50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.315199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:29.318409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77f5698e-39a6-4874-8ba8-3203c08298dd tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.318954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77f5698e-39a6-4874-8ba8-3203c08298dd tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.334807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.335660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.336954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.340362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.344403 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-77f5698e-39a6-4874-8ba8-3203c08298dd tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 2791 microversion: 2.25 time: 0.042877 Jul 02 21:05:29.345181 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 673/1276] 10.222.0.43 () {60 vars in 1183 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-migrations => generated 2791 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.370273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.370922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:29.378860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.380692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.381680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.383761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.479332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.490641 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f0ef47d-5ec9-4a4f-a289-c44b947b43a6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1219 microversion: 2.1 time: 0.196554 Jul 02 21:05:29.493184 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 604/1277] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1219 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:29.504920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d92461db-1710-4cc2-b7c2-0ba860f293e0 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.507391 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:29.507391 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:05:29.510124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d92461db-1710-4cc2-b7c2-0ba860f293e0 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.511013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d92461db-1710-4cc2-b7c2-0ba860f293e0 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.512976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d92461db-1710-4cc2-b7c2-0ba860f293e0 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.513464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d92461db-1710-4cc2-b7c2-0ba860f293e0 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.550799 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d92461db-1710-4cc2-b7c2-0ba860f293e0 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.056287 Jul 02 21:05:29.552354 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 605/1278] 10.222.0.43 () {60 vars in 1210 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.563538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.564233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:29.570981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.571536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.572368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.573447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.730431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:29.740256 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c87fab8d-eb49-4fd2-a26e-a9c58ec44f26 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1472 microversion: 2.1 time: 0.393887 Jul 02 21:05:29.751574 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 674/1279] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:29.757145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e04a2ad0-6bf3-4867-89af-852315f5fa71 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.758466 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:29.758466 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:29.759857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e04a2ad0-6bf3-4867-89af-852315f5fa71 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.760458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e04a2ad0-6bf3-4867-89af-852315f5fa71 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.761448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e04a2ad0-6bf3-4867-89af-852315f5fa71 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.762097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e04a2ad0-6bf3-4867-89af-852315f5fa71 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.787797 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e04a2ad0-6bf3-4867-89af-852315f5fa71 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.034602 Jul 02 21:05:29.789100 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 675/1280] 10.222.0.43 () {60 vars in 1177 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.800972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e392db5-dfc8-40ae-a6dc-e514e4d9842e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.802568 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:29.802568 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:29.804019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e392db5-dfc8-40ae-a6dc-e514e4d9842e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.804798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e392db5-dfc8-40ae-a6dc-e514e4d9842e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.805851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e392db5-dfc8-40ae-a6dc-e514e4d9842e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.806503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e392db5-dfc8-40ae-a6dc-e514e4d9842e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.832802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e392db5-dfc8-40ae-a6dc-e514e4d9842e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.035538 Jul 02 21:05:29.833416 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 676/1281] 10.222.0.43 () {60 vars in 1236 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:29.845777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a5d9bef-23e2-4485-9773-884f3d2c6b03 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.848084 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:29.848084 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:29.849715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a5d9bef-23e2-4485-9773-884f3d2c6b03 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.850407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a5d9bef-23e2-4485-9773-884f3d2c6b03 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.851470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a5d9bef-23e2-4485-9773-884f3d2c6b03 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.852226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a5d9bef-23e2-4485-9773-884f3d2c6b03 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.857346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 1731cd23-3195-40b5-a9da-1015e9f8b964 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:29.880366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:29.886816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01c379f7-2582-4745-83e7-5d390dbae9e1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 2422 microversion: 2.25 time: 0.332936 Jul 02 21:05:29.889086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9a5d9bef-23e2-4485-9773-884f3d2c6b03 tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.047997 Jul 02 21:05:29.890683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 677/1282] 10.222.0.43 () {60 vars in 1177 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:29.900268 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 606/1283] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 2422 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:29.906244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce0dd978-5b77-4a76-ab6b-8bf9f6c5583e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.908502 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:29.908502 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:29.910142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0dd978-5b77-4a76-ab6b-8bf9f6c5583e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.912564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0dd978-5b77-4a76-ab6b-8bf9f6c5583e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.916736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0dd978-5b77-4a76-ab6b-8bf9f6c5583e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.917285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0dd978-5b77-4a76-ab6b-8bf9f6c5583e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.917655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:29.918286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:29.935438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.935922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.936963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:29.943005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:29.961706 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce0dd978-5b77-4a76-ab6b-8bf9f6c5583e tempest-ServicesAdminNegativeV253TestJSON-162754349 tempest-ServicesAdminNegativeV253TestJSON-162754349-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.063215 Jul 02 21:05:29.963292 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 678/1284] 10.222.0.43 () {60 vars in 1238 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:30.217035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11815d9a-a117-43ad-a393-39162f137230 tempest-ServicesAdminNegativeV253TestJSON-1484730569 tempest-ServicesAdminNegativeV253TestJSON-1484730569-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:30.218508 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:30.218508 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:30.219688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11815d9a-a117-43ad-a393-39162f137230 tempest-ServicesAdminNegativeV253TestJSON-1484730569 tempest-ServicesAdminNegativeV253TestJSON-1484730569-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd5164f71494648a881073054de361a50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecfdf4cd98424466b843358ec3837dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11815d9a-a117-43ad-a393-39162f137230 tempest-ServicesAdminNegativeV253TestJSON-1484730569 tempest-ServicesAdminNegativeV253TestJSON-1484730569-project] Request method failure captured: Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLMVuJV4Pp93Xfmz7jHP7-IGgqk6jpUKLKV35FssMj4_wOz3YGho9zb3bZei6Nf60_4_0bfdCptKq-3UKi2MKtWiNv8RwQWVjcKKI2JPhquOI656ssUpnXZM9jbPGI-csAbnr1eck8yj-vXU2hAemqGciE5-IUZ-lazMEsPOSW4mw44 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.53 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ecfdf4cd98424466b843358ec3837dac Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1484730569 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecfdf4cd98424466b843358ec3837dac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecfdf4cd98424466b843358ec3837dac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecfdf4cd98424466b843358ec3837dac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecfdf4cd98424466b843358ec3837dac"}]}] Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1484730569 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ecfdf4cd98424466b843358ec3837dac Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1484730569 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1484730569-project Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d5164f71494648a881073054de361a50 Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1484730569-project Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: action_args: {} Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 02 21:05:30.221483 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11815d9a-a117-43ad-a393-39162f137230 tempest-ServicesAdminNegativeV253TestJSON-1484730569 tempest-ServicesAdminNegativeV253TestJSON-1484730569-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11815d9a-a117-43ad-a393-39162f137230 tempest-ServicesAdminNegativeV253TestJSON-1484730569 tempest-ServicesAdminNegativeV253TestJSON-1484730569-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.250196 Jul 02 21:05:30.225619 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 679/1285] 10.222.0.43 () {60 vars in 1177 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:05:30.260418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 1731cd23-3195-40b5-a9da-1015e9f8b964 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:30.283116 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf0abfa5-993e-4778-ab01-11357540a1c1 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 2422 microversion: 2.25 time: 0.369469 Jul 02 21:05:30.284437 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 607/1286] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:29 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 2422 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:30.322005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:30.322734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:30.339059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.339585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.342911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.347498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.396430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:30.397164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:30.408915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.409695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.410674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.412589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.676104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lazy-loading 'services' on Instance uuid 1731cd23-3195-40b5-a9da-1015e9f8b964 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:30.699817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:30.714485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:30.716951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:30.722580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5cb143d8-de54-42b7-a85d-448d9d7bdc4f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.405604 Jul 02 21:05:30.736571 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 680/1287] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:30 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:30.744588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bd304461-93e8-431f-88c5-633e58489760 req-403fb112-b02a-4e95-9a51-00cadd1cc505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:30.768701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bd304461-93e8-431f-88c5-633e58489760 req-403fb112-b02a-4e95-9a51-00cadd1cc505 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.769330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bd304461-93e8-431f-88c5-633e58489760 req-403fb112-b02a-4e95-9a51-00cadd1cc505 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.785761 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bd304461-93e8-431f-88c5-633e58489760 req-403fb112-b02a-4e95-9a51-00cadd1cc505 service nova] Creating event network-changed:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch1-master-1 Jul 02 21:05:30.792879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-bd304461-93e8-431f-88c5-633e58489760 req-403fb112-b02a-4e95-9a51-00cadd1cc505 service nova] Instance 2adc9c67-dec2-437a-825d-5bb427ac75df is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:05:30.807642 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bd304461-93e8-431f-88c5-633e58489760 req-403fb112-b02a-4e95-9a51-00cadd1cc505 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068488 Jul 02 21:05:30.809754 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 681/1288] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:30.828390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:30.833338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:30.845390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.846114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.847513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.848176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.917303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e70f7ac-bf1c-41f2-8e65-a276fbe28095 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments/48d74eca-fcde-4742-9dbc-87d3e9f0e8c2" status: 202 len: 0 microversion: 2.25 time: 0.524691 Jul 02 21:05:30.917840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 608/1289] 10.222.0.43 () {60 vars in 1456 bytes} [Sat Jul 2 21:05:30 2022] DELETE /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments/48d74eca-fcde-4742-9dbc-87d3e9f0e8c2 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:05:30.932306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:30.936323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:30.950887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:30.962738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.963045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3172dfa1-9618-4fdd-b140-713164fc5ce8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1273 microversion: 2.1 time: 0.151677 Jul 02 21:05:30.963930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.964626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 682/1290] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:30 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1273 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:30.965680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.967794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.971288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:30.972745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:30.980808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.981588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:30.983756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:30.984409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:31.022073 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f34bf9f1-0568-4545-9965-868b81f6e4ee tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.056119 Jul 02 21:05:31.022932 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 683/1291] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:05:30 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:05:31.319004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:31.327419 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c078049a-255c-4fc0-b7e3-47aa16db4c6c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1472 microversion: 2.1 time: 0.401646 Jul 02 21:05:31.337364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 609/1292] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:30 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1472 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:31.749625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:31.750851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:31.766687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:31.767468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:31.768498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:31.769220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:31.986636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:31.987276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:32.004426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.004944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.005719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.006145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.081305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:32.091302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:32.105044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:32.106309 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d35d715-1fac-4f12-8f62-a143421e2a57 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.360600 Jul 02 21:05:32.107357 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 684/1293] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:31 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:32.122002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:32.123315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:32.131468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.131925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.134719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.135160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.323279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:32.334957 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71352e76-b553-451b-8c6d-7a07c81765f1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.351309 Jul 02 21:05:32.335669 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 610/1294] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:31 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:32.350290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:32.351405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:32.359055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.359745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.360909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.361553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.581439 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b9b69bd-eb20-4a60-b245-688681793409 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.472636 Jul 02 21:05:32.582975 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 685/1295] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:05:32 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments => generated 197 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:05:32.645759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:32.655914 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9eb7ca9b-0f7c-45b6-9edd-c6902072d45a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1472 microversion: 2.1 time: 0.309209 Jul 02 21:05:32.657321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 611/1296] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:32 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:32.834884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-45a87fe9-5b59-4dd6-ada2-2ba0f2e50f1a req-2dec6a62-4f2c-42d7-8089-f48628de68f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8438550e-5629-411b-af19-402f3032a1f2", "tag": "af177369-7f3e-4190-a2ae-25a09cb9648d"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:32.871813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-45a87fe9-5b59-4dd6-ada2-2ba0f2e50f1a req-2dec6a62-4f2c-42d7-8089-f48628de68f5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:32.872537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-45a87fe9-5b59-4dd6-ada2-2ba0f2e50f1a req-2dec6a62-4f2c-42d7-8089-f48628de68f5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:32.897605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-45a87fe9-5b59-4dd6-ada2-2ba0f2e50f1a req-2dec6a62-4f2c-42d7-8089-f48628de68f5 service nova] Creating event network-changed:af177369-7f3e-4190-a2ae-25a09cb9648d for instance 8438550e-5629-411b-af19-402f3032a1f2 on nch2-master-1 Jul 02 21:05:32.911172 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-45a87fe9-5b59-4dd6-ada2-2ba0f2e50f1a req-2dec6a62-4f2c-42d7-8089-f48628de68f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081402 Jul 02 21:05:32.914558 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 686/1297] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:33.125039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:33.125630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:33.133569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.134290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.135218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.135859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.352471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:33.353417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:33.366350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.368549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.370034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.371530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.438435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:33.449230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:33.451670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:33.453637 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee4d220e-f948-450f-a641-a5d6b63d8d11 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.332480 Jul 02 21:05:33.467616 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 612/1298] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:33 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:33.594655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:33.596670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:33.607830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.611314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:33.612251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.613455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.615435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.622187 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c6aa9ad1-9025-4a22-a733-0c511d691554 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.273214 Jul 02 21:05:33.633067 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 687/1299] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:33 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:33.662685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47333cef-8d54-46bf-bd07-e319727dbb66 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072535 Jul 02 21:05:33.663310 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 613/1300] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:05:33 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:05:33.673182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:33.674261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:33.684933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.685668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.686791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:33.687319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:33.857170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:33.868791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:33.871899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-747138da-ddda-446c-9ea2-e95898fe7ba3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1472 microversion: 2.1 time: 0.202526 Jul 02 21:05:33.873841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 688/1301] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:33 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:34.475719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:34.478319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:34.490668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:34.491707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:34.493456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:34.494221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:34.649604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:34.651639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:34.669109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:34.670335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:34.672781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:34.673777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:34.929989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:34.944329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:34.947001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:34.949085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b59def4f-6b2c-4e4c-8245-99fbe2939719 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.478896 Jul 02 21:05:34.950498 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 614/1302] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:34 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:34.956979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:34.958147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:34.965408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:34.966184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:34.968178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:34.969332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:34.979803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:34.993778 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4178f114-945e-4839-bb89-ee2a3e5aac14 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.353439 Jul 02 21:05:34.996922 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 689/1303] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:34 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:35.008699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:35.009452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:35.016825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1be52413-998b-4a6b-801b-f30a28f8c2e7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.064781 Jul 02 21:05:35.023153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 615/1304] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:05:34 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:35.025691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.026173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.027522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.027977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.259547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:35.282260 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e8183c9-8843-4c85-afbc-8461679cd9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1469 microversion: 2.1 time: 0.281168 Jul 02 21:05:35.284467 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 690/1305] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:34 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:35.300326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:35.303494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:35.306430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:35.315253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.317742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.318553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.318996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.406093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.406629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.407651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.409549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.486490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:35.855390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for user 592e8c2ad31f459fa0b37f219cc4f84c and project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:35.968448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:35.969134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:35.986796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.987466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:35.988300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:35.988754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:36.010716 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-816bdfb9-53ba-44ab-9596-f548031edeb3 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df/action" status: 202 len: 0 microversion: 2.1 time: 0.713733 Jul 02 21:05:36.014235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 616/1306] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:05:35 2022] POST /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df/action => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:05:36.021651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:36.035002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:36.054745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:36.056482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:36.059338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:36.060031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:36.634228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:36.655411 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-752392f9-8cc7-4627-b922-f6fb0a5e2ded tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.637972 Jul 02 21:05:36.657802 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 617/1307] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:36 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:36.676151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:36.677515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:36.680111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:36.696894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:36.697497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:36.698325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:36.698776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:36.704561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:36.706648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:36.708030 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-683e6ed6-2a07-4624-878d-4475bc7eecbb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.743665 Jul 02 21:05:36.709414 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 691/1308] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:35 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:36.887593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1505071264", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f0d0b91f-6fd6-4007-bff1-daca6ddb8b98"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:36.956300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] validate_networks() for [('f0d0b91f-6fd6-4007-bff1-daca6ddb8b98', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:37.002544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:37.010564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b2f28e6-a877-43b3-8ac7-c2b0ec6f219d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1468 microversion: 2.1 time: 0.350255 Jul 02 21:05:37.011335 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 618/1309] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:36 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1468 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:37.678282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:37.679888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:37.706880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:37.707352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:37.708731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:37.710080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:37.739079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:38.156312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:38.166571 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63c31950-f5ea-48e3-971c-29ced5648564 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.493501 Jul 02 21:05:38.167423 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 619/1310] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:37 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:38.180209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6869f11a-3f24-47a1-a7be-5a32c9a140a2 req-bdf04f66-5a33-4bfc-82d9-3f1489a3cbdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "bc0b03a4-a4d1-46a8-bf46-32d0ea2ab69a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:38.204290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6869f11a-3f24-47a1-a7be-5a32c9a140a2 req-bdf04f66-5a33-4bfc-82d9-3f1489a3cbdc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.204740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6869f11a-3f24-47a1-a7be-5a32c9a140a2 req-bdf04f66-5a33-4bfc-82d9-3f1489a3cbdc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.237947 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6869f11a-3f24-47a1-a7be-5a32c9a140a2 req-bdf04f66-5a33-4bfc-82d9-3f1489a3cbdc service nova] Creating event network-vif-plugged:bc0b03a4-a4d1-46a8-bf46-32d0ea2ab69a for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:38.253267 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6869f11a-3f24-47a1-a7be-5a32c9a140a2 req-bdf04f66-5a33-4bfc-82d9-3f1489a3cbdc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084513 Jul 02 21:05:38.253853 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 620/1311] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:38.256755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:38.257297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:38.257978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:38.258399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:38.258819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:38.260332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:38.261298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:38.270624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.271056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.272197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.273605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.288566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.289328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.290172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.290617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.339252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Getting quotas for project 31671d11617e46fd881d114812d41e35. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:38.357836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Getting quotas for user 224f488d6b99461bb8bc37921813fb74 and project 31671d11617e46fd881d114812d41e35. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:38.392456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:38.396993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:38.501171 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a8120f96-3446-4e6a-83d9-390e2ea08da5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786952 Jul 02 21:05:38.502212 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 692/1312] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:38.507321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:38.508222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:38.515131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.515873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.517549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:38.518237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:38.866550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:38.923337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:38.927098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:38.933465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f68ed718-d3c3-4afa-bab4-633617acd3ca tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.677853 Jul 02 21:05:38.934293 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 621/1313] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:38 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:38.963664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-394288271", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "f62f5bc7-af47-49bf-8b23-df56ea5c37d7"}], "block_device_mapping_v2": [{"uuid": "84fa484c-0fe4-4a8b-83a4-e46960aee0a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:39.026457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:39.037445 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-61b3ba1f-ec61-41b2-878e-1d923d326327 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1468 microversion: 2.1 time: 0.533806 Jul 02 21:05:39.038374 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 693/1314] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:38 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1468 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:39.044289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2025482769", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f0d0b91f-6fd6-4007-bff1-daca6ddb8b98"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:39.143929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] validate_networks() for [('f0d0b91f-6fd6-4007-bff1-daca6ddb8b98', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:39.175793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] validate_networks() for [('f62f5bc7-af47-49bf-8b23-df56ea5c37d7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:40.432203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:40.434045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:40.434045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:40.434045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:40.434045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:40.450837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:40.451483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:40.454093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:40.454627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:40.537583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:40.566601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Getting quotas for user f3287fb85c2343d686718d3c4aaa5c00 and project d59cb1f0d7bb4708ac0994f7c9b846b3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:40.652535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:40.653540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:40.654215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:40.654803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:40.655390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:40.680853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:40.683392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:40.684494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:40.688363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:40.797118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:40.799330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84fa484c-0fe4-4a8b-83a4-e46960aee0a8',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:40.800461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Getting quotas for project 31671d11617e46fd881d114812d41e35. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:40.814645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Getting quotas for user 224f488d6b99461bb8bc37921813fb74 and project 31671d11617e46fd881d114812d41e35. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:40.882979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:40.891850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:40.922784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:41.031258 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d713482-beda-447e-9fcd-476ed514785f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991488 Jul 02 21:05:41.042465 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 694/1315] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:41.061804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:41.063868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:41.078211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.079076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:41.084350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.085397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:41.172580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3deca091-df97-4699-8826-7537d7b70ac2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.229603 Jul 02 21:05:41.173223 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 622/1316] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:05:41.200058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:41.201804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:41.228497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.228990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:41.229827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.232130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:41.847878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:41.862943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:41.897724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:41.904293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:41.904935 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d35f4385-9df2-4d4c-bdf2-05b133c7306c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.858184 Jul 02 21:05:41.906179 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 695/1317] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:41 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:41.912915 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f71520c-d876-4094-8fd5-9ccd8aa750c4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.721958 Jul 02 21:05:41.916351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:41.916806 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 623/1318] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:41 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:41.920868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:41.926271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5b41f62b-c21d-4ac6-8322-915f48a40cde req-3e3565bb-115b-4a46-8d8a-377cb250c028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "1afd4b1f-b58d-4f5d-a887-dc07fab9afe4"}, {"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "1b833045-67de-490c-a1bc-7322fe6f685a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:41.937583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.938301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:41.939699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.940698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:41.960331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b41f62b-c21d-4ac6-8322-915f48a40cde req-3e3565bb-115b-4a46-8d8a-377cb250c028 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:41.961186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b41f62b-c21d-4ac6-8322-915f48a40cde req-3e3565bb-115b-4a46-8d8a-377cb250c028 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:42.015224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5b41f62b-c21d-4ac6-8322-915f48a40cde req-3e3565bb-115b-4a46-8d8a-377cb250c028 service nova] Creating event network-vif-plugged:1afd4b1f-b58d-4f5d-a887-dc07fab9afe4 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:42.015800 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5b41f62b-c21d-4ac6-8322-915f48a40cde req-3e3565bb-115b-4a46-8d8a-377cb250c028 service nova] Creating event network-vif-plugged:1b833045-67de-490c-a1bc-7322fe6f685a for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:42.056787 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5b41f62b-c21d-4ac6-8322-915f48a40cde req-3e3565bb-115b-4a46-8d8a-377cb250c028 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.138280 Jul 02 21:05:42.063590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 624/1319] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:42.073858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-841365795", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "451", "networks": [{"uuid": "f0d0b91f-6fd6-4007-bff1-daca6ddb8b98"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:42.200001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] validate_networks() for [('f0d0b91f-6fd6-4007-bff1-daca6ddb8b98', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:43.555240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:43.563683 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14c50d00-0020-4b99-b58b-72062e08dffa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1534 microversion: 2.1 time: 1.656019 Jul 02 21:05:43.573542 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 696/1320] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:41 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1534 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:43.579588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:43.580260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:43.589756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:43.589887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:43.590686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:43.591138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:43.825666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:43.841130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:43.842790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:43.843957 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07144e7e-d638-4f7b-aad0-429e9f3afc47 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1240 microversion: 2.25 time: 0.277675 Jul 02 21:05:43.850689 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 697/1321] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:43 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1240 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:43.864954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:43.865870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:43.876739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:43.879592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:43.880684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:43.882966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:44.351593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:44.352143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:44.352531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:44.352945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:44.353358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:44.369009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:44.370679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:44.372201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:44.375658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:44.452763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Getting quotas for project 31671d11617e46fd881d114812d41e35. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:44.470010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Getting quotas for user 224f488d6b99461bb8bc37921813fb74 and project 31671d11617e46fd881d114812d41e35. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:44.488098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:44.493411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:44.596155 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-642da617-24ec-4252-ab49-1b1ea92fc00b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.530913 Jul 02 21:05:44.596950 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 625/1322] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:44.614323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:44.615255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:44.670110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:44.670572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:44.679387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:44.679864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:44.898782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:44.913352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c594227d-1794-45f2-a7c8-75f9f2c95fe3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 1.050183 Jul 02 21:05:44.926950 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 698/1323] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:43 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:44.941450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-db80c628-66a9-4886-aebe-bb72c353587b req-2a866857-dcca-4b74-839b-6f3b11b03e2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:44.990773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-db80c628-66a9-4886-aebe-bb72c353587b req-2a866857-dcca-4b74-839b-6f3b11b03e2d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:44.992486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-db80c628-66a9-4886-aebe-bb72c353587b req-2a866857-dcca-4b74-839b-6f3b11b03e2d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:45.023363 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-db80c628-66a9-4886-aebe-bb72c353587b req-2a866857-dcca-4b74-839b-6f3b11b03e2d service nova] Creating event network-changed:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch2-master-1 Jul 02 21:05:45.038969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-db80c628-66a9-4886-aebe-bb72c353587b req-2a866857-dcca-4b74-839b-6f3b11b03e2d service nova] Instance 2adc9c67-dec2-437a-825d-5bb427ac75df is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:05:45.074452 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-db80c628-66a9-4886-aebe-bb72c353587b req-2a866857-dcca-4b74-839b-6f3b11b03e2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145832 Jul 02 21:05:45.075416 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 699/1324] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:45.082063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bfb83e3c-ff3b-4117-a9d9-3d54dc8db3ec req-dd17dfec-b1ce-4f17-9995-56676959c173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8438550e-5629-411b-af19-402f3032a1f2", "name": "network-vif-plugged", "status": "completed", "tag": "af177369-7f3e-4190-a2ae-25a09cb9648d"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:45.107649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bfb83e3c-ff3b-4117-a9d9-3d54dc8db3ec req-dd17dfec-b1ce-4f17-9995-56676959c173 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:45.108140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bfb83e3c-ff3b-4117-a9d9-3d54dc8db3ec req-dd17dfec-b1ce-4f17-9995-56676959c173 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:45.146787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bfb83e3c-ff3b-4117-a9d9-3d54dc8db3ec req-dd17dfec-b1ce-4f17-9995-56676959c173 service nova] Creating event network-vif-plugged:af177369-7f3e-4190-a2ae-25a09cb9648d for instance 8438550e-5629-411b-af19-402f3032a1f2 on nch2-master-1 Jul 02 21:05:45.161427 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bfb83e3c-ff3b-4117-a9d9-3d54dc8db3ec req-dd17dfec-b1ce-4f17-9995-56676959c173 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081888 Jul 02 21:05:45.165772 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 700/1325] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:45.183219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:45.193998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:45.227232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:45.228200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:45.234626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:45.235309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:45.913174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:45.924357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:45.935121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:45.936817 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1c600ea-11c2-45bd-a77c-6775f5c3ba2c tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 1.335620 Jul 02 21:05:45.948311 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 626/1326] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:44 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:45.953552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:45.964986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:45.979824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:45.980453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:45.981319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:45.982642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:46.069655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:46.083747 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-24415259-b889-427f-b64e-3c78bb06a206 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1534 microversion: 2.1 time: 0.912949 Jul 02 21:05:46.084442 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 701/1327] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:45 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1534 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:46.103297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:46.104430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:46.122736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:46.123256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:46.128727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:46.130382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:46.186326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:46.200929 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b660eed-b9e0-4dff-ba61-5f1dbd6a8dba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1272 microversion: 2.1 time: 0.250844 Jul 02 21:05:46.201870 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 627/1328] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:45 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:46.207446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:46.208530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:46.219401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:46.221518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:46.224623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:46.225650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:46.228665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:46.229800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:46.231925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:46.234681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6136b0f1-3fae-47a0-a89b-9008f1873869 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1238 microversion: 2.25 time: 0.147179 Jul 02 21:05:46.236341 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 702/1329] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:46 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:46.469440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:46.483363 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d647ccb2-33b5-4aca-b2c3-e7f4a5993b53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1315 microversion: 2.1 time: 0.279448 Jul 02 21:05:46.495141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 628/1330] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:46 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:46.960717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:46.962076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:46.976810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:46.977384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:46.978245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:46.978714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.002293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c0249472-c0d3-4b81-ad80-a4812f7db236 req-71d90ca1-d5f9-440f-8fb0-ba2262e80422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c04ec7f0-2638-4afa-afde-866651a42a1e", "tag": "1a2aaa33-76b7-4eaf-8129-6c8637fb184b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:47.033848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0249472-c0d3-4b81-ad80-a4812f7db236 req-71d90ca1-d5f9-440f-8fb0-ba2262e80422 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.034553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0249472-c0d3-4b81-ad80-a4812f7db236 req-71d90ca1-d5f9-440f-8fb0-ba2262e80422 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.106561 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c0249472-c0d3-4b81-ad80-a4812f7db236 req-71d90ca1-d5f9-440f-8fb0-ba2262e80422 service nova] Creating event network-changed:1a2aaa33-76b7-4eaf-8129-6c8637fb184b for instance c04ec7f0-2638-4afa-afde-866651a42a1e on nch2-master-1 Jul 02 21:05:47.118270 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c0249472-c0d3-4b81-ad80-a4812f7db236 req-71d90ca1-d5f9-440f-8fb0-ba2262e80422 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123262 Jul 02 21:05:47.136117 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 629/1331] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:05:47.150426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:47.152781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:47.172355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.173482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.174570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.175358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.702390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:47.717498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:47.719296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:47.720731 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-084514ee-963f-40c0-a806-492042d7819f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.769731 Jul 02 21:05:47.722231 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 703/1332] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:46 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:47.727221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:47.728087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:47.734462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.735124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.736711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.737434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.845884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:47.858483 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1fa55875-601d-45b3-a86e-45affa11a0f1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1278 microversion: 2.1 time: 0.134866 Jul 02 21:05:47.860538 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 704/1333] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:47 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:47.869001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:47.870641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:47.879315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.880725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.882317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.882990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.941429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:47.957795 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4aa6d01-b1c1-4c48-a8dc-5e1adf2a7dd4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1534 microversion: 2.1 time: 0.817474 Jul 02 21:05:47.958858 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 630/1334] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:47 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1534 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:47.966813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-23439f03-a088-49de-b521-f9d2d6b66f48 req-df198e03-3a81-427c-8086-d6a27bc32b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "53ab081d-a441-43ec-bea7-7a9b418c3546"}, {"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "31a0e127-6d14-40ad-9cfc-2d221b2b34f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:47.977124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-23439f03-a088-49de-b521-f9d2d6b66f48 req-df198e03-3a81-427c-8086-d6a27bc32b95 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:47.977939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-23439f03-a088-49de-b521-f9d2d6b66f48 req-df198e03-3a81-427c-8086-d6a27bc32b95 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:47.991549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-23439f03-a088-49de-b521-f9d2d6b66f48 req-df198e03-3a81-427c-8086-d6a27bc32b95 service nova] Creating event network-vif-plugged:53ab081d-a441-43ec-bea7-7a9b418c3546 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:47.992519 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-23439f03-a088-49de-b521-f9d2d6b66f48 req-df198e03-3a81-427c-8086-d6a27bc32b95 service nova] Creating event network-vif-plugged:31a0e127-6d14-40ad-9cfc-2d221b2b34f7 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:48.000029 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-23439f03-a088-49de-b521-f9d2d6b66f48 req-df198e03-3a81-427c-8086-d6a27bc32b95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038813 Jul 02 21:05:48.001364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 631/1335] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:48.012485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:48.015062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:48.023835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.026767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.027927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.028636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.143379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:48.161948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:48.164336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:48.166203 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a183e368-6523-4208-93b6-d29ac1f6a1e1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.303822 Jul 02 21:05:48.168150 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 705/1336] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:47 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:48.455686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:48.470184 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b7cc52f-b934-4888-ab11-70f391fccd53 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1500 microversion: 2.1 time: 0.464872 Jul 02 21:05:48.471757 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 632/1337] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:48 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1500 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:48.489983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:48.490468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:48.508754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.511205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.514954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.515721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.679595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:48.708124 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e80a9c5-fd1e-46bb-acec-00c32662cb73 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2/action" status: 202 len: 0 microversion: 2.1 time: 0.222327 Jul 02 21:05:48.715236 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 706/1338] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:05:48 2022] POST /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:05:48.718387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:48.719062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:48.728330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.728781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.733656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.733854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.751855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:48.752633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:48.768162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.768162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:48.768704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:48.769311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:49.829113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:49.848990 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-858279e4-ac86-4687-b964-8294d77efbf7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1505 microversion: 2.1 time: 1.134889 Jul 02 21:05:49.850232 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 633/1339] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:48 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1505 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:49.867849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:49.868975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:49.883651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:49.884344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:49.898393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:49.902785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:49.904736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:49.916343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:49.918018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:49.922732 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79062b97-ccfd-4912-b690-6f61e853cba0 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 1.185168 Jul 02 21:05:49.923508 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 707/1340] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:48 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:05:49.941093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6bb8e70d-46e4-4e42-8fb1-bbff1c159931 req-f952dbce-027c-447d-bf59-63fc316c9257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771bfeb8-cc53-4509-ac0c-ecaec2116b7c", "tag": "eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:49.956759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6bb8e70d-46e4-4e42-8fb1-bbff1c159931 req-f952dbce-027c-447d-bf59-63fc316c9257 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:49.968852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6bb8e70d-46e4-4e42-8fb1-bbff1c159931 req-f952dbce-027c-447d-bf59-63fc316c9257 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:49.983554 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6bb8e70d-46e4-4e42-8fb1-bbff1c159931 req-f952dbce-027c-447d-bf59-63fc316c9257 service nova] Creating event network-changed:eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc for instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c on nch1-master-1 Jul 02 21:05:50.007690 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6bb8e70d-46e4-4e42-8fb1-bbff1c159931 req-f952dbce-027c-447d-bf59-63fc316c9257 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075708 Jul 02 21:05:50.008733 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 708/1341] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:50.013965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:50.014669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:50.029644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:50.030112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:50.030907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:50.031349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:50.150133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:50.162718 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-086f841e-9dbb-49f4-b618-60155047f677 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1278 microversion: 2.1 time: 0.310820 Jul 02 21:05:50.163720 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 634/1342] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:49 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1278 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:50.177259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:50.177907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:50.197303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:50.197757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:50.198543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:50.199166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:50.748982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=18 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:50.860532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=28 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:50.939360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:50.947312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:50.954496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:50.957997 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b10d56ef-0553-479c-941e-92e2ac765601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1527 microversion: 2.1 time: 0.948036 Jul 02 21:05:50.959135 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 709/1343] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:50 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1527 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:50.961339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:50.962580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7991a02-2858-4766-bb4b-94dea648bf79 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.797813 Jul 02 21:05:50.963071 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 635/1344] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:50 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:50.978097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-55a0ee4e-3216-4fbe-a45b-954951b4d526 req-854d6019-c324-4f1c-8f8b-68e090100fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ceec01b-0a29-4f85-a6e9-404754e90ee9", "tag": "515f1a8d-79bb-4891-967d-ea4c430d8c18"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:50.984551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b3a1ae00-5f07-42ab-acd4-ec71d3a235e8 req-adb268d9-b2b0-4bba-9e35-2b94d146d8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "308385e3-792d-4631-b8d7-c37d0374d7db"}, {"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-plugged", "status": "completed", "tag": "4d668df7-a488-410e-b721-df9a93a7b149"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:50.994177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-55a0ee4e-3216-4fbe-a45b-954951b4d526 req-854d6019-c324-4f1c-8f8b-68e090100fb2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:50.994553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-55a0ee4e-3216-4fbe-a45b-954951b4d526 req-854d6019-c324-4f1c-8f8b-68e090100fb2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:50.999401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b3a1ae00-5f07-42ab-acd4-ec71d3a235e8 req-adb268d9-b2b0-4bba-9e35-2b94d146d8f4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:50.999857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b3a1ae00-5f07-42ab-acd4-ec71d3a235e8 req-adb268d9-b2b0-4bba-9e35-2b94d146d8f4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.018904 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b3a1ae00-5f07-42ab-acd4-ec71d3a235e8 req-adb268d9-b2b0-4bba-9e35-2b94d146d8f4 service nova] Creating event network-vif-plugged:308385e3-792d-4631-b8d7-c37d0374d7db for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:51.020131 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b3a1ae00-5f07-42ab-acd4-ec71d3a235e8 req-adb268d9-b2b0-4bba-9e35-2b94d146d8f4 service nova] Creating event network-vif-plugged:4d668df7-a488-410e-b721-df9a93a7b149 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:05:51.024623 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-55a0ee4e-3216-4fbe-a45b-954951b4d526 req-854d6019-c324-4f1c-8f8b-68e090100fb2 service nova] Creating event network-changed:515f1a8d-79bb-4891-967d-ea4c430d8c18 for instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 on nch1-master-1 Jul 02 21:05:51.031088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b3a1ae00-5f07-42ab-acd4-ec71d3a235e8 req-adb268d9-b2b0-4bba-9e35-2b94d146d8f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070474 Jul 02 21:05:51.032291 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 710/1345] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:51.045287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-55a0ee4e-3216-4fbe-a45b-954951b4d526 req-854d6019-c324-4f1c-8f8b-68e090100fb2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080612 Jul 02 21:05:51.046176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.046360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 636/1346] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:51.047259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:51.052598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.057172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.057353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:51.059017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.060261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.060861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.070221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.070680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.071472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.075757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.409118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:51.418671 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b52a8949-171f-4f74-b546-f56b14b082f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1485 microversion: 2.1 time: 0.384894 Jul 02 21:05:51.435603 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 711/1347] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:51 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1485 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:51.442012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.448108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:51.463092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.463778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.465919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.469034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.484569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:51.506313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:51.509151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:51.510554 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d4a4858-2145-4d58-82d1-904ee021b34b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.463093 Jul 02 21:05:51.511612 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 637/1348] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:51 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:51.517651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.518773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:51.538790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.539745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.542995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.545014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.682535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:51.695969 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b28c91b8-729f-4fb4-929d-540196b56183 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1278 microversion: 2.1 time: 0.182998 Jul 02 21:05:51.700786 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 638/1349] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:51 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:51.708247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.708458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:51.709252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:51.716602 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0584a0e1-2af1-42f2-96f7-2db8054b11ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1527 microversion: 2.1 time: 0.279332 Jul 02 21:05:51.727944 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 712/1350] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:51 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1527 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:51.728391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.729289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.730494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.731107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.732796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8610be97-49b2-4c17-9939-35dc3a593d08 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.733665 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:05:51.733665 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:05:51.747398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8610be97-49b2-4c17-9939-35dc3a593d08 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] HTTP exception thrown: Flavor b17682a8-4235-4b48-adfb-6737e47abf74 could not be found. Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8610be97-49b2-4c17-9939-35dc3a593d08 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Request method failure captured: Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/flavors/b17682a8-4235-4b48-adfb-6737e47abf74 HTTP/1.1 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJAGUgOHvf3aULrzbzVdrshYVzo1OM1AX3Ubg51npa3xNL_u50OvnA2vC1d2350uassMDx5nE44oymbr7PcE93MptC1MtMQ9LXPPjsnjwuzpcoIoZuoxtJ89cIPzY-IJmTTgCb-XCYbmyaSA7C7h0dM9O6e3C0RWMc4HP5y7RJZGSY Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9aacdf1893ae44e383bfc224b1e78784 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-MigrationsAdminTest-1639921973 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9aacdf1893ae44e383bfc224b1e78784"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9aacdf1893ae44e383bfc224b1e78784", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9aacdf1893ae44e383bfc224b1e78784"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9aacdf1893ae44e383bfc224b1e78784"}]}] Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-MigrationsAdminTest-1639921973 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9aacdf1893ae44e383bfc224b1e78784 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-MigrationsAdminTest-1639921973 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-MigrationsAdminTest-1639921973-project-admin Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1068ef10c5ca46619e6280360e5a0930 Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-MigrationsAdminTest-1639921973-project-admin Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: exception: Flavor b17682a8-4235-4b48-adfb-6737e47abf74 could not be found. Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b17682a8-4235-4b48-adfb-6737e47abf74'} Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b17682a8-4235-4b48-adfb-6737e47abf74 could not be found. Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b17682a8-4235-4b48-adfb-6737e47abf74 could not be found. Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:51.749521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b17682a8-4235-4b48-adfb-6737e47abf74 could not be found. Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8610be97-49b2-4c17-9939-35dc3a593d08 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Returning 404 to user: Flavor b17682a8-4235-4b48-adfb-6737e47abf74 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8610be97-49b2-4c17-9939-35dc3a593d08 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/b17682a8-4235-4b48-adfb-6737e47abf74" status: 404 len: 109 microversion: 2.1 time: 0.021993 Jul 02 21:05:51.757805 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 713/1351] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:51 2022] DELETE /compute/v2.1/flavors/b17682a8-4235-4b48-adfb-6737e47abf74 => generated 109 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:51.788468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:51.837475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:51.948419 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-569ad420-733d-47a0-be47-8a3e8100053d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 204 len: 0 microversion: 2.1 time: 0.245413 Jul 02 21:05:51.958646 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 639/1352] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:51 2022] DELETE /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:51.967161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.968591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:51.985300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.985954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.987461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:51.988599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:51.989242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:51.990003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:52.004659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:52.005030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:52.005882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:52.006664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:52.345040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.356772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.358475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.366612 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-53bf1121-f239-4410-b2c2-119287f756fc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1491 microversion: 2.1 time: 0.403248 Jul 02 21:05:52.367207 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 714/1353] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:51 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1491 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:52.371728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.372855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-297357492", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:52.375113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52863216-5942-41a2-a152-0b0ab221d758 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.395191 Jul 02 21:05:52.378434 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 640/1354] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:51 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:52.429733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:52.535026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:52.535753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:52.546618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:52.549414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:52.550703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:52.551771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:52.552940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:52.905352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:52.906422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:52.910397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:52.911240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:52.911942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:52.935118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:52.935593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:52.936549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:52.942010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:52.961346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.970301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:52.979803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Getting quotas for user 592e8c2ad31f459fa0b37f219cc4f84c and project 63f39c85f12c4ad58be6d786de9a584b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:52.991545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.996688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:52.997185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:53.000758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:53.002475 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-972e2c31-c1b1-4f17-b65c-1c4e21a37a91 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.474149 Jul 02 21:05:53.003668 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 641/1355] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:52 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:53.018967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:53.019796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:53.037377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.037929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:53.041142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.043695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:53.057559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd8c6940-d68e-456f-9021-147c8802ba2b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689104 Jul 02 21:05:53.058505 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 715/1356] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:53.070075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6016cb54-7b35-4b1f-8ef2-7ad61f2f5d2a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:53.071055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6016cb54-7b35-4b1f-8ef2-7ad61f2f5d2a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:53.379261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6016cb54-7b35-4b1f-8ef2-7ad61f2f5d2a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:53.398028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6016cb54-7b35-4b1f-8ef2-7ad61f2f5d2a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1212 microversion: 2.1 time: 0.333169 Jul 02 21:05:53.399661 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 716/1357] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:53 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1212 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:53.424961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a65f84ae-14f6-449e-8ef8-e5ec0524d7f7 req-1cd17837-8f29-46dd-89c2-cf86e48d2ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "name": "network-vif-plugged", "status": "completed", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:53.440879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a65f84ae-14f6-449e-8ef8-e5ec0524d7f7 req-1cd17837-8f29-46dd-89c2-cf86e48d2ba2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.442537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a65f84ae-14f6-449e-8ef8-e5ec0524d7f7 req-1cd17837-8f29-46dd-89c2-cf86e48d2ba2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:53.466351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a65f84ae-14f6-449e-8ef8-e5ec0524d7f7 req-1cd17837-8f29-46dd-89c2-cf86e48d2ba2 service nova] Creating event network-vif-plugged:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch2-master-1 Jul 02 21:05:53.476789 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a65f84ae-14f6-449e-8ef8-e5ec0524d7f7 req-1cd17837-8f29-46dd-89c2-cf86e48d2ba2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074295 Jul 02 21:05:53.483649 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 717/1358] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:53.491330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:53.492203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:53.500375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.500842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:53.501699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.502148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:53.739089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:53.750689 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ce0dc2c-ad6a-462f-b2cf-016e4146ee66 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.744322 Jul 02 21:05:53.752533 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 642/1359] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:53 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:53.758728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:53.760292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:53.774169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.774968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:53.776270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:53.778152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.077822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:54.098481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acee53e5-1da9-4f35-b081-0ea991bc8768 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1491 microversion: 2.1 time: 0.611493 Jul 02 21:05:54.121424 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 718/1360] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:53 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1491 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:54.131037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:54.133036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:54.145282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:54.146828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.149178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:54.149981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.190967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:05:54.222582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:54.235266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:54.245249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:54.246457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-91dbe5b6-86df-4f66-ad5e-50f58f4b5fe1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.492691 Jul 02 21:05:54.247121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 643/1361] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:53 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:54.256448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:54.257780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:54.276438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:54.277222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.278634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:54.279374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.402082 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-383f47e4-0b0c-435b-b5b6-26312be391f7 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 204 len: 0 microversion: 2.1 time: 0.278103 Jul 02 21:05:54.404740 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 719/1362] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:05:54 2022] DELETE /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:05:54.411123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:54.415712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:54.416601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:54.424558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:54.425151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.426096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:54.426690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:54.481768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:55.434218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:55.464356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:55.473983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:55.475463 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adf42464-778d-49d2-b6b6-9b9c200bf519 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 1.227251 Jul 02 21:05:55.487274 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 644/1363] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:54 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:55.500312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:55.500992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:55.515208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.515932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.516829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.517269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.683086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:55.691361 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7b63048-726e-4d33-9ddc-ec1617d09bdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1270 microversion: 2.1 time: 0.202789 Jul 02 21:05:55.700920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:55.707130 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 645/1364] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:55 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:55.716224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8003e95c-6823-477d-a617-bb38b98a6b90 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1715 microversion: 2.1 time: 1.306514 Jul 02 21:05:55.717396 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 720/1365] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:54 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1715 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:55.724174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:55.724371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:55.724993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:55.725416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:55.734136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.735034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.735650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.737307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.738357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.741718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.742674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.743292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.836256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.836722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.837190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lazy-loading 'fault' on Instance uuid 8438550e-5629-411b-af19-402f3032a1f2 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:05:55.908684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:55.927189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17c22fe8-5510-4ec9-8d6f-410dc698872d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 200 len: 1305 microversion: 2.1 time: 0.208475 Jul 02 21:05:55.928881 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 721/1366] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:55 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 1305 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:55.936601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:55.937601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:55.947793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.948721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:55.949864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:55.950459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.033172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.080842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9499bb96-aa62-4119-9e3a-7926a089b428 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.363575 Jul 02 21:05:56.082065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 646/1367] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:55 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:56.094954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-bcc83b22-7a2d-4c52-8efd-5ed258d3a785 req-62a06e05-64b6-41e7-a0d7-e4dd49741711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8438550e-5629-411b-af19-402f3032a1f2", "name": "network-vif-deleted", "tag": "af177369-7f3e-4190-a2ae-25a09cb9648d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:56.120927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bcc83b22-7a2d-4c52-8efd-5ed258d3a785 req-62a06e05-64b6-41e7-a0d7-e4dd49741711 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.121382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bcc83b22-7a2d-4c52-8efd-5ed258d3a785 req-62a06e05-64b6-41e7-a0d7-e4dd49741711 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.143775 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-bcc83b22-7a2d-4c52-8efd-5ed258d3a785 req-62a06e05-64b6-41e7-a0d7-e4dd49741711 service nova] Creating event network-vif-deleted:af177369-7f3e-4190-a2ae-25a09cb9648d for instance 8438550e-5629-411b-af19-402f3032a1f2 on nch2-master-1 Jul 02 21:05:56.158633 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-bcc83b22-7a2d-4c52-8efd-5ed258d3a785 req-62a06e05-64b6-41e7-a0d7-e4dd49741711 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075237 Jul 02 21:05:56.159256 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 647/1368] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:56.173683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-bf448bab-2e28-4030-8acb-0e44b86b8686 req-57465f43-a392-4a92-bb7f-5e14b482208b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc18f7b8-eef1-4bb2-9c72-0d744c679963", "tag": "1fbac6fc-7ea1-4724-9990-66f2b54b3dd8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:56.195812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bf448bab-2e28-4030-8acb-0e44b86b8686 req-57465f43-a392-4a92-bb7f-5e14b482208b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.197367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bf448bab-2e28-4030-8acb-0e44b86b8686 req-57465f43-a392-4a92-bb7f-5e14b482208b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.229198 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-bf448bab-2e28-4030-8acb-0e44b86b8686 req-57465f43-a392-4a92-bb7f-5e14b482208b service nova] Creating event network-changed:1fbac6fc-7ea1-4724-9990-66f2b54b3dd8 for instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 on nch2-master-1 Jul 02 21:05:56.238714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-bf448bab-2e28-4030-8acb-0e44b86b8686 req-57465f43-a392-4a92-bb7f-5e14b482208b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076912 Jul 02 21:05:56.241862 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 648/1369] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:56.258964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.283351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.285438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.286885 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a537f1ec-f85e-491f-a657-d44161837ba2 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.356738 Jul 02 21:05:56.287462 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 722/1370] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:55 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:56.496095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:56.496932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:56.504027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.504680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.505840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.506508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.716425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:56.717630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:56.730658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.731294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.732236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.734833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.837487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.852979 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ca66897-4715-440a-ae6c-a360c0aaf733 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1270 microversion: 2.1 time: 0.141273 Jul 02 21:05:56.857041 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 723/1371] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:56 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:56.857486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.863368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:56.864350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:56.869639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.872411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:56.873855 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7fceb240-7a0e-4ecb-9b09-816c211d5601 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.382540 Jul 02 21:05:56.886063 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 649/1372] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:56 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:56.886439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.888573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.889523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.890532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.894683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c2f4be85-16d3-419c-9078-018c74e4a316 req-2832b905-e14d-4cbc-96f2-35b0d256928b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c04ec7f0-2638-4afa-afde-866651a42a1e", "name": "network-vif-plugged", "status": "completed", "tag": "1a2aaa33-76b7-4eaf-8129-6c8637fb184b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:56.921623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2f4be85-16d3-419c-9078-018c74e4a316 req-2832b905-e14d-4cbc-96f2-35b0d256928b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.922305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2f4be85-16d3-419c-9078-018c74e4a316 req-2832b905-e14d-4cbc-96f2-35b0d256928b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.943830 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c2f4be85-16d3-419c-9078-018c74e4a316 req-2832b905-e14d-4cbc-96f2-35b0d256928b service nova] Creating event network-vif-plugged:1a2aaa33-76b7-4eaf-8129-6c8637fb184b for instance c04ec7f0-2638-4afa-afde-866651a42a1e on nch2-master-1 Jul 02 21:05:56.949975 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c2f4be85-16d3-419c-9078-018c74e4a316 req-2832b905-e14d-4cbc-96f2-35b0d256928b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061990 Jul 02 21:05:56.950744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 650/1373] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:05:56.962510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:56.963844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:56.985682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.987767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:56.988794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:56.992876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:57.016676 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 HTTP/1.1 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8438550e-5629-411b-af19-402f3032a1f2'} Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:05:57.018740 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:05:57.025524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:05:57.042242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:05:57.047292 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fb1a2c3-4173-4a78-9756-039e6da0d126 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 404 len: 111 microversion: 2.1 time: 0.089209 Jul 02 21:05:57.063051 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 651/1374] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:56 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:05:57.098422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:57.099105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:57.110695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:57.111280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:57.111932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:57.112400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:57.182039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:57.198300 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aeb18aed-2e96-4130-afe7-0bde0c8d6f2f tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1715 microversion: 2.1 time: 0.339713 Jul 02 21:05:57.203940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 724/1375] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:56 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1715 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:57.240698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-883410240", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:05:57.339627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:05:57.379403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:57.389487 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee9e36c3-e9da-43e8-a8c5-a127dae79512 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.295060 Jul 02 21:05:57.401005 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 652/1376] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:57 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:57.411974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:57.412862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:57.424534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:57.425328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:57.432535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:57.433251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:57.744998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:57.757659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:57.761774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:57.762953 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cda05f53-958e-4619-8965-67dcfd6a7297 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.357124 Jul 02 21:05:57.764916 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 653/1377] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:57 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:57.873282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:57.874380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:57.890067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:57.894851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:57.896093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:57.897083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.170157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:05:58.170652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.170771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:05:58.171078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:05:58.171498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:05:58.171921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:05:58.183943 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1aa1ca86-8df7-49db-9dda-021a51b4a24d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.314114 Jul 02 21:05:58.184585 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 654/1378] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:57 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:05:58.193707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.194166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.195555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.196005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.198654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:58.199273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:58.217572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.218043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.218853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.219290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.236879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:05:58.249205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:05:58.272492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:05:58.276333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:05:58.297910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:58.354576 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce4d3c32-5e7a-44cb-b0c1-17f1d3964301 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.119122 Jul 02 21:05:58.361839 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 725/1379] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:05:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:05:58.369922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:58.370558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:58.378705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.379179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.380016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.380489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.434210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.443634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.445627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.447031 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfe8cd02-1171-4d19-b425-724fee7828b4 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.252756 Jul 02 21:05:58.447987 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 655/1380] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:58 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:58.453271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83f3b153-8318-4fbf-8458-99f3ccc648e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:58.454190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83f3b153-8318-4fbf-8458-99f3ccc648e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:58.526969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83f3b153-8318-4fbf-8458-99f3ccc648e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.534957 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83f3b153-8318-4fbf-8458-99f3ccc648e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1214 microversion: 2.1 time: 0.085272 Jul 02 21:05:58.539089 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 656/1381] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:58 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:58.552121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:58.552759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:58.560639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.561284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.562087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.562527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.609203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.611722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:58.622561 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b32b24c-1409-4027-9f78-96caca58f750 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1715 microversion: 2.1 time: 0.259520 Jul 02 21:05:58.638616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 726/1382] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:58 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1715 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:58.740709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.750712 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3004d9de-8534-4c6b-8d10-7b1fbcccdf37 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.210539 Jul 02 21:05:58.752236 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 657/1383] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:58 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:58.783329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:58.784224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:58.791793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.792267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.793273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:58.793708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:58.954782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.965840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.968148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:58.970511 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64804fbe-7ad0-41c3-96c4-87b0fa12f363 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.192036 Jul 02 21:05:58.981754 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 727/1384] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:58 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:05:59.202333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:59.202960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:59.214621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.215116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.215914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.220245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.467553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:59.469174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:59.486786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.487864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.489220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.493050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.752535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:59.770653 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-649ac68a-5ae3-4565-ab28-112b946efa1c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.571863 Jul 02 21:05:59.783035 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 658/1385] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:59 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:59.790059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:59.792505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:59.800903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.802322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.803360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.804018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.830796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:05:59.931594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:05:59.944021 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1e111e2-0cc4-4e3f-9ded-057183465f55 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1266 microversion: 2.1 time: 0.159254 Jul 02 21:05:59.944737 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 659/1386] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:59 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:05:59.961106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:05:59.962267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:05:59.970918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.975276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:05:59.980019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:05:59.982552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:00.002238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:00.017733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:00.024389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:00.027273 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-318fa691-fe6c-425c-8159-6a916dda729f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1869 microversion: 2.42 time: 0.565323 Jul 02 21:06:00.031532 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 728/1387] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:05:59 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1869 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:00.050106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:00.051347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:00.074265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:00.075381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:00.076579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:00.081578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:01.040989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:01.063438 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4245f6af-3ae1-49e2-ace6-56c4de627d33 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1715 microversion: 2.1 time: 1.116687 Jul 02 21:06:01.084569 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 660/1388] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:05:59 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1715 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:01.096995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:01.105203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:01.125399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:01.125848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:01.126671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:01.127284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:01.491129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:01.504201 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b3c0346-15e9-4209-a390-7f11e597f3ab tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 1.467186 Jul 02 21:06:01.517799 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 729/1389] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:00 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:01.530211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-40298ad5-fce5-40a8-bf70-52998992f0d2 req-2048191b-3a95-4895-b795-c759112b2441 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:01.554925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-40298ad5-fce5-40a8-bf70-52998992f0d2 req-2048191b-3a95-4895-b795-c759112b2441 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:01.555826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-40298ad5-fce5-40a8-bf70-52998992f0d2 req-2048191b-3a95-4895-b795-c759112b2441 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:01.594580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-40298ad5-fce5-40a8-bf70-52998992f0d2 req-2048191b-3a95-4895-b795-c759112b2441 service nova] Creating event network-changed:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch2-master-1 Jul 02 21:06:01.605855 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-40298ad5-fce5-40a8-bf70-52998992f0d2 req-2048191b-3a95-4895-b795-c759112b2441 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086253 Jul 02 21:06:01.608732 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 730/1390] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:01.620830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:01.624030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:01.640876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:01.641435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:01.642371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:01.647927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:02.602958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:02.612435 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6fcb8dc4-361d-4113-bd58-f7a4ff47c70e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 1.001158 Jul 02 21:06:02.617863 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 731/1391] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:01 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:02.627772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:02.630608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:02.634984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:02.641498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:02.649392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:02.649854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:02.650652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:02.651802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:02.655480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:02.657125 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f545e441-765b-4c62-92c7-6c8f877b1859 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 1.571327 Jul 02 21:06:02.658460 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 661/1392] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:01 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:02.664525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:02.669035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:02.689992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:02.690464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:02.691276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:02.691714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:02.951094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:02.990980 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2fdb832f-3e37-426d-b858-f30a5137f05a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1272 microversion: 2.1 time: 0.356088 Jul 02 21:06:02.996097 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 732/1393] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:02 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1272 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:03.007657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:03.008689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:03.019001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:03.019649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:03.021334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:03.022210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:03.732701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60bf5141fea499abb9b22658e56c944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8920bed46d34026a06fedf429e5cca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:03.747244 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7490bd0c-5c04-47c1-83ea-ee79da6bb230 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 200 len: 1647 microversion: 2.1 time: 0.746667 Jul 02 21:06:03.748369 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 733/1394] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:02 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 1647 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:03.761451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:03.765326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:03.784621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:03.786405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:03.789734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:03.790500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:03.959577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:03.978383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:03.979979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:03.985567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e7f6485-c4b4-4bd7-98f8-e3b215b8817f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2828 microversion: 2.42 time: 1.323571 Jul 02 21:06:03.996893 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 662/1395] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:02 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2828 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:04.016452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:04.018730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:04.033783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.034248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.037161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.053376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.452208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:04.461495 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6d313cff-472e-4b18-8b02-4cdaf9c5adba tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.711306 Jul 02 21:06:04.465683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 734/1396] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:03 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:04.504813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:04.519695 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb66e355-af97-41e4-a36f-ba8bf4a86f84 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.521544 Jul 02 21:06:04.524343 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 663/1397] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:03 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:04.532827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:04.535746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:04.549367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.551612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.555504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.556235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.610967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6481b1b3-0d96-4a26-a437-ed886f84c368 req-50eefdcc-3514-4da1-a9da-7cc472d8536b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c074787f-d02a-4e68-a9a2-58442e8fef1c", "name": "network-vif-deleted", "tag": "99084601-a941-4aba-b7d7-5df7fa7250c0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:04.641320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6481b1b3-0d96-4a26-a437-ed886f84c368 req-50eefdcc-3514-4da1-a9da-7cc472d8536b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.648184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6481b1b3-0d96-4a26-a437-ed886f84c368 req-50eefdcc-3514-4da1-a9da-7cc472d8536b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.678018 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6481b1b3-0d96-4a26-a437-ed886f84c368 req-50eefdcc-3514-4da1-a9da-7cc472d8536b service nova] Creating event network-vif-deleted:99084601-a941-4aba-b7d7-5df7fa7250c0 for instance c074787f-d02a-4e68-a9a2-58442e8fef1c on nch1-master-1 Jul 02 21:06:04.693573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6481b1b3-0d96-4a26-a437-ed886f84c368 req-50eefdcc-3514-4da1-a9da-7cc472d8536b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223882 Jul 02 21:06:04.694854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 735/1398] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:04.708257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3fe729e5-3a00-4545-b6f0-1d74d94220b9 req-20d0e6da-86be-4777-b9e6-fec27d91fc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771bfeb8-cc53-4509-ac0c-ecaec2116b7c", "name": "network-vif-plugged", "status": "completed", "tag": "eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:04.728680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3fe729e5-3a00-4545-b6f0-1d74d94220b9 req-20d0e6da-86be-4777-b9e6-fec27d91fc35 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.729144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3fe729e5-3a00-4545-b6f0-1d74d94220b9 req-20d0e6da-86be-4777-b9e6-fec27d91fc35 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.768279 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3fe729e5-3a00-4545-b6f0-1d74d94220b9 req-20d0e6da-86be-4777-b9e6-fec27d91fc35 service nova] Creating event network-vif-plugged:eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc for instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c on nch1-master-1 Jul 02 21:06:04.788685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3fe729e5-3a00-4545-b6f0-1d74d94220b9 req-20d0e6da-86be-4777-b9e6-fec27d91fc35 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083107 Jul 02 21:06:04.789403 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 736/1399] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:04.802829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:04.804110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:04.812412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.813223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:04.814374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:04.815519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.492867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:05.509831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:05.515927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:05.517213 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9597a4c-e44a-401b-ba95-41ef1dbd7f00 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.991668 Jul 02 21:06:05.525056 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 664/1400] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:04 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:05.538379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:05.538900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:05.557898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.558284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.559094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.559541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.706588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:05.720106 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-543257c8-340b-4552-89e7-487016f27f78 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.923182 Jul 02 21:06:05.720935 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 737/1401] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:04 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:05.727333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:05.734641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:05.746629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.747911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.748976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.749652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.768509 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c HTTP/1.1 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c074787f-d02a-4e68-a9a2-58442e8fef1c'} Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:05.771636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:05.776598 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:05.778402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:05.779876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d535e0a2-ae2f-4e58-b8a1-86e1df38e8e9 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 404 len: 111 microversion: 2.1 time: 0.057111 Jul 02 21:06:05.781045 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 738/1402] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:05 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:05.786631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:05.789002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:05.797667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.798477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.799590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.800250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.888348 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e12b194-3e01-4d91-99bb-7278a8c1901b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.358738 Jul 02 21:06:05.910487 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 665/1403] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:06:05 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c/os-interface => generated 1832 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:05.926544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:05.930169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:05.950688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.953213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:05.957664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:05.960521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:06.612221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:06.624022 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2a5f410-410e-4a3f-a95e-377c7d732313 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.710553 Jul 02 21:06:06.628171 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 666/1404] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:05 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:06.656143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:06.656613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:06.674061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:06.674524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:06.675333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:06.675784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:06.717863 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 HTTP/1.1 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981'} Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:06.724068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:06.730984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:06.735369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:06.737780 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4cda342-e56c-48a7-9e21-9d4ba944d05e tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 404 len: 111 microversion: 2.1 time: 0.106943 Jul 02 21:06:06.741523 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 667/1405] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:06:06 2022] DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:06.746509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:06.756216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:06.759281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:06.761963 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55006ffd-f5f7-4dc5-98ad-90d8f1eb20b4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.979307 Jul 02 21:06:06.772282 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 739/1406] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:05 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:06.782571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:06.785602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:06.786152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:06.786306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:06.790372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:06.793304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:06.809370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:06.810176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:06.811193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:06.811827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.103376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:07.119884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:07.127272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:07.134245 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c20118a-3180-4330-b8e4-292208d77885 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1280 microversion: 2.25 time: 0.390308 Jul 02 21:06:07.135933 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 668/1407] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:06 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:07.145008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:07.149812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:07.167767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.173049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.174722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.175422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.224017 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 HTTP/1.1 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981'} Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:07.232431 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:07.247109 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:07.258119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:07.261355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bddcfbf1-eea2-4545-98f3-9c6122bffae1 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 404 len: 111 microversion: 2.1 time: 0.123907 Jul 02 21:06:07.262912 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 669/1408] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:07 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:07.270271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:07.285797 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1dfcfa58-b8f2-4fd3-96df-6b127d99dea3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.508829 Jul 02 21:06:07.303705 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 740/1409] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:06 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:07.312654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-569b9375-6890-4451-9ba2-a6a1561a9214 req-4f272a14-5997-460e-9fb0-86aa2f6d3f27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc18f7b8-eef1-4bb2-9c72-0d744c679963", "name": "network-vif-plugged", "status": "completed", "tag": "1fbac6fc-7ea1-4724-9990-66f2b54b3dd8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:07.319381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1eeb46d3-5124-4ebb-a2d4-5cb7286f936d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '.version_select at 0x7fabe4570700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:07.344179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-569b9375-6890-4451-9ba2-a6a1561a9214 req-4f272a14-5997-460e-9fb0-86aa2f6d3f27 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.345770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-569b9375-6890-4451-9ba2-a6a1561a9214 req-4f272a14-5997-460e-9fb0-86aa2f6d3f27 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.366447 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1eeb46d3-5124-4ebb-a2d4-5cb7286f936d tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614579100" status: 202 len: 0 microversion: 2.1 time: 0.065460 Jul 02 21:06:07.367222 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 741/1410] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:06:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614579100 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:06:07.378173 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-569b9375-6890-4451-9ba2-a6a1561a9214 req-4f272a14-5997-460e-9fb0-86aa2f6d3f27 service nova] Creating event network-vif-plugged:1fbac6fc-7ea1-4724-9990-66f2b54b3dd8 for instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 on nch2-master-1 Jul 02 21:06:07.399248 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-569b9375-6890-4451-9ba2-a6a1561a9214 req-4f272a14-5997-460e-9fb0-86aa2f6d3f27 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131144 Jul 02 21:06:07.399919 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 670/1411] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:07.565044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5fc3cd37-8d9e-4bdf-848c-4705984f5c79 req-589bff7f-b4c7-460f-baab-1e7c189518ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dbd7119-38af-45a9-997f-2001926d852b", "tag": "f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:07.582700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5fc3cd37-8d9e-4bdf-848c-4705984f5c79 req-589bff7f-b4c7-460f-baab-1e7c189518ca service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.583171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5fc3cd37-8d9e-4bdf-848c-4705984f5c79 req-589bff7f-b4c7-460f-baab-1e7c189518ca service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.609950 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5fc3cd37-8d9e-4bdf-848c-4705984f5c79 req-589bff7f-b4c7-460f-baab-1e7c189518ca service nova] Creating event network-changed:f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a for instance 9dbd7119-38af-45a9-997f-2001926d852b on nch2-master-1 Jul 02 21:06:07.622150 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5fc3cd37-8d9e-4bdf-848c-4705984f5c79 req-589bff7f-b4c7-460f-baab-1e7c189518ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061600 Jul 02 21:06:07.622752 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 742/1412] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:07.650177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:07.651672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:07.671641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.672495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.673531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.674191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.808014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:07.809709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:07.823118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.823827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:07.829023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:07.829894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:08.180117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:08.195875 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51e53071-7fd7-474f-8eaa-dd9e8581247d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.404813 Jul 02 21:06:08.198100 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 743/1413] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:07 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:08.209720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-819c2d56-aed7-43ec-b6a9-f9d9a04dae98 req-f1be84e9-d966-4818-9792-d3650117711a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "tag": "308385e3-792d-4631-b8d7-c37d0374d7db"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:08.220599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:08.237259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:08.240918 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39ab26cd-1f72-4390-a1c1-12980c5cb282 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.594139 Jul 02 21:06:08.243635 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 671/1414] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:07 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:08.244655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-819c2d56-aed7-43ec-b6a9-f9d9a04dae98 req-f1be84e9-d966-4818-9792-d3650117711a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:08.246216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-819c2d56-aed7-43ec-b6a9-f9d9a04dae98 req-f1be84e9-d966-4818-9792-d3650117711a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:08.256505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:08.258068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:08.272513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:08.273285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:08.277555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:08.278225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:08.280217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=14 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:08.286405 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-819c2d56-aed7-43ec-b6a9-f9d9a04dae98 req-f1be84e9-d966-4818-9792-d3650117711a service nova] Creating event network-changed:308385e3-792d-4631-b8d7-c37d0374d7db for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:06:08.302581 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-819c2d56-aed7-43ec-b6a9-f9d9a04dae98 req-f1be84e9-d966-4818-9792-d3650117711a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101913 Jul 02 21:06:08.313386 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 744/1415] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:08.325424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:08.329144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:08.338839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:08.350230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:08.351386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:08.351840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:08.534502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:08.891698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:08.905129 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-646b3bf4-9039-4ed6-8320-aa5691757ed3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.589653 Jul 02 21:06:08.905773 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 745/1416] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:08 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:08.987216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:09.007027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:09.009950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:09.011430 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-679299da-32a8-4f81-8058-992b35dd6940 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1475 microversion: 2.25 time: 0.766119 Jul 02 21:06:09.012645 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 672/1417] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:08 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1475 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:09.035859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:09.038108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:09.050335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.051902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.053010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.053678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.214812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:09.215346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:09.223250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.244164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.245367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.245828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.843812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 771bfeb8-cc53-4509-ac0c-ecaec2116b7c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:09.866347 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fb66ad9e-bc77-4be5-8e58-e31a46b78267 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1967 microversion: 2.25 time: 0.827186 Jul 02 21:06:09.872564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 746/1418] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:09 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1967 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:09.886595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:09.887332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:09.888301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:09.895557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.896888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.897261 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb657b34-4bb8-4c41-9ac8-0e57bec5e1c7 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1320 microversion: 2.1 time: 0.686430 Jul 02 21:06:09.898562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.907645 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 673/1419] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:09 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1320 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:09.907645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c2395945-f9bd-4e2e-9084-bb3c386ba53b req-0b1dc0a9-6b4b-4155-9130-4e19ff4437bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ceec01b-0a29-4f85-a6e9-404754e90ee9", "name": "network-vif-plugged", "status": "completed", "tag": "515f1a8d-79bb-4891-967d-ea4c430d8c18"}, {"server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "name": "network-vif-plugged", "status": "completed", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:09.910173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.924899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2395945-f9bd-4e2e-9084-bb3c386ba53b req-0b1dc0a9-6b4b-4155-9130-4e19ff4437bd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.925811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c2395945-f9bd-4e2e-9084-bb3c386ba53b req-0b1dc0a9-6b4b-4155-9130-4e19ff4437bd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.950366 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c2395945-f9bd-4e2e-9084-bb3c386ba53b req-0b1dc0a9-6b4b-4155-9130-4e19ff4437bd service nova] Creating event network-vif-plugged:515f1a8d-79bb-4891-967d-ea4c430d8c18 for instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 on nch1-master-1 Jul 02 21:06:09.951193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c2395945-f9bd-4e2e-9084-bb3c386ba53b req-0b1dc0a9-6b4b-4155-9130-4e19ff4437bd service nova] Creating event network-vif-plugged:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch2-master-1 Jul 02 21:06:09.970796 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c2395945-f9bd-4e2e-9084-bb3c386ba53b req-0b1dc0a9-6b4b-4155-9130-4e19ff4437bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.070079 Jul 02 21:06:09.971587 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 674/1420] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:09.980695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:09.981536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:09.988651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.989367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:09.990103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:09.990620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.388312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:10.403224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a800df0-b8a7-4667-89b0-948156a7e0f0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.528682 Jul 02 21:06:10.412641 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 747/1421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:09 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:10.422947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.424510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.427870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 771bfeb8-cc53-4509-ac0c-ecaec2116b7c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:10.434709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.435552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.436739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.437355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.440986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:10.446113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09a5e0ee-4ac7-4a79-af8c-fa6bdab074a0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1967 microversion: 2.25 time: 0.472928 Jul 02 21:06:10.454469 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 675/1422] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:09 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1967 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:10.466521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d690841a-fc5f-41a3-9719-4fa0cb261951 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.468395 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:10.468395 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:10.515670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d690841a-fc5f-41a3-9719-4fa0cb261951 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/616433894" status: 202 len: 0 microversion: 2.1 time: 0.059416 Jul 02 21:06:10.520547 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 676/1423] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:06:10 2022] DELETE /compute/v2.1/flavors/616433894 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:06:10.525925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f46cc496-8db9-4ca7-9d6c-49879bb8867f tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.527677 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:10.527677 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:10.532620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f46cc496-8db9-4ca7-9d6c-49879bb8867f tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.537932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f46cc496-8db9-4ca7-9d6c-49879bb8867f tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.539322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f46cc496-8db9-4ca7-9d6c-49879bb8867f tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.540302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f46cc496-8db9-4ca7-9d6c-49879bb8867f tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.586548 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f46cc496-8db9-4ca7-9d6c-49879bb8867f tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.064415 Jul 02 21:06:10.593987 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 677/1424] 10.222.0.43 () {60 vars in 1216 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:06:10.599042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9830c2b4-7b85-45c4-8d33-486d387e7df6 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.618567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9830c2b4-7b85-45c4-8d33-486d387e7df6 tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.023050 Jul 02 21:06:10.619621 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 678/1425] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:10.634283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:10.635460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.637448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:10.642761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.643320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.644258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.644763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.646319 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1ec43595-26ba-4f62-89d2-13516fb1188a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.231945 Jul 02 21:06:10.646905 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 748/1426] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:10.656669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48519036-fbec-4f54-a641-d3c8b7702d6d tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.657848 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:10.657848 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:10.674133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'flavor' on Instance uuid 771bfeb8-cc53-4509-ac0c-ecaec2116b7c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:10.681243 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48519036-fbec-4f54-a641-d3c8b7702d6d tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/1875449373" status: 202 len: 0 microversion: 2.1 time: 0.032059 Jul 02 21:06:10.682470 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 749/1427] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:06:10 2022] DELETE /compute/v2.1/flavors/1875449373 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:06:10.692650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b370d877-6155-4ba4-8a00-f64a71f6846e tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.694758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Going to try to live migrate instance to nch2-master-1 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:06:10.716111 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b370d877-6155-4ba4-8a00-f64a71f6846e tempest-ServersWithSpecificFlavorTestJSON-257702968 tempest-ServersWithSpecificFlavorTestJSON-257702968-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028146 Jul 02 21:06:10.717481 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 750/1428] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:10.748476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.749354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.761402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.762162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.763372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.764158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.768431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:10.783083 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c HTTP/1.1 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c074787f-d02a-4e68-a9a2-58442e8fef1c'} Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:10.785068 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f1469b5b-c4c9-4af1-94ce-ed2b7cae9d5a tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 404 len: 111 microversion: 2.1 time: 0.046145 Jul 02 21:06:10.794356 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 751/1429] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:06:10 2022] DELETE /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:10.795720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.796343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: c074787f-d02a-4e68-a9a2-58442e8fef1c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.803306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.803821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.804811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.805270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.822120 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c HTTP/1.1 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c074787f-d02a-4e68-a9a2-58442e8fef1c'} Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.824684 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance c074787f-d02a-4e68-a9a2-58442e8fef1c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d18a1b8a-29f6-46d2-aa23-323683ab5969 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c" status: 404 len: 111 microversion: 2.1 time: 0.034191 Jul 02 21:06:10.830743 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 752/1430] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/servers/c074787f-d02a-4e68-a9a2-58442e8fef1c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:10.837669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.838312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.845722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.846281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.847071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.847515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.862202 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 HTTP/1.1 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981'} Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:10.864114 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ff07b42a-cddf-4e28-bfd9-26c394711fcf tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 404 len: 111 microversion: 2.1 time: 0.033104 Jul 02 21:06:10.868464 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 753/1431] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:06:10 2022] DELETE /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:10.888394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.888394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] [instance: 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.888394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.888394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.888394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.888394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.901110 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] HTTP exception thrown: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Request method failure captured: Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 HTTP/1.1 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLJEeO4vdmn-GdHPxZCghRwwQaXf47X8WmeHwib0XIzmeEG4hTIqCE4WgghrFzighY1xwyFWo-r8YmvucWdvGS6SQ6DJx-sA1P5iMeUXAxAo0SgR3zqO7TuMNMJ1vDek0nEjnkV2CXrxvXE_Fs3NWLxgwK_FHGkM754CeTj5sQVNt8U Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f8920bed46d34026a06fedf429e5cca4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f8920bed46d34026a06fedf429e5cca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f8920bed46d34026a06fedf429e5cca4"}]}] Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f8920bed46d34026a06fedf429e5cca4 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a60bf5141fea499abb9b22658e56c944 Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1088870529-project Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981'} Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.902890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] Returning 404 to user: Instance 8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-13da87f9-8c5d-4cdf-a1cb-69ecf4468964 tempest-ServersWithSpecificFlavorTestJSON-1088870529 tempest-ServersWithSpecificFlavorTestJSON-1088870529-project] 10.222.0.43 "GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981" status: 404 len: 111 microversion: 2.1 time: 0.033569 Jul 02 21:06:10.908160 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 754/1432] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/servers/8c4ad6e3-b3bf-4489-aec1-e9f5ac5d3981 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:10.922979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:10.924079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:10.933309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.934021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:10.935482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:10.936253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:11.250930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:11.273502 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-315a8661-f07e-47bd-a3d2-650664b6d883 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1511 microversion: 2.1 time: 0.355727 Jul 02 21:06:11.274683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 755/1433] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:10 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1511 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:11.292283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:11.293787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:11.301991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:11.302806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:11.304367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:11.305067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:11.601454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:11.611314 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-161bcd3f-c935-4d31-ba9b-549032e88c7d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1512 microversion: 2.1 time: 0.323020 Jul 02 21:06:11.621119 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 756/1434] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:11 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1512 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:11.624635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:11.625518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:11.633202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:11.633983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:11.635640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:11.635899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:11.914061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:11.923765 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bde265c9-6617-4794-9819-531df11546a2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1312 microversion: 2.1 time: 0.310368 Jul 02 21:06:11.925793 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 757/1435] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:11 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:11.938163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:11.938853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:11.958708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:11.959158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:11.960008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:11.960465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:12.291198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:12.302183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6f5bce54-7e66-44f4-a43e-23d29bcce7ff tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 200 len: 1513 microversion: 2.1 time: 0.374950 Jul 02 21:06:12.303457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 758/1436] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:11 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 1513 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:12.311428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:12.315792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:12.318642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:12.319764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:12.321041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:12.321640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:12.639802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:12.657933 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83e2f674-9557-4a2e-bf61-90cad0379e1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.345826 Jul 02 21:06:12.672478 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 759/1437] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:12 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:12.696535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:12.716365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:12.717271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:12.744816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:12.745267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:12.746072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:12.746517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:12.959802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:13.149849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:13.165947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.168197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.217228 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1eabf886-f8ae-4d97-8da0-e1a848155429 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c/action" status: 202 len: 0 microversion: 2.25 time: 2.586938 Jul 02 21:06:13.221705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 679/1438] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:06:10 2022] POST /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c/action => generated 0 bytes in 2602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:06:13.227822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:13.229169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:13.251255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.255605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.256779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.260175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.584539 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8113bcff-e3e7-4483-868d-ecd527665819 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.910752 Jul 02 21:06:13.587049 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 760/1439] 10.222.0.43 () {58 vars in 1166 bytes} [Sat Jul 2 21:06:12 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:13.603246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:13.604547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:13.614632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.615487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.620714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.621440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.720873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:13.732641 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-92611280-aa55-4d2f-9d38-b0cd9ab86914 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1462 microversion: 2.1 time: 0.509498 Jul 02 21:06:13.750926 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 680/1440] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:13 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1462 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:13.763494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:13.770736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:13.775159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1505071264', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:13.781363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.781825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.782640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.783076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:13.893693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:13.985922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:13.992885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:13.993364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.136605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.146050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.147561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.154515 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e56145cf-0d38-4740-8b92-0474c960a0a9 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.561846 Jul 02 21:06:14.155848 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 761/1441] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:13 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:14.160530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:14.161504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:14.169722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.170433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.171477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.172100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.393320 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8771bf2c-2553-47e6-ac4e-9e715ea1e42f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1505071264" status: 200 len: 1515 microversion: 2.1 time: 0.640015 Jul 02 21:06:14.394601 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 681/1442] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:06:13 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1505071264 => generated 1515 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:14.400573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:14.401389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:14.417499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.418591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.419834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.420529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.508098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.515751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-848ffd3a-3dd1-45c2-854d-4bf53d981573 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.358772 Jul 02 21:06:14.520746 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 762/1443] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:14 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:14.529627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:14.542453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.543590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:14.550222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.555555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.556707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.557336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.713711 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e43808ef-fd6b-464b-a856-1b738c92c30e tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1613 microversion: 2.1 time: 0.317363 Jul 02 21:06:14.714823 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 682/1444] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:14 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1613 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:14.734100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:14.734279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:14.734681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:14.741975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.742436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.744325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.744325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:14.857946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1068ef10c5ca46619e6280360e5a0930', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aacdf1893ae44e383bfc224b1e78784', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.860383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] flavor_id is None. Assuming migration. {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 02 21:06:14.860718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:14.860846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:06:14.868857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:14.869401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.155434 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f098de18-8d3d-45a3-a5ac-1ececfe6df17 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.633338 Jul 02 21:06:15.156852 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 763/1445] 10.222.0.43 () {58 vars in 1172 bytes} [Sat Jul 2 21:06:14 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:15.161687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-209d038b-dba3-44ac-83c5-495d45bb7b28 req-f8a72d3c-f4fe-4936-9541-d67c2e599138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd7119-38af-45a9-997f-2001926d852b", "name": "network-vif-plugged", "status": "completed", "tag": "f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:15.187368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-209d038b-dba3-44ac-83c5-495d45bb7b28 req-f8a72d3c-f4fe-4936-9541-d67c2e599138 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.188247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-209d038b-dba3-44ac-83c5-495d45bb7b28 req-f8a72d3c-f4fe-4936-9541-d67c2e599138 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.213248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-209d038b-dba3-44ac-83c5-495d45bb7b28 req-f8a72d3c-f4fe-4936-9541-d67c2e599138 service nova] Creating event network-vif-plugged:f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a for instance 9dbd7119-38af-45a9-997f-2001926d852b on nch2-master-1 Jul 02 21:06:15.220672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e20b823e-2b5e-4d5f-bbab-4354c8ef0f11 tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4/action" status: 202 len: 0 microversion: 2.1 time: 0.489585 Jul 02 21:06:15.232201 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 683/1446] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:06:14 2022] POST /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:06:15.234362 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-209d038b-dba3-44ac-83c5-495d45bb7b28 req-f8a72d3c-f4fe-4936-9541-d67c2e599138 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075997 Jul 02 21:06:15.235472 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 764/1447] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:15.238506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:15.246563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:15.252652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:15.255265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:15.261983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.compute.servers [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Removing options 'limit' from query {{(pid=131045) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 02 21:06:15.263235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:15.276769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.277619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.278636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.279312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.291506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:15.295683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.300673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.303022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.303482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.455316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:15.466428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.467037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.829040 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-58dca96c-0026-4327-8deb-e93375e5d27f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.591750 Jul 02 21:06:15.830714 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 765/1448] 10.222.0.43 () {58 vars in 1160 bytes} [Sat Jul 2 21:06:15 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:15.842003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:15.842003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:15.855458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:15.871957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:15.874807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=93,nova_api:DELETE=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:15.886288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:15.894467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8807c51e-6301-4c66-87ec-9d557ea8f237 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.656454 Jul 02 21:06:15.904162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.904162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.904482 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 684/1449] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:15 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:15.904578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.904578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.932638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:15.934278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:15.945337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.946174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:15.947176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:15.948416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.317621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:16.328992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-581fe0ee-a6e1-42f0-8bf6-ffbe876160e0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1471 microversion: 2.1 time: 0.496438 Jul 02 21:06:16.329599 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 766/1450] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:15 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:16.342744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:16.364885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:16.365630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:16.386901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:16.387355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.388191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:16.388630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.565821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:16.577848 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5295414-f93c-4130-b9ff-3dd9d268159c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1314 microversion: 2.1 time: 0.678164 Jul 02 21:06:16.590092 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 685/1451] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:15 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1314 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:16.667217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:16.776581 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a938b62c-17de-46f8-bbba-3f1ff9520423 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.445802 Jul 02 21:06:16.778088 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 767/1452] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:06:16 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:16.793207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:16.800683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:16.803392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Removing options 'limit' from query {{(pid=131044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 02 21:06:16.804183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:16.836288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:16.837430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.839152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:16.840922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.892996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:16.914685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:16.915682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:16.924135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:16.925773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.926916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:16.927735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:16.976508 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c759ec0-fd84-49e5-a0a3-ea61ac362e8e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.189170 Jul 02 21:06:16.985082 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 686/1453] 10.222.0.43 () {58 vars in 1149 bytes} [Sat Jul 2 21:06:16 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:16.997660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:17.003276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.004491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:17.013255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.014095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.015609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.016530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.063006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:17.085399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:17.179555 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4406f0a3-fa52-4eed-a88e-8d2094560cb5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.192232 Jul 02 21:06:17.181248 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 687/1454] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:06:16 2022] GET /compute/v2.1/servers => generated 1011 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:17.200972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:17.207694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.208426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:17.294601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.298543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.299862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.304957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.496526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:17.568176 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8035e3b-0b3e-48d1-a86b-db3a076a3858 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.377892 Jul 02 21:06:17.569398 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 688/1455] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:17 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:17.574439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:17.575243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:17.600292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.601415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.602516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.603856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.611925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.628495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.631589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.634240 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe47c254-dc36-485c-af4a-280214947174 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.723213 Jul 02 21:06:17.646545 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 768/1456] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:16 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:17.654694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:17.660451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.661540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.compute.servers [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Removing options 'limit' from query {{(pid=131045) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 02 21:06:17.662456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:17.671647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.673217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.675473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.676133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.716963 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a59a986d-9472-4db6-9414-8ce7545979db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.068713 Jul 02 21:06:17.718120 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 769/1457] 10.222.0.43 () {58 vars in 1139 bytes} [Sat Jul 2 21:06:17 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:17.726334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:17.727520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:17.741692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.742522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.745089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.746294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.956490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.956490 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78208cf5-d1b8-4d8c-a169-d727abca43f7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1471 microversion: 2.1 time: 0.374070 Jul 02 21:06:17.956490 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 689/1458] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:17 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:17.956490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:17.956490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:17.956490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1505071264', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:17.961058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.961535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:17.962926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:17.962926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.003708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:18.019752 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d9fc80e-0906-45a8-b61f-409e265384ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1500 microversion: 2.1 time: 0.300342 Jul 02 21:06:18.020652 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 770/1459] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:17 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1500 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:18.059559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:18.081157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:18.083247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:18.097274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.100252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.103935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.106103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.151572 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96cd49a8-4f7f-4a5f-afe8-17259a7ad8db tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1505071264" status: 200 len: 346 microversion: 2.1 time: 0.204994 Jul 02 21:06:18.152504 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 690/1460] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:06:17 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1505071264 => generated 346 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:18.166081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-536acaec-fc26-4434-9841-62f1a572fade tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:18.167466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lazy-loading 'flavor' on Instance uuid 9dbd7119-38af-45a9-997f-2001926d852b {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:18.173733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-536acaec-fc26-4434-9841-62f1a572fade tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.174413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-536acaec-fc26-4434-9841-62f1a572fade tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.244080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-536acaec-fc26-4434-9841-62f1a572fade tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:06:18.315952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:18.363733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-536acaec-fc26-4434-9841-62f1a572fade tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "POST /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e/action" status: 202 len: 0 microversion: 2.1 time: 0.201601 Jul 02 21:06:18.377688 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 691/1461] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:06:18 2022] POST /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:06:18.387256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:18.388322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:18.396780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.397826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.399037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.399705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.639823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:18.649484 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c1cd9c1-059a-4532-abe8-7e96902a3ec3 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.268053 Jul 02 21:06:18.650869 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 692/1462] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:18 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:18.656511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:18.657603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:18.664599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.665280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.666479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.667239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.702439 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27280e91-342c-4c64-8f0f-e30d17bc6326 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b/action" status: 202 len: 0 microversion: 2.1 time: 0.646659 Jul 02 21:06:18.708132 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 771/1463] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:06:18 2022] POST /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:06:18.719882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:18.723103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:18.738377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.741199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:18.743270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:18.744575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:19.115549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:19.132176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:19.137676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:19.140305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7fff313a-b984-4eae-85b6-1370b60133ca tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.488147 Jul 02 21:06:19.143939 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 693/1464] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:18 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:19.151267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:19.157282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:19.173164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:19.173615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:19.177728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:19.178133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:19.220216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:19.240952 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-39f09fe1-ba11-4437-b8b1-af0adcf8c1b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.529437 Jul 02 21:06:19.241734 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 772/1465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:18 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:19.360995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:19.369981 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-302b913d-e582-4461-8af2-08c4b67e6fce tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1471 microversion: 2.1 time: 0.224667 Jul 02 21:06:19.373131 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 694/1466] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:19 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1471 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:19.669712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:19.672566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:19.679853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:19.681573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:19.682696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:19.683418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:19.891709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:19.900759 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-956848ff-7528-4fa1-9daa-ae6561cec946 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.236103 Jul 02 21:06:19.902131 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 773/1467] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:19 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:20.133327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-277791f0-1755-4c14-b0ad-816feedfe70b req-5f4f102c-031e-4c0e-991c-3c84fa316b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771bfeb8-cc53-4509-ac0c-ecaec2116b7c", "name": "network-vif-unplugged", "status": "completed", "tag": "eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:20.154073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-277791f0-1755-4c14-b0ad-816feedfe70b req-5f4f102c-031e-4c0e-991c-3c84fa316b40 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.154932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-277791f0-1755-4c14-b0ad-816feedfe70b req-5f4f102c-031e-4c0e-991c-3c84fa316b40 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.161970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:20.162848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:20.177236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.179230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.184598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.185487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.207488 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-277791f0-1755-4c14-b0ad-816feedfe70b req-5f4f102c-031e-4c0e-991c-3c84fa316b40 service nova] Creating event network-vif-unplugged:eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc for instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c on nch1-master-1 Jul 02 21:06:20.231560 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-277791f0-1755-4c14-b0ad-816feedfe70b req-5f4f102c-031e-4c0e-991c-3c84fa316b40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100282 Jul 02 21:06:20.236364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 695/1468] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:20.267640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:20.267640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:20.286783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.292636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.296529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.300631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.606158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:20.628604 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe2c2496-8fcf-432a-a09b-f20a2dcca78b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.372465 Jul 02 21:06:20.640078 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 696/1469] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:20 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:20.645844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:20.646470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:20.681702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.688319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.690014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.694684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.720653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:20.732260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:20.741422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:20.743180 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5eecee9-a94e-4254-a8d0-77c2b314a0f3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.585968 Jul 02 21:06:20.745300 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 774/1470] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:20 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:20.919038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:20.919970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:20.936579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.936579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:20.936579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:20.937110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:21.034694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:21.057578 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2453c2e1-572a-493d-9b69-4228913b0232 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1471 microversion: 2.1 time: 0.411515 Jul 02 21:06:21.058418 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 697/1471] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:20 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:21.293303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:21.302547 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fbeed147-d4b0-4a22-bd84-1019ef324193 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.387747 Jul 02 21:06:21.305768 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 775/1472] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:20 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:21.653447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:21.654101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:21.675556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:21.678585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:21.679526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:21.683222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:21.764621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:21.767809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:21.783621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:21.788553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:21.791829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:21.792620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:22.019545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:22.029860 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-658ccc5f-15ca-4752-8b6b-9a9f3caf81f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.380620 Jul 02 21:06:22.030457 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 698/1473] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:21 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:22.071519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:22.085077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:22.086696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:22.101868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:22.104317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:22.104712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:22.106657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:22.108075 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc0391e6-90b5-40cb-80bf-77c8b1fd3bb0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.349146 Jul 02 21:06:22.118657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:22.118657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:22.122297 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 776/1474] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:21 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:22.252829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7d9c1001-38ca-4887-8f5a-90689bb0c425 req-438b8f5e-c8be-4e10-9942-7b639fb0ec30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771bfeb8-cc53-4509-ac0c-ecaec2116b7c", "tag": "eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:22.272500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7d9c1001-38ca-4887-8f5a-90689bb0c425 req-438b8f5e-c8be-4e10-9942-7b639fb0ec30 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:22.273045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7d9c1001-38ca-4887-8f5a-90689bb0c425 req-438b8f5e-c8be-4e10-9942-7b639fb0ec30 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:22.290550 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7d9c1001-38ca-4887-8f5a-90689bb0c425 req-438b8f5e-c8be-4e10-9942-7b639fb0ec30 service nova] Creating event network-changed:eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc for instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c on nch1-master-1 Jul 02 21:06:22.297643 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7d9c1001-38ca-4887-8f5a-90689bb0c425 req-438b8f5e-c8be-4e10-9942-7b639fb0ec30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048741 Jul 02 21:06:22.299307 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 777/1475] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:22.322940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:22.323862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:22.333256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:22.334003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:22.334969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:22.335569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:22.491197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:22.499704 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89daed69-59ef-4430-8e12-9f6c3e059948 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.428768 Jul 02 21:06:22.520365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 699/1476] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:22 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:22.816863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:22.826537 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c09c21d8-0e5b-42dc-bd50-85961e41e463 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.508764 Jul 02 21:06:22.831094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 778/1477] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:22 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:23.048775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:23.049527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:23.068001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.068860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.069911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.070778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.138785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:23.138785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:23.146943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.147619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.148794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.149610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.481233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:23.499181 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cc597d0-8ba7-44a4-8b9c-2765a191f79d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.455261 Jul 02 21:06:23.500427 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 700/1478] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:23 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:23.531023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:23.532344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:23.539273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.540317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.541421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.542152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.554273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:23.569301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:23.570959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:23.577204 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a79e3463-0e8e-409f-80a1-d63287190743 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.446124 Jul 02 21:06:23.578437 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 779/1479] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:23 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:23.793384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:23.801658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e0906b2-0f84-4298-8f91-47bdff91793e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.275123 Jul 02 21:06:23.802765 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 701/1480] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:23 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:23.850271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:23.850899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:23.863038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.863491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:23.864298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:23.864737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:24.119711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:24.128032 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a48d9c9e-8555-411b-96c9-2791426876e8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.281489 Jul 02 21:06:24.128776 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 780/1481] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:23 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:24.529999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:24.533375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:24.540482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:24.544506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:24.545290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:24.546852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:24.547512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:24.595195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:24.595820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:24.631429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:24.632001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:24.633128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:24.633612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:25.369867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:25.379828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78056d9d-6428-4788-a560-29ec060effcc tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.866114 Jul 02 21:06:25.381399 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 702/1482] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:24 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:25.390359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:25.393050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:25.396421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:25.402891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:25.403879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:25.404882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:25.405622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:25.413690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:25.418401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:25.425353 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc8d104b-772b-4081-90d7-20fe1906d0a3 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.834400 Jul 02 21:06:25.425956 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 781/1483] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:24 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:25.436660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:25.438146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:25.448661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:25.449543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:25.450513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:25.451940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:25.458647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:25.876218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:25.888451 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0bb727a-2f7d-4dcd-a165-62fbc16a466d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.505610 Jul 02 21:06:25.889223 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 703/1484] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:25 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:25.905105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:25.919978 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d8e5e18c-db5b-4240-8b0f-30913056d5cd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.492780 Jul 02 21:06:25.921732 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 782/1485] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:25 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:25.998267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c0847e00-efa7-41fb-9584-a9face718649 req-f2e93040-0857-4ef9-978c-e5b958ced251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771bfeb8-cc53-4509-ac0c-ecaec2116b7c", "name": "network-vif-unplugged", "status": "completed", "tag": "eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:26.010200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0847e00-efa7-41fb-9584-a9face718649 req-f2e93040-0857-4ef9-978c-e5b958ced251 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.010783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c0847e00-efa7-41fb-9584-a9face718649 req-f2e93040-0857-4ef9-978c-e5b958ced251 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.033513 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c0847e00-efa7-41fb-9584-a9face718649 req-f2e93040-0857-4ef9-978c-e5b958ced251 service nova] Creating event network-vif-unplugged:eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc for instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c on nch1-master-1 Jul 02 21:06:26.042207 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c0847e00-efa7-41fb-9584-a9face718649 req-f2e93040-0857-4ef9-978c-e5b958ced251 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049346 Jul 02 21:06:26.043418 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 704/1486] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:26.399015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:26.399729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:26.409144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.410020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.410976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.413182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.446134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:26.446928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:26.459396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.460330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.463341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.463728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.777825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:26.781480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:26.796530 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-19f3551e-4361-48ac-b74e-a275068cbee0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.402146 Jul 02 21:06:26.797483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:26.799969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:26.801705 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21b504f1-f647-4316-965a-9d2799c87d8d tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1485 microversion: 2.25 time: 0.362035 Jul 02 21:06:26.807470 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 783/1487] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:26 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:26.814949 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 705/1488] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:26 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1485 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:26.911496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:26.915378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:26.919583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.920651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.921840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.922476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.943086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:26.943869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:26.944866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:26.964197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.964781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:26.965615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:26.966076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:27.274406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:27.276953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:27.286342 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ae0816c-ad86-48d7-afd6-eb226553656a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.351032 Jul 02 21:06:27.287238 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 706/1489] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:26 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:27.303354 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4efc08c6-e5b7-48d4-8af3-42e4e441ed77 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.398007 Jul 02 21:06:27.315592 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 784/1490] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:26 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:27.816165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:27.817117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:27.821293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:27.827086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:27.827818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:27.829575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:27.830388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:27.831346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:27.832413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:27.837907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:27.838413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:27.839465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:27.839920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:27.999356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:28.067458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:28.082184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:28.084511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:28.086163 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3e50112-da33-4594-af98-646abc70aca7 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1475 microversion: 2.25 time: 0.266616 Jul 02 21:06:28.097207 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 785/1491] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:27 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1475 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:28.100471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:28.112384 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-769004ed-b2d7-43e7-9948-8ff19440e6b8 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.301911 Jul 02 21:06:28.113012 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 707/1492] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:27 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:28.129273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b696ccf1-dfea-49c4-926c-19d6acb9a1c0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '.version_select at 0x7fabe4b7f040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:28.133967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b696ccf1-dfea-49c4-926c-19d6acb9a1c0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.134997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b696ccf1-dfea-49c4-926c-19d6acb9a1c0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.159074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b696ccf1-dfea-49c4-926c-19d6acb9a1c0 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 3629 microversion: 2.25 time: 0.044761 Jul 02 21:06:28.159918 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 708/1493] 10.222.0.43 () {60 vars in 1183 bytes} [Sat Jul 2 21:06:28 2022] GET /compute/v2.1/os-migrations => generated 3629 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:28.173804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:28.174786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:28.181808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.182365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.183166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.183616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.341995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] Lazy-loading 'services' on Instance uuid 771bfeb8-cc53-4509-ac0c-ecaec2116b7c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:28.345781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:28.358452 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13e08111-df22-42f6-bbd5-ff57528b4d85 tempest-LiveAutoBlockMigrationV225Test-2025202973 tempest-LiveAutoBlockMigrationV225Test-2025202973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1967 microversion: 2.25 time: 0.188524 Jul 02 21:06:28.359089 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 709/1494] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:28 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1967 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:28.380473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:28.381102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:28.389135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.389611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.390455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.391076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.394554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-74cd6166-9196-4da2-8978-4104617faf3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Action: 'create', calling method: .version_select at 0x7fabe4774700>, body: {"keypair": {"name": "tempest-keypair-1098367299", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3DeG97hxb4aBnq/0gALae/kTxet0IW8k4tBA/ldTrU6yMlkssqp3XD9O5NJhbnbSFvtJNDQ7c9G13MUhISmjpqHcPoq0W/gEngsRDLCXfBBBuq2v7KiJwCRGNu06d9TA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:28.410728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-74cd6166-9196-4da2-8978-4104617faf3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Getting quotas for project 426d63ca5cfa48e19a7156d1b848447e. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:06:28.416329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-74cd6166-9196-4da2-8978-4104617faf3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Getting quotas for user 097020096c1c4ff2b67800be67cd708a and project 426d63ca5cfa48e19a7156d1b848447e. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:06:28.449590 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-74cd6166-9196-4da2-8978-4104617faf3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360648 Jul 02 21:06:28.455770 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 786/1495] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:06:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:28.458968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:28.459785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:28.466753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.467214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.468065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.468633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.600570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:28.621391 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10c182ea-f824-4fc0-aec6-86013ff217fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.248064 Jul 02 21:06:28.622035 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 710/1496] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:28 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:28.640586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:28.641146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:28.650502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.651464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.652474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.653200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.700294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:28.704112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:28.716696 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0c064fb1-83c8-427a-b750-94f7f92ca475 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.264676 Jul 02 21:06:28.717293 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 787/1497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:28 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:28.833316 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4bca53cf-b6f1-4284-897f-fe5d142917d5 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "DELETE /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 204 len: 0 microversion: 2.25 time: 0.202493 Jul 02 21:06:28.834654 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 711/1498] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:06:28 2022] DELETE /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:06:28.843121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:28.843764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:28.851444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.851925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:28.852881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:28.853322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.072197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:29.096220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:29.105052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:29.107706 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-62201a4a-1491-4623-a4e3-d1575dd08902 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1481 microversion: 2.25 time: 0.267494 Jul 02 21:06:29.110590 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 788/1499] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:28 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1481 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:29.153251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:29.155371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:29.173342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.174748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.176108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.177222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.463859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:29.472860 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-053d7c63-a646-4699-b6f1-3a7f11a4e9e7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.345064 Jul 02 21:06:29.473672 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 712/1500] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:29 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:29.621419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe4806a60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:29.622330 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:29.622330 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:29.623566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.624024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.640332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.640786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.641520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:29.642482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:29.652476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.652648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.652930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.653160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.654472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.655018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.660204 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a24212f1-a1de-4bf3-84a5-687669ce5435 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.166976 Jul 02 21:06:29.660924 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 789/1501] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:29.672032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe4806ca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:29.673498 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:29.673498 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:29.674757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.675136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.693974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.694694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.706769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.707470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.715103 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c41b1e19-d7a9-44b8-9acb-7476e4c23c06 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.046622 Jul 02 21:06:29.715637 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 790/1502] 10.222.0.43 () {58 vars in 1166 bytes} [Sat Jul 2 21:06:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:29.729107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe484b790>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:29.730192 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:29.730192 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:29.731819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.732488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.748359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.748785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.768866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.769395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.784141 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc79c64e-5687-4351-8b9e-c1edb8729909 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056533 Jul 02 21:06:29.785967 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 791/1503] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:29.794027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:29.795092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:29.806006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.806684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:29.807664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:29.808196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.016751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:30.027070 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d75ed4eb-0762-4958-8f86-36c6b16f5d90 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.391525 Jul 02 21:06:30.027679 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 713/1504] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:29 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:30.034045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3485c0e-abec-41ce-b912-62656005a1ee tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe46b5160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.036863 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:30.036863 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:30.038981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3485c0e-abec-41ce-b912-62656005a1ee tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.039528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3485c0e-abec-41ce-b912-62656005a1ee tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.061030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3485c0e-abec-41ce-b912-62656005a1ee tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.061553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3485c0e-abec-41ce-b912-62656005a1ee tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.069096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3485c0e-abec-41ce-b912-62656005a1ee tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.039741 Jul 02 21:06:30.069795 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 714/1505] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:30.082712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:30.101469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8a84ef2-bced-428f-b01c-4810a32a6f0c tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe536c9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.103307 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:30.103307 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:30.105260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8a84ef2-bced-428f-b01c-4810a32a6f0c tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.105970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8a84ef2-bced-428f-b01c-4810a32a6f0c tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.106991 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-67b90db0-4362-4a27-91d8-2ba32ba2a5ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.319365 Jul 02 21:06:30.108120 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 792/1506] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:29 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:30.126359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.126975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:30.130664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8a84ef2-bced-428f-b01c-4810a32a6f0c tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.042851 Jul 02 21:06:30.132444 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 715/1507] 10.222.0.43 () {58 vars in 1178 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:30.134234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.135023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.135923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.136664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.150080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe4959e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.151542 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:30.151542 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:30.153184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.153902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.180983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.182607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.198088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.199032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.207047 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f034699-db0b-43d7-b887-122b5f231c64 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062610 Jul 02 21:06:30.208420 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 716/1508] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:30.218608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-856a51e9-47a6-4938-8809-d9e94c0593b9 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe47c1b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.220070 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:30.220070 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:30.221930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-856a51e9-47a6-4938-8809-d9e94c0593b9 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.222716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-856a51e9-47a6-4938-8809-d9e94c0593b9 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.243627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-856a51e9-47a6-4938-8809-d9e94c0593b9 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.244412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-856a51e9-47a6-4938-8809-d9e94c0593b9 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.255510 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-856a51e9-47a6-4938-8809-d9e94c0593b9 tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.041558 Jul 02 21:06:30.257643 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 717/1509] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:30.269569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07414442-961c-4424-bb57-82bb0f42928f tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe456b160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.270384 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:30.270384 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:30.271610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07414442-961c-4424-bb57-82bb0f42928f tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.272117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07414442-961c-4424-bb57-82bb0f42928f tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.289272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07414442-961c-4424-bb57-82bb0f42928f tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.289832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07414442-961c-4424-bb57-82bb0f42928f tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.297708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07414442-961c-4424-bb57-82bb0f42928f tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.032709 Jul 02 21:06:30.298319 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 718/1510] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:30.311120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Calling method '.version_select at 0x7fabe4deee50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.312251 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:30.312251 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:30.313574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.314620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.346779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.348554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.366712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.368180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.390287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2180cc28-623d-4af1-89c4-d38e811597ab tempest-HypervisorAdminTestJSON-1696666408 tempest-HypervisorAdminTestJSON-1696666408-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.083056 Jul 02 21:06:30.392104 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 719/1511] 10.222.0.43 () {58 vars in 1172 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:30.493794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:30.494352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:30.513390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.513917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.514969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.519230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.758178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:30.770987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:30.773239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:30.774447 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d59f7fa8-b97e-456b-bed2-fc270275cf29 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 200 len: 1481 microversion: 2.25 time: 0.652067 Jul 02 21:06:30.787993 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 793/1512] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 1481 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:30.793127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-255d0aee-116b-491b-9e8f-18edf796cfa9 req-f7366ffe-baec-448c-8aa2-74fb5bf7d04b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771bfeb8-cc53-4509-ac0c-ecaec2116b7c", "name": "network-vif-deleted", "tag": "eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:30.797996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:30.806661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-255d0aee-116b-491b-9e8f-18edf796cfa9 req-f7366ffe-baec-448c-8aa2-74fb5bf7d04b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:30.807133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-255d0aee-116b-491b-9e8f-18edf796cfa9 req-f7366ffe-baec-448c-8aa2-74fb5bf7d04b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:30.811414 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c38cedf4-1eab-42db-9570-c980dd8ef695 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.323968 Jul 02 21:06:30.814348 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 720/1513] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:30 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:30.827207 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-255d0aee-116b-491b-9e8f-18edf796cfa9 req-f7366ffe-baec-448c-8aa2-74fb5bf7d04b service nova] Creating event network-vif-deleted:eea2b4b9-ed3c-4d3e-bd4a-a72ac0fb27cc for instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c on nch2-master-1 Jul 02 21:06:30.830643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-109974815", "imageRef": "dec4f2da-ddcd-4093-9a00-070c5ea96b39", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "006a9de2-312a-42c1-801e-4cc630be8793"}], "security_groups": [{"name": "tempest-securitygroup--938697826"}], "key_name": "tempest-keypair-1098367299", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:30.836256 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-255d0aee-116b-491b-9e8f-18edf796cfa9 req-f7366ffe-baec-448c-8aa2-74fb5bf7d04b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046792 Jul 02 21:06:30.836854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 794/1514] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:30.981627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] validate_networks() for [('006a9de2-312a-42c1-801e-4cc630be8793', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:06:31.049408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:31.050685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:31.068175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.069274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.072785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.075164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.380860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:31.391286 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2c34665f-c9ac-4679-951e-eebab18dec1f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.349513 Jul 02 21:06:31.401364 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 795/1515] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:31 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:31.401364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:31.401364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:31.407926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.409115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.410298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.410936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.679879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:31.690490 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0077e685-ffab-4444-824c-eb222593f18e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.296715 Jul 02 21:06:31.691597 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 796/1516] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:31 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:31.726718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:06:31.727195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:06:31.727920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:06:31.728639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:06:31.729134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:06:31.742141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.742695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.743686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.744697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.768276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Getting quotas for project 426d63ca5cfa48e19a7156d1b848447e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:06:31.775276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Getting quotas for user 097020096c1c4ff2b67800be67cd708a and project 426d63ca5cfa48e19a7156d1b848447e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:06:31.793385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:06:31.795766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:31.796253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dec4f2da-ddcd-4093-9a00-070c5ea96b39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:06:31.796449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 771bfeb8-cc53-4509-ac0c-ecaec2116b7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:31.803928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.804768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.805828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.806619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.827718 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] HTTP exception thrown: Instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c could not be found. Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Request method failure captured: Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c HTTP/1.1 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIf_eySkbypAUBTAdHqcxZEY3ZMglGQlqGNT_XQniidfPgAofdOTSnPpZDPwLj0eqCZQIWGdvsxwvUZuujjefuSaHuQ9Lb-kGQ9s5kTw_C-d-H1uz5Q-uqfZPpcBbDGhEJEY8HLAqT38ApXlIL_tZFuAtGfprOBzF-Mk1Aztvpo298 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.25 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d59cb1f0d7bb4708ac0994f7c9b846b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}] Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: f3287fb85c2343d686718d3c4aaa5c00 Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c could not be found. Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '771bfeb8-cc53-4509-ac0c-ecaec2116b7c'} Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c could not be found. Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c could not be found. Jul 02 21:06:31.830343 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c could not be found. Jul 02 21:06:31.836439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:31.838439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Returning 404 to user: Instance 771bfeb8-cc53-4509-ac0c-ecaec2116b7c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:31.839774 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b0c26c4-5073-4420-b6af-e475f93c14fb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c" status: 404 len: 111 microversion: 2.25 time: 0.048475 Jul 02 21:06:31.841030 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 797/1517] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:31 2022] GET /compute/v2.1/servers/771bfeb8-cc53-4509-ac0c-ecaec2116b7c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:06:31.856564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:31.857372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:31.866118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.866636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.868102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:31.868870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:31.874794 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b61984f2-d8fc-41b4-8d95-8426eeccc2d1 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.059078 Jul 02 21:06:31.875947 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 721/1518] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:06:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:06:31.886984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f7e6208-0c4c-4c84-8f29-abaa195a9e4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:31.887730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f7e6208-0c4c-4c84-8f29-abaa195a9e4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:31.893925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:31.960966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f7e6208-0c4c-4c84-8f29-abaa195a9e4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:31.974888 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f7e6208-0c4c-4c84-8f29-abaa195a9e4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1245 microversion: 2.1 time: 0.092458 Jul 02 21:06:31.976181 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 722/1519] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:31 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:32.093265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:32.104178 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4443cd78-fae3-4f69-a132-74fe7ad3b7fa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.261831 Jul 02 21:06:32.124146 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 798/1520] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:31 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:32.408968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:32.410020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:32.418735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:32.419299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:32.420297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:32.421661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:32.598210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:32.606357 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-665be437-46e5-42bb-a3b4-34332f480132 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.201952 Jul 02 21:06:32.609229 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 723/1521] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:32 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:32.708565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:32.709309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:32.719361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:32.720482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:32.721969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:32.722739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:32.892461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:32.901590 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8d0cf18-28bb-4168-b445-24d8b34c3ac4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.196655 Jul 02 21:06:32.901911 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 799/1522] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:32 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:32.993406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:32.994856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:33.003239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.003689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.004542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.004982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.095330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:33.112761 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fcffed86-2f85-45c5-a10e-f3ca5169d856 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1297 microversion: 2.1 time: 0.123657 Jul 02 21:06:33.115646 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 724/1523] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:32 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:33.130633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:33.131309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:33.140912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.141833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.142742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.143689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.629812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:33.630780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:33.651481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.652654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.653747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.656477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.690118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:33.706776 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a46df4f4-f19c-490c-b738-6002f7d07ce5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.580389 Jul 02 21:06:33.709639 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 800/1524] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:33 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:33.921701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:33.922673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:33.930739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.931439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.932631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:33.933401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:33.935532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:33.953825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f91362f-ea7c-445c-960e-03b7547c706b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.332110 Jul 02 21:06:33.954987 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 725/1525] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:33 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:34.132653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.134247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:34.154643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.155436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.157387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.159505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.366347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:34.374007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:34.374428 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a63056f9-dbd8-4256-8946-f6f9a9e3ff0e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.458577 Jul 02 21:06:34.376602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 801/1526] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:33 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:34.385419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.386230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:34.390785 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7f50ca0-0ef3-4662-a4ff-b9970430d848 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1303 microversion: 2.1 time: 0.262715 Jul 02 21:06:34.406006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.407398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.409919 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 726/1527] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:34 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1303 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:34.416467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.416467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.464747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:34.508688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:34.608519 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f3f5def6-3d6c-4dfe-8a66-95cb39601c9a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 204 len: 0 microversion: 2.25 time: 0.229300 Jul 02 21:06:34.609189 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 802/1528] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:06:34 2022] DELETE /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:06:34.625019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.626438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:34.634801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.635690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.637643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.638363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.781121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Calling method '.version_select at 0x7fabe483c0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.782125 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:34.782125 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:34.783774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.784339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.800532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.801405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.813965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.814410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.820658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86fe13d9-af03-478d-b25e-f9e8fa0c1cdb tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.207185 Jul 02 21:06:34.821380 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 727/1529] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:34.830371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.831267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:34.839256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.839809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.841034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.841797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.869242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:34.885334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:34.894838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:34.896537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:34.897772 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5de15788-5a7f-4072-a32f-fb19d6d9376f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.278631 Jul 02 21:06:34.898444 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 803/1530] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:34 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:34.903095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Calling method '.version_select at 0x7fabe47eb310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.903978 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:34.903978 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:34.905371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.905999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.926899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.928227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.969928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:34.974030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:34.974835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:34.983462 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d1c31f22-30b7-4822-a25c-455da41cdeb8 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 749 microversion: 2.1 time: 0.083838 Jul 02 21:06:34.984264 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 804/1531] 10.222.0.43 () {58 vars in 1211 bytes} [Sat Jul 2 21:06:34 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 749 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:34.991271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:34.992183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:34.999780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.000512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.001442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.002081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.220681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:35.236432 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8769861-72eb-421a-95f6-c95811af93f3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.413801 Jul 02 21:06:35.237080 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 728/1532] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:34 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:35.242046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Calling method '.version_select at 0x7fabe49590d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:35.251471 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:35.251471 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:35.252963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.253926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.270221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.270829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.290557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.291045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.307193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2b8bbbd-8593-4557-86c6-2bf15c3c60ce tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067932 Jul 02 21:06:35.313963 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 729/1533] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:35.320438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4a78f77-86de-4ee7-825f-462929124d08 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Calling method '.version_select at 0x7fabe474d430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:35.321646 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:35.321646 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:35.323067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a78f77-86de-4ee7-825f-462929124d08 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.324646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a78f77-86de-4ee7-825f-462929124d08 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.341899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a78f77-86de-4ee7-825f-462929124d08 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.342544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4a78f77-86de-4ee7-825f-462929124d08 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.346118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:35.351300 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4a78f77-86de-4ee7-825f-462929124d08 tempest-HypervisorAdminUnderV252Test-1551011013 tempest-HypervisorAdminUnderV252Test-1551011013-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.035879 Jul 02 21:06:35.358339 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 730/1534] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:06:35 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:35.373207 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ae59f0e0-e9dd-454d-a56a-0c5235a13904 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.384535 Jul 02 21:06:35.374021 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 805/1535] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:34 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:35.396371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:35.397839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:35.406217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.406880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.407792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.408363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.427875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:35.428876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:35.436222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.440607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.442772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.445355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.714752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:35.720956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:35.726828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0cd2e924-170a-4c6b-a500-b459f6670cdc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.333956 Jul 02 21:06:35.729446 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 731/1536] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:35 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:35.742451 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ca1b3c4-5688-4fc8-9a4d-f4635cc1236c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.317067 Jul 02 21:06:35.744210 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 806/1537] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:35 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:35.919405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:35.919405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:35.925039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.925772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:35.926802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:35.927233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.137748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:36.151982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:36.154479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:36.155826 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc86979f-ac0d-459a-9b07-9da5f3d07681 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.243019 Jul 02 21:06:36.161225 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 732/1538] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:35 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:36.258189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:36.259320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:36.285657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.286419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.287992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.288743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.391295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:36.392229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:36.399808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.400427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.401287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.402671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.571299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:36.585874 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5e18ac4-1e6d-453e-b2bc-90f7c72bd842 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.333921 Jul 02 21:06:36.587058 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 807/1539] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:36 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:36.638909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:36.651075 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-310fca22-0cca-4eec-9bd2-92eea678bd30 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.263705 Jul 02 21:06:36.652028 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 733/1540] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:36 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:36.745974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:36.746943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:36.755268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.755981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.760380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.761973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.769695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:36.770600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:36.792324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.792898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:36.793990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:36.800750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.088329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:37.099444 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47d1dc10-634a-4ca4-b089-2c819afba52a tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.335748 Jul 02 21:06:37.116137 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 734/1541] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:36 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:37.124138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:37.132604 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26842833-c6c5-44dc-9020-cd29167f126c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.390843 Jul 02 21:06:37.133722 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 808/1542] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:36 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:37.186007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:37.186893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:37.199731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:37.205495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.206664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:37.207195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.399157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:37.413604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:37.415145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:37.416914 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65b02041-4f2a-4666-9dc4-ee0bcf96ad25 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.241719 Jul 02 21:06:37.418203 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 735/1543] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:37 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:37.608010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:37.609553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:37.625395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:37.627005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.630475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:37.631382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.670890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:37.671529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:37.682923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:37.685153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.687227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:37.689572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:37.943804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:37.955692 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b09baac9-28f7-40e7-a2fa-3108217135d2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.353585 Jul 02 21:06:37.957242 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 809/1544] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:37 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:37.985689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:38.004109 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce0b0141-25d2-495b-bdbe-bd96cdf72a4f tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.338546 Jul 02 21:06:38.014692 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 736/1545] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:37 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:38.117419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:38.118403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:38.129296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.130332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.131422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.132087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.156112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:38.156779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:38.170949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.171878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.172948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.174934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.426367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:38.537656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:38.540813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:38.551165 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe4aea59-226a-484f-871f-a415ce2d9f7b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.437709 Jul 02 21:06:38.553661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0235a026-5ff4-43c9-9bd9-8c6491158c4c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.403471 Jul 02 21:06:38.564069 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 737/1546] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:38 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:38.565014 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 810/1547] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:38 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:38.577651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:38.578431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:38.586006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.586614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.590958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.592586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.841887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:38.867661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:38.875946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:38.882644 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63ec8bb7-9a90-4c44-879b-f3ef9d12bceb tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.317415 Jul 02 21:06:38.895297 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 738/1548] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:38 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:38.974363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:38.976495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:38.989214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.989720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:38.990555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:38.990989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.033697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:39.034753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:39.044561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.044992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.047565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.048966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.341083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:39.356440 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e4b147b-e873-43f8-ad8f-a4bc21c3e87e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.386304 Jul 02 21:06:39.357194 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 811/1549] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:38 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:39.399762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:39.413668 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1bb22532-ab55-4f52-85e8-c6d640f22163 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1522 microversion: 2.1 time: 0.383706 Jul 02 21:06:39.416240 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 739/1550] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:39 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:39.577413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:39.579203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:39.581012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:39.583044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:39.597321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.597768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.598448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.599073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.600747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.601162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.605081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.605605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.894980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:39.903270 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-66523ddf-c16a-45e3-b0ab-92cc4c3e0cad tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.336252 Jul 02 21:06:39.914354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 812/1551] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:39 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:39.929983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:39.941289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9853fb8-9b82-4389-b0df-043f4d62a301 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.372161 Jul 02 21:06:39.941880 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 740/1552] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:39 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:39.951205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:39.952099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:39.962259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.963022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:39.963889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:39.964403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.099559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Calling method '.version_select at 0x7fabe48f1820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.101038 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:40.101038 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:40.102612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.104382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.125780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.133036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.133804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.136428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.138355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.139578 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f87e956-3538-45c9-8fc5-04930894b73f tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.195407 Jul 02 21:06:40.150250 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 741/1553] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:39 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:40.158428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.158884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.165823 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34693fff-0252-45b2-bbe8-35447b08f642 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.250349 Jul 02 21:06:40.166667 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 813/1554] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:39 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:40.293236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-253b24a7-5400-4b5c-9d9e-f8ad544f49dc tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Calling method '.version_select at 0x7fabe47024c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.294108 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:40.294108 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:40.295364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-253b24a7-5400-4b5c-9d9e-f8ad544f49dc tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '81d1c4eab12c4c619db4f6714240d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22301d58fee4371ad12affa16941f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-253b24a7-5400-4b5c-9d9e-f8ad544f49dc tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Request method failure captured: Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLNet7Guu9wnA1RlOr3mi1PT14ffK_EKgzKFmyrhpKv2jcgwc848Yb7tDCO9QBaEkDF9M7-xMqnGfGE4xpRCitbJ2pMGOEBj9UEpUouyzxvVEiDjMsG7kisKdzfn_9-ZIjNqC2H4wif9n_ZwFfoS4g8aBqtWDxBwD1M04rpTEtc44ao Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: b22301d58fee4371ad12affa16941f18 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1634323200 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22301d58fee4371ad12affa16941f18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22301d58fee4371ad12affa16941f18", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22301d58fee4371ad12affa16941f18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22301d58fee4371ad12affa16941f18"}]}] Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1634323200 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: b22301d58fee4371ad12affa16941f18 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1634323200 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 81d1c4eab12c4c619db4f6714240d552 Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'nch2-master-1'} Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:40.297503 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 02 21:06:40.302921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.304516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-253b24a7-5400-4b5c-9d9e-f8ad544f49dc tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:40.305464 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-253b24a7-5400-4b5c-9d9e-f8ad544f49dc tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.132619 Jul 02 21:06:40.310607 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 742/1555] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 138 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:40.316495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Calling method '.version_select at 0x7fabe4806dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.317410 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:40.317410 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:06:40.318535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.318992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.325886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Request method failure captured: Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLNfeQJtAhhpTI0-YNi1ICFuAt5lIlFH4M-tTUj89Nt878gIF8j7FZyUDjsKBztez7wuxDs7B6MwoJi4HLUkcJgf5zZXKtVHXqeV2Ib7sCjI6FCRUREEfyzAHRlMWJbyFc27pz3NYHQ7Ty33JZjfMDRwvbyeJfPvIL9kE7PlvUOHxn4 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 6203aca8bd3e4b0a967f313a1f38bc2f Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-377099511 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6203aca8bd3e4b0a967f313a1f38bc2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6203aca8bd3e4b0a967f313a1f38bc2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6203aca8bd3e4b0a967f313a1f38bc2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6203aca8bd3e4b0a967f313a1f38bc2f"}]}] Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-377099511 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 6203aca8bd3e4b0a967f313a1f38bc2f Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-377099511 Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 18210d6c256940689c154859e97cee7d Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 02 21:06:40.328803 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.334737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:40.334737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-60576455-2417-42f2-a901-588e4ee08556 tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.017966 Jul 02 21:06:40.334737 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 814/1556] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:40.340257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Calling method '.version_select at 0x7fabe4656160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.341162 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:40.341162 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:40.342454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.342925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.359740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.360263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.372142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.372954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.375581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.377392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:40.379700 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce79fa79-59c2-44a4-913d-0d29763a1dfa tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043223 Jul 02 21:06:40.385445 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 743/1557] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:40.389251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.390402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47043f69-e36b-45f1-9234-c6e3eaec4536 tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Calling method '.version_select at 0x7fabe4bf43a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.390695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.391266 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:06:40.391266 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:06:40.391528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.392268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.392496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47043f69-e36b-45f1-9234-c6e3eaec4536 tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '81d1c4eab12c4c619db4f6714240d552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22301d58fee4371ad12affa16941f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47043f69-e36b-45f1-9234-c6e3eaec4536 tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Request method failure captured: Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLNet7Guu9wnA1RlOr3mi1PT14ffK_EKgzKFmyrhpKv2jcgwc848Yb7tDCO9QBaEkDF9M7-xMqnGfGE4xpRCitbJ2pMGOEBj9UEpUouyzxvVEiDjMsG7kisKdzfn_9-ZIjNqC2H4wif9n_ZwFfoS4g8aBqtWDxBwD1M04rpTEtc44ao Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: b22301d58fee4371ad12affa16941f18 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1634323200 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22301d58fee4371ad12affa16941f18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b22301d58fee4371ad12affa16941f18", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b22301d58fee4371ad12affa16941f18"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b22301d58fee4371ad12affa16941f18"}]}] Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1634323200 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: b22301d58fee4371ad12affa16941f18 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1634323200 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 81d1c4eab12c4c619db4f6714240d552 Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1'} Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:40.394078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47043f69-e36b-45f1-9234-c6e3eaec4536 tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47043f69-e36b-45f1-9234-c6e3eaec4536 tempest-HypervisorAdminNegativeUnderV252Test-1634323200 tempest-HypervisorAdminNegativeUnderV252Test-1634323200-project] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009076 Jul 02 21:06:40.401187 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 744/1558] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:40.406092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Calling method '.version_select at 0x7fabe4b2ddc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.408234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.408789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.416946 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] HTTP exception thrown: No hypervisor matching '5fcd176f-671e-42fc-9986-ef40a91baf8e' could be found. Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Request method failure captured: Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-hypervisors/5fcd176f-671e-42fc-9986-ef40a91baf8e/servers HTTP/1.1 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLNfeQJtAhhpTI0-YNi1ICFuAt5lIlFH4M-tTUj89Nt878gIF8j7FZyUDjsKBztez7wuxDs7B6MwoJi4HLUkcJgf5zZXKtVHXqeV2Ib7sCjI6FCRUREEfyzAHRlMWJbyFc27pz3NYHQ7Ty33JZjfMDRwvbyeJfPvIL9kE7PlvUOHxn4 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6203aca8bd3e4b0a967f313a1f38bc2f Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-377099511 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6203aca8bd3e4b0a967f313a1f38bc2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6203aca8bd3e4b0a967f313a1f38bc2f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6203aca8bd3e4b0a967f313a1f38bc2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6203aca8bd3e4b0a967f313a1f38bc2f"}]}] Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-377099511 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6203aca8bd3e4b0a967f313a1f38bc2f Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-377099511 Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 18210d6c256940689c154859e97cee7d Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: exception: No hypervisor matching '5fcd176f-671e-42fc-9986-ef40a91baf8e' could be found. Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5fcd176f-671e-42fc-9986-ef40a91baf8e'} Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5fcd176f-671e-42fc-9986-ef40a91baf8e' could be found. Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5fcd176f-671e-42fc-9986-ef40a91baf8e' could be found. Jul 02 21:06:40.418774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:40.423988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] Returning 404 to user: No hypervisor matching '5fcd176f-671e-42fc-9986-ef40a91baf8e' could be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:40.425210 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a067ef79-c1d6-4656-9c13-fea9f3a7301e tempest-HypervisorAdminNegativeUnderV252Test-377099511 tempest-HypervisorAdminNegativeUnderV252Test-377099511-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors/5fcd176f-671e-42fc-9986-ef40a91baf8e/servers" status: 404 len: 123 microversion: 2.1 time: 0.023233 Jul 02 21:06:40.433828 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 745/1559] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/os-hypervisors/5fcd176f-671e-42fc-9986-ef40a91baf8e/servers => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:40.442435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.448964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:40.460078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.460831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.461803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.462442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.692484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.702304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-65be108c-d04a-4da1-b88d-b986407045b9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.331434 Jul 02 21:06:40.703456 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 815/1560] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:40.729620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.738174 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ac5fc3f-e3ef-493a-8806-608d47f0877b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1499 microversion: 2.1 time: 0.299539 Jul 02 21:06:40.739072 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 746/1561] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1499 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:40.755550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.759489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:40.760499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:40.766987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.767586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.768287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.768765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.802382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:40.834643 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f4d8465-bd2f-44c5-902e-d325231a13d2 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.083575 Jul 02 21:06:40.841320 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 816/1562] 10.222.0.43 () {58 vars in 1153 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:40.846711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be33a08d-1476-4c4c-91c4-0e4cbf80e192 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:40.863535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be33a08d-1476-4c4c-91c4-0e4cbf80e192 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.863998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be33a08d-1476-4c4c-91c4-0e4cbf80e192 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.889346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be33a08d-1476-4c4c-91c4-0e4cbf80e192 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 21:06:40.894296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:40.921960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.922945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:40.933065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.933882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.934957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.935597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.960587 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be33a08d-1476-4c4c-91c4-0e4cbf80e192 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "POST /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e/action" status: 202 len: 0 microversion: 2.1 time: 0.117358 Jul 02 21:06:40.961874 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 747/1563] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:06:40 2022] POST /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:06:40.971217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:40.975213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:40.982713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.983210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:40.984209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:40.984663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.233897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.241281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.256816 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b1eba9c-3277-472d-9a16-f36b938c958c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.338750 Jul 02 21:06:41.258126 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 817/1564] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:41.261134 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b57b5d0e-0646-4563-851b-9daf072fedea tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.297498 Jul 02 21:06:41.262186 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 748/1565] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:40 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:41.270209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:41.271114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:41.278531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:41.279655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:41.286896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:41.287627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.288656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:41.289416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.292337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:41.292884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.313403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:41.313678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:41.313678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.546765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.580680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.585500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.589045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8670cb3-f774-4ca1-8f32-d4d8c5f37f48 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.321792 Jul 02 21:06:41.589885 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 818/1566] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:41 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:41.714023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.719169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:41.721054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:41.736814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:41.737347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.738857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:41.738857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:41.740458 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a3ba3d2-60c7-41d2-8550-a70ac63804cc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1508 microversion: 2.1 time: 0.476876 Jul 02 21:06:41.744443 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 749/1567] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:41 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1508 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:41.986651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:41.995842 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8452fc85-eb95-4161-81e5-e09dcda6e6b3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.280439 Jul 02 21:06:42.000792 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 819/1568] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:41 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:42.275337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:42.276157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:42.278245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:42.278957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:42.282040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:42.284817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:42.285283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.285805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.286712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.287158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.295606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.296402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.298185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.298662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.579883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:42.600661 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-69e78805-ceea-4301-b241-92e1db493a66 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.325164 Jul 02 21:06:42.617219 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 820/1569] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:42 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:42.622592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:42.622997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:42.644545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.646115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.649167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.649754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.691149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:42.708160 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c3585f6-1696-456a-8216-5956db18096e tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.436018 Jul 02 21:06:42.712303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 750/1570] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:42 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:42.759343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:42.760268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:42.772203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.777052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.779737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:42.781388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:42.978495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:42.986488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:42.989129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:42.991073 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6af3a225-b8a7-46a3-9c76-f8189b6b65bc tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.372562 Jul 02 21:06:43.002723 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 821/1571] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:42 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:43.013124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.013970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.021542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.022245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.024276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.024926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.028074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.036676 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f98cfc1-e310-486c-9ab5-1979cf41d96d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1512 microversion: 2.1 time: 0.281969 Jul 02 21:06:43.051763 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 751/1572] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:42 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:43.056824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.060632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.061910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Removing options 'limit' from query {{(pid=131044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 02 21:06:43.062876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:43.064321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.065112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.066082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.067330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.068984 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0a299b2-b90d-4e2c-b106-4e24f05b8f27 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.016155 Jul 02 21:06:43.075774 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 752/1573] 10.222.0.43 () {58 vars in 1139 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:06:43.084973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.084973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.096810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.097500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.098383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.099327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.231479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.240341 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c14640c-fd4e-4bd0-89db-791b30125afb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.231112 Jul 02 21:06:43.241406 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 822/1574] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:43.280496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.289136 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a25fb84c-bae3-43ef-8c47-58bde2206281 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1512 microversion: 2.1 time: 0.210243 Jul 02 21:06:43.289709 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 753/1575] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1512 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:43.306183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.306823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.313154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.313609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.314375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.314806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.453818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.461918 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c637e241-d58d-444b-8f1a-5bb05637c618 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 200 len: 1513 microversion: 2.1 time: 0.160086 Jul 02 21:06:43.472150 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 823/1576] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:43.481127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.481763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.488279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.488735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.489545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.489987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.621338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.625038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.625685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.629392 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39d63678-3d5a-4d57-8051-cfdf7a1bc081 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1511 microversion: 2.1 time: 0.152883 Jul 02 21:06:43.630226 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 754/1577] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:43.643411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.643795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.644603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.645319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.645446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.649259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.650077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:43.786518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.787643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.788498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.788952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.867065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:43.876630 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9fb8e2de-90bb-4d16-9875-dde08836e247 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.256392 Jul 02 21:06:43.877220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 824/1578] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:43.883258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.884022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.891192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:43.891848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.892410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.893238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.893773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.959827 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24d03a79-9e87-459c-a120-376f5914e4ea tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.317335 Jul 02 21:06:43.961023 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 755/1579] 10.222.0.43 () {58 vars in 1153 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:06:43.973778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:43.974392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:43.982340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.982956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:43.983753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:43.984257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.090794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.100593 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c9c703cc-a1d6-4583-8fae-a218669136bc tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.222195 Jul 02 21:06:44.110314 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 825/1580] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:44.110314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.110314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:44.112539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.112983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.113948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.114379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.167935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.176263 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4980b775-0f34-4437-974c-1b3d930dfd61 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1512 microversion: 2.1 time: 0.207799 Jul 02 21:06:44.177034 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 756/1581] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:43 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:44.192322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.192922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:44.198982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.199437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.200229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.200653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.290005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.299252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.300949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.302221 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de970586-ddbd-4922-a25f-d301407abf5c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.199781 Jul 02 21:06:44.302790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 826/1582] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:44.308152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.309464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:44.316461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.317020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.317870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.319055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.376611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.385491 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9945c45-9a49-4d03-baa9-ff0e6097c66d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 200 len: 1513 microversion: 2.1 time: 0.196829 Jul 02 21:06:44.386069 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 757/1583] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:44.401451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.402047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:44.408950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.409388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.410611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.410960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.494015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.505939 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5f414c5-4f7b-4719-96b2-fc8727f8e6ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.201613 Jul 02 21:06:44.506789 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 827/1584] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:44.562904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.570835 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55a4a0e8-9d34-4b94-aafe-67f71b4b9337 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1511 microversion: 2.1 time: 0.173318 Jul 02 21:06:44.571416 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 758/1585] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:44.587022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.590682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.591453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:44.596817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.597256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.598534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.598968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.626550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-28c842b8-4f67-4d7a-a6a9-cd577da92388 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Action: 'update', calling method: .version_select at 0x7fabe46c43a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:44.689059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28c842b8-4f67-4d7a-a6a9-cd577da92388 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.689621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28c842b8-4f67-4d7a-a6a9-cd577da92388 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.690530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28c842b8-4f67-4d7a-a6a9-cd577da92388 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.690970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28c842b8-4f67-4d7a-a6a9-cd577da92388 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.697762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:44.745396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-28c842b8-4f67-4d7a-a6a9-cd577da92388 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9" status: 200 len: 240 microversion: 2.36 time: 0.237395 Jul 02 21:06:44.746240 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 828/1586] 10.222.0.43 () {62 vars in 1302 bytes} [Sat Jul 2 21:06:44 2022] PUT /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9 => generated 240 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:06:44.757578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f35ce73-7ca3-4a77-aa14-bf28316ae425 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Calling method '.version_select at 0x7fabe4db05e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.767780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.775744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.776379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.818635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f35ce73-7ca3-4a77-aa14-bf28316ae425 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.819079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f35ce73-7ca3-4a77-aa14-bf28316ae425 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.819870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f35ce73-7ca3-4a77-aa14-bf28316ae425 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.820335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f35ce73-7ca3-4a77-aa14-bf28316ae425 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.842433 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f35ce73-7ca3-4a77-aa14-bf28316ae425 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9/detail" status: 200 len: 672 microversion: 2.36 time: 0.089206 Jul 02 21:06:44.850366 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 829/1587] 10.222.0.43 () {60 vars in 1303 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9/detail => generated 672 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:06:44.898255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.898947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:44.905384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.906015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.906852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:44.907356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:44.922211 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-829ca92b-33ad-4598-955b-f22ca8de72c8 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.338786 Jul 02 21:06:44.922995 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 759/1588] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:44.944466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:44.950344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:44.951439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:45.059037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.059719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.060528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.061017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.090429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:45.095871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.103586 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32f8f9ee-f6c9-42ff-834a-6558ac7d7530 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.212958 Jul 02 21:06:45.104185 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 830/1589] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:45.108597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Action: 'update', calling method: .version_select at 0x7fabe495a790>, body: {"quota_set": {"ram": "2048"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:45.121792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39d26c6c-1fd0-45b9-b9df-5975430768a5 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.182295 Jul 02 21:06:45.122423 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 760/1590] 10.222.0.43 () {58 vars in 1149 bytes} [Sat Jul 2 21:06:44 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:45.127078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.127705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:45.133760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.134207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.134976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.135414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.176335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.176792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.177598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.178035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.212515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.212874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.213654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.214187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.266041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.270594 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-460c2e0a-2e1c-470a-b071-384e57e0a10b tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9?user_id=4931881f62ef436eab9ee8676a7f3ca6" status: 200 len: 240 microversion: 2.36 time: 0.165305 Jul 02 21:06:45.278117 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 831/1591] 10.222.0.43 () {62 vars in 1383 bytes} [Sat Jul 2 21:06:45 2022] PUT /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9?user_id=4931881f62ef436eab9ee8676a7f3ca6 => generated 240 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:06:45.278334 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad2652f4-5f2e-4fa6-be0e-e564ac9966d2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.150272 Jul 02 21:06:45.278482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.279602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.280302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:45.283635 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 761/1592] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:45.286122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.286567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.287369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.287801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.288769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba194a99-670b-4ef0-be60-b3b7f86c7a90 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] Calling method '.version_select at 0x7fabe4702160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.371135 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba194a99-670b-4ef0-be60-b3b7f86c7a90 tempest-QuotasAdminTestV236-590692270 tempest-QuotasAdminTestV236-590692270-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9?user_id=4931881f62ef436eab9ee8676a7f3ca6" status: 200 len: 282 microversion: 2.36 time: 0.086277 Jul 02 21:06:45.371874 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 762/1593] 10.222.0.43 () {60 vars in 1363 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/os-quota-sets/2cb2549d293a4159818bb76df4bb1aa9?user_id=4931881f62ef436eab9ee8676a7f3ca6 => generated 282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:06:45.377703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.378383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:45.379124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:45.385017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.385538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.386750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.387874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.440448 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b1896c62-da1d-41a4-ad67-ffb81f9105c6 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.168000 Jul 02 21:06:45.441268 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 832/1594] 10.222.0.43 () {58 vars in 1211 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:45.452414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.456086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.456813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:45.463550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.463956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.464947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.465346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.598624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.608273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.610173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.611592 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd05fa84-891b-4a01-96df-7e3f50c736a8 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1731 microversion: 2.25 time: 0.238657 Jul 02 21:06:45.611715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:45.612853 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 763/1595] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:45.617586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.618494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:45.627330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.628140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.629144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.629808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.634863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:45.690041 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6fc1e64a-d0c7-42a1-a51e-58b18b284fe4 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.242218 Jul 02 21:06:45.696342 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 833/1596] 10.222.0.43 () {58 vars in 1195 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:45.703419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.710487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.711153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': '1505071264', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:45.717025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.717441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.718227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.718617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.837825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:45.932239 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49da8f6f-8daf-4f79-b07a-dda27f6847bc tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?name=1505071264" status: 200 len: 346 microversion: 2.1 time: 0.232863 Jul 02 21:06:45.940618 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 834/1597] 10.222.0.43 () {58 vars in 1155 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers?name=1505071264 => generated 346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:45.946969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:45.950089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.950763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:45.954159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:45.957165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.957621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.958430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:45.960724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:45.964337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c82705f-d26c-4da4-9aea-63353b310cf0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.349619 Jul 02 21:06:45.965579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 764/1598] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:46.065898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:46.071182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:46.120866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:46.121478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:46.129141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.129850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.130805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.131397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.148605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac9a041b-e38f-40a6-9205-e4890eb38392 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.206631 Jul 02 21:06:46.149258 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 835/1599] 10.222.0.43 () {58 vars in 1153 bytes} [Sat Jul 2 21:06:45 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:46.162720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:46.166953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:46.167701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-150507126', 'deleted': False, 'project_id': '31671d11617e46fd881d114812d41e35'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:06:46.169771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:46.174424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.175272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.176411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.177905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.302244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:06:46.440528 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9936886a-b5d8-416f-8b25-845cf0fefbc1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-150507126" status: 200 len: 346 microversion: 2.1 time: 0.283115 Jul 02 21:06:46.441997 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 836/1600] 10.222.0.43 () {58 vars in 1227 bytes} [Sat Jul 2 21:06:46 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-150507126 => generated 346 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:46.454167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:46.455758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:46.476961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.478121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.479380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.480390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.559439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:46.570635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59285baf-f8c9-4200-aea0-abf3a2018776 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.453678 Jul 02 21:06:46.571605 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 765/1601] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:46 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:46.579429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:46.582387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:46.594646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.596107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.598773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.599497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.630076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:46.807823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:46.818091 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f2552012-aa85-4388-aced-4d7a45185cd6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.368205 Jul 02 21:06:46.820518 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 837/1602] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:46 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:46.829917 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f356c617-e80c-4946-bd1b-e28293a7d31a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 204 len: 0 microversion: 2.1 time: 0.256771 Jul 02 21:06:46.831818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:46.832871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:46.834023 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 766/1603] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:06:46 2022] DELETE /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:06:46.846279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-bdf9205b-6e2f-448f-98c6-518395c51f60 req-137c1acc-c717-4c34-a6b7-203c9d1ec8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e580-65f0-4113-bad0-009411076964", "tag": "4d772c9f-4751-413b-b370-6aff3b44273b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:46.850769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.851346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.852282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.853109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.869483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bdf9205b-6e2f-448f-98c6-518395c51f60 req-137c1acc-c717-4c34-a6b7-203c9d1ec8f2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.869945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bdf9205b-6e2f-448f-98c6-518395c51f60 req-137c1acc-c717-4c34-a6b7-203c9d1ec8f2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.904016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-bdf9205b-6e2f-448f-98c6-518395c51f60 req-137c1acc-c717-4c34-a6b7-203c9d1ec8f2 service nova] Creating event network-changed:4d772c9f-4751-413b-b370-6aff3b44273b for instance 2a52e580-65f0-4113-bad0-009411076964 on nch1-master-1 Jul 02 21:06:46.919891 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-bdf9205b-6e2f-448f-98c6-518395c51f60 req-137c1acc-c717-4c34-a6b7-203c9d1ec8f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084295 Jul 02 21:06:46.923471 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 767/1604] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:46.941916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-62ae8b87-2242-4d36-b9c5-5fbc7c7f3b80 req-2506b034-329a-4991-8719-a24414ff993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1731cd23-3195-40b5-a9da-1015e9f8b964", "name": "network-vif-deleted", "tag": "1abc3028-ca97-4a5f-947a-621fb52e38f7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:46.954511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:46.957360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-62ae8b87-2242-4d36-b9c5-5fbc7c7f3b80 req-2506b034-329a-4991-8719-a24414ff993d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:46.959125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-62ae8b87-2242-4d36-b9c5-5fbc7c7f3b80 req-2506b034-329a-4991-8719-a24414ff993d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:46.977609 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-62ae8b87-2242-4d36-b9c5-5fbc7c7f3b80 req-2506b034-329a-4991-8719-a24414ff993d service nova] Creating event network-vif-deleted:1abc3028-ca97-4a5f-947a-621fb52e38f7 for instance 1731cd23-3195-40b5-a9da-1015e9f8b964 on nch1-master-1 Jul 02 21:06:46.986187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-62ae8b87-2242-4d36-b9c5-5fbc7c7f3b80 req-2506b034-329a-4991-8719-a24414ff993d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060934 Jul 02 21:06:46.989000 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 768/1605] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:46.995404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:47.005324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:47.017109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:47.040404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:47.041918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:47.048489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.049132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.049938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.050566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.057672 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a543f832-60d9-4d5e-87c7-0ef22289d9a1 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 200 len: 1371 microversion: 2.25 time: 0.235601 Jul 02 21:06:47.060720 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 838/1606] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:46 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:47.078848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:47.080792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:47.093206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.094159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.095201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.097195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.345278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:47.346287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:47.353874 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17f910a5-4fb5-4b04-bfc0-e44692a80917 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1517 microversion: 2.1 time: 0.363126 Jul 02 21:06:47.354086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b6f9fd3-495e-489f-8297-7dd40e32f3ac tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.289671 Jul 02 21:06:47.354463 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 769/1607] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:46 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:47.365212 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 839/1608] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:47 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:47.587658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:47.588285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:47.595549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.596294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.597251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.597828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.761311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:47.770101 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-143a9bd0-edcc-41ea-9446-30757ef6cb46 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.186097 Jul 02 21:06:47.771387 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 770/1609] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:47 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:47.835888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:47.836850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:47.843907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.844404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.845187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:47.845690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:47.991878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:48.001017 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3a08660f-0854-4457-8f53-9146094e50cf tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.169017 Jul 02 21:06:48.001960 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 840/1610] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:47 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:48.080344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:48.080962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: 1731cd23-3195-40b5-a9da-1015e9f8b964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:48.087543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.087990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.089434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.090049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.107056 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] HTTP exception thrown: Instance 1731cd23-3195-40b5-a9da-1015e9f8b964 could not be found. Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Request method failure captured: Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 HTTP/1.1 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIf_eySkbypAUBTAdHqcxZEY3ZMglGQlqGNT_XQniidfPgAofdOTSnPpZDPwLj0eqCZQIWGdvsxwvUZuujjefuSaHuQ9Lb-kGQ9s5kTw_C-d-H1uz5Q-uqfZPpcBbDGhEJEY8HLAqT38ApXlIL_tZFuAtGfprOBzF-Mk1Aztvpo298 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.25 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d59cb1f0d7bb4708ac0994f7c9b846b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}] Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f3287fb85c2343d686718d3c4aaa5c00 Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 1731cd23-3195-40b5-a9da-1015e9f8b964 could not be found. Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '1731cd23-3195-40b5-a9da-1015e9f8b964'} Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1731cd23-3195-40b5-a9da-1015e9f8b964 could not be found. Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1731cd23-3195-40b5-a9da-1015e9f8b964 could not be found. Jul 02 21:06:48.108747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1731cd23-3195-40b5-a9da-1015e9f8b964 could not be found. Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Returning 404 to user: Instance 1731cd23-3195-40b5-a9da-1015e9f8b964 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-263362d8-ef3e-43d7-9da3-8674affa1a2c tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964" status: 404 len: 111 microversion: 2.25 time: 0.035646 Jul 02 21:06:48.113255 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 771/1611] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:48 2022] GET /compute/v2.1/servers/1731cd23-3195-40b5-a9da-1015e9f8b964 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:06:48.119403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29c8ba88-e44e-4418-b134-48bde1e11d5a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '.version_select at 0x7fabd7f09e50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:48.138769 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-29c8ba88-e44e-4418-b134-48bde1e11d5a tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013394427" status: 204 len: 0 microversion: 2.25 time: 0.023477 Jul 02 21:06:48.139353 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 841/1612] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1013394427 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 02 21:06:48.372454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:48.379112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:48.379877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:48.382008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:48.393283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.395201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.395688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.396693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.397206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.398206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.398449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.404002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.667699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:48.669571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:48.680424 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31a5cdee-db78-4316-8359-362db2b73f9b tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1517 microversion: 2.1 time: 0.313434 Jul 02 21:06:48.681335 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 772/1613] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:48 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:48.695380 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5e1eee0f-8a2b-484f-8a01-0dadb5b49dc7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.317503 Jul 02 21:06:48.696276 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 842/1614] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:48 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:48.787831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:48.788744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:48.801299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.801970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.803036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:48.803667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:48.960711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:48.974988 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3da7c08-f83c-4721-ab99-696d359e40a6 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.191608 Jul 02 21:06:48.975573 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 773/1615] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:48 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:49.019676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:49.020453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:49.044268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.044498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.045299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.045728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.161127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-00b05053-d0b5-449b-843b-7f90d5ac2006 req-558e3636-6006-4d38-9a1c-4f5f3e44f6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc18f7b8-eef1-4bb2-9c72-0d744c679963", "name": "network-vif-deleted", "tag": "1fbac6fc-7ea1-4724-9990-66f2b54b3dd8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:49.182854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00b05053-d0b5-449b-843b-7f90d5ac2006 req-558e3636-6006-4d38-9a1c-4f5f3e44f6d1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.185003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00b05053-d0b5-449b-843b-7f90d5ac2006 req-558e3636-6006-4d38-9a1c-4f5f3e44f6d1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.201895 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-00b05053-d0b5-449b-843b-7f90d5ac2006 req-558e3636-6006-4d38-9a1c-4f5f3e44f6d1 service nova] Creating event network-vif-deleted:1fbac6fc-7ea1-4724-9990-66f2b54b3dd8 for instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 on nch2-master-1 Jul 02 21:06:49.208317 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-00b05053-d0b5-449b-843b-7f90d5ac2006 req-558e3636-6006-4d38-9a1c-4f5f3e44f6d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052623 Jul 02 21:06:49.209842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 774/1616] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:49.338690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:49.343535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:49.347640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:49.356476 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7eafa747-d047-4630-b26d-e8e62d93739d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.342178 Jul 02 21:06:49.359805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.361356 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 843/1617] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:49 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:49.362076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.363219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.363909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.394272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:49.514861 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01c778d7-9483-4965-a609-31ed6bebecc0 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "DELETE /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 204 len: 0 microversion: 2.25 time: 0.181268 Jul 02 21:06:49.515879 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 775/1618] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:06:49 2022] DELETE /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:06:49.525089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:49.526806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:49.534665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.535658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.536543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.537298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.705187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:49.705927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:49.713288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.713736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.714609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.715044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.751443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.751881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.752396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lazy-loading 'fault' on Instance uuid fc18f7b8-eef1-4bb2-9c72-0d744c679963 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:49.951401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:49.959988 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c05d689-e8bd-48bd-b287-aead6e68ad85 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 200 len: 1310 microversion: 2.1 time: 0.261590 Jul 02 21:06:49.970839 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 776/1619] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:49 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:49.976142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:49.977143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:49.984901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.985608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:49.986607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:49.987256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.080419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:50.134670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:50.138688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:50.141981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b180ca49-4ca2-432f-90f8-7333684fc284 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1549 microversion: 2.25 time: 0.621789 Jul 02 21:06:50.153741 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 844/1620] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:49 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1549 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:50.162929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:50.163761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:50.169259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:50.178079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5cb73f3-2371-4b8f-b66c-5c4f85da75f9 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.205933 Jul 02 21:06:50.180364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 777/1621] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:49 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:50.185531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:50.186239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.187249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:50.188178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.372915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:50.382443 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b2a2ce9-91fd-464f-b2b9-a76e0183f2eb tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.228938 Jul 02 21:06:50.383143 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 845/1622] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:50 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:50.401548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:50.402527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:50.409347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:50.410142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.411510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:50.412404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.418048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1341062223", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:50.478730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:06:50.647941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:50.663063 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f12cd21-9135-49e0-9b70-eda501b5956b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.265942 Jul 02 21:06:50.664031 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 846/1623] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:50 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:50.742985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:06:50.743523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:06:50.744164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:06:50.744655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:06:50.745097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:06:50.757046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:50.757496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.758305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:50.758749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:50.779082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Getting quotas for project 381ec26b4d1240b4889b5ecfebf02610. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:06:50.785103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Getting quotas for user 5198cb44d38d495794cc8b0fc5d9d4c3 and project 381ec26b4d1240b4889b5ecfebf02610. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:06:50.800801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:06:50.803486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:06:50.855346 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71a74d98-1d7b-44e3-8430-0eafd5dfa7e0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610723 Jul 02 21:06:50.863411 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 778/1624] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:06:50.936346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-112054988", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:50.984138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:50.988443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: fc18f7b8-eef1-4bb2-9c72-0d744c679963] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:50.998847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.003117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.004456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.004904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.008824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:06:51.050754 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] HTTP exception thrown: Instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 could not be found. Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Request method failure captured: Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 HTTP/1.1 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLMfb_2YPzNPowLG6XjLnrBgSRJ3jezQVUrCTtxE1ttDAU7MnsFsQgZadHg6exmMDBircfx6XoqHanBJ59GPip72jO1y65JrQPvolUOQJLHhmYDQf9yluUuZ5ERi67ZuvB3pjyPv9rE2WPnEaif5-KzLxNwhRAXZoOvK8ouJHDABzVg Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 31671d11617e46fd881d114812d41e35 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/31671d11617e46fd881d114812d41e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_31671d11617e46fd881d114812d41e35", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/31671d11617e46fd881d114812d41e35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/31671d11617e46fd881d114812d41e35"}]}] Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 31671d11617e46fd881d114812d41e35 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListServerFiltersTestJSON-2081556442-project Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 224f488d6b99461bb8bc37921813fb74 Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListServerFiltersTestJSON-2081556442-project Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 could not be found. Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'fc18f7b8-eef1-4bb2-9c72-0d744c679963'} Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 could not be found. Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 could not be found. Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:51.058610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 could not be found. Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Returning 404 to user: Instance fc18f7b8-eef1-4bb2-9c72-0d744c679963 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:51.063780 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a647748-3725-47cc-8f0b-77cfbe97497c tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963" status: 404 len: 111 microversion: 2.1 time: 0.088009 Jul 02 21:06:51.064546 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 779/1625] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:50 2022] GET /compute/v2.1/servers/fc18f7b8-eef1-4bb2-9c72-0d744c679963 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:06:51.074704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.084535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.100172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.100645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.101733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.102343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.150722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:51.172189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:51.286785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:06:51.287416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:06:51.287687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:06:51.288298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:06:51.289090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:06:51.300587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.301411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.302717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.303627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.305305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fd083d4-8ae5-46d9-ab99-7bf931dfc1fd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 204 len: 0 microversion: 2.1 time: 0.235463 Jul 02 21:06:51.306736 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 780/1626] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:06:51 2022] DELETE /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:06:51.318158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.318898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.327337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.328834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Getting quotas for project 381ec26b4d1240b4889b5ecfebf02610. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:06:51.328989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.329868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.330917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.334975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Getting quotas for user 5198cb44d38d495794cc8b0fc5d9d4c3 and project 381ec26b4d1240b4889b5ecfebf02610. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:06:51.350349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:06:51.353611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:06:51.421049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.423614 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-28094dab-bfb7-47ff-9be8-0c908e718deb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494246 Jul 02 21:06:51.425518 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 847/1627] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:06:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:06:51.433752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.435151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.436871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.438446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.439637 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ef2cb85-a46f-49fc-9d35-39b9b9eed3ef tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1507 microversion: 2.25 time: 0.130336 Jul 02 21:06:51.440860 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 781/1628] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:51 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1507 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:51.446997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.449516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.450270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.450694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.452322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.453005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.465664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.466377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.467226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.467684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.701893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.709561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.711364 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4dc0ea25-4f7c-4879-bcb0-fda9e0b92680 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.284539 Jul 02 21:06:51.712254 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 848/1629] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:51 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:51.717671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.718354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.719465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f567b455-48f3-4395-bfb9-eaf75b575fe1 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 200 len: 1519 microversion: 2.1 time: 0.277474 Jul 02 21:06:51.729671 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 782/1630] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:51 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 1519 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:51.735662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.736150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.737123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.737565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.742821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f6ba8b3-2afc-4915-bacf-6d86e93db156 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.745115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f6ba8b3-2afc-4915-bacf-6d86e93db156 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.851028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f6ba8b3-2afc-4915-bacf-6d86e93db156 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.859014 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f6ba8b3-2afc-4915-bacf-6d86e93db156 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1213 microversion: 2.1 time: 0.137050 Jul 02 21:06:51.859729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 783/1631] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:51 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1213 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:51.868669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d0ddc291-6b13-445c-96eb-8ff905ae3b6d req-ab75af0a-4b8e-4197-95df-bc7e04384100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da121054-2171-4d59-953b-a32b36cb4f58", "name": "network-vif-deleted", "tag": "c5028830-52b6-4ff4-903e-dd2f1b7d3876"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:51.881275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0ddc291-6b13-445c-96eb-8ff905ae3b6d req-ab75af0a-4b8e-4197-95df-bc7e04384100 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.882084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d0ddc291-6b13-445c-96eb-8ff905ae3b6d req-ab75af0a-4b8e-4197-95df-bc7e04384100 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.895522 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d0ddc291-6b13-445c-96eb-8ff905ae3b6d req-ab75af0a-4b8e-4197-95df-bc7e04384100 service nova] Creating event network-vif-deleted:c5028830-52b6-4ff4-903e-dd2f1b7d3876 for instance da121054-2171-4d59-953b-a32b36cb4f58 on nch2-master-1 Jul 02 21:06:51.901403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d0ddc291-6b13-445c-96eb-8ff905ae3b6d req-ab75af0a-4b8e-4197-95df-bc7e04384100 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040180 Jul 02 21:06:51.902433 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 784/1632] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:51.908707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:51.909517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:51.916814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.917274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.918089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:51.918528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:51.927236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:51.937023 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9faa9f1e-59cb-4e9c-bdac-e9bc1d27718c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.223040 Jul 02 21:06:51.938500 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 849/1633] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:51 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:52.079281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:52.088490 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bd98b0c-a4a7-4398-9b8a-7c311a2139c7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1476 microversion: 2.1 time: 0.184605 Jul 02 21:06:52.089257 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 785/1634] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:51 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:52.464608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:52.466331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:52.478209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:52.478870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:52.480480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:52.481279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:52.562179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:52.571730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:52.574051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:52.575312 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54447881-d661-4358-919d-ad1238872e16 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 200 len: 1507 microversion: 2.25 time: 0.118185 Jul 02 21:06:52.576363 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 850/1635] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:52 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 1507 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:06:52.732274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:52.734410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:52.737200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:52.737819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:52.742798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:52.743341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:52.744871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:52.745385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:52.745525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:52.746046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:52.747077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:52.747542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:52.963158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:52.975839 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9a054188-1a1b-4c2b-b9c2-04e1ea8b0c0a tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 200 len: 1519 microversion: 2.1 time: 0.242578 Jul 02 21:06:52.977996 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 851/1636] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:52 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:52.980581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:52.984558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:52.985835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:52.989569 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c49f8ef2-ee86-40cf-abfb-a7928f7cec5c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.262523 Jul 02 21:06:52.990327 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 786/1637] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:52 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:06:53.007835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.008721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.009791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.010179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:53.011266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:53.013511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.019102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.019907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.020982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.021702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.142430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:53.151781 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a37f9b6-d94e-4500-aa5d-fab510bbefe6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1265 microversion: 2.1 time: 0.172089 Jul 02 21:06:53.152590 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 852/1638] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:52 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:53.159787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:53.162970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:53.178987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.179444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.182509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.183148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.188147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:53.269313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:53.282849 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be018ef6-40fb-4832-99b9-df76d48cf9ac tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.278855 Jul 02 21:06:53.285471 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 787/1639] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:52 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:53.594756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:53.595630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: da121054-2171-4d59-953b-a32b36cb4f58] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:53.604277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.604733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.605587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.606024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.635491 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] HTTP exception thrown: Instance da121054-2171-4d59-953b-a32b36cb4f58 could not be found. Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Request method failure captured: Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 HTTP/1.1 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLIf_eySkbypAUBTAdHqcxZEY3ZMglGQlqGNT_XQniidfPgAofdOTSnPpZDPwLj0eqCZQIWGdvsxwvUZuujjefuSaHuQ9Lb-kGQ9s5kTw_C-d-H1uz5Q-uqfZPpcBbDGhEJEY8HLAqT38ApXlIL_tZFuAtGfprOBzF-Mk1Aztvpo298 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.25 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d59cb1f0d7bb4708ac0994f7c9b846b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}] Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f3287fb85c2343d686718d3c4aaa5c00 Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance da121054-2171-4d59-953b-a32b36cb4f58 could not be found. Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'da121054-2171-4d59-953b-a32b36cb4f58'} Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da121054-2171-4d59-953b-a32b36cb4f58 could not be found. Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da121054-2171-4d59-953b-a32b36cb4f58 could not be found. Jul 02 21:06:53.637376 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da121054-2171-4d59-953b-a32b36cb4f58 could not be found. Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Returning 404 to user: Instance da121054-2171-4d59-953b-a32b36cb4f58 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1503371a-61e5-4427-9b0a-3ae4c9f97388 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58" status: 404 len: 111 microversion: 2.25 time: 0.048120 Jul 02 21:06:53.642623 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 788/1640] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:53 2022] GET /compute/v2.1/servers/da121054-2171-4d59-953b-a32b36cb4f58 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:06:53.648836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:53.649390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:53.651996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:53.656881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.657494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.658459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.658986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.669065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-602ff126-0dc9-433f-8598-ec150f9666c1 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1475 microversion: 2.1 time: 0.512909 Jul 02 21:06:53.679562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 853/1641] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:53 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1475 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:53.698088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:53.855998 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f585e9ac-90f3-4675-b50a-21eca26b8baf tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 204 len: 0 microversion: 2.25 time: 0.211120 Jul 02 21:06:53.867409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:53.869810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:53.874608 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 789/1642] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:06:53 2022] DELETE /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:06:53.878327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.879200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.880347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.881026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:53.929692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-316d1692-67de-4e9b-8cdd-293deda93637 req-02389fc6-5878-4718-b1ad-56c89fa12fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ceec01b-0a29-4f85-a6e9-404754e90ee9", "name": "network-vif-deleted", "tag": "515f1a8d-79bb-4891-967d-ea4c430d8c18"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:53.958453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-316d1692-67de-4e9b-8cdd-293deda93637 req-02389fc6-5878-4718-b1ad-56c89fa12fe4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:53.958907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-316d1692-67de-4e9b-8cdd-293deda93637 req-02389fc6-5878-4718-b1ad-56c89fa12fe4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.015413 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-316d1692-67de-4e9b-8cdd-293deda93637 req-02389fc6-5878-4718-b1ad-56c89fa12fe4 service nova] Creating event network-vif-deleted:515f1a8d-79bb-4891-967d-ea4c430d8c18 for instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 on nch1-master-1 Jul 02 21:06:54.035205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-316d1692-67de-4e9b-8cdd-293deda93637 req-02389fc6-5878-4718-b1ad-56c89fa12fe4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118344 Jul 02 21:06:54.038297 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 790/1643] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:54.058031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:54.061431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:54.106676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.108613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.110465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.110953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.302419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:54.316169 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe67a240-c4b2-4d1d-9b25-a673ecb5539e tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 200 len: 1306 microversion: 2.1 time: 0.273997 Jul 02 21:06:54.317151 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 791/1644] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:54 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 1306 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:54.326396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:54.327570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:54.341065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.341533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.342326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.342759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.373058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:54.382352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:54.388368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:54.390072 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fbf1eeca-9901-4b55-a64a-c02b4014e397 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1564 microversion: 2.25 time: 0.527009 Jul 02 21:06:54.391167 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 854/1645] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:53 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1564 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:54.415633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:54.416533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:54.428023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.428540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.429627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.430235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.565785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:54.581609 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5055561c-4a3c-484b-999b-d8e9a9b2799a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1271 microversion: 2.1 time: 0.189157 Jul 02 21:06:54.582225 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 855/1646] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:54 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:54.599252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:54.602233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:54.610721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.613250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.615326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.616387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.623521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:54.639572 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-307c5476-e7a0-453c-a473-fab9a5ed5ee6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1506 microversion: 2.1 time: 0.319001 Jul 02 21:06:54.660821 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 792/1647] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:54 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:54.688693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:54.689371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:54.700949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.703719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:54.706337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:54.706789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.142170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:55.154474 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2201870d-8cd7-4dc1-bb6d-c49a9e54bc6a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1475 microversion: 2.1 time: 0.471305 Jul 02 21:06:55.155073 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 793/1648] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:54 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:55.171129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:55.183906 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-00e96415-813d-4c8f-a01b-e0904a4c7284 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.591304 Jul 02 21:06:55.184613 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 856/1649] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:54 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:55.335039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:55.336962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: 4ceec01b-0a29-4f85-a6e9-404754e90ee9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:55.348689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.350520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.353366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.354852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.388861 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] HTTP exception thrown: Instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 could not be found. Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Request method failure captured: Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 HTTP/1.1 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLMfb_2YPzNPowLG6XjLnrBgSRJ3jezQVUrCTtxE1ttDAU7MnsFsQgZadHg6exmMDBircfx6XoqHanBJ59GPip72jO1y65JrQPvolUOQJLHhmYDQf9yluUuZ5ERi67ZuvB3pjyPv9rE2WPnEaif5-KzLxNwhRAXZoOvK8ouJHDABzVg Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 31671d11617e46fd881d114812d41e35 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/31671d11617e46fd881d114812d41e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_31671d11617e46fd881d114812d41e35", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/31671d11617e46fd881d114812d41e35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/31671d11617e46fd881d114812d41e35"}]}] Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 31671d11617e46fd881d114812d41e35 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListServerFiltersTestJSON-2081556442-project Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 224f488d6b99461bb8bc37921813fb74 Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListServerFiltersTestJSON-2081556442-project Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 could not be found. Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '4ceec01b-0a29-4f85-a6e9-404754e90ee9'} Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 could not be found. Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 could not be found. Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:55.410698 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 could not be found. Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:55.422309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Returning 404 to user: Instance 4ceec01b-0a29-4f85-a6e9-404754e90ee9 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:55.424416 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9de62bc-71e7-4dca-8cdd-be666c7d63af tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9" status: 404 len: 111 microversion: 2.1 time: 0.088067 Jul 02 21:06:55.425445 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 857/1650] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:55 2022] GET /compute/v2.1/servers/4ceec01b-0a29-4f85-a6e9-404754e90ee9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:06:55.442346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:55.443493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:55.452457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.453610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.455880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.457860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.473043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-33f19b99-528a-43bb-874b-331b8d0b3c6d req-acca73f3-a0a7-486d-ba29-9d134d7901ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "name": "network-vif-unplugged", "status": "completed", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:55.498701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-33f19b99-528a-43bb-874b-331b8d0b3c6d req-acca73f3-a0a7-486d-ba29-9d134d7901ed service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.501136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-33f19b99-528a-43bb-874b-331b8d0b3c6d req-acca73f3-a0a7-486d-ba29-9d134d7901ed service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.522304 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-33f19b99-528a-43bb-874b-331b8d0b3c6d req-acca73f3-a0a7-486d-ba29-9d134d7901ed service nova] Creating event network-vif-unplugged:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch1-master-1 Jul 02 21:06:55.531332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-33f19b99-528a-43bb-874b-331b8d0b3c6d req-acca73f3-a0a7-486d-ba29-9d134d7901ed service nova] Instance b9e29424-2b31-4721-84ff-591ef411dbf4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:06:55.552816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-33f19b99-528a-43bb-874b-331b8d0b3c6d req-acca73f3-a0a7-486d-ba29-9d134d7901ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.248674 Jul 02 21:06:55.553788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 794/1651] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:55.559379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:55.559911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:55.566828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.567283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.568127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.568578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.574372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:55.585515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:55.587120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:55.588376 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8968bfb5-b5f2-4da4-8123-309dfd640769 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1347 microversion: 2.25 time: 0.161718 Jul 02 21:06:55.588953 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 858/1652] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:55 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1347 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:55.613245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:55.613960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:55.629128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.629532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.630413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.630894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.652086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:06:55.818840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b24c939-709e-4831-bd16-b4fbb4897967 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 204 len: 0 microversion: 2.1 time: 0.262352 Jul 02 21:06:55.819681 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 795/1653] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:06:55 2022] DELETE /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:06:55.828534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:55.829356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:55.842452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.842897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.854555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:55.860928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:55.876327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:55.952315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:55.975590 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-022706d2-b92a-4a9d-bda5-5805b5562061 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1271 microversion: 2.1 time: 0.377091 Jul 02 21:06:55.991615 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 859/1654] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:55 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1271 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:56.000539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72680320-7036-4e2f-a778-86b690394823"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:56.007089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:56.017915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.018701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.019734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.020590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.516899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48c6caca-6152-43eb-8ea8-ecf192f89005 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "POST /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523044 Jul 02 21:06:56.518367 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 860/1655] 10.222.0.43 () {60 vars in 1322 bytes} [Sat Jul 2 21:06:55 2022] POST /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments => generated 194 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:56.545001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:56.546904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:56.570262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.571011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.572367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.573019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.597348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:56.608290 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce3e64e6-e664-4105-8f08-a6fcfaa3a527 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1527 microversion: 2.1 time: 0.786680 Jul 02 21:06:56.608888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 796/1656] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:55 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1527 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:56.700072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-788306d5-42f2-4f26-9196-c65de5bd30a5 req-7ac467f9-ca93-4a40-91ae-5c8f009d6eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e580-65f0-4113-bad0-009411076964", "name": "network-vif-plugged", "status": "completed", "tag": "4d772c9f-4751-413b-b370-6aff3b44273b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:56.703822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:06:56.710951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-788306d5-42f2-4f26-9196-c65de5bd30a5 req-7ac467f9-ca93-4a40-91ae-5c8f009d6eac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.711637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-788306d5-42f2-4f26-9196-c65de5bd30a5 req-7ac467f9-ca93-4a40-91ae-5c8f009d6eac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.725605 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-788306d5-42f2-4f26-9196-c65de5bd30a5 req-7ac467f9-ca93-4a40-91ae-5c8f009d6eac service nova] Creating event network-vif-plugged:4d772c9f-4751-413b-b370-6aff3b44273b for instance 2a52e580-65f0-4113-bad0-009411076964 on nch1-master-1 Jul 02 21:06:56.730996 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-788306d5-42f2-4f26-9196-c65de5bd30a5 req-7ac467f9-ca93-4a40-91ae-5c8f009d6eac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120010 Jul 02 21:06:56.731812 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 797/1657] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:56.738169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7811b45a-812d-4a79-a0d6-831bf28cf1f4 req-7e660288-07f9-4f8a-a843-af20e9ff04d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb1aece9-4d7e-4240-9645-4ff29fa23d8c", "name": "network-vif-deleted", "tag": "97d0372f-9d42-420d-83a4-f34986f4a07d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:56.751823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7811b45a-812d-4a79-a0d6-831bf28cf1f4 req-7e660288-07f9-4f8a-a843-af20e9ff04d8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.752695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7811b45a-812d-4a79-a0d6-831bf28cf1f4 req-7e660288-07f9-4f8a-a843-af20e9ff04d8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.771868 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7811b45a-812d-4a79-a0d6-831bf28cf1f4 req-7e660288-07f9-4f8a-a843-af20e9ff04d8 service nova] Creating event network-vif-deleted:97d0372f-9d42-420d-83a4-f34986f4a07d for instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c on nch2-master-1 Jul 02 21:06:56.783434 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7811b45a-812d-4a79-a0d6-831bf28cf1f4 req-7e660288-07f9-4f8a-a843-af20e9ff04d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049313 Jul 02 21:06:56.784654 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 798/1658] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:56.791776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:56.792516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:56.799608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.800485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:56.801344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:56.801953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.052132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.061121 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78ea21e1-12a4-4085-b546-f22b8b1e1c5d tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1518 microversion: 2.1 time: 0.541186 Jul 02 21:06:57.062329 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 861/1659] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:56 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1518 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:57.067570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:57.068413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:57.074417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.075640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.076299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.077829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.078469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.086557 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-018ee644-a4a4-4eb7-9aad-7a4e8d2f801d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1475 microversion: 2.1 time: 0.300484 Jul 02 21:06:57.087079 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 799/1660] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:56 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1475 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:57.100541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:57.101287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:57.112945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.113399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.114187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.114626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.215947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.216582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.217097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lazy-loading 'fault' on Instance uuid cb1aece9-4d7e-4240-9645-4ff29fa23d8c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:06:57.321336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.330732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.338136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f3287fb85c2343d686718d3c4aaa5c00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59cb1f0d7bb4708ac0994f7c9b846b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.339567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82497dca-6668-4976-8e6e-4d62a65d8777 tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 200 len: 1352 microversion: 2.25 time: 0.251427 Jul 02 21:06:57.343548 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 800/1661] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:57 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 1352 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:06:57.348574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:57.390860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:57.408522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.409363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.410536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.411146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.753158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.763300 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ae8de58-a75c-4ab6-ba54-383eb3c22e76 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1370 microversion: 2.1 time: 0.699552 Jul 02 21:06:57.763907 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 862/1662] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:57 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:57.780504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:57.781691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:57.792694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.795668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.802494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.802494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.902361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:57.921830 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78022c98-3247-4e07-acf0-a25bd83a3dc2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.576762 Jul 02 21:06:57.923438 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 801/1663] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:57 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:57.960010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2891938f-5ab7-469b-a110-880846bb7ad1 req-3991f524-b754-4c2e-a689-9c975b358f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:57.981225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2891938f-5ab7-469b-a110-880846bb7ad1 req-3991f524-b754-4c2e-a689-9c975b358f64 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:57.981880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2891938f-5ab7-469b-a110-880846bb7ad1 req-3991f524-b754-4c2e-a689-9c975b358f64 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:57.999997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2891938f-5ab7-469b-a110-880846bb7ad1 req-3991f524-b754-4c2e-a689-9c975b358f64 service nova] Creating event network-changed:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch1-master-1 Jul 02 21:06:58.006783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-2891938f-5ab7-469b-a110-880846bb7ad1 req-3991f524-b754-4c2e-a689-9c975b358f64 service nova] Instance b9e29424-2b31-4721-84ff-591ef411dbf4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:06:58.025191 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2891938f-5ab7-469b-a110-880846bb7ad1 req-3991f524-b754-4c2e-a689-9c975b358f64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100609 Jul 02 21:06:58.026676 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 802/1664] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:58.095765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:58.096756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:58.113041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:58.114579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:58.116061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:58.118525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:58.761953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '224f488d6b99461bb8bc37921813fb74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31671d11617e46fd881d114812d41e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:58.775890 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb646c6a-816d-4e64-8568-642b55f013dd tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 200 len: 1476 microversion: 2.1 time: 0.700604 Jul 02 21:06:58.784393 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 803/1665] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:58 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 1476 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:58.801106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:58.805088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:58.826379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:58.829082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:58.830172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:58.836124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.217028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:59.234476 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6790600-817e-40ee-a8a9-f5b75811b838 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1527 microversion: 2.1 time: 1.467770 Jul 02 21:06:59.237415 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 863/1666] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:57 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1527 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:59.257850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:59.259646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] [instance: cb1aece9-4d7e-4240-9645-4ff29fa23d8c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:59.276801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.278743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.282803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.283273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.339836 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] HTTP exception thrown: Instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c could not be found. Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Request method failure captured: Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c HTTP/1.1 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLIf_eySkbypAUBTAdHqcxZEY3ZMglGQlqGNT_XQniidfPgAofdOTSnPpZDPwLj0eqCZQIWGdvsxwvUZuujjefuSaHuQ9Lb-kGQ9s5kTw_C-d-H1uz5Q-uqfZPpcBbDGhEJEY8HLAqT38ApXlIL_tZFuAtGfprOBzF-Mk1Aztvpo298 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.25 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d59cb1f0d7bb4708ac0994f7c9b846b3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d59cb1f0d7bb4708ac0994f7c9b846b3"}]}] Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d59cb1f0d7bb4708ac0994f7c9b846b3 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: f3287fb85c2343d686718d3c4aaa5c00 Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1025963900-project Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c could not be found. Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cb1aece9-4d7e-4240-9645-4ff29fa23d8c'} Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c could not be found. Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c could not be found. Jul 02 21:06:59.342138 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c could not be found. Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:06:59.347233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] Returning 404 to user: Instance cb1aece9-4d7e-4240-9645-4ff29fa23d8c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:06:59.350583 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8091e0f7-a330-4837-abf4-0f91e40904be tempest-LiveAutoBlockMigrationV225Test-1025963900 tempest-LiveAutoBlockMigrationV225Test-1025963900-project] 10.222.0.43 "GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c" status: 404 len: 111 microversion: 2.25 time: 0.106201 Jul 02 21:06:59.356514 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 864/1667] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:06:59 2022] GET /compute/v2.1/servers/cb1aece9-4d7e-4240-9645-4ff29fa23d8c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:06:59.378701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:59.379941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:59.422138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.422655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.423517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.423955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.469639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:59.479696 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02178e6b-3f42-4483-afa7-b52f195b2719 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1475 microversion: 2.1 time: 0.683842 Jul 02 21:06:59.482323 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 804/1668] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:58 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1475 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:59.490442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-49e36245-e7ca-4cfe-ac0f-f9e0996ebffa req-521bcf8a-81ea-48f1-955c-4ae61bf90ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}, {"server_uuid": "c04ec7f0-2638-4afa-afde-866651a42a1e", "name": "network-vif-deleted", "tag": "1a2aaa33-76b7-4eaf-8129-6c8637fb184b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:59.520587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49e36245-e7ca-4cfe-ac0f-f9e0996ebffa req-521bcf8a-81ea-48f1-955c-4ae61bf90ebb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.522214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-49e36245-e7ca-4cfe-ac0f-f9e0996ebffa req-521bcf8a-81ea-48f1-955c-4ae61bf90ebb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.575893 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-49e36245-e7ca-4cfe-ac0f-f9e0996ebffa req-521bcf8a-81ea-48f1-955c-4ae61bf90ebb service nova] Creating event network-changed:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:06:59.581128 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-49e36245-e7ca-4cfe-ac0f-f9e0996ebffa req-521bcf8a-81ea-48f1-955c-4ae61bf90ebb service nova] Creating event network-vif-deleted:1a2aaa33-76b7-4eaf-8129-6c8637fb184b for instance c04ec7f0-2638-4afa-afde-866651a42a1e on nch2-master-1 Jul 02 21:06:59.611918 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-49e36245-e7ca-4cfe-ac0f-f9e0996ebffa req-521bcf8a-81ea-48f1-955c-4ae61bf90ebb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.122795 Jul 02 21:06:59.617011 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 805/1669] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:59.635055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:59.639885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:59.660549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.661297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.662707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.663356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.857610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:06:59.874033 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dc384531-936b-4cd9-ab3a-afdefa49ef8f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1555 microversion: 2.1 time: 0.512645 Jul 02 21:06:59.877725 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 865/1670] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:59 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1555 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:06:59.883667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-006db9a1-d1cb-40ca-aba3-5f06c9fb748d req-10dcf304-d6be-4c29-87ad-ab14fd18bc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd7119-38af-45a9-997f-2001926d852b", "name": "network-vif-plugged", "status": "completed", "tag": "f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:06:59.904777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-006db9a1-d1cb-40ca-aba3-5f06c9fb748d req-10dcf304-d6be-4c29-87ad-ab14fd18bc8e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.910048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-006db9a1-d1cb-40ca-aba3-5f06c9fb748d req-10dcf304-d6be-4c29-87ad-ab14fd18bc8e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.934372 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-006db9a1-d1cb-40ca-aba3-5f06c9fb748d req-10dcf304-d6be-4c29-87ad-ab14fd18bc8e service nova] Creating event network-vif-plugged:f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a for instance 9dbd7119-38af-45a9-997f-2001926d852b on nch2-master-1 Jul 02 21:06:59.941668 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-006db9a1-d1cb-40ca-aba3-5f06c9fb748d req-10dcf304-d6be-4c29-87ad-ab14fd18bc8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062378 Jul 02 21:06:59.945562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 866/1671] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:06:59.958575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:06:59.959510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] [instance: c04ec7f0-2638-4afa-afde-866651a42a1e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:06:59.974344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.978340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:06:59.979820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:06:59.980493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.003571 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] HTTP exception thrown: Instance c04ec7f0-2638-4afa-afde-866651a42a1e could not be found. Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Request method failure captured: Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e HTTP/1.1 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLMfb_2YPzNPowLG6XjLnrBgSRJ3jezQVUrCTtxE1ttDAU7MnsFsQgZadHg6exmMDBircfx6XoqHanBJ59GPip72jO1y65JrQPvolUOQJLHhmYDQf9yluUuZ5ERi67ZuvB3pjyPv9rE2WPnEaif5-KzLxNwhRAXZoOvK8ouJHDABzVg Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 31671d11617e46fd881d114812d41e35 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/31671d11617e46fd881d114812d41e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_31671d11617e46fd881d114812d41e35", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/31671d11617e46fd881d114812d41e35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/31671d11617e46fd881d114812d41e35"}]}] Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 31671d11617e46fd881d114812d41e35 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-2081556442 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListServerFiltersTestJSON-2081556442-project Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 224f488d6b99461bb8bc37921813fb74 Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListServerFiltersTestJSON-2081556442-project Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c04ec7f0-2638-4afa-afde-866651a42a1e could not be found. Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c04ec7f0-2638-4afa-afde-866651a42a1e'} Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c04ec7f0-2638-4afa-afde-866651a42a1e could not be found. Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c04ec7f0-2638-4afa-afde-866651a42a1e could not be found. Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:00.012521 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c04ec7f0-2638-4afa-afde-866651a42a1e could not be found. Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] Returning 404 to user: Instance c04ec7f0-2638-4afa-afde-866651a42a1e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-164bb571-571e-4cc7-8e03-27da3fffe756 tempest-ListServerFiltersTestJSON-2081556442 tempest-ListServerFiltersTestJSON-2081556442-project] 10.222.0.43 "GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e" status: 404 len: 111 microversion: 2.1 time: 0.066090 Jul 02 21:07:00.023465 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 867/1672] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:59 2022] GET /compute/v2.1/servers/c04ec7f0-2638-4afa-afde-866651a42a1e => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:00.040381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:00.040895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:00.047269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:00.047761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.060903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:00.061407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.280080 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-70ebfba7-0e79-473a-ba78-449bd540372e tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255704 Jul 02 21:07:00.281412 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 868/1673] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:07:00 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-interface => generated 284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:00.292737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:00.293736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:00.317826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:00.318361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.319300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:00.319832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.443177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:00.452426 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb528bc4-dfff-49cc-923b-1a54c26cc314 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.832172 Jul 02 21:07:00.455478 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 806/1674] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:06:59 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:00.500619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:00.501461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:00.517506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:00.518148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.519060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:00.519617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:00.768692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:01.218978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:01.246214 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa838ec8-0b04-4a38-b9e1-28c92acb70d4 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1473 microversion: 2.1 time: 0.749758 Jul 02 21:07:01.247823 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 807/1675] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:00 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1473 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:01.270688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:01.290946 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-338cea4c-8db0-4ef2-9b39-cc15f433aa1c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 1.000892 Jul 02 21:07:01.296171 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 869/1676] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:00 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:01.471578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:01.472743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:01.482853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=23 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:01.490536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=28 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:01.493191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:01.496056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:01.497930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:01.499514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:01.515630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4ec42083-6706-48a3-b0ef-082114ff4fe0"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:01.524140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:01.542282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:01.543795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:01.551800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:01.552572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:01.752569 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] HTTP exception thrown: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Request method failure captured: Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments/72680320-7036-4e2f-a778-86b690394823 HTTP/1.1 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 74 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLyOJu77GEtuOLEzvPg8X-8PVEs2oYV8P4gKAFWDRvPmt57I6tG71QoFLpTv9W8keTaUH7g5BcgmXxToG4PQYO47jjt4iqzepcsIqvuo_0kxCsOBtSsTHp4ksE6aXHx3CyZagcqekdBdqdxW0rloD1f8jzkNqIjqUdub9o3JxHjdOQ Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 05a8c36319054fc8af0b5dd1916d7b5f Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesAdminNegativeTest-1402470717 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/05a8c36319054fc8af0b5dd1916d7b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_05a8c36319054fc8af0b5dd1916d7b5f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/05a8c36319054fc8af0b5dd1916d7b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/05a8c36319054fc8af0b5dd1916d7b5f"}]}] Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesAdminNegativeTest-1402470717 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 05a8c36319054fc8af0b5dd1916d7b5f Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1402470717 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesAdminNegativeTest-1402470717-project-admin Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 276b5102c10049faa2de880b2c3a8ee6 Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesAdminNegativeTest-1402470717-project-admin Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: {"volumeAttachment": {"volumeId": "4ec42083-6706-48a3-b0ef-082114ff4fe0"}} Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'server_id': '1bc8e287-b938-43c3-8d6d-342220d0319a', 'id': '72680320-7036-4e2f-a778-86b690394823', 'body': {'volumeAttachment': {'volumeId': '4ec42083-6706-48a3-b0ef-082114ff4fe0'}}} Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. (HTTP 404) (Request-ID: req-9b9a6323-79d9-4388-a8d5-a86f55c5f7d0) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:07:01.790429 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. Jul 02 21:07:01.798405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:01.806048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Returning 400 to user: Volume 4ec42083-6706-48a3-b0ef-082114ff4fe0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:01.807250 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b74cfd4-e1d5-4c6c-88ee-e47ae5906ae2 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments/72680320-7036-4e2f-a778-86b690394823" status: 400 len: 107 microversion: 2.1 time: 0.557681 Jul 02 21:07:01.808863 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 808/1677] 10.222.0.43 () {60 vars in 1432 bytes} [Sat Jul 2 21:07:01 2022] PUT /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments/72680320-7036-4e2f-a778-86b690394823 => generated 107 bytes in 560 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:07:01.898943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:01.908318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:01.908961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:01.922400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:01.923165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:01.924717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:01.925366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:02.110192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lazy-loading 'services' on Instance uuid 1bc8e287-b938-43c3-8d6d-342220d0319a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:07:02.267179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a51fb2c8-756a-4739-be74-37e86ee26355 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments/72680320-7036-4e2f-a778-86b690394823" status: 202 len: 0 microversion: 2.1 time: 0.370815 Jul 02 21:07:02.267788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 809/1678] 10.222.0.43 () {58 vars in 1415 bytes} [Sat Jul 2 21:07:01 2022] DELETE /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments/72680320-7036-4e2f-a778-86b690394823 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:02.278971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:02.282421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:02.299953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:02.300769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:02.301828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:02.302437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:02.605855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:02.627145 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1de7b1c0-9911-4efd-9bcf-a18b93bb2f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 1.159798 Jul 02 21:07:02.627744 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 870/1679] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:01 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:02.661757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:02.669347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:02.686014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:02.686786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:02.687775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:02.689940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:02.727087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:02.822715 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-19907ef9-89aa-4331-b103-612123d9787e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171040 Jul 02 21:07:02.827266 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 871/1680] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:07:02 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:02.831531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:02.832288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:02.847036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:02.848380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:02.849542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:02.851014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:03.351685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:03.366184 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23682419-836e-45d9-900b-965a56861d3c tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1473 microversion: 2.1 time: 1.096880 Jul 02 21:07:03.366812 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 810/1681] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:02 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1473 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:03.383268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f898c2cc-1502-4d09-92c6-65e2a82d3db9 req-26e993c6-70f2-4434-8aa9-a6d650ad8cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e56357a-da4c-449a-841c-de49a1756c81", "tag": "43e2625c-2036-4486-9cdd-2894eeafca79"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:03.393557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f898c2cc-1502-4d09-92c6-65e2a82d3db9 req-26e993c6-70f2-4434-8aa9-a6d650ad8cfc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:03.394278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f898c2cc-1502-4d09-92c6-65e2a82d3db9 req-26e993c6-70f2-4434-8aa9-a6d650ad8cfc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:03.426318 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f898c2cc-1502-4d09-92c6-65e2a82d3db9 req-26e993c6-70f2-4434-8aa9-a6d650ad8cfc service nova] Creating event network-changed:43e2625c-2036-4486-9cdd-2894eeafca79 for instance 5e56357a-da4c-449a-841c-de49a1756c81 on nch1-master-1 Jul 02 21:07:03.436428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f898c2cc-1502-4d09-92c6-65e2a82d3db9 req-26e993c6-70f2-4434-8aa9-a6d650ad8cfc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057871 Jul 02 21:07:03.436946 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 811/1682] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:03.618285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:03.635303 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-47473d3c-ed39-491d-8378-6206e72b8d5f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.807382 Jul 02 21:07:03.653536 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 872/1683] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:02 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:03.662864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:03.663623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:03.683626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:03.690804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:03.692119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:03.697824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:03.836448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:03.837737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:03.850843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:03.855380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:03.856499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:03.857110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:03.932934 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb883104-1568-4551-b34c-3baaac07a378 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101630 Jul 02 21:07:03.936335 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 873/1684] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:07:03 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:07:04.171293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:04.194364 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b15ff73-f47f-4d6f-8fb6-61bd7967493f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.533552 Jul 02 21:07:04.194993 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 812/1685] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:03 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:04.383273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:04.384156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:04.391471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:04.397245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:04.399309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:04.409803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:04.654528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:04.655769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:04.671428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:04.673042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:04.674876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:04.684374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:04.959358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:04.971941 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e9eb8fa-eef1-4ec3-9e81-bc51955c4fa6 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1473 microversion: 2.1 time: 0.592635 Jul 02 21:07:04.980653 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 874/1686] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:04 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1473 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:04.996975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:04.999578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:05.015643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:05.016416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:05.018192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:05.018869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:05.117393 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f058f3aa-670e-431d-adfb-07a7c4b220a4 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115986 Jul 02 21:07:05.118080 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 875/1687] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:07:04 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:05.199459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:05.199459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c80097aa-d172-4308-ab4e-3bedf5bac7ee tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.537672 Jul 02 21:07:05.199459 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 813/1688] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:04 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:05.213722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:05.214922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:05.226465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:05.227219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:05.229079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:05.231647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:05.543367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-191a98c9-4594-4c9c-a790-9a611b59acc4 req-437d2c69-499f-41b3-b1e4-ee4fe53b48ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a52e580-65f0-4113-bad0-009411076964", "tag": "4d772c9f-4751-413b-b370-6aff3b44273b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:05.560616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-191a98c9-4594-4c9c-a790-9a611b59acc4 req-437d2c69-499f-41b3-b1e4-ee4fe53b48ad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:05.561416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-191a98c9-4594-4c9c-a790-9a611b59acc4 req-437d2c69-499f-41b3-b1e4-ee4fe53b48ad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:05.616159 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-191a98c9-4594-4c9c-a790-9a611b59acc4 req-437d2c69-499f-41b3-b1e4-ee4fe53b48ad service nova] Creating event network-changed:4d772c9f-4751-413b-b370-6aff3b44273b for instance 2a52e580-65f0-4113-bad0-009411076964 on nch1-master-1 Jul 02 21:07:05.642132 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-191a98c9-4594-4c9c-a790-9a611b59acc4 req-437d2c69-499f-41b3-b1e4-ee4fe53b48ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102298 Jul 02 21:07:05.642784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 814/1689] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:07:05.978955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:05.998345 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80f6efdc-312a-4d12-8f12-2c1cd4abb130 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.788816 Jul 02 21:07:05.998778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:05.999249 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 876/1690] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:05 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:05.999502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:06.031397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:06.031964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:06.036231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:06.039781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:06.130203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:06.131479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:06.147096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:06.150745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:06.151791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:06.163731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:06.207328 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dc2cbd48-9c5c-4b0d-ab5e-e691415463d3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081380 Jul 02 21:07:06.208629 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 877/1691] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:07:06 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:06.227433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:06.228465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:06.231678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:06.237527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:06.238158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:06.239578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:06.240505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.040620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:07.042543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:07.051755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1df2ea4e-e4f9-402f-a2a3-bf37e7dc0486 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.834335 Jul 02 21:07:07.052519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:07.056223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64be8c84-fedf-4105-a761-a43c195d7d86 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1470 microversion: 2.1 time: 1.062774 Jul 02 21:07:07.057438 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 815/1692] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:05 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1470 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:07.069826 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 878/1693] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:06 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:07.096911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:07.097754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:07.099906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:07.104463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:07.112161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.112857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.115081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.116715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.117021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.126355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.127547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.128214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.408817 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2e544f6-d226-4817-ad68-2af880f199c0 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "POST /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4/action" status: 202 len: 0 microversion: 2.1 time: 0.337562 Jul 02 21:07:07.411575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 879/1694] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:07:07 2022] POST /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:07.440622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:07.441864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:07.457839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.458997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.459720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.460199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.525942 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-af315a88-b54c-4660-84dd-08b44de719db tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111795 Jul 02 21:07:07.530022 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 880/1695] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:07:07 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a/os-volume_attachments => generated 25 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:07:07.554623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:07.555488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:07.563320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.563800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:07.564652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:07.565122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:08.305730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:08.323223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a8b7ed2-c100-49fe-90e9-585271f01898 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 1.251628 Jul 02 21:07:08.325123 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 816/1696] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:07 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:08.356846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1654830125", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e39f0b0f-abc7-4756-8cec-d0a1f8b71f93"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:08.375989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:08.390064 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-958a0a29-2e8a-40ba-bef8-c0affaef824b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.858160 Jul 02 21:07:08.402431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 881/1697] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:07 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:08.410198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:08.411982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:08.452297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:08.452872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:08.457125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:08.459742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:08.508695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] validate_networks() for [('e39f0b0f-abc7-4756-8cec-d0a1f8b71f93', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:07:09.244602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:09.253280 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-258bf634-7f4e-47f7-bd55-db6d3453fa2f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.853199 Jul 02 21:07:09.253878 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 882/1698] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:08 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:09.268214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c89d3004-cdb3-45d0-a38b-12bd7ea5abaf req-94fc4995-fdd2-4534-9d85-09efed71874f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "name": "network-vif-plugged", "status": "completed", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:09.300738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c89d3004-cdb3-45d0-a38b-12bd7ea5abaf req-94fc4995-fdd2-4534-9d85-09efed71874f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.301622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c89d3004-cdb3-45d0-a38b-12bd7ea5abaf req-94fc4995-fdd2-4534-9d85-09efed71874f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.320398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c89d3004-cdb3-45d0-a38b-12bd7ea5abaf req-94fc4995-fdd2-4534-9d85-09efed71874f service nova] Creating event network-vif-plugged:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch1-master-1 Jul 02 21:07:09.327049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-c89d3004-cdb3-45d0-a38b-12bd7ea5abaf req-94fc4995-fdd2-4534-9d85-09efed71874f service nova] Instance b9e29424-2b31-4721-84ff-591ef411dbf4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:07:09.349221 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c89d3004-cdb3-45d0-a38b-12bd7ea5abaf req-94fc4995-fdd2-4534-9d85-09efed71874f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090493 Jul 02 21:07:09.350893 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 883/1699] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:09.359732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:09.373066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:09.380464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.381185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.389674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.390272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.575131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:09.588403 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c8cec98-191a-40bb-b820-681304631aa2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.231826 Jul 02 21:07:09.589180 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 884/1700] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:09 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:09.601155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:09.602113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:09.609069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.609802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.610817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.611460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.704545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:09.705304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:09.705932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:09.706478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:09.707039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:09.725958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.729045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.730317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:09.731579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:09.781666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Getting quotas for project 4b15f516c6a34343979d19a0938c232b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:07:09.797762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Getting quotas for user 1fade188e2a14766ae95fe44143bca97 and project 4b15f516c6a34343979d19a0938c232b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:07:09.827336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:07:09.835195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:09.874448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:09.893969 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bed8b7da-f13d-45a4-a601-46a70a0ee441 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.302650 Jul 02 21:07:09.894877 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 885/1701] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:09 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:09.923517 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b6cebb1-c16c-4bc4-822a-6307a2c4d43b tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595936 Jul 02 21:07:09.924432 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 817/1702] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:07:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:07:09.936299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccdc7bd9-7a80-4542-b8df-489ddb055b33 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:09.937305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccdc7bd9-7a80-4542-b8df-489ddb055b33 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:10.036091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccdc7bd9-7a80-4542-b8df-489ddb055b33 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:10.045278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccdc7bd9-7a80-4542-b8df-489ddb055b33 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1218 microversion: 2.1 time: 0.113971 Jul 02 21:07:10.046413 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 886/1703] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:09 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:10.275326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:10.276201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:10.296594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:10.297126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:10.302113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:10.307996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:10.607002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:10.607665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:11.252733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:11.252961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:11.253742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:11.254157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:11.635140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:11.651202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2880ce64-ff11-4dbc-97b0-b1af3588ed72 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 1.380656 Jul 02 21:07:11.663660 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 818/1704] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:10 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:11.669133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:11.670185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:11.679060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:11.681242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:11.682338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:11.686644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:12.422240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:12.426462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:12.437733 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-636a4746-68ba-4a31-b816-ba4de7698a1c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 1.835817 Jul 02 21:07:12.458337 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 887/1705] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:10 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:12.470709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:12.471639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:12.493142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:12.494095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:12.495567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:12.497623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:12.806231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:12.825057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adf9abbf-56a5-491f-ab18-a9da4a3800aa tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 1.157631 Jul 02 21:07:12.829691 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 819/1706] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:11 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:12.836736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-82ad06cd-f1dd-4635-9995-e3acd89822e8 req-ba6d467f-d912-4fe1-8b82-47311f16a841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "name": "network-vif-plugged", "status": "completed", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:12.883930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82ad06cd-f1dd-4635-9995-e3acd89822e8 req-ba6d467f-d912-4fe1-8b82-47311f16a841 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:12.892858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82ad06cd-f1dd-4635-9995-e3acd89822e8 req-ba6d467f-d912-4fe1-8b82-47311f16a841 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:12.944863 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-82ad06cd-f1dd-4635-9995-e3acd89822e8 req-ba6d467f-d912-4fe1-8b82-47311f16a841 service nova] Creating event network-vif-plugged:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:07:12.957690 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-82ad06cd-f1dd-4635-9995-e3acd89822e8 req-ba6d467f-d912-4fe1-8b82-47311f16a841 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124576 Jul 02 21:07:12.960612 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 820/1707] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:12.974113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:12.977116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:12.980809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:13.000751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b04cc75-702c-4f42-ba68-26ca3584290e tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1276 microversion: 2.1 time: 0.531312 Jul 02 21:07:13.001560 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 888/1708] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:12 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1276 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:13.003598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:13.005199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:13.006189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:13.009868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:13.462192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:13.463529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:13.492970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:13.493505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:13.494300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:13.495256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:13.751770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:13.767842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e2eaab3-f9ed-4d5e-b90c-1a323619841a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.802596 Jul 02 21:07:13.769305 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 821/1709] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:12 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:13.847306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:13.848790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:13.879232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:13.879750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:13.892335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:13.892924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:15.970588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:16.004917 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed99b2aa-7d91-49c4-a4d9-b9c50f95ec9b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 2.549107 Jul 02 21:07:16.009025 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 889/1710] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:13 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:16.025031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:16.028030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:16.054761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:16.055235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:16.056062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:16.062690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:16.087164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:16.111918 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73eaa7e1-84ac-4436-983d-4d6a9f250751 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 2.274051 Jul 02 21:07:16.117163 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 822/1711] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:13 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:16.133757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:16.135596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:16.146758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:16.150772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:16.152977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:16.154856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:16.689755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:16.701533 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e2b8bb9-f866-4fe0-8cc0-6c93bae5644a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.691297 Jul 02 21:07:16.705043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:16.715970 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 890/1712] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:16 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:16.720101 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2e50941-4226-4ba6-8a09-42fb42118af3 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.598905 Jul 02 21:07:16.720729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 823/1713] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:16 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:17.029628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:17.030263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:17.049383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.056152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.057674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.058379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.133014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:17.136478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:17.145712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.146585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.148909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.150311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.517193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:17.530087 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-995ed13b-23ab-4de0-8ef9-892172eee08b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.508673 Jul 02 21:07:17.531444 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 891/1714] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:17 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:17.553898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2e255641-b3d8-419b-aad6-9eb78c8edeb1 req-3180509b-9bbc-4209-b10d-2b67f927c7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e56357a-da4c-449a-841c-de49a1756c81", "name": "network-vif-plugged", "status": "completed", "tag": "43e2625c-2036-4486-9cdd-2894eeafca79"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:17.573786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2e255641-b3d8-419b-aad6-9eb78c8edeb1 req-3180509b-9bbc-4209-b10d-2b67f927c7a8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.576907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2e255641-b3d8-419b-aad6-9eb78c8edeb1 req-3180509b-9bbc-4209-b10d-2b67f927c7a8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.589984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:17.604892 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2676de8b-6293-4dd1-9d91-deb5669135f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.476884 Jul 02 21:07:17.618268 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 824/1715] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:17 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:17.621392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2e255641-b3d8-419b-aad6-9eb78c8edeb1 req-3180509b-9bbc-4209-b10d-2b67f927c7a8 service nova] Creating event network-vif-plugged:43e2625c-2036-4486-9cdd-2894eeafca79 for instance 5e56357a-da4c-449a-841c-de49a1756c81 on nch1-master-1 Jul 02 21:07:17.633375 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2e255641-b3d8-419b-aad6-9eb78c8edeb1 req-3180509b-9bbc-4209-b10d-2b67f927c7a8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084682 Jul 02 21:07:17.635371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 892/1716] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:07:17.720203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:17.720822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:17.739178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:17.739900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:17.744176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.747205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.748546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.758865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.759450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.760173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:17.760636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:17.763449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:18.202452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:18.237251 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2150e119-39ea-4ffe-8b8e-9af32a94b334 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.500746 Jul 02 21:07:18.240124 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 825/1717] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:17 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:18.552092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:18.553677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:18.574091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:18.587425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:18.588704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:18.590354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:18.592277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:18.592610 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2357e811-7d06-4775-bc74-b23dd38839ca tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 0.857396 Jul 02 21:07:18.596399 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 893/1718] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:17 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:18.629563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:18.631427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:18.647936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:18.648791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:18.649842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:18.651909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.431460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:19.450895 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c4a6442-8597-4caf-8f11-8136f1667258 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1313 microversion: 2.1 time: 0.905966 Jul 02 21:07:19.452649 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 826/1719] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:18 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:19.463710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:19.479914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-188b6629-6f7a-4a76-b572-d4ffd2e815b5 req-664bbfd5-c75d-412f-b4ec-afae86c3618c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cc270e-70fc-4757-9d25-c26db03fe8e8", "tag": "c95e0903-0804-48ed-b293-c06ad9b62975"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:19.481498 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1635a1b1-5774-457e-8467-24fc72d3a351 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.859338 Jul 02 21:07:19.496415 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 894/1720] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:18 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:19.510288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:19.512786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-188b6629-6f7a-4a76-b572-d4ffd2e815b5 req-664bbfd5-c75d-412f-b4ec-afae86c3618c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:19.514558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:19.516948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-188b6629-6f7a-4a76-b572-d4ffd2e815b5 req-664bbfd5-c75d-412f-b4ec-afae86c3618c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.540117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:19.540826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.541759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:19.547628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.553389 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-188b6629-6f7a-4a76-b572-d4ffd2e815b5 req-664bbfd5-c75d-412f-b4ec-afae86c3618c service nova] Creating event network-changed:c95e0903-0804-48ed-b293-c06ad9b62975 for instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 on nch2-master-1 Jul 02 21:07:19.579037 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-188b6629-6f7a-4a76-b572-d4ffd2e815b5 req-664bbfd5-c75d-412f-b4ec-afae86c3618c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123164 Jul 02 21:07:19.580167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 827/1721] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:19.585924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1984918f-af7d-4678-992e-3234382a2f69 req-5847c5dd-3e95-4a1c-aa9a-754a827f483d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "name": "network-vif-unplugged", "status": "completed", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:19.615161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1984918f-af7d-4678-992e-3234382a2f69 req-5847c5dd-3e95-4a1c-aa9a-754a827f483d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:19.615607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1984918f-af7d-4678-992e-3234382a2f69 req-5847c5dd-3e95-4a1c-aa9a-754a827f483d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.641410 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1984918f-af7d-4678-992e-3234382a2f69 req-5847c5dd-3e95-4a1c-aa9a-754a827f483d service nova] Creating event network-vif-unplugged:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch2-master-1 Jul 02 21:07:19.650828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-1984918f-af7d-4678-992e-3234382a2f69 req-5847c5dd-3e95-4a1c-aa9a-754a827f483d service nova] Instance b9e29424-2b31-4721-84ff-591ef411dbf4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:07:19.684326 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1984918f-af7d-4678-992e-3234382a2f69 req-5847c5dd-3e95-4a1c-aa9a-754a827f483d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092626 Jul 02 21:07:19.687655 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 828/1722] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:19.705084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:19.706191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:19.720914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:19.726991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.728426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:19.729107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:19.761029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:19.812662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:20.041041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:20.762795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:20.779801 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fde73700-9e1c-449b-98ab-b614ce9be1d5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1522 microversion: 2.1 time: 1.090497 Jul 02 21:07:20.793084 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 829/1723] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:19 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1522 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:20.793509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:20.793922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:20.796370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:20.803825 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3b052c9-d809-4d4f-8e94-acbaaf2f0795 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 1.304878 Jul 02 21:07:20.804491 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 895/1724] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:19 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:20.808972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:20.812766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:20.815917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:20.816623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:20.819262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:20.820343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:20.829403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:20.830333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:20.831926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:20.832775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.410426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:21.422041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:21.433996 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-417cfb82-0513-494c-bce6-9e18944ceecb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1463 microversion: 2.1 time: 0.643307 Jul 02 21:07:21.438355 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 830/1725] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:20 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1463 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:21.454091 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a61b1d97-8e9d-4ef0-b22c-963b72452f41 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.639260 Jul 02 21:07:21.456460 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 896/1726] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:20 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:21.456726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:21.457053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:21.469093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.469558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.470361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.470803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.706333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c0153263-5bd8-414a-9d27-aaec61ff3228 req-760f09b8-9c30-47fa-a508-712b9a1b9d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:21.725978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c0153263-5bd8-414a-9d27-aaec61ff3228 req-760f09b8-9c30-47fa-a508-712b9a1b9d69 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.729987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c0153263-5bd8-414a-9d27-aaec61ff3228 req-760f09b8-9c30-47fa-a508-712b9a1b9d69 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.759729 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c0153263-5bd8-414a-9d27-aaec61ff3228 req-760f09b8-9c30-47fa-a508-712b9a1b9d69 service nova] Creating event network-changed:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch2-master-1 Jul 02 21:07:21.777333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-c0153263-5bd8-414a-9d27-aaec61ff3228 req-760f09b8-9c30-47fa-a508-712b9a1b9d69 service nova] Instance b9e29424-2b31-4721-84ff-591ef411dbf4 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:07:21.802640 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c0153263-5bd8-414a-9d27-aaec61ff3228 req-760f09b8-9c30-47fa-a508-712b9a1b9d69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100726 Jul 02 21:07:21.805276 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 897/1727] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:07:21.819939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:21.821617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:21.831572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.832258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.833405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.834006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.947635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:21.957449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8763e2a-064e-4032-b2d5-63951ac28bf6 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1463 microversion: 2.1 time: 0.505575 Jul 02 21:07:21.958402 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 831/1728] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:21 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1463 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:21.963152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:21.964086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:21.970981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.971815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:21.972874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:21.973598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:22.372375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:22.384679 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44e15a99-50ea-4424-a4f7-4c20315b5ef6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1504 microversion: 2.1 time: 0.577279 Jul 02 21:07:22.387129 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 898/1729] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:21 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1504 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:22.397191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2064160682", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "ef3bcf67-5b5e-4038-b770-6025197f7a96"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:22.477464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:07:22.486719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:22.497099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81e8ee94-cea2-4528-b55c-1aeae2c32095 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.537349 Jul 02 21:07:22.498978 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 832/1730] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:21 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:22.505929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:22.506874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:22.518052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:22.520111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:22.522196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:22.522850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:23.115904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:23.116606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:23.117249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:23.117899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:23.118686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:23.133188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:23.133646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:23.134466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:23.134940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:23.145107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:23.157784 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca2a3e44-004a-429c-9e2c-b4545dc5a27a tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.657029 Jul 02 21:07:23.160917 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 833/1731] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:22 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:23.177042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Getting quotas for project 381ec26b4d1240b4889b5ecfebf02610. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:07:23.183702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Getting quotas for user 5198cb44d38d495794cc8b0fc5d9d4c3 and project 381ec26b4d1240b4889b5ecfebf02610. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:07:23.200324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:07:23.215914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:23.311973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-158efd93-45ba-4f38-b4e4-385a3fbb9836 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921825 Jul 02 21:07:23.313882 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 899/1732] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:07:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:07:23.329655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb56e9b4-7219-4ef4-a32e-07c23827ae66 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:23.330395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb56e9b4-7219-4ef4-a32e-07c23827ae66 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:23.403691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:23.407935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:23.419020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:23.422567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:23.423484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:23.425333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:23.497587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb56e9b4-7219-4ef4-a32e-07c23827ae66 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:23.507621 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb56e9b4-7219-4ef4-a32e-07c23827ae66 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1214 microversion: 2.1 time: 0.187364 Jul 02 21:07:23.517901 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 834/1733] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:23 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:23.523161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:23.523782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:23.532851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:23.533656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:23.534631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:23.535274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:24.006503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:24.010310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:24.026403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f1ed2fee-2900-4061-a6af-757fd1e3d884 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.507083 Jul 02 21:07:24.027313 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 835/1734] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:23 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:24.046375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:24.087338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6fe803cc-481a-4caf-b72d-d348932ab238 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1504 microversion: 2.1 time: 0.686439 Jul 02 21:07:24.089771 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 900/1735] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:23 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1504 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:24.175923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:24.176850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:24.194327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:24.196327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:24.197741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:24.200344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:24.525761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:24.526704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:24.534091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:24.535010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:24.536257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:24.537027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:24.834158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:24.843427 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6220756d-5c0b-4e0b-af0d-43d3214180c3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1266 microversion: 2.1 time: 0.321654 Jul 02 21:07:24.847166 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 901/1736] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:24 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:25.044775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:25.045809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:25.053309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.059985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:25.061830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.062466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:25.098121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:25.110957 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11d5c269-32d2-4cbe-a47d-11957a24b2f2 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1469 microversion: 2.1 time: 0.939348 Jul 02 21:07:25.119586 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 836/1737] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:24 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1469 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:25.135412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:25.139016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:25.153670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.154546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:25.155761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.156584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:25.672638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:25.684812 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ec8be11-c4fb-48c4-aa84-48ebca76408d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.643870 Jul 02 21:07:25.685415 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 902/1738] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:25 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:25.698278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c089334e-298f-43a0-b70f-922c41a535cf req-c4982198-ddc4-44f6-ae36-7ba174977702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd7119-38af-45a9-997f-2001926d852b", "name": "network-vif-unplugged", "status": "completed", "tag": "f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:25.707047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c089334e-298f-43a0-b70f-922c41a535cf req-c4982198-ddc4-44f6-ae36-7ba174977702 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.707871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c089334e-298f-43a0-b70f-922c41a535cf req-c4982198-ddc4-44f6-ae36-7ba174977702 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:25.719959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c089334e-298f-43a0-b70f-922c41a535cf req-c4982198-ddc4-44f6-ae36-7ba174977702 service nova] Creating event network-vif-unplugged:f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a for instance 9dbd7119-38af-45a9-997f-2001926d852b on nch2-master-1 Jul 02 21:07:25.726061 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c089334e-298f-43a0-b70f-922c41a535cf req-c4982198-ddc4-44f6-ae36-7ba174977702 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038971 Jul 02 21:07:25.726999 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 903/1739] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:25.732611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:25.752531 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66828d2d-3a4e-4975-b8ec-5e3201343558 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1504 microversion: 2.1 time: 0.624394 Jul 02 21:07:25.753744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 837/1740] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:25 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1504 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:25.865371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:25.866220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:25.883940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.884555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:25.885442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:25.886014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:26.050592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:26.062277 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34b6b7d7-ca38-410c-bcb2-81cbb5651997 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1272 microversion: 2.1 time: 0.201445 Jul 02 21:07:26.076115 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 904/1741] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:25 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:26.140164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:26.141106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:26.145621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:26.156701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:26.158320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:26.159848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:26.163336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:26.501626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:26.511840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c49d7d1d-4fb6-4bce-8474-f78e4d39df9b tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1462 microversion: 2.1 time: 0.377857 Jul 02 21:07:26.526915 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 838/1742] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:26 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1462 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:26.786297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-295555691", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3101ad44-29e0-4a63-891c-95309e726df6"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:26.893015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] validate_networks() for [('3101ad44-29e0-4a63-891c-95309e726df6', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:07:26.907700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:26.908387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:26.915858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:26.916376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:26.917266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:26.917715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:27.657074 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f782d73a-bc0f-4e3f-8131-91d9e4cea61c tempest-MigrationsAdminTest-1639921973 tempest-MigrationsAdminTest-1639921973-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1613 microversion: 2.1 time: 1.131779 Jul 02 21:07:27.672633 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 905/1743] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:26 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1613 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:27.672633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:27.672633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:27.675762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:27.678570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:27.679575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:27.686982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:28.681126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:28.688734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:28.695398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cfcef864-a147-4b94-a705-4614e9af42ed tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 1.036214 Jul 02 21:07:28.696439 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 906/1744] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:27 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:28.701341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:28.704863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:28.721664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:28.738786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:28.741219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:28.741678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:29.251472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:29.252746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:29.253609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:29.254265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:29.255229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:29.285216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:29.286297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:29.291336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:29.294164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:29.327250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Getting quotas for project 73fe5e9f9b7e401488333f601eaa80ac. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:07:29.341809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Getting quotas for user 27059ad6d23e4faf8f09c22cf6ee1475 and project 73fe5e9f9b7e401488333f601eaa80ac. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:07:29.399339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Going to run 2 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:07:29.404078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: 872adba3-ec3c-4555-b21e-d1f94a30612a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:29.478445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=872adba3-ec3c-4555-b21e-d1f94a30612a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:29.708320 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cde639fc-088e-4054-892c-5b03adb03428 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.147766 Jul 02 21:07:29.719992 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 839/1745] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:07:29.726660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:29.727285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:29.743797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:29.744608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:29.745874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:29.746508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.115507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:30.136253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26ca1aec-811d-466f-913d-1c7e0839da74 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 200 len: 1447 microversion: 2.1 time: 1.435930 Jul 02 21:07:30.137132 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 907/1746] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:28 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 1447 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:30.151105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:30.153826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:30.183875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.184982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.185814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.186263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.248497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:30.463398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1178ddc-fefd-47d0-a86f-39814234a9ac tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 204 len: 0 microversion: 2.1 time: 0.325029 Jul 02 21:07:30.464245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 908/1747] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:30 2022] DELETE /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:30.473500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:30.474508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:30.492232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.496324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.498029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:30.500289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.511120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.525481 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e970d304-8445-44db-bf82-a45a0f972c17 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 0.803435 Jul 02 21:07:30.531226 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 840/1748] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:29 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:30.556772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:30.580915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:30.585222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Searching by: {'deleted': False, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:30.638940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.639248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.646646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.647193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.703627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46551a18-58d7-470b-8fa3-232eb2edef1b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.168396 Jul 02 21:07:30.704540 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 841/1749] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:07:30 2022] GET /compute/v2.1/servers => generated 675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:30.714269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:30.715004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:30.738352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.756539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.757402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:30.757844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:30.842166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:30.875884 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Working on deleting snapshot c634ebab-a82e-44d0-888b-9baa9420e962 from shelved instance... Jul 02 21:07:31.300823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:31.329338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-47044de8-8e97-4c4a-8182-e01d77fb73a3 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.862164 Jul 02 21:07:31.332273 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 909/1750] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:30 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:31.363175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c9281e99-71fb-4306-ab3a-d7b9ebe37109 req-0e22e7fb-172b-4c05-8f47-4436d2ab579e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0088d04-8df6-4deb-8abe-630b761d2c39", "tag": "b050c162-ea74-4a29-b0c0-c047c6ec2703"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:31.431331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c9281e99-71fb-4306-ab3a-d7b9ebe37109 req-0e22e7fb-172b-4c05-8f47-4436d2ab579e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:31.432830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c9281e99-71fb-4306-ab3a-d7b9ebe37109 req-0e22e7fb-172b-4c05-8f47-4436d2ab579e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:31.490771 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c9281e99-71fb-4306-ab3a-d7b9ebe37109 req-0e22e7fb-172b-4c05-8f47-4436d2ab579e service nova] Creating event network-changed:b050c162-ea74-4a29-b0c0-c047c6ec2703 for instance b0088d04-8df6-4deb-8abe-630b761d2c39 on nch1-master-1 Jul 02 21:07:31.497432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c9281e99-71fb-4306-ab3a-d7b9ebe37109 req-0e22e7fb-172b-4c05-8f47-4436d2ab579e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162665 Jul 02 21:07:31.498430 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 910/1751] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:31.539771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:31.541261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:31.586900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:31.587570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:31.588886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:31.589785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.026065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Doing local delete in cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=131044) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 02 21:07:32.026618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:32.043856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:32.044838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.045478 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 02 21:07:32.063813 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dbfb0708-63d8-4683-9274-40a18ffa7601 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1468 microversion: 2.1 time: 0.542698 Jul 02 21:07:32.066973 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 911/1752] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:31 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1468 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:32.068949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] deallocate_for_instance() {{(pid=131044) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 02 21:07:32.094689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:32.095630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:32.111543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:32.112376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.120204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:32.120766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.409124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:32.427514 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1144c37-a193-4862-a26a-fbec78eda745 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1271 microversion: 2.1 time: 0.358285 Jul 02 21:07:32.428801 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 912/1753] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:32 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1271 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:32.434069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-93a033e2-462f-47fc-9207-0e8fb655815f req-81d9a753-18a8-4cbd-b159-bc6f6a5aedb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "name": "network-vif-plugged", "status": "completed", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:32.446995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-93a033e2-462f-47fc-9207-0e8fb655815f req-81d9a753-18a8-4cbd-b159-bc6f6a5aedb6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:32.448032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-93a033e2-462f-47fc-9207-0e8fb655815f req-81d9a753-18a8-4cbd-b159-bc6f6a5aedb6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.465584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-93a033e2-462f-47fc-9207-0e8fb655815f req-81d9a753-18a8-4cbd-b159-bc6f6a5aedb6 service nova] Creating event network-vif-plugged:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch2-master-1 Jul 02 21:07:32.471645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-93a033e2-462f-47fc-9207-0e8fb655815f req-81d9a753-18a8-4cbd-b159-bc6f6a5aedb6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041243 Jul 02 21:07:32.472688 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 913/1754] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:32.480863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:32.481883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:32.495675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:32.496313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.497253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:32.497940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:32.981461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:32.998677 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12a5477b-4c23-4b0f-975d-03a33c22c3d7 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 0.523836 Jul 02 21:07:32.999371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 914/1755] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:32 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:33.008909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:33.009529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:33.011527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:33.029258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:33.029717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:33.030517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:33.031018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:33.154613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:33.201099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:33.688078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:33.702697 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acaf5729-874a-4d08-9aea-f24f4891050a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 0.697565 Jul 02 21:07:33.705434 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 915/1756] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:33 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:33.710420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:33.711261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:33.721460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:33.722107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:33.723574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:33.724393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:34.485049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:34.501497 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fa94adfd-2eb6-44ed-bb8d-103aa0d22381 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 200 len: 1468 microversion: 2.1 time: 0.793150 Jul 02 21:07:34.501766 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 916/1757] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:33 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 1468 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:34.511725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:34.512585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:34.522283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:34.522890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:34.526432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:34.527208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:34.621036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Updating instance_info_cache with network_info: [] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:07:35.630090 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef380569-0a3b-4664-aa02-5120e41ada6b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 204 len: 0 microversion: 2.1 time: 4.924048 Jul 02 21:07:35.630704 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 842/1758] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:30 2022] DELETE /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 0 bytes in 4925 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:35.647029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:35.654359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:35.671670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:35.673188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:35.674379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:35.674994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:35.892434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:35.919299 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-455d6df1-1669-436c-872a-89a1e45b04a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 1.405374 Jul 02 21:07:35.920798 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 917/1759] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:34 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:35.926132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a538bfd4-b097-4e5a-b455-8380797c5f58 req-921450e3-4760-48ba-b526-e959029c1f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cc270e-70fc-4757-9d25-c26db03fe8e8", "name": "network-vif-plugged", "status": "completed", "tag": "c95e0903-0804-48ed-b293-c06ad9b62975"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:35.945480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a538bfd4-b097-4e5a-b455-8380797c5f58 req-921450e3-4760-48ba-b526-e959029c1f20 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:35.951997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a538bfd4-b097-4e5a-b455-8380797c5f58 req-921450e3-4760-48ba-b526-e959029c1f20 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:35.969740 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a538bfd4-b097-4e5a-b455-8380797c5f58 req-921450e3-4760-48ba-b526-e959029c1f20 service nova] Creating event network-vif-plugged:c95e0903-0804-48ed-b293-c06ad9b62975 for instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 on nch2-master-1 Jul 02 21:07:35.975707 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a538bfd4-b097-4e5a-b455-8380797c5f58 req-921450e3-4760-48ba-b526-e959029c1f20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053368 Jul 02 21:07:35.976936 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 918/1760] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:35.982946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4119c0fb-1880-4711-aca4-b8612e40e49f req-a0cf497f-76d2-4ec2-a263-7becf5d87008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dbd7119-38af-45a9-997f-2001926d852b", "name": "network-vif-deleted", "tag": "f2ffcd13-1c6c-4ff4-9e86-4e7156d0181a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:36.004598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4119c0fb-1880-4711-aca4-b8612e40e49f req-a0cf497f-76d2-4ec2-a263-7becf5d87008 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:36.005350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4119c0fb-1880-4711-aca4-b8612e40e49f req-a0cf497f-76d2-4ec2-a263-7becf5d87008 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:36.022694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.compute.server_external_events [req-4119c0fb-1880-4711-aca4-b8612e40e49f req-a0cf497f-76d2-4ec2-a263-7becf5d87008 service nova] Unable to find a host for instance 9dbd7119-38af-45a9-997f-2001926d852b. Dropping event network-vif-deleted {{(pid=131045) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 02 21:07:36.024170 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4119c0fb-1880-4711-aca4-b8612e40e49f req-a0cf497f-76d2-4ec2-a263-7becf5d87008 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.045770 Jul 02 21:07:36.025949 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 919/1761] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 02 21:07:36.032378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:36.033860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:36.041160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:36.041950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:36.042927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:36.043539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:36.698162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:36.713771 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50e5ca48-e933-468e-8841-498c5a53313a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 1.078791 Jul 02 21:07:36.714727 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 843/1762] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:35 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:36.727602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:36.728541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:36.739223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:36.739687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:36.740544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:36.741071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.030688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:37.053658 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b565b617-f6af-435f-8227-e78206189bff tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1318 microversion: 2.1 time: 1.026371 Jul 02 21:07:37.055943 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 920/1763] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:36 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1318 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:37.076025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:37.077093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: b9e29424-2b31-4721-84ff-591ef411dbf4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:37.084378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.085066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.086843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.087474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.111802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] HTTP exception thrown: Instance b9e29424-2b31-4721-84ff-591ef411dbf4 could not be found. Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Request method failure captured: Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 HTTP/1.1 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLI_HXDIyZZxG-gKa7KB2Ytwwg_ahPBBhc9piNMHa8hDTiivH8YzlIRNDpcV2RNrcPR1EMR8bYZ87ndPR95PmWl5A2lOIccStomRqqK06p7AhMIBc_495k_Dlq4oWPf20ExcJZkYTBJIF83xXwUSjpGzRnVblKWKt0_JdTIKol3TmSY Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63f39c85f12c4ad58be6d786de9a584b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63f39c85f12c4ad58be6d786de9a584b"}]}] Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 592e8c2ad31f459fa0b37f219cc4f84c Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance b9e29424-2b31-4721-84ff-591ef411dbf4 could not be found. Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b9e29424-2b31-4721-84ff-591ef411dbf4'} Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e29424-2b31-4721-84ff-591ef411dbf4 could not be found. Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e29424-2b31-4721-84ff-591ef411dbf4 could not be found. Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:37.113993 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e29424-2b31-4721-84ff-591ef411dbf4 could not be found. Jul 02 21:07:37.119146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.121862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Returning 404 to user: Instance b9e29424-2b31-4721-84ff-591ef411dbf4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:37.123040 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51fc8409-f8b4-4596-bd6e-6a86b3e8a08f tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4" status: 404 len: 111 microversion: 2.1 time: 0.064227 Jul 02 21:07:37.124264 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 921/1764] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:37 2022] GET /compute/v2.1/servers/b9e29424-2b31-4721-84ff-591ef411dbf4 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:37.130841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:37.131970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:37.139443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.140310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.141332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.142079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.182842 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b HTTP/1.1 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9dbd7119-38af-45a9-997f-2001926d852b'} Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:37.184910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:07:37.190168 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:37.192969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:37.198367 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0bd37b7d-dd63-4069-a05f-a4a198612c96 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 404 len: 111 microversion: 2.1 time: 0.071153 Jul 02 21:07:37.199474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 922/1765] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:37 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:37.233820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6e4e6404-ac3b-4299-8c18-df5e1afddc89 req-a366ebf3-cf34-42de-9791-be41b6224e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a95758eb-8431-4d2b-8af5-f9568d6726d7", "tag": "d43fc323-2a44-45f3-b303-8050ccdd5236"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:37.245143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e4e6404-ac3b-4299-8c18-df5e1afddc89 req-a366ebf3-cf34-42de-9791-be41b6224e54 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.246023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e4e6404-ac3b-4299-8c18-df5e1afddc89 req-a366ebf3-cf34-42de-9791-be41b6224e54 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.263959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6e4e6404-ac3b-4299-8c18-df5e1afddc89 req-a366ebf3-cf34-42de-9791-be41b6224e54 service nova] Creating event network-changed:d43fc323-2a44-45f3-b303-8050ccdd5236 for instance a95758eb-8431-4d2b-8af5-f9568d6726d7 on nch2-master-1 Jul 02 21:07:37.272574 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6e4e6404-ac3b-4299-8c18-df5e1afddc89 req-a366ebf3-cf34-42de-9791-be41b6224e54 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070797 Jul 02 21:07:37.274300 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 923/1766] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:37.280603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:37.282738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:37.298898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.301380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.311611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.315259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.512014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:37.523664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:37.534744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:37.536710 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0403d6b-87e4-4782-8bc6-3cf8e0a71f46 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2946 microversion: 2.42 time: 0.820816 Jul 02 21:07:37.544675 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 844/1767] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:07:36 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2946 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:07:37.564287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:37.564748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:37.575164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.575614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.576423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.586638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.644930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:37.712898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:37.721758 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b800c92-fbf6-4dd3-9b21-618ac47ba1c5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 0.445792 Jul 02 21:07:37.722559 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 924/1768] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:37 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:37.736977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-112566693", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:37.743641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:37.807237 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-450eae30-e2c9-4578-97e1-f88431a0a229 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 204 len: 0 microversion: 2.1 time: 0.257149 Jul 02 21:07:37.812863 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 845/1769] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:37 2022] DELETE /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:37.817003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:07:37.820109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:37.822060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:37.830739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.831357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:37.832839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:37.833348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:38.062973 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81111c39-a4d6-4a24-bebb-3c17fccc0c4a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.246910 Jul 02 21:07:38.068428 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 846/1770] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:07:37 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c/os-interface => generated 1832 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:07:38.073966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:38.079856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:38.094152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:38.094953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:38.095801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:38.096235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:38.344183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:38.357518 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a49aa6c4-c217-4d81-a567-4e5f67944e64 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 0.287622 Jul 02 21:07:38.360128 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 847/1771] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:38 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:38.376847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:38.377823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:38.393860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:38.394740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:38.395818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:38.397827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:38.794248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:38.818758 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc3623d1-a03f-44c4-8e4a-ec71b08a1d06 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1533 microversion: 2.1 time: 0.448857 Jul 02 21:07:38.828234 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 848/1772] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:38 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1533 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:38.841215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:38.843524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:38.860315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:38.864655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:38.865694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:38.866299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.026027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:39.026492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:39.026977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:39.028276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:39.028727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:39.048670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.049434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.050562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.051302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.084741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:07:39.102994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:07:39.133995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:07:39.144698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:39.235587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:39.247479 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8f1185d-de42-4abf-bd36-4659dfa8156a tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1507 microversion: 2.1 time: 0.416151 Jul 02 21:07:39.262285 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 849/1773] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:38 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1507 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:39.269052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-88d0e5a7-13ed-4312-a595-a5fe6fcd7104 req-8c26aa87-dc19-4b70-9593-3ad56212eaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e29424-2b31-4721-84ff-591ef411dbf4", "name": "network-vif-deleted", "tag": "e38b104e-be0f-4c3f-b762-8b453bcc5d38"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:39.276661 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1011f6b2-c232-443d-9335-40458ef332e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.541262 Jul 02 21:07:39.278074 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 925/1774] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:07:39.298736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:39.299560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:39.307235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88d0e5a7-13ed-4312-a595-a5fe6fcd7104 req-8c26aa87-dc19-4b70-9593-3ad56212eaf3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.309892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88d0e5a7-13ed-4312-a595-a5fe6fcd7104 req-8c26aa87-dc19-4b70-9593-3ad56212eaf3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.314507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.315397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.317428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.322296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.348363 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-88d0e5a7-13ed-4312-a595-a5fe6fcd7104 req-8c26aa87-dc19-4b70-9593-3ad56212eaf3 service nova] Creating event network-vif-deleted:e38b104e-be0f-4c3f-b762-8b453bcc5d38 for instance b9e29424-2b31-4721-84ff-591ef411dbf4 on nch2-master-1 Jul 02 21:07:39.358591 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-88d0e5a7-13ed-4312-a595-a5fe6fcd7104 req-8c26aa87-dc19-4b70-9593-3ad56212eaf3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092602 Jul 02 21:07:39.359799 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 850/1775] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:39.375005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90cd9c85-2721-407b-835a-18c72398544d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:39.380057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90cd9c85-2721-407b-835a-18c72398544d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:39.383106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:39.489110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90cd9c85-2721-407b-835a-18c72398544d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:39.501725 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90cd9c85-2721-407b-835a-18c72398544d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1214 microversion: 2.1 time: 0.135398 Jul 02 21:07:39.513867 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 851/1776] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:39 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:39.530390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:39.534260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:39.573511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.575471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.578937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:39.579413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:39.918383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:39.931325 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acd5560b-149b-4416-a15e-ed0f28ea817f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 0.651910 Jul 02 21:07:39.935763 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 926/1777] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:39 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:39.957687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:39.961312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:40.027681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:40.035012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:40.047812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:40.053263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:40.075673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:40.659668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:40.896827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:40.917509 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ea2181e-a431-4739-8162-d12987b18c5f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 1.389150 Jul 02 21:07:40.919616 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 852/1778] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:39 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:40.929600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1ebedebb-5c58-4175-9df5-57762908ce96 req-6d02fcf8-097d-466c-b159-91be505b76c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872adba3-ec3c-4555-b21e-d1f94a30612a", "tag": "837a8780-81d0-4420-9494-0c17939a10d6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:40.946314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1ebedebb-5c58-4175-9df5-57762908ce96 req-6d02fcf8-097d-466c-b159-91be505b76c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:40.949812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1ebedebb-5c58-4175-9df5-57762908ce96 req-6d02fcf8-097d-466c-b159-91be505b76c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:40.999958 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1ebedebb-5c58-4175-9df5-57762908ce96 req-6d02fcf8-097d-466c-b159-91be505b76c3 service nova] Creating event network-changed:837a8780-81d0-4420-9494-0c17939a10d6 for instance 872adba3-ec3c-4555-b21e-d1f94a30612a on nch2-master-1 Jul 02 21:07:41.014297 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1ebedebb-5c58-4175-9df5-57762908ce96 req-6d02fcf8-097d-466c-b159-91be505b76c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086032 Jul 02 21:07:41.016372 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 853/1779] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:41.045858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:41.049109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:41.079785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:41.081858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:41.089788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:41.091903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:41.253493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:41.271189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-261f8de8-9509-4a95-9f80-3ad92febdd31 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1533 microversion: 2.1 time: 1.327320 Jul 02 21:07:41.271841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 927/1780] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:39 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1533 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:41.285973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5e755bf8-405d-4050-ac15-a1ff84181eef"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:41.288524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:41.310068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:41.310536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:41.314674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:41.315264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:41.488315 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] HTTP exception thrown: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Request method failure captured: Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8/os-volume_attachments/9feae5ca-0eb1-43d5-9758-c25410d422fa HTTP/1.1 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 74 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLyOJu77GEtuOLEzvPg8X-8PVEs2oYV8P4gKAFWDRvPmt57I6tG71QoFLpTv9W8keTaUH7g5BcgmXxToG4PQYO47jjt4iqzepcsIqvuo_0kxCsOBtSsTHp4ksE6aXHx3CyZagcqekdBdqdxW0rloD1f8jzkNqIjqUdub9o3JxHjdOQ Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 05a8c36319054fc8af0b5dd1916d7b5f Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-VolumesAdminNegativeTest-1402470717 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/05a8c36319054fc8af0b5dd1916d7b5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_05a8c36319054fc8af0b5dd1916d7b5f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/05a8c36319054fc8af0b5dd1916d7b5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/05a8c36319054fc8af0b5dd1916d7b5f"}]}] Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-VolumesAdminNegativeTest-1402470717 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 05a8c36319054fc8af0b5dd1916d7b5f Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1402470717 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-VolumesAdminNegativeTest-1402470717-project-admin Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 276b5102c10049faa2de880b2c3a8ee6 Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-VolumesAdminNegativeTest-1402470717-project-admin Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: {"volumeAttachment": {"volumeId": "5e755bf8-405d-4050-ac15-a1ff84181eef"}} Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: exception: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'server_id': '78cc270e-70fc-4757-9d25-c26db03fe8e8', 'id': '9feae5ca-0eb1-43d5-9758-c25410d422fa', 'body': {'volumeAttachment': {'volumeId': '5e755bf8-405d-4050-ac15-a1ff84181eef'}}} Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. (HTTP 404) (Request-ID: req-18936bb9-00ac-456e-9c29-554f1590bc18) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:07:41.494810 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] Returning 404 to user: Volume 9feae5ca-0eb1-43d5-9758-c25410d422fa could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:41.500174 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a956515e-4262-44a5-8e29-155a38247489 tempest-VolumesAdminNegativeTest-1402470717 tempest-VolumesAdminNegativeTest-1402470717-project-admin] 10.222.0.43 "PUT /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8/os-volume_attachments/9feae5ca-0eb1-43d5-9758-c25410d422fa" status: 404 len: 109 microversion: 2.1 time: 0.223525 Jul 02 21:07:41.509302 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 928/1781] 10.222.0.43 () {60 vars in 1432 bytes} [Sat Jul 2 21:07:41 2022] PUT /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8/os-volume_attachments/9feae5ca-0eb1-43d5-9758-c25410d422fa => generated 109 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:41.540857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:41.544950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:41.567517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:41.571284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:41.574142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:41.574638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.124226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:42.151735 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcde7970-9497-42b2-bf50-980a79334ae0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1266 microversion: 2.1 time: 1.129298 Jul 02 21:07:42.166714 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 854/1782] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:41 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1266 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:42.185319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-554734f7-61d8-40e1-b29c-685117f72136 req-028fd5c6-5238-4273-ae7c-2d03099fd2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0088d04-8df6-4deb-8abe-630b761d2c39", "name": "network-vif-plugged", "status": "completed", "tag": "b050c162-ea74-4a29-b0c0-c047c6ec2703"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:42.217010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-554734f7-61d8-40e1-b29c-685117f72136 req-028fd5c6-5238-4273-ae7c-2d03099fd2cf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:42.217736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-554734f7-61d8-40e1-b29c-685117f72136 req-028fd5c6-5238-4273-ae7c-2d03099fd2cf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.252071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-554734f7-61d8-40e1-b29c-685117f72136 req-028fd5c6-5238-4273-ae7c-2d03099fd2cf service nova] Creating event network-vif-plugged:b050c162-ea74-4a29-b0c0-c047c6ec2703 for instance b0088d04-8df6-4deb-8abe-630b761d2c39 on nch1-master-1 Jul 02 21:07:42.263271 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-554734f7-61d8-40e1-b29c-685117f72136 req-028fd5c6-5238-4273-ae7c-2d03099fd2cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095466 Jul 02 21:07:42.264626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 855/1783] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:42.274074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:42.280287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:42.295250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:42.298218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.299206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:42.303244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.547643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:42.561366 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b7f79caa-785b-4a18-b815-3f958377484f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 1.045767 Jul 02 21:07:42.563941 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 929/1784] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:41 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:42.576434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:42.577576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:42.592183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:42.597200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.598284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:42.598922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.803166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:42.807716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:42.814191 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93243594-84d7-4c77-987b-d030eeb80fe8 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 200 len: 1363 microversion: 2.1 time: 0.247374 Jul 02 21:07:42.819458 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 930/1785] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:42 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:42.823057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e6dbbdc-895a-421d-9982-f8173a06a6ae tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 0.556026 Jul 02 21:07:42.824450 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 856/1786] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:42 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:42.826467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e3497f87-56d8-4a05-9eb7-5925ec5fd484 req-2c6f70a9-fb4c-4a2b-b32e-3bffcf6da6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2adc9c67-dec2-437a-825d-5bb427ac75df", "name": "network-vif-deleted", "tag": "58d3ed61-47e6-4380-bd79-8075b64e428e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:42.886162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e3497f87-56d8-4a05-9eb7-5925ec5fd484 req-2c6f70a9-fb4c-4a2b-b32e-3bffcf6da6c7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:42.888217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e3497f87-56d8-4a05-9eb7-5925ec5fd484 req-2c6f70a9-fb4c-4a2b-b32e-3bffcf6da6c7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:42.924340 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e3497f87-56d8-4a05-9eb7-5925ec5fd484 req-2c6f70a9-fb4c-4a2b-b32e-3bffcf6da6c7 service nova] Creating event network-vif-deleted:58d3ed61-47e6-4380-bd79-8075b64e428e for instance 2adc9c67-dec2-437a-825d-5bb427ac75df on nch2-master-1 Jul 02 21:07:42.935541 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e3497f87-56d8-4a05-9eb7-5925ec5fd484 req-2c6f70a9-fb4c-4a2b-b32e-3bffcf6da6c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114390 Jul 02 21:07:42.939064 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 931/1787] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:43.175971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:43.176942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:43.185604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.186501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.187615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.188298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.293328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:43.310299 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f00446b5-860f-44aa-9e5b-416bbb76b402 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1272 microversion: 2.1 time: 0.141774 Jul 02 21:07:43.310902 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 857/1788] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:43 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1272 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:43.591507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:43.592847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:43.601341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.601980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.602949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.603550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.773380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:43.783358 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a46f2696-b542-4475-8cf5-d387b3491047 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 0.205396 Jul 02 21:07:43.783934 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 932/1789] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:43 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:43.834912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:43.835787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: 2adc9c67-dec2-437a-825d-5bb427ac75df] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:43.843670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.843670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.844583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.845262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.852080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:43.855897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:43.861773 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] HTTP exception thrown: Instance 2adc9c67-dec2-437a-825d-5bb427ac75df could not be found. Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Request method failure captured: Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df HTTP/1.1 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLI_HXDIyZZxG-gKa7KB2Ytwwg_ahPBBhc9piNMHa8hDTiivH8YzlIRNDpcV2RNrcPR1EMR8bYZ87ndPR95PmWl5A2lOIccStomRqqK06p7AhMIBc_495k_Dlq4oWPf20ExcJZkYTBJIF83xXwUSjpGzRnVblKWKt0_JdTIKol3TmSY Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63f39c85f12c4ad58be6d786de9a584b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63f39c85f12c4ad58be6d786de9a584b"}]}] Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 592e8c2ad31f459fa0b37f219cc4f84c Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 2adc9c67-dec2-437a-825d-5bb427ac75df could not be found. Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2adc9c67-dec2-437a-825d-5bb427ac75df'} Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2adc9c67-dec2-437a-825d-5bb427ac75df could not be found. Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2adc9c67-dec2-437a-825d-5bb427ac75df could not be found. Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:43.863998 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2adc9c67-dec2-437a-825d-5bb427ac75df could not be found. Jul 02 21:07:43.869445 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:43.871815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Returning 404 to user: Instance 2adc9c67-dec2-437a-825d-5bb427ac75df could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:43.873006 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68fe8119-aee2-44f6-9a7e-8726686f9068 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df" status: 404 len: 111 microversion: 2.1 time: 0.042101 Jul 02 21:07:43.874240 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 858/1790] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:43 2022] GET /compute/v2.1/servers/2adc9c67-dec2-437a-825d-5bb427ac75df => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:43.879723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.880208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.880999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:43.881433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:43.882620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-726ba7e4-a925-405b-8922-4a4c27e0b550 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '.version_select at 0x7fabe405c4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:43.906961 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-726ba7e4-a925-405b-8922-4a4c27e0b550 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-25533866" status: 202 len: 0 microversion: 2.1 time: 0.028500 Jul 02 21:07:43.908587 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 859/1791] 10.222.0.43 () {58 vars in 1214 bytes} [Sat Jul 2 21:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-25533866 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:43.991472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:43.992105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:44.001196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.001665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.002448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.002880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.056988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:44.155507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:44.163747 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5709b509-c787-419b-a431-66870f6ade4a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1314 microversion: 2.1 time: 0.317108 Jul 02 21:07:44.171040 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 933/1792] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:43 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:44.274627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb367f92-9472-4a14-8969-c1cd78178297 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "DELETE /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 204 len: 0 microversion: 2.1 time: 0.287725 Jul 02 21:07:44.276366 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 860/1793] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:43 2022] DELETE /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:44.286871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:44.287585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:44.308568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.309316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.310389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.311058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.329180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:44.329861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:44.339496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.344552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.345424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.348732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.670720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:44.714476 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed9c2dd6-5ac7-413c-b08e-d1aa57d19f46 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1513 microversion: 2.1 time: 0.433464 Jul 02 21:07:44.720546 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 934/1794] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:44 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1513 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:44.729029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-57ab7a6a-6042-426c-9874-1f9f159d4484 req-23a1a980-87da-4e84-99c6-ed51837f733c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95758eb-8431-4d2b-8af5-f9568d6726d7", "name": "network-vif-plugged", "status": "completed", "tag": "d43fc323-2a44-45f3-b303-8050ccdd5236"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:44.750118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-57ab7a6a-6042-426c-9874-1f9f159d4484 req-23a1a980-87da-4e84-99c6-ed51837f733c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.751056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-57ab7a6a-6042-426c-9874-1f9f159d4484 req-23a1a980-87da-4e84-99c6-ed51837f733c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.754995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:44.766912 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b91df9f-8e0c-4b76-80e4-1f95fe6eb1f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.441973 Jul 02 21:07:44.770442 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-57ab7a6a-6042-426c-9874-1f9f159d4484 req-23a1a980-87da-4e84-99c6-ed51837f733c service nova] Creating event network-vif-plugged:d43fc323-2a44-45f3-b303-8050ccdd5236 for instance a95758eb-8431-4d2b-8af5-f9568d6726d7 on nch2-master-1 Jul 02 21:07:44.776755 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 861/1795] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:44 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:44.780741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-57ab7a6a-6042-426c-9874-1f9f159d4484 req-23a1a980-87da-4e84-99c6-ed51837f733c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056514 Jul 02 21:07:44.782626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 935/1796] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:44.802280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:44.802896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:44.810516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.813052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:44.815716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:44.818028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.060981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1692650234", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "2e05cfae-5311-414e-b03f-d5b620078b94"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:45.171564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] validate_networks() for [('2e05cfae-5311-414e-b03f-d5b620078b94', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:07:45.440350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:45.455054 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d94a3884-2d1c-441f-a392-8607465030d5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 0.657814 Jul 02 21:07:45.465838 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 862/1797] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:44 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:45.472023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:45.472988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:45.480277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.481144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.482251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.482919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.767580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:45.777870 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7fe9c67-e4f2-4c37-8521-548b477292f0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1463 microversion: 2.1 time: 0.310519 Jul 02 21:07:45.779126 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 863/1798] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:45 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1463 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:45.784363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4aa27bc1-2c59-4180-a5a5-f8c9f0e62d83 req-1aa611ba-9ae7-4a9d-aaf2-bbc7a3a4534a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e924300-c50c-44b5-9a78-67a3904f0dc7", "tag": "f27cc745-bafe-4a5e-92cc-48f64e6214c6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:45.794359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4aa27bc1-2c59-4180-a5a5-f8c9f0e62d83 req-1aa611ba-9ae7-4a9d-aaf2-bbc7a3a4534a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.795074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4aa27bc1-2c59-4180-a5a5-f8c9f0e62d83 req-1aa611ba-9ae7-4a9d-aaf2-bbc7a3a4534a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.815553 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4aa27bc1-2c59-4180-a5a5-f8c9f0e62d83 req-1aa611ba-9ae7-4a9d-aaf2-bbc7a3a4534a service nova] Creating event network-changed:f27cc745-bafe-4a5e-92cc-48f64e6214c6 for instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 on nch2-master-1 Jul 02 21:07:45.822637 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4aa27bc1-2c59-4180-a5a5-f8c9f0e62d83 req-1aa611ba-9ae7-4a9d-aaf2-bbc7a3a4534a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041586 Jul 02 21:07:45.823931 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 864/1799] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:45.831050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:45.832622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:45.843883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.845551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.848165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.849109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.913296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:45.946182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:45.947347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:45.948150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:45.948996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:45.949604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:45.963211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.963848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.964854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:45.965481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:45.980077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:45.996146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:07:46.007042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for user 8b345a42784d4df79caab6d667117418 and project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:07:46.022020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:07:46.024778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:46.078989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:46.108449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86f651fc-0bfb-4b2e-808d-b389dee32682 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 204 len: 0 microversion: 2.1 time: 0.282154 Jul 02 21:07:46.112627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 865/1800] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:45 2022] DELETE /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:46.118946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:46.120394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:46.129061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.131103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.131103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.132131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.133725 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78bfc24f-fc4d-45df-ac63-99d05f7abb69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294013 Jul 02 21:07:46.134663 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 936/1801] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:07:46.139437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:46.143216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:46.166232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.167527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.168600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.169257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.527695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:46.536326 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3617efa-9f79-4d9c-9893-289aa36f49ae tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1513 microversion: 2.1 time: 0.422309 Jul 02 21:07:46.547846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:46.555584 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 866/1802] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:46 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1513 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:46.561244 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ceddc58d-e95f-4d5f-a1f4-9cceef9645aa tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.425191 Jul 02 21:07:46.570940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 937/1803] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:46 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:46.578039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:46.583463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:46.597232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.598177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.599265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.599899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.839875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:46.843944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'deleted': False, 'project_id': 'f98c80749a084cc49245163c6add17cb'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:46.850542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.851265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.852264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.852865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.887661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3003d17-f793-496e-bbf2-3f88244141d5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.330733 Jul 02 21:07:46.901146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 867/1804] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:07:46 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:07:46.928793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:46.929583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:46.948409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.949664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:46.950862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:46.951645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.070610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:47.087277 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7b3802f9-2d0c-4920-b37d-a372bb3140ee tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1469 microversion: 2.1 time: 0.514714 Jul 02 21:07:47.100701 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 938/1805] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:46 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1469 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:47.122493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:47.129991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:47.134062 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1397f35c-7f70-46ed-9f45-afb062715abb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1215 microversion: 2.1 time: 0.231654 Jul 02 21:07:47.135279 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 868/1806] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:46 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1215 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:47.148364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:47.149068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:47.165783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:47.184298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.184903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.185924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.186442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.191702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.196014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.197059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.198768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.332585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:07:47.435988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.437603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.519005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:47.533905 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14cd20f6-cbf5-47b6-9b47-e6901631655b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1319 microversion: 2.1 time: 0.431669 Jul 02 21:07:47.534946 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 939/1807] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:47 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:47.541238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a7c6caae-ffc3-41a3-9f2d-96ae7761b693 req-14d0ccbb-d116-4af3-a27a-99c995db0867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cc270e-70fc-4757-9d25-c26db03fe8e8", "name": "network-vif-deleted", "tag": "c95e0903-0804-48ed-b293-c06ad9b62975"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:47.560436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a7c6caae-ffc3-41a3-9f2d-96ae7761b693 req-14d0ccbb-d116-4af3-a27a-99c995db0867 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.561107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a7c6caae-ffc3-41a3-9f2d-96ae7761b693 req-14d0ccbb-d116-4af3-a27a-99c995db0867 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.600124 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a7c6caae-ffc3-41a3-9f2d-96ae7761b693 req-14d0ccbb-d116-4af3-a27a-99c995db0867 service nova] Creating event network-vif-deleted:c95e0903-0804-48ed-b293-c06ad9b62975 for instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 on nch2-master-1 Jul 02 21:07:47.607189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a7c6caae-ffc3-41a3-9f2d-96ae7761b693 req-14d0ccbb-d116-4af3-a27a-99c995db0867 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070789 Jul 02 21:07:47.607819 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 940/1808] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:47.615192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:47.627115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:47.634958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.636173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.637539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.638093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.685961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.686721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.687225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lazy-loading 'fault' on Instance uuid 78cc270e-70fc-4757-9d25-c26db03fe8e8 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:07:47.769915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:47.784580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11d5cc26-43eb-4866-af87-1ef5c6a4ad68 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1308 microversion: 2.1 time: 0.175087 Jul 02 21:07:47.795052 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 941/1809] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:47 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:47.795052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:47.795683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:47.802542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.803342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:47.805167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:47.805611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.175827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:48.189064 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ac7faf3-4c6e-46b7-94e2-43dc8be45d65 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.399064 Jul 02 21:07:48.189982 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 942/1810] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:47 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:48.197083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e86f132b-314c-41cc-9ced-2f05478658bb req-18e9f07c-0898-435d-a714-93a4ee47d615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872adba3-ec3c-4555-b21e-d1f94a30612a", "name": "network-vif-plugged", "status": "completed", "tag": "837a8780-81d0-4420-9494-0c17939a10d6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:48.211742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e86f132b-314c-41cc-9ced-2f05478658bb req-18e9f07c-0898-435d-a714-93a4ee47d615 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.212494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e86f132b-314c-41cc-9ced-2f05478658bb req-18e9f07c-0898-435d-a714-93a4ee47d615 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.227810 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e86f132b-314c-41cc-9ced-2f05478658bb req-18e9f07c-0898-435d-a714-93a4ee47d615 service nova] Creating event network-vif-plugged:837a8780-81d0-4420-9494-0c17939a10d6 for instance 872adba3-ec3c-4555-b21e-d1f94a30612a on nch2-master-1 Jul 02 21:07:48.233628 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e86f132b-314c-41cc-9ced-2f05478658bb req-18e9f07c-0898-435d-a714-93a4ee47d615 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042251 Jul 02 21:07:48.235955 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 943/1811] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:48.242915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.243875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:48.252225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.252984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.253966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.254626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.303352 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c5af02c-a896-4361-834c-8f9f6411eedc tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 21755 microversion: 2.1 time: 1.166590 Jul 02 21:07:48.304103 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 869/1812] 10.222.0.43 () {58 vars in 1170 bytes} [Sat Jul 2 21:07:47 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 21755 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:07:48.308990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.311170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:48.323186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.323877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.329530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.330084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.437979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:48.446313 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dd07623-81b4-49b9-9620-aab1afec1e7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1271 microversion: 2.1 time: 0.140972 Jul 02 21:07:48.446906 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 870/1813] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:48.460017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.464118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'deleted': False, 'project_id': 'f98c80749a084cc49245163c6add17cb'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:48.469647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.470164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.471218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.471675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.502043 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f3e308a7-fa04-46a6-9ab5-d270a8cc69af tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?tenant_id=381ec26b4d1240b4889b5ecfebf02610" status: 200 len: 15 microversion: 2.1 time: 0.053974 Jul 02 21:07:48.502934 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 871/1814] 10.222.0.43 () {58 vars in 1230 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/detail?tenant_id=381ec26b4d1240b4889b5ecfebf02610 => generated 15 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:07:48.512850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:48.515988 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eba7b083-80cc-47c3-8924-281b7c732b17 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 200 len: 1469 microversion: 2.1 time: 0.278583 Jul 02 21:07:48.517220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 944/1815] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 1469 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:48.523669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.528647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'tenant_id': '381ec26b4d1240b4889b5ecfebf02610', 'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:48.534165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.534618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.535428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.535865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.551386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.552004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:48.558986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.558986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.559716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.560170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.575719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:07:48.628158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.628617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.865556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:48.880819 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e23860f-aa5a-46c5-9730-0df32adaf296 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 200 len: 1507 microversion: 2.1 time: 0.333415 Jul 02 21:07:48.881431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 945/1816] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:48.889749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.890079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5411c8a2-5a2d-453a-aeb0-405c9b84c6a5 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=381ec26b4d1240b4889b5ecfebf02610" status: 200 len: 4825 microversion: 2.1 time: 0.373615 Jul 02 21:07:48.890523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:48.890668 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 872/1817] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=381ec26b4d1240b4889b5ecfebf02610 => generated 4825 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:48.900141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:48.901114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: 872adba3-ec3c-4555-b21e-d1f94a30612a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:48.911843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.912742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.914545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.916070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.917594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.918063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.918876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.919334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.966322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:48.967798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:48.968699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lazy-loading 'fault' on Instance uuid 78cc270e-70fc-4757-9d25-c26db03fe8e8 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:07:49.040115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:49.046707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:49.051517 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e11e36af-aa6c-438a-94de-07c879796577 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 200 len: 1308 microversion: 2.1 time: 0.168993 Jul 02 21:07:49.061853 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 946/1818] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:49.066969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.079307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'tenant_id': 'f98c80749a084cc49245163c6add17cb', 'deleted': False} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:49.101599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.102051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.102849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.103282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.151765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:49.167951 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-daec6884-d9c5-4b07-a7f6-61614eee0987 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f98c80749a084cc49245163c6add17cb" status: 200 len: 15 microversion: 2.1 time: 0.104852 Jul 02 21:07:49.168768 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed78dc85-7953-4d27-9d2a-b0c9d03ef7ad tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a" status: 200 len: 1319 microversion: 2.1 time: 0.272467 Jul 02 21:07:49.171167 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 947/1819] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f98c80749a084cc49245163c6add17cb => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:07:49.177973 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 873/1820] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:48 2022] GET /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:49.187496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a65205c8-5f9f-4d24-bd7a-a228eb2b3280 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.191811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a65205c8-5f9f-4d24-bd7a-a228eb2b3280 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008091 Jul 02 21:07:49.192272 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 948/1821] 10.222.0.43 () {58 vars in 1188 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 02 21:07:49.214590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.218903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:49.233060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.236510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.252883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:49.258015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.259416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.262154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.262448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.263110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.263775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.265237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.267746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.457506 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9486f3f7-70de-41e6-9039-1c7388479406 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 0 microversion: 2.1 time: 0.250921 Jul 02 21:07:49.458228 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 949/1822] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:07:49 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:49.465059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.466719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.478257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.478709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.479622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.480156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.564671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:49.580224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:49.580808 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d8d5b69a-1da4-4976-8d18-c7ee90e80dd9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1269 microversion: 2.1 time: 0.120961 Jul 02 21:07:49.581607 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 950/1823] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1269 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:49.588642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.592697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:49.592863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '381ec26b4d1240b4889b5ecfebf02610'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:49.595542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cc10bf3-3e9e-43ad-a149-afd4c123c23c tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.386402 Jul 02 21:07:49.598430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.599118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.599967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.600598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.608131 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 874/1824] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:49.613626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.614459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: a0f6a822-7105-43d0-b2d3-934f6e737e6e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.621651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.622105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.622873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.623307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.640338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:07:49.641892 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] HTTP exception thrown: Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e could not be found. Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Request method failure captured: Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e HTTP/1.1 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLI_HXDIyZZxG-gKa7KB2Ytwwg_ahPBBhc9piNMHa8hDTiivH8YzlIRNDpcV2RNrcPR1EMR8bYZ87ndPR95PmWl5A2lOIccStomRqqK06p7AhMIBc_495k_Dlq4oWPf20ExcJZkYTBJIF83xXwUSjpGzRnVblKWKt0_JdTIKol3TmSY Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63f39c85f12c4ad58be6d786de9a584b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63f39c85f12c4ad58be6d786de9a584b"}]}] Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 592e8c2ad31f459fa0b37f219cc4f84c Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e could not be found. Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a0f6a822-7105-43d0-b2d3-934f6e737e6e'} Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e could not be found. Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e could not be found. Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:49.643606 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e could not be found. Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Returning 404 to user: Instance a0f6a822-7105-43d0-b2d3-934f6e737e6e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6ffa039-7b91-40f5-8e4d-1ab86583f867 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e" status: 404 len: 111 microversion: 2.1 time: 0.035534 Jul 02 21:07:49.649507 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 875/1825] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/a0f6a822-7105-43d0-b2d3-934f6e737e6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:49.652339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-82eab72e-b5cf-4fe0-8464-9401547bb705 req-fe5c7983-d0b5-4aa0-8670-6b4b446ce71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f6a822-7105-43d0-b2d3-934f6e737e6e", "name": "network-vif-deleted", "tag": "5d1235fa-f55d-444b-99f9-811cc2aa77fe"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:49.658601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82eab72e-b5cf-4fe0-8464-9401547bb705 req-fe5c7983-d0b5-4aa0-8670-6b4b446ce71d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.660103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82eab72e-b5cf-4fe0-8464-9401547bb705 req-fe5c7983-d0b5-4aa0-8670-6b4b446ce71d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.671494 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-82eab72e-b5cf-4fe0-8464-9401547bb705 req-fe5c7983-d0b5-4aa0-8670-6b4b446ce71d service nova] Creating event network-vif-deleted:5d1235fa-f55d-444b-99f9-811cc2aa77fe for instance a0f6a822-7105-43d0-b2d3-934f6e737e6e on nch1-master-1 Jul 02 21:07:49.676905 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-82eab72e-b5cf-4fe0-8464-9401547bb705 req-fe5c7983-d0b5-4aa0-8670-6b4b446ce71d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030046 Jul 02 21:07:49.677488 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 876/1826] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:49.681285 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-239dfe18-b5dc-4d3e-a35d-ca708398d784 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.098436 Jul 02 21:07:49.682964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 951/1827] 10.222.0.43 () {58 vars in 1149 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:49.683931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.684766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.696602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:49.697585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.698101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.698768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.699903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.700910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.704237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.705234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.706410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.708281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.734179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:49.805107 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e57064ad-4ab0-46b4-ab8d-ec683c656ad9 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 0 microversion: 2.1 time: 0.112623 Jul 02 21:07:49.809048 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 952/1828] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:07:49 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:49.816107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.816741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.826867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.828076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.830124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.830737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.885180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83b6a9c7-7b30-4263-8099-9b8bb99c19e7 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 204 len: 0 microversion: 2.1 time: 0.206007 Jul 02 21:07:49.887157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 877/1829] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:49 2022] DELETE /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:49.902617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:49.904112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:49.915921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.916497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:49.918045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:49.918498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.036433 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ad10b39-7d78-410d-ab39-3f1c4a373970 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1614 microversion: 2.1 time: 0.224204 Jul 02 21:07:50.037218 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 953/1830] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1614 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:50.054716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.056104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.063462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.063929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.064840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.065638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.091965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:50.100372 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c17e8f7-dbb5-418b-94b4-b39bfb3d3f47 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1468 microversion: 2.1 time: 0.203065 Jul 02 21:07:50.101272 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 878/1831] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:49 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:50.106035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.106634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 78cc270e-70fc-4757-9d25-c26db03fe8e8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.112937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.113392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.114166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.114597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.128902 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] HTTP exception thrown: Instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 could not be found. Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Request method failure captured: Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 HTTP/1.1 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLkfybCClKs8Da_d0NgspdrvTv3KiXGul4qgkYzMeyp-6DgWIuYopwtCjK-zKW2zk_6O3ZroAB6_OeVo4rgs9aDH3VEOoy3wBBjELhyVESRhP_8LkRsvRUoMKAtTEPMkDgyiUK66N6UPJUUP7Ik3JIJrXd9e9CBP1FUl8tUkewCcYU Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 4b15f516c6a34343979d19a0938c232b Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesAdminNegativeTest-1317235312 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b15f516c6a34343979d19a0938c232b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b15f516c6a34343979d19a0938c232b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b15f516c6a34343979d19a0938c232b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b15f516c6a34343979d19a0938c232b"}]}] Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesAdminNegativeTest-1317235312 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 4b15f516c6a34343979d19a0938c232b Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1317235312 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesAdminNegativeTest-1317235312-project Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1fade188e2a14766ae95fe44143bca97 Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesAdminNegativeTest-1317235312-project Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 could not be found. Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '78cc270e-70fc-4757-9d25-c26db03fe8e8'} Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 could not be found. Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 could not be found. Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:50.130829 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 could not be found. Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Returning 404 to user: Instance 78cc270e-70fc-4757-9d25-c26db03fe8e8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f6ab8ee-add6-430a-ab02-e3a14f15688d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8" status: 404 len: 111 microversion: 2.1 time: 0.030696 Jul 02 21:07:50.136469 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 879/1832] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers/78cc270e-70fc-4757-9d25-c26db03fe8e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:50.188215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.189178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: 872adba3-ec3c-4555-b21e-d1f94a30612a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.195584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.196136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.197116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.197793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.284474 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d7338f9-386e-4fad-ad88-cf96041a13a6 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1614 microversion: 2.1 time: 0.230597 Jul 02 21:07:50.285158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 954/1833] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1614 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:50.304947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.311111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:50.318130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.318587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.319396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.320030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.392655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:50.406175 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e186f398-0914-460b-bf07-b3026ac40c31 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a" status: 200 len: 1319 microversion: 2.1 time: 0.221698 Jul 02 21:07:50.416024 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 880/1834] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:50.450289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:07:50.528900 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9dd783f6-2858-40ec-b5d9-b547d919cf18 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1968 microversion: 2.1 time: 0.229288 Jul 02 21:07:50.529660 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 955/1835] 10.222.0.43 () {58 vars in 1189 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1968 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:50.542333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.547469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:50.553160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.553604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.554460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.555246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.599283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.599916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.607319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.607804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.608721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.609165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.653485 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-abb7ca73-b267-46f2-8265-8fef1abae197 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.106743 Jul 02 21:07:50.654935 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 881/1836] 10.222.0.43 () {58 vars in 1195 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:07:50.660742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:50.661714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.671684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.672518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.674189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.674873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.700367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:50.804562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:50.818054 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-215224e6-c0b9-460c-a187-a388a35789a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.222231 Jul 02 21:07:50.818890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 956/1837] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:50.823666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:50.824757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.833438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.834530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.835967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.835967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.862875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:50.872096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-575e9f5a-c3c7-441d-8d21-226b66a0e7f5 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.215383 Jul 02 21:07:50.873286 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 882/1838] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:50 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:50.927244 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce8ca18a-2896-4068-a1d6-3093d9380c5b tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 0 microversion: 2.1 time: 0.107076 Jul 02 21:07:50.928015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 957/1839] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:07:50 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:50.936588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:50.938304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:50.945649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.946111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:50.946997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:50.947449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.025393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:51.025760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:51.026242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:51.026657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:51.027081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:51.089595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.096497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.096497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.097152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.097590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.117969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.118604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.124891 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc51c7f4-5160-4087-90fe-ada212db4527 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 1067 microversion: 2.1 time: 0.192498 Jul 02 21:07:51.125040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.126119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.126285 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 883/1840] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:07:50 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 1067 bytes in 194 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 02 21:07:51.126482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.126932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.140187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.140899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.150662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.151124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.152032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.152365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.337483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:51.341521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:51.345426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7f81d407-58cd-46ce-a6b7-e75206e5e6c9 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1468 microversion: 2.1 time: 0.231542 Jul 02 21:07:51.346014 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 958/1841] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:51 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1468 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:51.350828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.351548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.352994 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b6be778-2844-4581-aae8-a413cad41776 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.217203 Jul 02 21:07:51.362303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 884/1842] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:51 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:51.365961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.366425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.367611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.368085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.400962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:51.404013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:51.424757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.425721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: 872adba3-ec3c-4555-b21e-d1f94a30612a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.434032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.434507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.435316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.435794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.522786 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f0852cf-3c70-4cb6-a363-4c35fa806948 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 204 len: 0 microversion: 2.1 time: 0.174868 Jul 02 21:07:51.523549 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 959/1843] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:51 2022] DELETE /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:51.532408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.533244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.540723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.541303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.542541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.543043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.754785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:51.765137 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-396bb571-4c5c-4977-8c19-df1087f35be6 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a" status: 200 len: 1507 microversion: 2.1 time: 0.345794 Jul 02 21:07:51.767063 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 885/1844] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:51 2022] GET /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:51.785939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.786843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: 872adba3-ec3c-4555-b21e-d1f94a30612a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.795076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.795938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.797017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.800345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.831875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:51.843646 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bbd52c82-2cf1-4837-80e9-9932253fb079 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1682 microversion: 2.1 time: 0.315285 Jul 02 21:07:51.854811 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 960/1845] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:51 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1682 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:51.860170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:51.860804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:51.872832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.873303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.874138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:51.875023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:51.878511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: 872adba3-ec3c-4555-b21e-d1f94a30612a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:52.025525 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff81b076-ff98-4a9d-8887-230488ab74af tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "DELETE /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a" status: 204 len: 0 microversion: 2.1 time: 0.245103 Jul 02 21:07:52.026578 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 886/1846] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:51 2022] DELETE /compute/v2.1/servers/872adba3-ec3c-4555-b21e-d1f94a30612a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:07:52.033461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:52.034327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:52.041740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.042979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.044009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.044726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.581901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:52.591115 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c6c447d-2a05-43e9-af95-9e407064c14e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.735066 Jul 02 21:07:52.591710 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 961/1847] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:51 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:52.597280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:52.597993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:52.598690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:52.604916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.605276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.606298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.606697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.608624 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2792b65-b3e6-4478-9c55-505b3dc3f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.580652 Jul 02 21:07:52.609386 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 887/1848] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:52 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:52.616225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1577627a-f794-4481-a654-57683ad470af req-0fbd46a8-7ede-4755-a285-39deefd1eb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:52.625901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1577627a-f794-4481-a654-57683ad470af req-0fbd46a8-7ede-4755-a285-39deefd1eb56 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.627093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1577627a-f794-4481-a654-57683ad470af req-0fbd46a8-7ede-4755-a285-39deefd1eb56 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.639748 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1577627a-f794-4481-a654-57683ad470af req-0fbd46a8-7ede-4755-a285-39deefd1eb56 service nova] Creating event network-changed:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch2-master-1 Jul 02 21:07:52.644837 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1577627a-f794-4481-a654-57683ad470af req-0fbd46a8-7ede-4755-a285-39deefd1eb56 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034135 Jul 02 21:07:52.645936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: a95758eb-8431-4d2b-8af5-f9568d6726d7] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:07:52.646173 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 888/1849] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:52.652556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:52.653436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:52.659843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.660322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.661086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.661689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.729425 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db8ef1d1-04c3-4759-ac5a-3b008a706dcd tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7" status: 204 len: 0 microversion: 2.1 time: 0.135865 Jul 02 21:07:52.730331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 962/1850] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:07:52 2022] DELETE /compute/v2.1/servers/a95758eb-8431-4d2b-8af5-f9568d6726d7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:07:52.735933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:52.736870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:52.744389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.744912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.745951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.746488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.766814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:52.780722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76c37a67-760a-4cc5-8dc7-e70a562e6d2d tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1426 microversion: 2.1 time: 0.132885 Jul 02 21:07:52.790648 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 889/1851] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:52 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1426 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:52.842533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a5ebe9b2-6a5f-44a0-ae1c-817ba6cf239c req-e120ba0a-0ca0-4a86-bc38-7997d14714e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80f49de-27ea-4b1a-ad57-fec4b4c03605", "name": "network-vif-deleted", "tag": "09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:52.850680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5ebe9b2-6a5f-44a0-ae1c-817ba6cf239c req-e120ba0a-0ca0-4a86-bc38-7997d14714e7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.851119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5ebe9b2-6a5f-44a0-ae1c-817ba6cf239c req-e120ba0a-0ca0-4a86-bc38-7997d14714e7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.863738 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a5ebe9b2-6a5f-44a0-ae1c-817ba6cf239c req-e120ba0a-0ca0-4a86-bc38-7997d14714e7 service nova] Creating event network-vif-deleted:09d6da32-d4c2-49ca-a7fc-fbc6d3a4a009 for instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 on nch2-master-1 Jul 02 21:07:52.868605 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a5ebe9b2-6a5f-44a0-ae1c-817ba6cf239c req-e120ba0a-0ca0-4a86-bc38-7997d14714e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030246 Jul 02 21:07:52.869494 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 890/1852] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:07:52.874509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-784853467", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3101ad44-29e0-4a63-891c-95309e726df6"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:52.910270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:52.919139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b55d268-c0ac-4f41-9047-de6b4a9d9759 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.187715 Jul 02 21:07:52.919804 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 963/1853] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:52 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:52.924658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:52.925350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:52.927751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] validate_networks() for [('3101ad44-29e0-4a63-891c-95309e726df6', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:07:52.931524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.931984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:52.932789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:52.933228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:53.238303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:53.245911 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b5828e2-6c5b-4b90-9f38-0a0674206a4d tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1682 microversion: 2.1 time: 0.324898 Jul 02 21:07:53.257698 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 964/1854] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:52 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1682 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:53.499967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:07:53.500712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:07:53.501412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:07:53.501992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:07:53.502642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:07:53.516696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:53.517153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:53.517958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:53.518403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:53.535652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Getting quotas for project 73fe5e9f9b7e401488333f601eaa80ac. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:07:53.541089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Getting quotas for user 27059ad6d23e4faf8f09c22cf6ee1475 and project 73fe5e9f9b7e401488333f601eaa80ac. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:07:53.555210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Going to run 2 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:07:53.557656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:53.597277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=b958a2fd-b37b-49af-94f3-b0281d982ee8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:07:53.607908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:53.608969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:53.614862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:53.615306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:53.616096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:53.616532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:53.651707 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9c76d65-f397-4a44-8bcf-204b5edaf1cc tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.780903 Jul 02 21:07:53.652623 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 891/1855] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:07:52 2022] POST /compute/v2.1/servers => generated 32 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:07:53.657321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:53.658023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:53.664911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:53.665450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:53.666314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:53.666825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.005092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.017790 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1c807a2-8d5b-4713-90e4-b110ab46cdfe tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.413725 Jul 02 21:07:54.018379 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 965/1856] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:53 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:54.025862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:54.034809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.035858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Searching by: {'deleted': False, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:07:54.066174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.071418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.072880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.074390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.102113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.109616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:07:54.115193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-106ba3aa-9a6f-47cc-a658-9b740f27820b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.461668 Jul 02 21:07:54.116757 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 892/1857] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:53 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:54.122284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:54.123146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:54.125530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:54.135696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.136581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.137764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.138415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.143120 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-611a5335-92d5-42ed-80ec-06405460fa80 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.123243 Jul 02 21:07:54.144193 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 966/1858] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:07:54 2022] GET /compute/v2.1/servers => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:54.149652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6728e04a-84bf-4740-9316-53277ab6f233 req-2ef3148e-fe41-4b39-9f53-ae90ebb0033f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e924300-c50c-44b5-9a78-67a3904f0dc7", "name": "network-vif-plugged", "status": "completed", "tag": "f27cc745-bafe-4a5e-92cc-48f64e6214c6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:54.158396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6728e04a-84bf-4740-9316-53277ab6f233 req-2ef3148e-fe41-4b39-9f53-ae90ebb0033f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.158934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6728e04a-84bf-4740-9316-53277ab6f233 req-2ef3148e-fe41-4b39-9f53-ae90ebb0033f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.178920 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6728e04a-84bf-4740-9316-53277ab6f233 req-2ef3148e-fe41-4b39-9f53-ae90ebb0033f service nova] Creating event network-vif-plugged:f27cc745-bafe-4a5e-92cc-48f64e6214c6 for instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 on nch2-master-1 Jul 02 21:07:54.191559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6728e04a-84bf-4740-9316-53277ab6f233 req-2ef3148e-fe41-4b39-9f53-ae90ebb0033f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045878 Jul 02 21:07:54.192287 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 967/1859] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:54.197852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:54.198735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:54.205702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.206468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.207250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.207683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.262132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '592e8c2ad31f459fa0b37f219cc4f84c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63f39c85f12c4ad58be6d786de9a584b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.270342 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdb48476-996a-43f8-81b4-322988ed6471 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 200 len: 1298 microversion: 2.1 time: 0.152344 Jul 02 21:07:54.271054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 893/1860] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:54 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:54.276594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1b0629d-e29d-42ad-886f-21740a3df835 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:54.277406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1b0629d-e29d-42ad-886f-21740a3df835 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:54.369626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1b0629d-e29d-42ad-886f-21740a3df835 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.378013 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1b0629d-e29d-42ad-886f-21740a3df835 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1217 microversion: 2.1 time: 0.105738 Jul 02 21:07:54.378766 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 894/1861] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:54 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:54.393619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:54.394474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:54.404521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.404985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.405752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:54.406184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:54.775876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.784663 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc79b260-e211-49e1-a5ac-1da6df1f8223 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.590958 Jul 02 21:07:54.785254 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 968/1862] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:54 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:54.878698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:54.886516 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06bc75fc-5905-4d56-bc3e-c0d40a155568 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1682 microversion: 2.1 time: 0.496945 Jul 02 21:07:54.887095 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 895/1863] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:54 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1682 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:55.037139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:55.037908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:55.052699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:55.053608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:55.054670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:55.055489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:55.132829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:55.133450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:55.144547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:55.145003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:55.145856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:55.146287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:55.960621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:55.968491 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4720800-23c1-4e1a-98f4-20fbec8160e0 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1314 microversion: 2.1 time: 0.839891 Jul 02 21:07:55.973752 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 896/1864] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:55 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:07:55.982107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:55.982990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] [instance: d80f49de-27ea-4b1a-ad57-fec4b4c03605] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:55.992275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:56.004124 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d3d441c4-a729-4ae1-a6e4-e9625ccefb6b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.973058 Jul 02 21:07:56.005021 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 969/1865] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:55 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:56.012502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:56.013394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:56.019724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=12 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:56.025663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.027483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.028214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.028710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.030380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.031286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.040642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.041593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.103941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] HTTP exception thrown: Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 could not be found. Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Request method failure captured: Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 HTTP/1.1 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLI_HXDIyZZxG-gKa7KB2Ytwwg_ahPBBhc9piNMHa8hDTiivH8YzlIRNDpcV2RNrcPR1EMR8bYZ87ndPR95PmWl5A2lOIccStomRqqK06p7AhMIBc_495k_Dlq4oWPf20ExcJZkYTBJIF83xXwUSjpGzRnVblKWKt0_JdTIKol3TmSY Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63f39c85f12c4ad58be6d786de9a584b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63f39c85f12c4ad58be6d786de9a584b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63f39c85f12c4ad58be6d786de9a584b"}]}] Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 63f39c85f12c4ad58be6d786de9a584b Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MigrationsAdminTest-1630452247 Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 592e8c2ad31f459fa0b37f219cc4f84c Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MigrationsAdminTest-1630452247-project Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 could not be found. Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'd80f49de-27ea-4b1a-ad57-fec4b4c03605'} Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 could not be found. Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 could not be found. Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:56.111300 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 could not be found. Jul 02 21:07:56.118880 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:07:56.137867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] Returning 404 to user: Instance d80f49de-27ea-4b1a-ad57-fec4b4c03605 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:56.143065 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-488704b4-bc6c-45d8-82a6-36dc6ab99c05 tempest-MigrationsAdminTest-1630452247 tempest-MigrationsAdminTest-1630452247-project] 10.222.0.43 "GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605" status: 404 len: 111 microversion: 2.1 time: 0.165855 Jul 02 21:07:56.145656 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 897/1866] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:55 2022] GET /compute/v2.1/servers/d80f49de-27ea-4b1a-ad57-fec4b4c03605 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:56.167141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:56.168380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:56.178307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.179353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.180858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.181650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.238796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:56.253859 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-508ba8d1-41e5-49c1-bee6-ffd34b608d5d tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1275 microversion: 2.1 time: 0.246740 Jul 02 21:07:56.254464 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 970/1867] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:56 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1275 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:56.268634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:56.269613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:56.285653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.286420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.287459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.288147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.508323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:56.522523 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f02dfa7-2d74-42e1-b741-ac47be607223 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1614 microversion: 2.1 time: 0.266087 Jul 02 21:07:56.525411 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 971/1868] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:56 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1614 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:56.539956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-67d331b2-5765-43fb-9556-f905b88168c1 req-87bac4a8-170b-4b06-a6b9-8bf8b9059747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a95758eb-8431-4d2b-8af5-f9568d6726d7", "name": "network-vif-deleted", "tag": "d43fc323-2a44-45f3-b303-8050ccdd5236"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:56.564295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-67d331b2-5765-43fb-9556-f905b88168c1 req-87bac4a8-170b-4b06-a6b9-8bf8b9059747 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.565220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-67d331b2-5765-43fb-9556-f905b88168c1 req-87bac4a8-170b-4b06-a6b9-8bf8b9059747 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.583027 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-67d331b2-5765-43fb-9556-f905b88168c1 req-87bac4a8-170b-4b06-a6b9-8bf8b9059747 service nova] Creating event network-vif-deleted:d43fc323-2a44-45f3-b303-8050ccdd5236 for instance a95758eb-8431-4d2b-8af5-f9568d6726d7 on nch2-master-1 Jul 02 21:07:56.590020 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-67d331b2-5765-43fb-9556-f905b88168c1 req-87bac4a8-170b-4b06-a6b9-8bf8b9059747 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060286 Jul 02 21:07:56.591249 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 972/1869] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:56.705464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:56.715010 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f78247c3-c2e0-4899-9e79-c24f51a2686a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.567373 Jul 02 21:07:56.716146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 898/1870] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:56 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:56.941497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b421981d-2e00-4c55-bc94-09b6486291b7 req-944203c6-341b-4bfa-a395-f02717e984f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872adba3-ec3c-4555-b21e-d1f94a30612a", "name": "network-vif-deleted", "tag": "837a8780-81d0-4420-9494-0c17939a10d6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:56.970825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b421981d-2e00-4c55-bc94-09b6486291b7 req-944203c6-341b-4bfa-a395-f02717e984f4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:56.974529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b421981d-2e00-4c55-bc94-09b6486291b7 req-944203c6-341b-4bfa-a395-f02717e984f4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:56.991184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:56.991897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:57.018757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.022357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.023508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.024218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.029292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:57.031928 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b421981d-2e00-4c55-bc94-09b6486291b7 req-944203c6-341b-4bfa-a395-f02717e984f4 service nova] Creating event network-vif-deleted:837a8780-81d0-4420-9494-0c17939a10d6 for instance 872adba3-ec3c-4555-b21e-d1f94a30612a on nch2-master-1 Jul 02 21:07:57.054010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b421981d-2e00-4c55-bc94-09b6486291b7 req-944203c6-341b-4bfa-a395-f02717e984f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117368 Jul 02 21:07:57.059583 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 973/1871] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:57.065811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:57.080411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:57.096294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.100279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.108562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.109321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.447186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:57.451628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:57.454876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:07:57.457566 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-218547f6-5422-425c-8efa-403170104c4b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1500 microversion: 2.1 time: 0.470916 Jul 02 21:07:57.461480 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 899/1872] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:56 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1500 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:57.461792 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc1c1bdf-4dd9-40b9-acef-c71a9e2cb589 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.400602 Jul 02 21:07:57.462354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 974/1873] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:57 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:57.466949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:57.467842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:57.476364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.477143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.478290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.478977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.488785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad870609-c402-4a68-a35f-286f314f9966 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:57.512113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad870609-c402-4a68-a35f-286f314f9966 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.513008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad870609-c402-4a68-a35f-286f314f9966 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.553191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad870609-c402-4a68-a35f-286f314f9966 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:07:57.645867 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad870609-c402-4a68-a35f-286f314f9966 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7/action" status: 202 len: 0 microversion: 2.1 time: 0.169343 Jul 02 21:07:57.646701 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 900/1874] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:07:57 2022] POST /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:07:57.657124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:57.658225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:57.674241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.674709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.675502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.675946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.750129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.750623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.752428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lazy-loading 'fault' on Instance uuid 1bc8e287-b938-43c3-8d6d-342220d0319a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:07:57.907352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:57.922755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac6e673f-477a-4cb4-863e-1b1cfe127947 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.459104 Jul 02 21:07:57.932415 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 975/1875] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:57 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:57.937597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:57.938576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:57.946674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.947593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.948806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:57.949609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:57.964324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fade188e2a14766ae95fe44143bca97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b15f516c6a34343979d19a0938c232b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:57.980788 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64e49eae-f9c0-4ff6-bb28-72705d73f283 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 200 len: 1332 microversion: 2.1 time: 0.332309 Jul 02 21:07:57.981426 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 901/1876] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:57 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 1332 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:57.986871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:57.994447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:58.014785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:58.015624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:58.016772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:58.017392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:58.301429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:58.310273 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-804461e5-601b-4712-86e0-c11df532f0d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.376631 Jul 02 21:07:58.311448 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 976/1877] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:57 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:58.401060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:58.416673 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8790085-a57b-4af1-a0cc-b247a7b403c0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.433410 Jul 02 21:07:58.419747 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 902/1878] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:57 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:58.497430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:58.498055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:58.504465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:58.504927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:58.505717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:58.506161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:58.787561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:58.801494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b82daa25-c274-4881-b383-627214325dfb tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.307933 Jul 02 21:07:58.806057 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 977/1879] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:58 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:58.940407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:58.941713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:58.948817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:58.949537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:58.950528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:58.951200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.002114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:59.003782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] [instance: 1bc8e287-b938-43c3-8d6d-342220d0319a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:59.013400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.014214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.015195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.016343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.035726 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] HTTP exception thrown: Instance 1bc8e287-b938-43c3-8d6d-342220d0319a could not be found. Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Request method failure captured: Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a HTTP/1.1 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLkfybCClKs8Da_d0NgspdrvTv3KiXGul4qgkYzMeyp-6DgWIuYopwtCjK-zKW2zk_6O3ZroAB6_OeVo4rgs9aDH3VEOoy3wBBjELhyVESRhP_8LkRsvRUoMKAtTEPMkDgyiUK66N6UPJUUP7Ik3JIJrXd9e9CBP1FUl8tUkewCcYU Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4b15f516c6a34343979d19a0938c232b Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-VolumesAdminNegativeTest-1317235312 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b15f516c6a34343979d19a0938c232b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b15f516c6a34343979d19a0938c232b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b15f516c6a34343979d19a0938c232b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b15f516c6a34343979d19a0938c232b"}]}] Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-VolumesAdminNegativeTest-1317235312 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4b15f516c6a34343979d19a0938c232b Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1317235312 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-VolumesAdminNegativeTest-1317235312-project Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1fade188e2a14766ae95fe44143bca97 Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-VolumesAdminNegativeTest-1317235312-project Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 1bc8e287-b938-43c3-8d6d-342220d0319a could not be found. Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '1bc8e287-b938-43c3-8d6d-342220d0319a'} Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bc8e287-b938-43c3-8d6d-342220d0319a could not be found. Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bc8e287-b938-43c3-8d6d-342220d0319a could not be found. Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:07:59.037496 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bc8e287-b938-43c3-8d6d-342220d0319a could not be found. Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Returning 404 to user: Instance 1bc8e287-b938-43c3-8d6d-342220d0319a could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:07:59.044542 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f017c29c-1302-4573-b6fa-b33a05d39438 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a" status: 404 len: 111 microversion: 2.1 time: 0.049663 Jul 02 21:07:59.049053 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 978/1880] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:58 2022] GET /compute/v2.1/servers/1bc8e287-b938-43c3-8d6d-342220d0319a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:07:59.053932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6a368152-fcec-40c8-8d6b-e5ec1d94f380 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] Calling method '.version_select at 0x7fabe47ad5e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:59.083556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6a368152-fcec-40c8-8d6b-e5ec1d94f380 tempest-VolumesAdminNegativeTest-1317235312 tempest-VolumesAdminNegativeTest-1317235312-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009706156" status: 202 len: 0 microversion: 2.1 time: 0.033207 Jul 02 21:07:59.084365 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 979/1881] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:07:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1009706156 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:07:59.093190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1d8749f3-7b9f-478f-996a-b5ebdeddd981 req-f588f862-8dd4-4d98-b990-8688c12c097f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bc8e287-b938-43c3-8d6d-342220d0319a", "name": "network-vif-deleted", "tag": "9483df73-5f9d-4c45-be57-eeb24fa4b6fa"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:07:59.105566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1d8749f3-7b9f-478f-996a-b5ebdeddd981 req-f588f862-8dd4-4d98-b990-8688c12c097f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.106357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1d8749f3-7b9f-478f-996a-b5ebdeddd981 req-f588f862-8dd4-4d98-b990-8688c12c097f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.123296 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1d8749f3-7b9f-478f-996a-b5ebdeddd981 req-f588f862-8dd4-4d98-b990-8688c12c097f service nova] Creating event network-vif-deleted:9483df73-5f9d-4c45-be57-eeb24fa4b6fa for instance 1bc8e287-b938-43c3-8d6d-342220d0319a on nch1-master-1 Jul 02 21:07:59.134388 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1d8749f3-7b9f-478f-996a-b5ebdeddd981 req-f588f862-8dd4-4d98-b990-8688c12c097f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045759 Jul 02 21:07:59.135616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 980/1882] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:07:59.288860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:59.307081 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-533f938c-455c-4a1b-a381-ddf965f13f4b tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.371008 Jul 02 21:07:59.309877 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 903/1883] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:58 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:59.333786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:59.334643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:59.351669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.353499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.355127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.355868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.444415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:59.452263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:59.463043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.467751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.473166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.474522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.715645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:59.725545 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ed0f837-721a-42bb-b664-6b6749fb42ab tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.401045 Jul 02 21:07:59.736428 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 981/1884] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:59 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:59.818077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:07:59.824901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:07:59.827233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:07:59.834135 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-931fb3c0-eee3-429b-b956-f40e238ef34d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.400606 Jul 02 21:07:59.837099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.837825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.839801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:07:59.840795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:07:59.850321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 904/1885] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:59 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:07:59.987092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0fa564a7-70ee-49cf-94df-a65d963f3a91 req-db771cc8-da7d-4ff3-8f7d-6c3207877b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39f8df0-5454-42fe-80bc-b682c96b5423", "tag": "72877cf0-f3ce-45d8-860e-fa088f41e58f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:00.019988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0fa564a7-70ee-49cf-94df-a65d963f3a91 req-db771cc8-da7d-4ff3-8f7d-6c3207877b51 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.022590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0fa564a7-70ee-49cf-94df-a65d963f3a91 req-db771cc8-da7d-4ff3-8f7d-6c3207877b51 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.049365 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0fa564a7-70ee-49cf-94df-a65d963f3a91 req-db771cc8-da7d-4ff3-8f7d-6c3207877b51 service nova] Creating event network-changed:72877cf0-f3ce-45d8-860e-fa088f41e58f for instance c39f8df0-5454-42fe-80bc-b682c96b5423 on nch1-master-1 Jul 02 21:08:00.054896 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0fa564a7-70ee-49cf-94df-a65d963f3a91 req-db771cc8-da7d-4ff3-8f7d-6c3207877b51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074259 Jul 02 21:08:00.056272 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 905/1886] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:00.160969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:00.170146 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59c19b10-655e-490d-845f-a7d7353fecf9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.351006 Jul 02 21:08:00.170819 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 982/1887] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:07:59 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:00.326289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:00.327053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:00.343932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.344420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.345264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.345703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.632769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:00.651014 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e57d01d-cf7f-47ba-a22e-69f6c78bdef9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.329049 Jul 02 21:08:00.653795 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 906/1888] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:00 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:00.742844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:00.743474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:00.750375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.750841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.751714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.752524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.855416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:00.856516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:00.863340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.864150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.865309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:00.866003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:00.936002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:00.946086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9921c58f-25f5-4ee4-afaf-fedf4f61043f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.207166 Jul 02 21:08:00.957158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 983/1889] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:00 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:01.054449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:01.066231 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f90ca79d-619a-4a95-84d2-ed14c9fdccce tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.212690 Jul 02 21:08:01.068657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 907/1890] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:00 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:01.187349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:01.188292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:01.205611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:01.212583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:01.213884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:01.214499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:01.677159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa7ba604-3b01-4c18-9a12-9bde485cb3d4 tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] Action: 'create', calling method: .version_select at 0x7fabe46928b0>, body: {"security_group": {"name": "tempest-securitygroup-1700300256", "description": "tempest-description-437965063"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:01.693534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:01.701375 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad78e066-c38f-45bd-ac94-88d077c7672f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.518201 Jul 02 21:08:01.702096 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 984/1891] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:01 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:01.718455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:01.719093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:01.726930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:01.727403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:01.728243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:01.729661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:01.933819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:01.951005 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a041403e-f240-46bf-9fa5-298d1dcac3eb tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.247516 Jul 02 21:08:01.953026 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 985/1892] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:01 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:01.971782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:01.974124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:01.985790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:01.986865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:01.988202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:01.988874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.116023 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa7ba604-3b01-4c18-9a12-9bde485cb3d4 tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.638641 Jul 02 21:08:02.116861 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 908/1893] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:08:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:02.125112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:02.126014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:02.134903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:02.135615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.136737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:02.137391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.177189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:02.193506 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c081ac9a-bc95-40ba-993a-74a5569ee995 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.231727 Jul 02 21:08:02.194737 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 986/1894] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:01 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:02.206860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-463282c5-e039-496c-be66-882b91633ee3 tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] Action: 'create', calling method: .version_select at 0x7fabe467a700>, body: {"security_group": {"name": "tempest-securitygroup-3752812", "description": "tempest-description-1874136231"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:02.327441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:02.343076 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4d4937e-155f-4423-ae13-18342f338f43 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.224368 Jul 02 21:08:02.344793 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 909/1895] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:02 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:02.352108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c62c8d78-6a07-4d94-8eee-6154514f8038 req-65bc5bb1-81aa-4601-a42d-81c57c604721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b958a2fd-b37b-49af-94f3-b0281d982ee8", "tag": "06823d2f-6623-46f7-a95a-14f63f9fb667"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:02.361136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c62c8d78-6a07-4d94-8eee-6154514f8038 req-65bc5bb1-81aa-4601-a42d-81c57c604721 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:02.361953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c62c8d78-6a07-4d94-8eee-6154514f8038 req-65bc5bb1-81aa-4601-a42d-81c57c604721 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.374739 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c62c8d78-6a07-4d94-8eee-6154514f8038 req-65bc5bb1-81aa-4601-a42d-81c57c604721 service nova] Creating event network-changed:06823d2f-6623-46f7-a95a-14f63f9fb667 for instance b958a2fd-b37b-49af-94f3-b0281d982ee8 on nch2-master-1 Jul 02 21:08:02.382026 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c62c8d78-6a07-4d94-8eee-6154514f8038 req-65bc5bb1-81aa-4601-a42d-81c57c604721 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035510 Jul 02 21:08:02.385614 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 910/1896] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:02.418584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-463282c5-e039-496c-be66-882b91633ee3 tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.222229 Jul 02 21:08:02.426033 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 987/1897] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:08:02 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:02.478612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c00db0ab-b3fe-4eee-95c0-6fea2653e0d8 tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] Action: 'create', calling method: .version_select at 0x7fabd7fa15e0>, body: {"security_group": {"name": "tempest-securitygroup-1925330067", "description": "tempest-description-1022188268"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:02.722972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:02.723884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:02.732880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c00db0ab-b3fe-4eee-95c0-6fea2653e0d8 tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.304893 Jul 02 21:08:02.739745 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 911/1898] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:08:02 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:02.744938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-285060a9-281f-4cf5-81de-1490f327268c tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] Action: 'create', calling method: .version_select at 0x7fabe4692dc0>, body: {"security_group": {"name": "tempest-securitygroup-156103993", "description": "tempest-description-1759995850"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:02.745389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:02.746068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.747161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:02.748310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.962250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:02.972512 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-251808ab-37d2-4b6c-9f5c-d66c08997a69 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.256998 Jul 02 21:08:02.973290 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 988/1899] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:02 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:02.976680 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-285060a9-281f-4cf5-81de-1490f327268c tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.236089 Jul 02 21:08:02.978629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:02.979348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:02.982998 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 912/1900] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:08:02 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:02.988250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-126962f3-474c-4f60-866d-f8b171fd2a25 tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] Calling method '.version_select at 0x7fabe48a6c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:02.997966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:02.998619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:02.999633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:03.000173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:03.217764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:03.228256 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c7352820-ac26-4074-9565-6ee5d78a269f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.253496 Jul 02 21:08:03.229730 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 989/1901] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:02 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:03.235008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:03.236011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:03.242498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:03.243316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:03.244384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:03.245079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:03.451917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:03.467444 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c26e3531-717e-4143-b89a-b65d36480697 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.235939 Jul 02 21:08:03.478906 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 990/1902] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:03 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:03.484454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:03.485204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:03.493676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:03.494260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:03.495145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:03.495724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:03.526760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:03.686722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:03.698918 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9b48eed8-3fdd-449d-bb5e-f71b13fc3e95 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.218508 Jul 02 21:08:03.709527 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 991/1903] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:03 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:03.930590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1d746d65-d338-4e8c-b02d-e9966618ff7d req-cd02f27a-d9f0-4917-9c8c-db5d25a07178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "name": "network-vif-plugged", "status": "completed", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:03.951113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1d746d65-d338-4e8c-b02d-e9966618ff7d req-cd02f27a-d9f0-4917-9c8c-db5d25a07178 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:03.952191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1d746d65-d338-4e8c-b02d-e9966618ff7d req-cd02f27a-d9f0-4917-9c8c-db5d25a07178 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:03.969443 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1d746d65-d338-4e8c-b02d-e9966618ff7d req-cd02f27a-d9f0-4917-9c8c-db5d25a07178 service nova] Creating event network-vif-plugged:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch2-master-1 Jul 02 21:08:03.975859 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1d746d65-d338-4e8c-b02d-e9966618ff7d req-cd02f27a-d9f0-4917-9c8c-db5d25a07178 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049764 Jul 02 21:08:03.977329 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 992/1904] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:04.010721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:04.011445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:04.014611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:04.019653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.020146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.020941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.021383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.085239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=12 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:04.207604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:04.224302 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8bb1ca20-6d7f-483f-958d-b8b1c65c616c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1311 microversion: 2.1 time: 0.220847 Jul 02 21:08:04.235706 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 993/1905] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:04 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:04.257267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:04.258563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:04.278768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.280162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.281163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.281966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.375094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:04.500654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:04.514676 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d8b5b96-750b-4611-be8d-7fd1b8d679a2 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.264586 Jul 02 21:08:04.515309 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 994/1906] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:04 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:04.522899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:04.523518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:04.534779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.535318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.535973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.536782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.576510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:04.760918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:04.770944 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-15bb98b1-0843-4099-966c-70e049cf0e1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.253695 Jul 02 21:08:04.771533 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 995/1907] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:04 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:04.776907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:04.777070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:04.783269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.783716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.784526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:04.784957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:04.992986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:05.003175 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6eaa366e-d74a-414f-aadd-dbe981503248 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1471 microversion: 2.1 time: 0.230386 Jul 02 21:08:05.005153 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 996/1908] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:04 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:05.242126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:05.242766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:05.259296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:05.259788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:05.260924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:05.261380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:05.494141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:05.504241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d437f66-f73a-49cc-ab60-734e1842a820 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1495 microversion: 2.1 time: 0.266665 Jul 02 21:08:05.504835 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 997/1909] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:05 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1495 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:05.665025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:05.665885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:05.672957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:05.673731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:05.674827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:05.675433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:05.856346 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9340caa9-92dc-459b-a3f2-4f713bcd77c4 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1646 microversion: 2.1 time: 0.338952 Jul 02 21:08:05.858227 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 998/1910] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:05 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1646 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:05.865061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:05.866227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:05.880315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:05.881101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:05.884296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:05.885306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.183549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:06.193335 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-126962f3-474c-4f60-866d-f8b171fd2a25 tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13731 microversion: 2.1 time: 3.208809 Jul 02 21:08:06.195004 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 913/1911] 10.222.0.43 () {58 vars in 1190 bytes} [Sat Jul 2 21:08:02 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13731 bytes in 3211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:08:06.201222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:06.202404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:06.206618 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6f72245c-f7d1-447b-8a48-608d8691e584 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.347004 Jul 02 21:08:06.208599 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 999/1912] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:05 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:06.221814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:06.222614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:06.230980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.231721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.233058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.234624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.235100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.235926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.236364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.236497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.450025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:06.459265 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a43b7153-ec6a-46ae-b3d7-e2565342220d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.262795 Jul 02 21:08:06.460153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 914/1913] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:06 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:06.465179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:06.466024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:06.472482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.473152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.474123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.474722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.486949 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-52fcd7ae-65a7-4bcb-b5ef-056e32b267e5 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1646 microversion: 2.1 time: 0.276434 Jul 02 21:08:06.496140 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1000/1914] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:06 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1646 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:06.496140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a755ce6a-e9c2-4949-bdb1-b19c240d87fb tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] Calling method '.version_select at 0x7fabe495a430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:06.720673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:06.729200 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a0d4e07-0bdd-40e8-bfcd-9b3705dc9bb0 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.267846 Jul 02 21:08:06.729795 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 915/1915] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:06 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:06.734459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35c144de-90a4-47a9-b4bd-2f0a6669822b tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:06.736332 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:06.736332 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:06.737859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c144de-90a4-47a9-b4bd-2f0a6669822b tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.738304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c144de-90a4-47a9-b4bd-2f0a6669822b tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.739105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c144de-90a4-47a9-b4bd-2f0a6669822b tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.739730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c144de-90a4-47a9-b4bd-2f0a6669822b tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.764498 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35c144de-90a4-47a9-b4bd-2f0a6669822b tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033340 Jul 02 21:08:06.770380 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 916/1916] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:08:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:06.777605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a755ce6a-e9c2-4949-bdb1-b19c240d87fb tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1109 microversion: 2.1 time: 0.288213 Jul 02 21:08:06.778044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:06.778211 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1001/1917] 10.222.0.43 () {58 vars in 1190 bytes} [Sat Jul 2 21:08:06 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1109 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:06.780762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:06.790813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-09c9f911-f49a-4c39-a380-1bd228fbc663 tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] Calling method '.version_select at 0x7fabe47d8a60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:06.795049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.795678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.796862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:06.797663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:06.824782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lazy-loading 'flavor' on Instance uuid c992b533-5d21-4815-b979-65f3b530d668 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:06.838459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: c992b533-5d21-4815-b979-65f3b530d668] Going to try to live migrate instance to nch1-master-1 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:08:06.972798 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-09c9f911-f49a-4c39-a380-1bd228fbc663 tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c4bd9a6e-3451-4cdf-9b2e-37e3783eb4b2" status: 202 len: 0 microversion: 2.1 time: 0.186441 Jul 02 21:08:06.974172 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1002/1918] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:08:06 2022] DELETE /compute/v2.1/os-security-groups/c4bd9a6e-3451-4cdf-9b2e-37e3783eb4b2 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:06.992861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5677d287-90b5-4e41-b5b6-d7033a34ae2c tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] Calling method '.version_select at 0x7fabe467a700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:07.213562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5677d287-90b5-4e41-b5b6-d7033a34ae2c tempest-SecurityGroupsTestAdminJSON-1205640437 tempest-SecurityGroupsTestAdminJSON-1205640437-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/7d286f7e-f7fa-44b4-ab3c-3c68c3ed45a6" status: 202 len: 0 microversion: 2.1 time: 0.231145 Jul 02 21:08:07.217545 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1003/1919] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:08:06 2022] DELETE /compute/v2.1/os-security-groups/7d286f7e-f7fa-44b4-ab3c-3c68c3ed45a6 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:07.222855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-96782b66-e120-43db-ac26-1409b9e7b225 tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] Calling method '.version_select at 0x7fabea327dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:07.461892 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-96782b66-e120-43db-ac26-1409b9e7b225 tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/24cda86b-08f5-4c8e-bde5-a56759ee2402" status: 202 len: 0 microversion: 2.1 time: 0.243163 Jul 02 21:08:07.462477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1004/1920] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:08:07 2022] DELETE /compute/v2.1/os-security-groups/24cda86b-08f5-4c8e-bde5-a56759ee2402 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:07.467062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:07.468170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:07.474690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:07.475145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:07.476158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:07.476774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:07.620466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:07.628343 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ae9275b6-7c4b-4d02-b517-44e2b5e350f5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.164856 Jul 02 21:08:07.628925 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1005/1921] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:07 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:07.635789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1df5b43-5caa-4936-a694-a1c32c16cf3a tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] Calling method '.version_select at 0x7fabe495a430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:07.827276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1df5b43-5caa-4936-a694-a1c32c16cf3a tempest-SecurityGroupsTestAdminJSON-985340425 tempest-SecurityGroupsTestAdminJSON-985340425-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/3453d287-f38b-4bdf-9b62-f975c8f48e53" status: 202 len: 0 microversion: 2.1 time: 0.197272 Jul 02 21:08:07.827879 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1006/1922] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:08:07 2022] DELETE /compute/v2.1/os-security-groups/3453d287-f38b-4bdf-9b62-f975c8f48e53 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:07.832822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:07.833689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:07.840211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:07.840676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:07.841463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:07.841904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:07.980583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:07.989886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-687c4e02-11c5-4cdf-9aea-11453114f224 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.160791 Jul 02 21:08:07.996629 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1007/1923] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:07 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:08.003512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:08.004329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:08.013444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:08.013937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:08.014865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:08.015581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:08.261120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:08.270799 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ea6fa43-e793-4d29-9af6-2976012f31c2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.272739 Jul 02 21:08:08.271793 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1008/1924] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:07 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:08.463249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0bc16fe4-3570-42fb-acc8-60af5c3c7c1d req-166f1ed5-b234-4f50-b22d-356f7658f2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b958a2fd-b37b-49af-94f3-b0281d982ee8", "name": "network-vif-plugged", "status": "completed", "tag": "06823d2f-6623-46f7-a95a-14f63f9fb667"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:08.472280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0bc16fe4-3570-42fb-acc8-60af5c3c7c1d req-166f1ed5-b234-4f50-b22d-356f7658f2db service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:08.472924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0bc16fe4-3570-42fb-acc8-60af5c3c7c1d req-166f1ed5-b234-4f50-b22d-356f7658f2db service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:08.485115 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0bc16fe4-3570-42fb-acc8-60af5c3c7c1d req-166f1ed5-b234-4f50-b22d-356f7658f2db service nova] Creating event network-vif-plugged:06823d2f-6623-46f7-a95a-14f63f9fb667 for instance b958a2fd-b37b-49af-94f3-b0281d982ee8 on nch2-master-1 Jul 02 21:08:08.490555 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0bc16fe4-3570-42fb-acc8-60af5c3c7c1d req-166f1ed5-b234-4f50-b22d-356f7658f2db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032255 Jul 02 21:08:08.491423 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1009/1925] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:08.646828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:08.647662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:08.655041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:08.655617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:08.656548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:08.657130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:08.818565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:08.829891 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7b9212d5-bd58-4054-b07e-afe4a8fb1ad4 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.187748 Jul 02 21:08:08.840609 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1010/1926] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:08 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:09.007490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:09.008142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:09.015735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:09.016310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:09.017099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:09.017570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:09.226442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:09.236966 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9ef3d9bf-d03e-4eb9-9616-d902fb29af1d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.234026 Jul 02 21:08:09.239855 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1011/1927] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:09 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:09.292802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:09.293402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:09.301488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:09.302418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:09.303430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:09.305266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:09.447511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:09.455258 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-31e83e15-c744-45e9-a2cd-bb8282b4a597 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.166232 Jul 02 21:08:09.456197 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1012/1928] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:09 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:09.857347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:09.858000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:09.871758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:09.882317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:09.886375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:09.888517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:10.213700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:10.223666 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b84a0fa-dab5-4a41-a426-183b6542f8bf tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.378971 Jul 02 21:08:10.224410 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1013/1929] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:09 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:10.260743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:10.261685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:10.270824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:10.271555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:10.272775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:10.273676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:10.494847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:10.509165 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b6b2e33-6ba2-4011-ab4b-fbe759a0fa37 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.256411 Jul 02 21:08:10.509773 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1014/1930] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:10 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:10.515775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:10.516929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:10.525277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:10.526454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:10.528469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:10.529638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:10.719951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:10.728634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9fb45bc8-c7df-4f8e-a0dd-6c565085071a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.217771 Jul 02 21:08:10.729222 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1015/1931] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:10 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:10.734005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7e696835-c280-442b-915a-20b6e071f84f req-464732e5-8ab5-43cc-8225-2927f74a3917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39f8df0-5454-42fe-80bc-b682c96b5423", "name": "network-vif-plugged", "status": "completed", "tag": "72877cf0-f3ce-45d8-860e-fa088f41e58f"}, {"server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "name": "network-vif-unplugged", "status": "completed", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:10.744013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7e696835-c280-442b-915a-20b6e071f84f req-464732e5-8ab5-43cc-8225-2927f74a3917 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:10.744699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7e696835-c280-442b-915a-20b6e071f84f req-464732e5-8ab5-43cc-8225-2927f74a3917 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:10.761477 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7e696835-c280-442b-915a-20b6e071f84f req-464732e5-8ab5-43cc-8225-2927f74a3917 service nova] Creating event network-vif-plugged:72877cf0-f3ce-45d8-860e-fa088f41e58f for instance c39f8df0-5454-42fe-80bc-b682c96b5423 on nch1-master-1 Jul 02 21:08:10.762254 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7e696835-c280-442b-915a-20b6e071f84f req-464732e5-8ab5-43cc-8225-2927f74a3917 service nova] Creating event network-vif-unplugged:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:08:10.770452 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7e696835-c280-442b-915a-20b6e071f84f req-464732e5-8ab5-43cc-8225-2927f74a3917 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039888 Jul 02 21:08:10.771985 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1016/1932] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:11.068728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a16140a0-85a7-49d1-8db5-b8ee3c2bb7ef tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668/action" status: 202 len: 0 microversion: 2.1 time: 4.295302 Jul 02 21:08:11.072832 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 917/1933] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:08:06 2022] POST /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668/action => generated 0 bytes in 4300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:11.099780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.103551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:11.119364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.129735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.131171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.131946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.241414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.243516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:11.256109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.256569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.257817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.258448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.288122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:11.301367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:11.312989 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bcf4325c-0609-4709-9d8b-c57f3659ed38 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.237242 Jul 02 21:08:11.314615 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1017/1934] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:11.441789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:11.459523 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-af2d8624-c376-4e9a-ac9d-8cd88b239554 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.222275 Jul 02 21:08:11.460394 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 918/1935] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:11.527129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.527747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:11.535987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.536694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.537481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.538083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.562343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:11.688983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:11.697754 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c822d176-4089-4ce4-8366-732cd5de1d6a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.174430 Jul 02 21:08:11.699395 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1018/1936] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:11.744471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.745285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:11.752137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.752920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.753829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.754272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.785588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-873fc984-3f7e-4911-be82-abbefdbf9be7 tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.787066 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:11.787066 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:11.788781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873fc984-3f7e-4911-be82-abbefdbf9be7 tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.800628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873fc984-3f7e-4911-be82-abbefdbf9be7 tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.801545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873fc984-3f7e-4911-be82-abbefdbf9be7 tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.801988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873fc984-3f7e-4911-be82-abbefdbf9be7 tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.827664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-873fc984-3f7e-4911-be82-abbefdbf9be7 tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.186608 Jul 02 21:08:11.829356 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 919/1937] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/os-services => generated 947 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:11.840115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dd960d1-1118-411f-8141-b60a3b7eb1ed tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.841555 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:11.841555 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:11.843242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dd960d1-1118-411f-8141-b60a3b7eb1ed tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.843864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dd960d1-1118-411f-8141-b60a3b7eb1ed tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.845217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dd960d1-1118-411f-8141-b60a3b7eb1ed tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.845868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dd960d1-1118-411f-8141-b60a3b7eb1ed tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.872785 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dd960d1-1118-411f-8141-b60a3b7eb1ed tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.036239 Jul 02 21:08:11.873404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 920/1938] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:11.885810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6b24124-1416-46d8-b9c4-278f834c264d tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.887747 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:11.887747 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:11.889376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b24124-1416-46d8-b9c4-278f834c264d tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.890029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b24124-1416-46d8-b9c4-278f834c264d tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.891169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b24124-1416-46d8-b9c4-278f834c264d tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.891771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6b24124-1416-46d8-b9c4-278f834c264d tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.905059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:11.915178 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8c878793-6d6d-46fb-8655-5db59740f98e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.174338 Jul 02 21:08:11.916474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1019/1939] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:11.920294 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6b24124-1416-46d8-b9c4-278f834c264d tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038671 Jul 02 21:08:11.920911 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 921/1940] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/os-services => generated 947 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:11.931228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c99dbe8-094f-4be9-876c-7a8f2333f1cd tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.932716 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:11.932716 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:08:11.933936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c99dbe8-094f-4be9-876c-7a8f2333f1cd tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.934407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c99dbe8-094f-4be9-876c-7a8f2333f1cd tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.935187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c99dbe8-094f-4be9-876c-7a8f2333f1cd tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.935624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c99dbe8-094f-4be9-876c-7a8f2333f1cd tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.967660 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c99dbe8-094f-4be9-876c-7a8f2333f1cd tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.033643 Jul 02 21:08:11.967660 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1020/1941] 10.222.0.43 () {58 vars in 1195 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 02 21:08:11.972834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28042aff-c44b-49b5-997e-ca1ab87517bc tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:11.974166 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:11.974166 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:11.975259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28042aff-c44b-49b5-997e-ca1ab87517bc tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.975717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28042aff-c44b-49b5-997e-ca1ab87517bc tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:11.976584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28042aff-c44b-49b5-997e-ca1ab87517bc tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:11.977021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28042aff-c44b-49b5-997e-ca1ab87517bc tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.000872 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28042aff-c44b-49b5-997e-ca1ab87517bc tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.032025 Jul 02 21:08:12.004070 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 922/1942] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:08:11 2022] GET /compute/v2.1/os-services => generated 947 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:12.012429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-47d934bb-4a8e-4d46-afe9-29096889f26e tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.013971 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:12.013971 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:08:12.015375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47d934bb-4a8e-4d46-afe9-29096889f26e tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.015838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47d934bb-4a8e-4d46-afe9-29096889f26e tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.016973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47d934bb-4a8e-4d46-afe9-29096889f26e tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.017183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47d934bb-4a8e-4d46-afe9-29096889f26e tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.045054 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-47d934bb-4a8e-4d46-afe9-29096889f26e tempest-ServicesAdminNegativeTestJSON-1323758411 tempest-ServicesAdminNegativeTestJSON-1323758411-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.036021 Jul 02 21:08:12.045989 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1021/1943] 10.222.0.43 () {58 vars in 1197 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:08:12.337437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f65f772-a410-49fd-950b-31a3679c003d tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.351567 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f65f772-a410-49fd-950b-31a3679c003d tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.098605 Jul 02 21:08:12.355636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4019720b-27c8-45a3-acd5-218ef61ac565 tempest-ServicesAdminNegativeTestJSON-590616014 tempest-ServicesAdminNegativeTestJSON-590616014-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.357005 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:12.357005 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:12.358128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4019720b-27c8-45a3-acd5-218ef61ac565 tempest-ServicesAdminNegativeTestJSON-590616014 tempest-ServicesAdminNegativeTestJSON-590616014-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b20959ef471349ba8c0cba87579d2dc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11f8356b092424299996ee25929ac33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4019720b-27c8-45a3-acd5-218ef61ac565 tempest-ServicesAdminNegativeTestJSON-590616014 tempest-ServicesAdminNegativeTestJSON-590616014-project] Request method failure captured: Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLO6QUPo1U0zTpZBSWVajIJcTcpuCQ6VmhDUi8Losm26VlwmREs4pLFSY6tQ0REEEVGo7yNx3txtfwHECOxyEVGZfVJt3wm5jxPWe2tggh3wJtjJB6gl8Dil-0Twm4y3EaB4djAOGsFLzzm5IPJP9kjq85VSgWW13DD_XKRowupr2J8 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: e11f8356b092424299996ee25929ac33 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-590616014 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e11f8356b092424299996ee25929ac33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e11f8356b092424299996ee25929ac33", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e11f8356b092424299996ee25929ac33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e11f8356b092424299996ee25929ac33"}]}] Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-590616014 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: e11f8356b092424299996ee25929ac33 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-590616014 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServicesAdminNegativeTestJSON-590616014-project Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b20959ef471349ba8c0cba87579d2dc3 Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-590616014-project Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 02 21:08:12.359851 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4019720b-27c8-45a3-acd5-218ef61ac565 tempest-ServicesAdminNegativeTestJSON-590616014 tempest-ServicesAdminNegativeTestJSON-590616014-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4019720b-27c8-45a3-acd5-218ef61ac565 tempest-ServicesAdminNegativeTestJSON-590616014 tempest-ServicesAdminNegativeTestJSON-590616014-project] 10.222.0.43 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.308642 Jul 02 21:08:12.365444 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 923/1944] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/os-services => generated 112 bytes in 310 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:12.366323 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1022/1945] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:12.368747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.369432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:12.376821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.377257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.378045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.378489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.477028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.477997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:12.485374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.486067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.487659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.488440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.588478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:12.598752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f7ace82-c366-4235-a318-d8738d86d498 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.235589 Jul 02 21:08:12.599347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 924/1946] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:12.668334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:12.676466 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-906ba861-61c1-4443-9b16-654913b64967 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1317 microversion: 2.1 time: 0.203275 Jul 02 21:08:12.677075 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1023/1947] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:12.714542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.715571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:12.722744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.723309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.724310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.725011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.899740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:12.907965 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2846fd76-1977-41c7-aa21-ce794c9de623 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.197271 Jul 02 21:08:12.909032 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 925/1948] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:12.933190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:12.934190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:12.943452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.944403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:12.945978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:12.946653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:13.151629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:13.163687 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca16bf2c-d1b5-4b99-bf5d-2667ed036afe tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.232628 Jul 02 21:08:13.164602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1024/1949] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:12 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:13.230433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e379fdb-0732-4985-a1d7-3f0311f00e7b tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-19250166", "imageRef": "2a26da5f-8333-4e95-9c46-2982096cd037", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:13.279992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-1e379fdb-0732-4985-a1d7-3f0311f00e7b tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:08:13.497276 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1e379fdb-0732-4985-a1d7-3f0311f00e7b tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e379fdb-0732-4985-a1d7-3f0311f00e7b tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] Request method failure captured: Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 141 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLO8YF-pS_IlJi-3bbPfdGs1Wow481yB-Qax8spZT17QNIDA1UX95EJYDNQpeFRYhc9qLPa8ygglhVE8Krb1mcF6fwyU8azpQ6CKPpS8Uij-wJ_FhxAf5uUdy7MTbwFNa3DZDfUwdQ9fwm54a8WIDORtbahH2VY0tUIPIc86JbJZk7o Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 3e6374f0dc6f46e9b0cdead21e69a4fa Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FlavorsV2NegativeTest-1912799675 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e6374f0dc6f46e9b0cdead21e69a4fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_3e6374f0dc6f46e9b0cdead21e69a4fa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/3e6374f0dc6f46e9b0cdead21e69a4fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/3e6374f0dc6f46e9b0cdead21e69a4fa"}]}] Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FlavorsV2NegativeTest-1912799675 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 3e6374f0dc6f46e9b0cdead21e69a4fa Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1912799675 Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FlavorsV2NegativeTest-1912799675-project Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3a8b9e1d931342d3a06dcf3d7076f28c Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FlavorsV2NegativeTest-1912799675-project Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-19250166", "imageRef": "2a26da5f-8333-4e95-9c46-2982096cd037", "flavorRef": "452"}} Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: exception: Flavor's memory is too small for requested image. Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-19250166', 'imageRef': '2a26da5f-8333-4e95-9c46-2982096cd037', 'flavorRef': '452'}}} Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:08:13.500279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 02 21:08:13.505660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:13.507825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e379fdb-0732-4985-a1d7-3f0311f00e7b tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:13.508743 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e379fdb-0732-4985-a1d7-3f0311f00e7b tempest-FlavorsV2NegativeTest-1912799675 tempest-FlavorsV2NegativeTest-1912799675-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.282616 Jul 02 21:08:13.509722 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 926/1950] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:08:13 2022] POST /compute/v2.1/servers => generated 93 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:08:13.624809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:13.626842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:13.627542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a6f1e26e-ba29-4a22-baea-191906d78f6c req-b7228935-ded0-4c26-8831-846cb5e68e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "name": "network-vif-unplugged", "status": "completed", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:13.644619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:13.645461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:13.647892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:13.648605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a6f1e26e-ba29-4a22-baea-191906d78f6c req-b7228935-ded0-4c26-8831-846cb5e68e32 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:13.649049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a6f1e26e-ba29-4a22-baea-191906d78f6c req-b7228935-ded0-4c26-8831-846cb5e68e32 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:13.650978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:13.674910 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a6f1e26e-ba29-4a22-baea-191906d78f6c req-b7228935-ded0-4c26-8831-846cb5e68e32 service nova] Creating event network-vif-unplugged:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch2-master-1 Jul 02 21:08:13.685187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a6f1e26e-ba29-4a22-baea-191906d78f6c req-b7228935-ded0-4c26-8831-846cb5e68e32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067509 Jul 02 21:08:13.686421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 927/1951] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:13.696651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:13.698079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:13.706595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:13.707646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:13.708724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:13.709803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:13.957006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:13.971743 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-550f6ab7-7e30-4663-a0f9-380fc59baf55 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.359133 Jul 02 21:08:13.974630 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1025/1952] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:13 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:13.990535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:13.992973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:14.007579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:14.010114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.010584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.011863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.012342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.017720 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7c139d1-7b02-4be3-8508-071e432c1836 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1506 microversion: 2.1 time: 0.327075 Jul 02 21:08:14.018564 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 928/1953] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:13 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:14.036524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:14.037225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:14.051705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.054958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.055840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.056879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.369623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:14.386006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-84ca9c44-e152-49a7-8021-9663ff5b3b60 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.409252 Jul 02 21:08:14.386760 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1026/1954] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:13 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:14.406508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:14.407115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:14.407553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:14.418720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.421988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.425468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.427300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.469849 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-763a8d89-e9af-4ae8-b573-b22e986ec92c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8" status: 200 len: 1506 microversion: 2.1 time: 0.436303 Jul 02 21:08:14.484379 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 929/1955] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:14 2022] GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:14.506417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:14.508439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:14.519444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.520398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.521575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.522230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.560079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:08:14.678140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:14.686645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d516f802-d3e1-4e33-be6a-e73e8779ae3b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.298233 Jul 02 21:08:14.688832 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1027/1956] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:14 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:14.695618 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50418dcb-9985-4912-b470-b8cd35ddb38a tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8" status: 204 len: 0 microversion: 2.1 time: 0.208874 Jul 02 21:08:14.696595 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 930/1957] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:14 2022] DELETE /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:08:14.706233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:14.706754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:14.715394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.715860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.717166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.717872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.764427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:08:14.952558 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6025041-32c9-447c-881e-252cab99cdf8 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 204 len: 0 microversion: 2.1 time: 0.250478 Jul 02 21:08:14.953909 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1028/1958] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:14 2022] DELETE /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:08:14.963317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:14.964469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:14.973423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.974128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.975171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:14.975897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:14.994931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:14.996356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:15.026045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.026759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.027789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.028481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.324092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:15.334483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58b0270f-c98e-4d9a-a2a3-fb1c80839394 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8" status: 200 len: 1512 microversion: 2.1 time: 0.375870 Jul 02 21:08:15.335078 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 931/1959] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:14 2022] GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:15.340731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:15.345998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d2521c00-27f6-49e0-a687-36efed64f9dc req-65144ed1-c68b-4ea2-a798-395d8a3e83c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "name": "network-vif-plugged", "status": "completed", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:15.354179 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d02bab4a-7fd7-4758-ac2a-9f3a05bea89a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.366709 Jul 02 21:08:15.355704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d2521c00-27f6-49e0-a687-36efed64f9dc req-65144ed1-c68b-4ea2-a798-395d8a3e83c7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.356374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d2521c00-27f6-49e0-a687-36efed64f9dc req-65144ed1-c68b-4ea2-a798-395d8a3e83c7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.356753 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1029/1960] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:14 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:15.370856 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d2521c00-27f6-49e0-a687-36efed64f9dc req-65144ed1-c68b-4ea2-a798-395d8a3e83c7 service nova] Creating event network-vif-plugged:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:08:15.377330 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d2521c00-27f6-49e0-a687-36efed64f9dc req-65144ed1-c68b-4ea2-a798-395d8a3e83c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039576 Jul 02 21:08:15.378708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 932/1961] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:15.405279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:15.406413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:15.428972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.433107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.434298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.434977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.580963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:15.590027 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-740ceb78-0023-4158-8c1a-03328f9dc188 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.190144 Jul 02 21:08:15.599680 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1030/1962] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:15 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:15.705187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:15.707025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:15.714366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.714828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.715749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:15.716231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:15.877639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:15.886574 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71a67a2e-2a03-456b-8036-b2c101d89958 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.186140 Jul 02 21:08:15.888079 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 933/1963] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:15 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:15.998835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-be816381-296e-48a0-955e-6aa114299379 req-90e0be7c-4ff6-4bab-8571-0bb415a4eb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:16.008191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-be816381-296e-48a0-955e-6aa114299379 req-90e0be7c-4ff6-4bab-8571-0bb415a4eb14 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.008640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-be816381-296e-48a0-955e-6aa114299379 req-90e0be7c-4ff6-4bab-8571-0bb415a4eb14 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.020927 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-be816381-296e-48a0-955e-6aa114299379 req-90e0be7c-4ff6-4bab-8571-0bb415a4eb14 service nova] Creating event network-changed:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch2-master-1 Jul 02 21:08:16.025738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-be816381-296e-48a0-955e-6aa114299379 req-90e0be7c-4ff6-4bab-8571-0bb415a4eb14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030603 Jul 02 21:08:16.026345 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1031/1964] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:16.354354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:16.355345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:16.363219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.364073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.365072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.366033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.376314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:16.377268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:16.398614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.399227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.400086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.400539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.584424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:16.591480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:16.593098 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-851429f4-bf82-4897-9b7a-c8e510e549ef tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8" status: 200 len: 1512 microversion: 2.1 time: 0.245169 Jul 02 21:08:16.593786 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 934/1965] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:16 2022] GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:16.601643 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-739534ed-471f-4043-8672-aa8aa20fba83 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.232299 Jul 02 21:08:16.610854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1032/1966] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:16 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:16.610854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:16.610854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:16.615575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.616320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.617139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.617589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.751016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1438933096", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:16.767175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:16.776328 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-343d5c9e-887d-4537-aea3-29c3e75ffd2d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.173050 Jul 02 21:08:16.787513 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1033/1967] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:16 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:16.808785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:08:16.904551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:16.905492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:16.913368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.914176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:16.915272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:16.915879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.122509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:17.123137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:17.123726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:17.124270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:17.124934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:17.126213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:17.134285 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad46da13-95d8-4708-9abb-7239ec65236b tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.234145 Jul 02 21:08:17.134876 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1034/1968] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:16 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:17.136997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.137702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.138747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.139258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.152753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:17.160107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Getting quotas for project 7cd138b817eb422591e9bc94163efadd. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:08:17.166012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Getting quotas for user 75ae0c662e20465db6b854244a0a61f4 and project 7cd138b817eb422591e9bc94163efadd. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:08:17.179273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:08:17.181892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:08:17.226586 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d11dc9c9-2281-411e-b4ce-c46b145e063c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631274 Jul 02 21:08:17.227542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 935/1969] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:08:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:08:17.237587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5485ac6e-18bc-4d59-be84-0b8ee97f9012 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:17.238696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5485ac6e-18bc-4d59-be84-0b8ee97f9012 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:17.295649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5485ac6e-18bc-4d59-be84-0b8ee97f9012 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:17.306564 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5485ac6e-18bc-4d59-be84-0b8ee97f9012 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1214 microversion: 2.1 time: 0.072628 Jul 02 21:08:17.307756 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1035/1970] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:17 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:17.611295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:17.613803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:17.619397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:17.620415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:17.632817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.633602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.635553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.638183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.638865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.640749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.642087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.651714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.801548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:17.810011 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac24680f-3a96-4487-8791-c5092f2fefa5 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8" status: 200 len: 1470 microversion: 2.1 time: 0.203312 Jul 02 21:08:17.814962 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 936/1971] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:17 2022] GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 => generated 1470 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:17.844998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:17.846543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:17.858167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.858718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:17.866587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:17.867287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.206471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:18.215523 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b80ad17f-4464-45ed-8c02-1dfcc20911d6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.384634 Jul 02 21:08:18.220258 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 937/1972] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:17 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:18.230470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2e1a9f5c-f018-4cdb-a605-7e7111469ac6 req-1ce2c391-511e-4618-b946-1e62cc139b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b958a2fd-b37b-49af-94f3-b0281d982ee8", "name": "network-vif-deleted", "tag": "06823d2f-6623-46f7-a95a-14f63f9fb667"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:18.257104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2e1a9f5c-f018-4cdb-a605-7e7111469ac6 req-1ce2c391-511e-4618-b946-1e62cc139b4d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.259611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2e1a9f5c-f018-4cdb-a605-7e7111469ac6 req-1ce2c391-511e-4618-b946-1e62cc139b4d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.271804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:18.280639 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4dc9c85e-c1cb-4ffa-8835-dfc73d41bd96 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.665574 Jul 02 21:08:18.281222 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1036/1973] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:17 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:18.281485 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2e1a9f5c-f018-4cdb-a605-7e7111469ac6 req-1ce2c391-511e-4618-b946-1e62cc139b4d service nova] Creating event network-vif-deleted:06823d2f-6623-46f7-a95a-14f63f9fb667 for instance b958a2fd-b37b-49af-94f3-b0281d982ee8 on nch2-master-1 Jul 02 21:08:18.304691 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2e1a9f5c-f018-4cdb-a605-7e7111469ac6 req-1ce2c391-511e-4618-b946-1e62cc139b4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078639 Jul 02 21:08:18.306866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:18.307505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:18.308504 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 938/1974] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:18.330720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.331680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.332252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c9ea10cb-9260-4ae4-83e3-e0194b8d3ab6 req-7c0f516e-7585-4951-9a97-8b6ca185c0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39f8df0-5454-42fe-80bc-b682c96b5423", "name": "network-vif-deleted", "tag": "72877cf0-f3ce-45d8-860e-fa088f41e58f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:18.335167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.335829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.355881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c9ea10cb-9260-4ae4-83e3-e0194b8d3ab6 req-7c0f516e-7585-4951-9a97-8b6ca185c0ad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.358139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c9ea10cb-9260-4ae4-83e3-e0194b8d3ab6 req-7c0f516e-7585-4951-9a97-8b6ca185c0ad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.383952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:18.388843 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c9ea10cb-9260-4ae4-83e3-e0194b8d3ab6 req-7c0f516e-7585-4951-9a97-8b6ca185c0ad service nova] Creating event network-vif-deleted:72877cf0-f3ce-45d8-860e-fa088f41e58f for instance c39f8df0-5454-42fe-80bc-b682c96b5423 on nch1-master-1 Jul 02 21:08:18.399386 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c9ea10cb-9260-4ae4-83e3-e0194b8d3ab6 req-7c0f516e-7585-4951-9a97-8b6ca185c0ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088042 Jul 02 21:08:18.400588 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 939/1975] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:18.409581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:18.410668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:18.423725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.426208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.427584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.430448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.568239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:18.575825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0238050d-8e7a-425b-9ec7-678a3d1071cc tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1210 microversion: 2.1 time: 0.173431 Jul 02 21:08:18.576943 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 940/1976] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:18 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1210 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:18.624582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:18.634487 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f03988b7-fe2e-4698-a304-4cefacc28d38 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1477 microversion: 2.1 time: 0.343133 Jul 02 21:08:18.636422 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1037/1977] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:18 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1477 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:18.831146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:18.832785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: b958a2fd-b37b-49af-94f3-b0281d982ee8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:18.842318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.843513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.844755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.845196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.863643 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] HTTP exception thrown: Instance b958a2fd-b37b-49af-94f3-b0281d982ee8 could not be found. Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Request method failure captured: Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 HTTP/1.1 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLOOxu5a1cy3ZOI3278BkpVi_Bg6Alp3leWbObvTcFwzB7x9oCFRc-yCuEYryyV7SFg37XZmwvjZrzZLVmuwvP0OjlXVmR-IaF3Mr76PQe1nD6JDFXdBWkE63Svv1O5LRiW_VNolOYACHoVrgieGR38RMHsFmvb7YJ3zLXsOUJg_8OI Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 73fe5e9f9b7e401488333f601eaa80ac Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateTestJSON-153383856 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/73fe5e9f9b7e401488333f601eaa80ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_73fe5e9f9b7e401488333f601eaa80ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/73fe5e9f9b7e401488333f601eaa80ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/73fe5e9f9b7e401488333f601eaa80ac"}]}] Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateTestJSON-153383856 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 73fe5e9f9b7e401488333f601eaa80ac Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateTestJSON-153383856 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateTestJSON-153383856-project Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 27059ad6d23e4faf8f09c22cf6ee1475 Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateTestJSON-153383856-project Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b958a2fd-b37b-49af-94f3-b0281d982ee8 could not be found. Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b958a2fd-b37b-49af-94f3-b0281d982ee8'} Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b958a2fd-b37b-49af-94f3-b0281d982ee8 could not be found. Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b958a2fd-b37b-49af-94f3-b0281d982ee8 could not be found. Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:18.865777 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b958a2fd-b37b-49af-94f3-b0281d982ee8 could not be found. Jul 02 21:08:18.871255 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:18.873600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Returning 404 to user: Instance b958a2fd-b37b-49af-94f3-b0281d982ee8 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:18.874733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d79b5e7-ed10-4016-8988-da85514a6bd9 tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8" status: 404 len: 111 microversion: 2.1 time: 0.047683 Jul 02 21:08:18.876124 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 941/1978] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:18 2022] GET /compute/v2.1/servers/b958a2fd-b37b-49af-94f3-b0281d982ee8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:18.886893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:18.887641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:18.897183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.897805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.898871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.899368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.942617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:18.942963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:18.943628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lazy-loading 'fault' on Instance uuid c39f8df0-5454-42fe-80bc-b682c96b5423 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:19.011041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27059ad6d23e4faf8f09c22cf6ee1475', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73fe5e9f9b7e401488333f601eaa80ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:19.019862 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ede4a87-5b2f-466e-b367-61c7f7c4711c tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 200 len: 1307 microversion: 2.1 time: 0.138738 Jul 02 21:08:19.021625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1038/1979] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:18 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 1307 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:19.246911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:19.247931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:19.258112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.259656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.261090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.262021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.268940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:19.302392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:19.303028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:19.323457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.324027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.324974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.325414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.522402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:19.531610 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8def896-febb-4b24-9a4d-c3619601f49f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.294805 Jul 02 21:08:19.532939 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 942/1980] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:19 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:19.601360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:19.610244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:19.611583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:19.614858 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-141f7caa-ac0c-4fea-ba90-bd193a20dfda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.318086 Jul 02 21:08:19.617610 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1039/1981] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:19 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:19.631621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.632118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.632913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.633353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.653026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:19.653648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:19.676410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.676795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.677592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:19.678032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:19.790330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:19.807446 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55bc17a3-c2a4-4dfb-bcc1-cad909ab7391 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1284 microversion: 2.1 time: 0.215859 Jul 02 21:08:19.809298 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 943/1982] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:19 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:20.040633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:20.041266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] [instance: c39f8df0-5454-42fe-80bc-b682c96b5423] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:20.051931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:20.052420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:20.057555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:20.058047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:20.120661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] HTTP exception thrown: Instance c39f8df0-5454-42fe-80bc-b682c96b5423 could not be found. Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Request method failure captured: Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 HTTP/1.1 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLOOxu5a1cy3ZOI3278BkpVi_Bg6Alp3leWbObvTcFwzB7x9oCFRc-yCuEYryyV7SFg37XZmwvjZrzZLVmuwvP0OjlXVmR-IaF3Mr76PQe1nD6JDFXdBWkE63Svv1O5LRiW_VNolOYACHoVrgieGR38RMHsFmvb7YJ3zLXsOUJg_8OI Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 73fe5e9f9b7e401488333f601eaa80ac Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateTestJSON-153383856 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/73fe5e9f9b7e401488333f601eaa80ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_73fe5e9f9b7e401488333f601eaa80ac", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/73fe5e9f9b7e401488333f601eaa80ac"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/73fe5e9f9b7e401488333f601eaa80ac"}]}] Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateTestJSON-153383856 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 73fe5e9f9b7e401488333f601eaa80ac Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateTestJSON-153383856 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateTestJSON-153383856-project Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 27059ad6d23e4faf8f09c22cf6ee1475 Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateTestJSON-153383856-project Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance c39f8df0-5454-42fe-80bc-b682c96b5423 could not be found. Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c39f8df0-5454-42fe-80bc-b682c96b5423'} Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39f8df0-5454-42fe-80bc-b682c96b5423 could not be found. Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39f8df0-5454-42fe-80bc-b682c96b5423 could not be found. Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:20.122240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39f8df0-5454-42fe-80bc-b682c96b5423 could not be found. Jul 02 21:08:20.127644 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:20.129186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] Returning 404 to user: Instance c39f8df0-5454-42fe-80bc-b682c96b5423 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:20.130264 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81e3cb0e-5b47-4ca9-9fcc-77f853966d6f tempest-MultipleCreateTestJSON-153383856 tempest-MultipleCreateTestJSON-153383856-project] 10.222.0.43 "GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423" status: 404 len: 111 microversion: 2.1 time: 0.093887 Jul 02 21:08:20.131034 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 944/1983] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:20 2022] GET /compute/v2.1/servers/c39f8df0-5454-42fe-80bc-b682c96b5423 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:08:20.488080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:20.495983 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0369bb64-16ec-4530-878f-b1884a2ed3c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1463 microversion: 2.1 time: 0.846745 Jul 02 21:08:20.512465 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1040/1984] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:19 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1463 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:20.512651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:20.513369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:20.521912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:20.530140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:20.530140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:20.530140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:20.549544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:20.550175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:20.552185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:20.577685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:20.578496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:20.579555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:20.581656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.021799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:21.035719 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49943c73-f12f-4eab-adf6-880c0531015e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.489217 Jul 02 21:08:21.047585 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1041/1985] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:20 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:21.053563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:21.054192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:21.066132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.066600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.067517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.067962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.091524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:21.104490 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62648ea6-4320-4c03-b4a4-64e55b90dbb1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1463 microversion: 2.1 time: 0.595765 Jul 02 21:08:21.107466 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 945/1986] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:20 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1463 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:21.115797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:21.119785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:21.135359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.137406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.142601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.147492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.365818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:21.375770 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1ce1559-88d3-4ffc-bb40-6d1e9fa700c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1272 microversion: 2.1 time: 0.263709 Jul 02 21:08:21.377295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 946/1987] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:21 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:21.382349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:21.389057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:21.414455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.415162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.416252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.416918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.581033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:21.582408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:21.584992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:21.585633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:21.586244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:21.696642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:21.710092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.711368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.712519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.713539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.721681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:21.730978 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6883969-79cb-4569-b55e-6cd73d3dcb9f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.681824 Jul 02 21:08:21.742777 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1042/1988] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:21 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:21.774971 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c97e153-3184-4e19-a649-a634f2031f12 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 1067 microversion: 2.1 time: 0.395974 Jul 02 21:08:21.785108 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 947/1989] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:08:21 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 1067 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 02 21:08:21.790494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:21.791382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:21.803959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.804468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:21.805300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:21.806124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.019501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0c5d2301-2de2-4d4a-84f1-e9aadac6d1a2 req-0121b3f6-85dd-4fa3-b9fe-75226fa37848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "name": "network-vif-unplugged", "status": "completed", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:22.025404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:22.030416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c5d2301-2de2-4d4a-84f1-e9aadac6d1a2 req-0121b3f6-85dd-4fa3-b9fe-75226fa37848 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.031319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0c5d2301-2de2-4d4a-84f1-e9aadac6d1a2 req-0121b3f6-85dd-4fa3-b9fe-75226fa37848 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.090674 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0c5d2301-2de2-4d4a-84f1-e9aadac6d1a2 req-0121b3f6-85dd-4fa3-b9fe-75226fa37848 service nova] Creating event network-vif-unplugged:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch2-master-1 Jul 02 21:08:22.100248 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0c5d2301-2de2-4d4a-84f1-e9aadac6d1a2 req-0121b3f6-85dd-4fa3-b9fe-75226fa37848 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087849 Jul 02 21:08:22.101958 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 948/1990] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:22.107179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:22.107805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:22.114604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.115070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.115864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.116303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.422575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:22.439562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f91174c8-0c80-4eaf-8912-56d5e833c57a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.652721 Jul 02 21:08:22.440653 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1043/1991] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:21 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:22.447292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:22.448570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:22.475273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.476131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.476990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.477427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.838833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:22.849744 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edb255c6-1d3d-4fde-b27c-4512c133a11f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.745813 Jul 02 21:08:22.858263 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 949/1992] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:22 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:22.865614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:22.866628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:22.884237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.885084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:22.886118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:22.886769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:23.174830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:23.183927 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9be3934c-1f40-4efb-b372-84067057cb12 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.741960 Jul 02 21:08:23.184626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1044/1993] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:22 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:23.370141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:23.381419 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ea7b848-ba56-4a2d-bb1f-800e0b38169d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1505 microversion: 2.1 time: 0.520580 Jul 02 21:08:23.382802 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 950/1994] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:22 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:23.457826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:23.458782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:23.466646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:23.467493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:23.468515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:23.469135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:23.875673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:23.876562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:23.889901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:23.893597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:23.895118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:23.895680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:23.997236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:24.007038 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e58a8b86-eb0b-41af-be17-2ed9dd44144d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.553154 Jul 02 21:08:24.021587 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1045/1995] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:23 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:24.169162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80fd3068-f8e2-4330-9351-a6132de1ee5d tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Action: 'create', calling method: .version_select at 0x7fabea31baf0>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:24.720681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:24.733047 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bd473a8-5fe3-48b8-b491-0b0cd01f1aea tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.861155 Jul 02 21:08:24.758198 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 951/1996] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:23 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:24.769718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:24.771035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:24.779339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:24.779808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:24.780623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:24.782397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:25.195259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:25.209846 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27c348fb-72b2-406c-87bb-029117b51660 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.448761 Jul 02 21:08:25.210710 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 952/1997] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:24 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:25.221090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:25.222092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:25.230418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:25.231558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:25.232751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:25.233381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:25.689443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:25.702618 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c3fccc7-2478-4348-95f2-7d5b2bcdbcbc tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1495 microversion: 2.1 time: 0.486660 Jul 02 21:08:25.707186 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 953/1998] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:25 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1495 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:25.727745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:25.730764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:25.742611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:25.750638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:25.751328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:25.751775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.378886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:26.388643 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-063abcf3-d7e9-4f6f-a151-bcd7659596ad tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.679610 Jul 02 21:08:26.399064 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 954/1999] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:25 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:26.404614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ef4692aa-1e77-4d92-92b6-eab872f20584 req-4b5445bf-f9b3-4f0b-ba78-972745b428ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "name": "network-vif-plugged", "status": "completed", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:26.418067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef4692aa-1e77-4d92-92b6-eab872f20584 req-4b5445bf-f9b3-4f0b-ba78-972745b428ba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.418754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef4692aa-1e77-4d92-92b6-eab872f20584 req-4b5445bf-f9b3-4f0b-ba78-972745b428ba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.435349 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ef4692aa-1e77-4d92-92b6-eab872f20584 req-4b5445bf-f9b3-4f0b-ba78-972745b428ba service nova] Creating event network-vif-plugged:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch1-master-1 Jul 02 21:08:26.441830 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ef4692aa-1e77-4d92-92b6-eab872f20584 req-4b5445bf-f9b3-4f0b-ba78-972745b428ba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041180 Jul 02 21:08:26.443118 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 955/2000] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:26.449398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5075876b-7ee3-4f0d-95e2-068449614964 req-bd95772a-d5f1-4d80-95dd-78f1e7143134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9ed4fc-927c-4e75-8a08-be711ea95c44", "tag": "e5e604d4-5c03-46cb-99bd-50c8f490e477"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:26.459064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5075876b-7ee3-4f0d-95e2-068449614964 req-bd95772a-d5f1-4d80-95dd-78f1e7143134 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.459824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5075876b-7ee3-4f0d-95e2-068449614964 req-bd95772a-d5f1-4d80-95dd-78f1e7143134 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.475515 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5075876b-7ee3-4f0d-95e2-068449614964 req-bd95772a-d5f1-4d80-95dd-78f1e7143134 service nova] Creating event network-changed:e5e604d4-5c03-46cb-99bd-50c8f490e477 for instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 on nch1-master-1 Jul 02 21:08:26.484310 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5075876b-7ee3-4f0d-95e2-068449614964 req-bd95772a-d5f1-4d80-95dd-78f1e7143134 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039117 Jul 02 21:08:26.485573 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 956/2001] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:26.493845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27ed7e98-505d-42f3-a8c8-061a73fa9726 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '.version_select at 0x7fabe491a940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:26.497222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27ed7e98-505d-42f3-a8c8-061a73fa9726 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.498207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27ed7e98-505d-42f3-a8c8-061a73fa9726 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.507263 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27ed7e98-505d-42f3-a8c8-061a73fa9726 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 400 microversion: 2.1 time: 0.019167 Jul 02 21:08:26.508535 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 957/2002] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:08:26 2022] GET /compute/v2.1/os-migrations => generated 400 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:26.514551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:26.515633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:26.524085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.524888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.525880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.526522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.820359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:26.829336 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-389d1af9-345e-452a-a139-4fa831deb408 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1510 microversion: 2.1 time: 0.319330 Jul 02 21:08:26.833440 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 958/2003] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:26 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:26.840366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:26.854672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:26.880926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.881419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:26.882298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:26.882735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:27.148939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:27.169115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:27.173683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:27.181714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-827eb142-629e-4095-9a25-a6c27d6062c3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.347116 Jul 02 21:08:27.182433 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 959/2004] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:26 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:27.198240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:27.199575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:27.205824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:27.206448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:27.207996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:27.208565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:27.214694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:27.302663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:27.500183 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2046e90-ecbc-4666-873c-dee094e0bc34 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1646 microversion: 2.1 time: 0.310442 Jul 02 21:08:27.500630 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 960/2005] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:27 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1646 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:27.507484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:27.508216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:27.522973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:27.523289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:27.526555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:27.527265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:28.210188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:28.221059 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60f17ff1-7cd9-4867-9f64-8f71f748e908 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.718908 Jul 02 21:08:28.221696 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 961/2006] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:27 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:28.233625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-967725702", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "2e05cfae-5311-414e-b03f-d5b620078b94"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:28.301773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] validate_networks() for [('2e05cfae-5311-414e-b03f-d5b620078b94', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:08:28.500973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80fd3068-f8e2-4330-9351-a6132de1ee5d tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.440976 Jul 02 21:08:28.508516 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1046/2007] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:08:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:28.509664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:28.510385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:28.522059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:28.523113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:28.524430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:28.525085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:28.803901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:28.817148 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef9fe29b-085f-4aeb-afc0-36b25e9fe957 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1487 microversion: 2.1 time: 0.312481 Jul 02 21:08:28.818037 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1047/2008] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:28 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1487 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:28.822792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:28.825037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:28.833950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:28.834384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:28.835349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:28.835778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:28.996954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:28.997452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:28.997848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:28.998261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:28.998673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:29.007941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.008447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.009254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.009890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.028367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:08:29.033815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for user 8b345a42784d4df79caab6d667117418 and project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:08:29.035280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:29.043639 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-96a5a4b2-0327-4249-af28-202467a22be3 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.224358 Jul 02 21:08:29.049055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:08:29.049779 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1048/2009] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:28 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:29.052259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:08:29.055359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-595b5564-d2a2-49dc-905c-a96332340a6f tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Calling method '.version_select at 0x7fabea2bdb80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:29.102270 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f185378-2587-4e79-95c0-fa0412bd16a9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.879380 Jul 02 21:08:29.103292 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 962/2010] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:08:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:08:29.109049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:29.109796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:29.117753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.118305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.119165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.119958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.149271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:08:29.263763 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d23e27a9-33a2-4cd7-a6a8-c6e49519a352 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 204 len: 0 microversion: 2.1 time: 0.158669 Jul 02 21:08:29.268409 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 963/2011] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:29 2022] DELETE /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:08:29.271370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5b50876-452b-444c-b340-7f3a13a0ca5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:29.272270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5b50876-452b-444c-b340-7f3a13a0ca5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:29.340565 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-595b5564-d2a2-49dc-905c-a96332340a6f tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/3bf5a50a-8023-4917-92f8-b2a0d4094f0f" status: 200 len: 142 microversion: 2.1 time: 0.289468 Jul 02 21:08:29.341970 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1049/2012] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:08:29 2022] GET /compute/v2.1/os-floating-ips/3bf5a50a-8023-4917-92f8-b2a0d4094f0f => generated 142 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:29.345789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5b50876-452b-444c-b340-7f3a13a0ca5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:29.346976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:29.347923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:29.357159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.357849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.358627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.358762 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5b50876-452b-444c-b340-7f3a13a0ca5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1210 microversion: 2.1 time: 0.092014 Jul 02 21:08:29.359353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.359657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 964/2013] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:29 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:29.364503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:29.365114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:29.374120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.374571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.375606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:29.376359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:29.646226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:29.656267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d9a9a2b-6d8f-43a3-bfe8-18d3532036f2 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.313148 Jul 02 21:08:29.657090 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1050/2014] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:29 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:29.659315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:29.662595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06c1e972-de74-4e35-b1f2-cb4decf40e34 tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Calling method '.version_select at 0x7fabea2bd0d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:29.673267 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2daf08f9-0273-45f6-8d33-8708ceee08bf tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1493 microversion: 2.1 time: 0.312297 Jul 02 21:08:29.674167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 965/2015] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:29 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1493 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:29.864489 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06c1e972-de74-4e35-b1f2-cb4decf40e34 tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.206134 Jul 02 21:08:29.865083 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1051/2016] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:08:29 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:29.877763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab497f7d-7d83-42a5-bf9e-075be9792ee9 tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Calling method '.version_select at 0x7fabe4304040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:30.061896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:30.062765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:30.072137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.072959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.073980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.074631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.383501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:30.392030 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7db41d5e-905c-444c-aba9-4030725d2c70 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.334839 Jul 02 21:08:30.401715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1052/2017] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:30 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:30.401715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:30.401715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:30.408521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.408982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.409768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.410210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.534882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:30.547848 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9cd11db6-1163-4d93-be58-a5148a664aa2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1214 microversion: 2.1 time: 0.153651 Jul 02 21:08:30.548529 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1053/2018] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:30 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:30.703635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1142250013", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": "none"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:30.776780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:30.777206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:30.777682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:30.778070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:30.778496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:30.789386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.790238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.791228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.791846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.813886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Getting quotas for project 90cdcd51251b4b8b8b58802cdbc1713c. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:08:30.821548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Getting quotas for user 8b412fbcf382468c97d7d4f688f5e5b3 and project 90cdcd51251b4b8b8b58802cdbc1713c. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:08:30.835374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:08:30.838287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: e83447dc-efc9-4cb3-bb05-f2368fbd61a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:08:30.905360 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59955a6e-57f6-454a-96b3-d80e593d265b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.355302 Jul 02 21:08:30.906342 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1054/2019] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:08:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 357 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:08:30.965127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:30.970613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:30.995094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:30.995877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:30.998541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.000109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:31.402719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:31.412481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-92079bf8-6a41-4338-a17a-b0a3e3bc3484 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.503127 Jul 02 21:08:31.415664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1055/2020] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:30 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:31.423683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:31.426743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:31.428658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab497f7d-7d83-42a5-bf9e-075be9792ee9 tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/3bf5a50a-8023-4917-92f8-b2a0d4094f0f" status: 202 len: 0 microversion: 2.1 time: 1.555999 Jul 02 21:08:31.430402 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 966/2021] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:08:29 2022] DELETE /compute/v2.1/os-floating-ips/3bf5a50a-8023-4917-92f8-b2a0d4094f0f => generated 0 bytes in 1558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:31.437047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.437907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:31.438963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.439725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:31.440537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64a456ea-7221-4156-9f62-80f34ba4f66e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:31.441570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64a456ea-7221-4156-9f62-80f34ba4f66e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: e83447dc-efc9-4cb3-bb05-f2368fbd61a3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:31.608728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64a456ea-7221-4156-9f62-80f34ba4f66e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:31.616271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64a456ea-7221-4156-9f62-80f34ba4f66e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:31.617793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64a456ea-7221-4156-9f62-80f34ba4f66e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:31.618949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64a456ea-7221-4156-9f62-80f34ba4f66e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3" status: 200 len: 1278 microversion: 2.47 time: 0.187347 Jul 02 21:08:31.619519 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 967/2022] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:31 2022] GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3 => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:31.624435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:31.625254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:31.627370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:31.636139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.636853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:31.637854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.638676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:31.659752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:31.669331 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-867a5254-a2cf-4188-bf34-58794bb82681 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 200 len: 1493 microversion: 2.1 time: 0.249688 Jul 02 21:08:31.670910 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1056/2023] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:31 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 1493 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:31.686392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-21f0587c-8220-4f89-b4fb-6a8c7f88fe6b tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Action: 'create', calling method: .version_select at 0x7fabd7ede9d0>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:31.943370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:31.964331 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63d2eaa8-cec4-4bba-aef6-6c68d269947b tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.334052 Jul 02 21:08:31.965551 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 968/2024] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:31 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:31.971633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:31.972408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:31.979897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.980471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:31.981319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:31.981956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:32.061817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:32.072823 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ef1f5ca-e731-4d45-baf8-e800266f7f0c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1268 microversion: 2.1 time: 0.105922 Jul 02 21:08:32.073534 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 969/2025] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:31 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1268 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:32.085349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1629175179", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": "none"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:32.160900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:32.161487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:32.162355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:32.162919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:32.163634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:32.178418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:32.179257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:32.180638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:32.182475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:32.207072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Getting quotas for project 90cdcd51251b4b8b8b58802cdbc1713c. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:08:32.226266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Getting quotas for user 8b412fbcf382468c97d7d4f688f5e5b3 and project 90cdcd51251b4b8b8b58802cdbc1713c. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:08:32.240360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:08:32.242825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:08:32.303636 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f54ef3c6-b88d-4db3-9ab9-f09e6b740b7b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.223831 Jul 02 21:08:32.304847 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 970/2026] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 228 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:08:32.310789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b72de476-9c34-4367-916c-e2e6f7f3a838"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:32.312304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:32.320462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:32.321265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:32.322300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:32.322949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:32.793253 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6dcd0d70-8645-4b86-879e-fb5ec412fa23 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "POST /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.483123 Jul 02 21:08:32.799740 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 971/2027] 10.222.0.43 () {60 vars in 1322 bytes} [Sat Jul 2 21:08:32 2022] POST /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:32.805479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b1c37717-5140-4d9e-bd6b-d09f492229de req-8e897c95-f146-44b4-a0c5-a1a3dd2c520a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e924300-c50c-44b5-9a78-67a3904f0dc7", "name": "network-vif-deleted", "tag": "f27cc745-bafe-4a5e-92cc-48f64e6214c6"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:32.847210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b1c37717-5140-4d9e-bd6b-d09f492229de req-8e897c95-f146-44b4-a0c5-a1a3dd2c520a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:32.849458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b1c37717-5140-4d9e-bd6b-d09f492229de req-8e897c95-f146-44b4-a0c5-a1a3dd2c520a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:32.910950 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b1c37717-5140-4d9e-bd6b-d09f492229de req-8e897c95-f146-44b4-a0c5-a1a3dd2c520a service nova] Creating event network-vif-deleted:f27cc745-bafe-4a5e-92cc-48f64e6214c6 for instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 on nch2-master-1 Jul 02 21:08:32.927266 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b1c37717-5140-4d9e-bd6b-d09f492229de req-8e897c95-f146-44b4-a0c5-a1a3dd2c520a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125755 Jul 02 21:08:32.929658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 972/2028] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:32.944162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26180824-1383-4828-9f19-3d66ac0cb9d5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:32.948446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26180824-1383-4828-9f19-3d66ac0cb9d5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:33.051944 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26180824-1383-4828-9f19-3d66ac0cb9d5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "PUT /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 992 microversion: 2.47 time: 0.120927 Jul 02 21:08:33.052841 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 973/2029] 10.222.0.43 () {62 vars in 1296 bytes} [Sat Jul 2 21:08:32 2022] PUT /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 992 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:08:33.057858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:33.058734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:33.086974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:33.090451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:33.091814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:33.093081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:33.644429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:33.669501 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11298206-6eec-41b8-8f98-0e82b7053113 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.615348 Jul 02 21:08:33.670146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 974/2030] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:33 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:33.689989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:33.690691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:33.707702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:33.708177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:33.709154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:33.709751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:33.731125 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 HTTP/1.1 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9e924300-c50c-44b5-9a78-67a3904f0dc7'} Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:33.733151 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:33.737862 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac9e7fd0-bc89-4240-9857-025b797cfb02 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 404 len: 111 microversion: 2.1 time: 0.061228 Jul 02 21:08:33.740898 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 975/2031] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:33 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:33.755315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:33.755931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:33.763203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:33.763651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:33.764473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:33.764908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:34.042991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:34.055353 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8a4cb7a-124f-44cc-bd81-e993366b165e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.305647 Jul 02 21:08:34.061007 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 976/2032] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:33 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:34.068493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:34.072416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:34.084602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:34.092856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:34.093993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:34.094623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:34.117342 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-21f0587c-8220-4f89-b4fb-6a8c7f88fe6b tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.444643 Jul 02 21:08:34.117945 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1057/2033] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:08:31 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:34.129845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:34.130467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:34.151982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:34.154690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:34.156644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:34.157102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:34.194610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:34.209800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:34.212099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:34.213484 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c99c4d6e-d708-46ac-96f2-c3ee21973e31 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1282 microversion: 2.47 time: 0.150989 Jul 02 21:08:34.214542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 977/2034] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:34 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:34.219416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1214100166", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e2b21e10-2023-4aa0-9b39-edac66a9d97f"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:34.269518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:34.294692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] validate_networks() for [('e2b21e10-2023-4aa0-9b39-edac66a9d97f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:08:34.485967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:34.500989 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6c6249f2-d9d8-4924-a8f0-ca05b0b48cb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1310 microversion: 2.1 time: 0.376146 Jul 02 21:08:34.501589 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1058/2035] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:34 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1310 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:34.515422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d92ab8e7-3199-4ffa-b088-a6e642e66ba5 tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Calling method '.version_select at 0x7fabe46c4700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:35.280015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:35.281384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:35.282045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:35.282621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:35.283309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:35.295178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.296290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.297291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.297908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.319094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:08:35.326781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Getting quotas for user 3fefe83ec0664f6188af74ea4b5c1291 and project 8576652bfe8441e0985297d016a1ca9b. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:08:35.343841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:08:35.346599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:08:35.401909 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37882136-8d82-40a8-907b-236cbb3ce4f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185586 Jul 02 21:08:35.403327 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 978/2036] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:08:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:08:35.408513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:35.409417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:35.416685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.417461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.418672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.419325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.664612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:35.672993 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d41f9492-c72b-4098-8d6c-6389fd9cd2cc tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.268482 Jul 02 21:08:35.673657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 979/2037] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:35 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:35.678449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cac68a2e-4ceb-4d85-a13e-ff49ff6a9fd9 req-c4b100ec-a221-4527-8a91-b3ddbf67bcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0", "tag": "2173dcb0-34b1-4968-b27a-b806d4af1db4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:35.687960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cac68a2e-4ceb-4d85-a13e-ff49ff6a9fd9 req-c4b100ec-a221-4527-8a91-b3ddbf67bcf0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.688660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cac68a2e-4ceb-4d85-a13e-ff49ff6a9fd9 req-c4b100ec-a221-4527-8a91-b3ddbf67bcf0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.700062 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cac68a2e-4ceb-4d85-a13e-ff49ff6a9fd9 req-c4b100ec-a221-4527-8a91-b3ddbf67bcf0 service nova] Creating event network-changed:2173dcb0-34b1-4968-b27a-b806d4af1db4 for instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 on nch2-master-1 Jul 02 21:08:35.705528 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cac68a2e-4ceb-4d85-a13e-ff49ff6a9fd9 req-c4b100ec-a221-4527-8a91-b3ddbf67bcf0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030516 Jul 02 21:08:35.706546 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 980/2038] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:35.721731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:35.722773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:35.730884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.731357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.732160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.732638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.960001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:35.963703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:35.968670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd0afa62-6cb2-49ec-b9af-8d398b54e9c9 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.260990 Jul 02 21:08:35.969258 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 981/2039] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:35 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:35.973866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:35.974145 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d92ab8e7-3199-4ffa-b088-a6e642e66ba5 tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17" status: 202 len: 0 microversion: 2.1 time: 1.462406 Jul 02 21:08:35.974683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:35.975420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1059/2040] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:08:34 2022] DELETE /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17 => generated 0 bytes in 1473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:35.980814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:35.981803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:35.983640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.984113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.984924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.985351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.993327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.993787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:35.994544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:35.995168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.058326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:36.066824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:36.068426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:36.069576 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a5bcf2f-824d-48be-8435-46632802245e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1336 microversion: 2.47 time: 0.099390 Jul 02 21:08:36.070154 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 982/2041] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:35 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:36.074768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:36.075369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:36.081916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.082592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.083573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.084215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.084613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:36.098614 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0570df83-b055-4f71-a9e9-c641d8070134 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1219 microversion: 2.1 time: 0.121750 Jul 02 21:08:36.104252 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1060/2042] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:35 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:36.108816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ee337ec-3370-4f3a-ae4d-bfa55b3321ea tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Calling method '.version_select at 0x7fabe473c0d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:36.158087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-6ee337ec-3370-4f3a-ae4d-bfa55b3321ea tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 97d6dc24-db37-4733-aed6-8d014810da17 could not be found", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:08:36.158813 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-6ee337ec-3370-4f3a-ae4d-bfa55b3321ea tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] HTTP exception thrown: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ee337ec-3370-4f3a-ae4d-bfa55b3321ea tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Request method failure captured: Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17 HTTP/1.1 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLPHYeQ7QmDBCNXHMjp4MUWQv5ufgTyrkMtG3abThLk8SlvS65d0MrssYczRJO6IBXA7tJ2t62obG3XOilfHoA9l9dXsHafhnk5sBxLecu106PW4sa1WZkrvG76va9GSRsQruZbob4s8L_Jbh6sGHKKFCK0NhVHJ8Q-Q9m9JQfuhjK0 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c8d4f80c124f406c8b97e6f9f77b2249 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FloatingIPsTestJSON-1858973860 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8d4f80c124f406c8b97e6f9f77b2249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8d4f80c124f406c8b97e6f9f77b2249", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8d4f80c124f406c8b97e6f9f77b2249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8d4f80c124f406c8b97e6f9f77b2249"}]}] Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FloatingIPsTestJSON-1858973860 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c8d4f80c124f406c8b97e6f9f77b2249 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1858973860 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FloatingIPsTestJSON-1858973860-project Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 363483eb93ab469384ea6d81ee1c88cb Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FloatingIPsTestJSON-1858973860-project Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: exception: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '97d6dc24-db37-4733-aed6-8d014810da17'} Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 97d6dc24-db37-4733-aed6-8d014810da17 could not be found Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-923232c0-8a51-49f0-bf63-a5942692f26e'] Jul 02 21:08:36.161284 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17. Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ee337ec-3370-4f3a-ae4d-bfa55b3321ea tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Returning 404 to user: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ee337ec-3370-4f3a-ae4d-bfa55b3321ea tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17" status: 404 len: 111 microversion: 2.1 time: 0.058031 Jul 02 21:08:36.168493 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1061/2043] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:08:36 2022] GET /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:36.173936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e8d9e18-f8b7-4e30-ae15-a44a8ffc1b2c tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Calling method '.version_select at 0x7fabea32d1f0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:36.232228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-7e8d9e18-f8b7-4e30-ae15-a44a8ffc1b2c tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 97d6dc24-db37-4733-aed6-8d014810da17 could not be found", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:08:36.233099 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-7e8d9e18-f8b7-4e30-ae15-a44a8ffc1b2c tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] HTTP exception thrown: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e8d9e18-f8b7-4e30-ae15-a44a8ffc1b2c tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Request method failure captured: Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17 HTTP/1.1 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLPHYeQ7QmDBCNXHMjp4MUWQv5ufgTyrkMtG3abThLk8SlvS65d0MrssYczRJO6IBXA7tJ2t62obG3XOilfHoA9l9dXsHafhnk5sBxLecu106PW4sa1WZkrvG76va9GSRsQruZbob4s8L_Jbh6sGHKKFCK0NhVHJ8Q-Q9m9JQfuhjK0 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c8d4f80c124f406c8b97e6f9f77b2249 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FloatingIPsTestJSON-1858973860 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8d4f80c124f406c8b97e6f9f77b2249"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c8d4f80c124f406c8b97e6f9f77b2249", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c8d4f80c124f406c8b97e6f9f77b2249"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c8d4f80c124f406c8b97e6f9f77b2249"}]}] Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FloatingIPsTestJSON-1858973860 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c8d4f80c124f406c8b97e6f9f77b2249 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1858973860 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FloatingIPsTestJSON-1858973860-project Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 363483eb93ab469384ea6d81ee1c88cb Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FloatingIPsTestJSON-1858973860-project Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: exception: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '97d6dc24-db37-4733-aed6-8d014810da17'} Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 97d6dc24-db37-4733-aed6-8d014810da17 could not be found Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-855f390d-8cae-426c-8121-464c9b8d53af'] Jul 02 21:08:36.236357 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17. Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e8d9e18-f8b7-4e30-ae15-a44a8ffc1b2c tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] Returning 404 to user: Floating IP not found for ID 97d6dc24-db37-4733-aed6-8d014810da17 {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7e8d9e18-f8b7-4e30-ae15-a44a8ffc1b2c tempest-FloatingIPsTestJSON-1858973860 tempest-FloatingIPsTestJSON-1858973860-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17" status: 404 len: 111 microversion: 2.1 time: 0.069601 Jul 02 21:08:36.241440 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1062/2044] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:08:36 2022] DELETE /compute/v2.1/os-floating-ips/97d6dc24-db37-4733-aed6-8d014810da17 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:36.364946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:36.372733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7085f7be-ba8d-4432-aaae-7f445df45398 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1310 microversion: 2.1 time: 0.301474 Jul 02 21:08:36.373541 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 983/2045] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:36 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1310 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:36.690293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:36.690945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:36.697328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.698008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.698969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.699565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.741067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cfbf8dd7-dcb2-47a8-a46a-93a6178bbfdf req-3856b09d-1f8e-4347-b7ef-13c239e53495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ed4fc-927c-4e75-8a08-be711ea95c44", "name": "network-vif-plugged", "status": "completed", "tag": "e5e604d4-5c03-46cb-99bd-50c8f490e477"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:36.751374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cfbf8dd7-dcb2-47a8-a46a-93a6178bbfdf req-3856b09d-1f8e-4347-b7ef-13c239e53495 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.752270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cfbf8dd7-dcb2-47a8-a46a-93a6178bbfdf req-3856b09d-1f8e-4347-b7ef-13c239e53495 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.765722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cfbf8dd7-dcb2-47a8-a46a-93a6178bbfdf req-3856b09d-1f8e-4347-b7ef-13c239e53495 service nova] Creating event network-vif-plugged:e5e604d4-5c03-46cb-99bd-50c8f490e477 for instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 on nch1-master-1 Jul 02 21:08:36.770973 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cfbf8dd7-dcb2-47a8-a46a-93a6178bbfdf req-3856b09d-1f8e-4347-b7ef-13c239e53495 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033667 Jul 02 21:08:36.771583 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 984/2046] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:36.955092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:36.962904 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0234217-dbd8-4777-a9b1-e4c3660a5d55 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.276994 Jul 02 21:08:36.963626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1063/2047] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:36 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:36.986789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:36.987500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:36.994417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.994885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:36.995668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:36.996212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.088928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:37.089653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:37.096763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.097009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.097798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.098216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.188241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:37.196890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:37.198543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:37.199685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9c5c9f9-4e94-49bc-8d72-47348b04b522 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1336 microversion: 2.47 time: 0.114991 Jul 02 21:08:37.208178 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1064/2048] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:37 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:37.208178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:37.208178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:37.212748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.213206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.214338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.214936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.240534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:37.253850 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-091ea0b2-f685-430c-b178-86d821330eed tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.271294 Jul 02 21:08:37.254796 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 985/2049] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:36 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:37.293157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:37.301704 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e6e29bcc-6e50-4213-9f82-1cce676e119a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1219 microversion: 2.1 time: 0.099894 Jul 02 21:08:37.304114 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1065/2050] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:37 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:37.310349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:37.311393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:37.317738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.318234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.319059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.319558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.348912 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3e4768f-2f2b-45ac-b3c5-996910b5ed1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042406 Jul 02 21:08:37.349546 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 986/2051] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:08:37 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:37.359569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:37.360181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:37.367543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.368282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.369204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.369642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.389906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:37.390698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:37.396915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.397362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.398125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.398583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.575578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lazy-loading 'services' on Instance uuid 2a52e580-65f0-4113-bad0-009411076964 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:37.707543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:37.716887 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea0627f4-c6ab-43c4-861c-35692be6d7cd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1310 microversion: 2.1 time: 0.330868 Jul 02 21:08:37.721794 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 987/2052] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:37 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1310 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:37.762278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6bb50798-a5bb-4152-a580-f3394a56b757 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments/b72de476-9c34-4367-916c-e2e6f7f3a838" status: 202 len: 0 microversion: 2.1 time: 0.406291 Jul 02 21:08:37.763589 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1066/2053] 10.222.0.43 () {58 vars in 1415 bytes} [Sat Jul 2 21:08:37 2022] DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments/b72de476-9c34-4367-916c-e2e6f7f3a838 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:37.980709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:37.981531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:37.988431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.988999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:37.989915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:37.990435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.218839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:38.219562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:38.233852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.234710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.235668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.236163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.250671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.269820 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7fe57db1-9a12-4514-a937-09800ef8f481 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.293754 Jul 02 21:08:38.277264 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 988/2054] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:37 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:38.288559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:38.289418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:38.310101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.310986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.312738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.316384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.327112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.337467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.339974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.341364 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9a8f5419-f5fb-4310-bdc0-8c165d3d8082 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1336 microversion: 2.47 time: 0.127075 Jul 02 21:08:38.342409 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1067/2055] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:38 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:38.348054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:38.348917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:38.363844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.365443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.366474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.366985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.463688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.473436 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3c8f19e-1e7f-44cc-9b34-898789147efb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1267 microversion: 2.1 time: 0.129803 Jul 02 21:08:38.474618 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1068/2056] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:38 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:38.541052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.553889 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5cd74f53-01a0-4f76-be76-7b30c4bbe616 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1314 microversion: 2.1 time: 0.275249 Jul 02 21:08:38.563406 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 989/2057] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:38 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:38.738306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:38.739374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:38.746429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.747144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.748237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:38.748903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:38.949369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:38.957580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f659c29e-d2f8-44da-a29c-481d6ed891a8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1310 microversion: 2.1 time: 0.223211 Jul 02 21:08:38.958166 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1069/2058] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:38 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1310 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:39.294161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:39.295191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.312099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.313023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.314075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.315273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.360201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:39.360819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.376314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.377076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.378166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.390838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.511967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:39.520633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:39.522129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:39.523555 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cbfca4ba-60d9-4fe6-98ee-dc3dab13e71b tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1357 microversion: 2.47 time: 0.167754 Jul 02 21:08:39.524135 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1070/2059] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:39 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:39.528943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:39.529838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.536388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.537499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.538370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.538988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.550159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:39.561598 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98725cf5-2695-42e3-b7e5-3542dfb5dfcd tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.276963 Jul 02 21:08:39.562578 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 990/2060] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:39 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:39.567707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:39.569254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.575549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.576241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.577024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.577524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.609616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:39.617900 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c639224-b1f3-42ec-b23d-0c90bb313897 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1273 microversion: 2.1 time: 0.092471 Jul 02 21:08:39.618541 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1071/2061] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:39 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:39.623565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:39.624342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.631492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.631953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.633003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.633605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.700834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:39.701259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:39.701732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:39.702412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:39.703003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:39.775861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.783681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.785058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.786072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.786732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.805647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:39.817488 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5733ebfb-bfed-46ae-b8f6-e94a11ed01ff tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1464 microversion: 2.1 time: 0.196539 Jul 02 21:08:39.830608 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1072/2062] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:39 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1464 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:39.844513 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e5d6086-1cea-408c-97e6-5ab3be95c444 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "POST /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d/action" status: 202 len: 1079 microversion: 2.47 time: 0.280648 Jul 02 21:08:39.845286 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 991/2063] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:08:39 2022] POST /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d/action => generated 1079 bytes in 282 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 02 21:08:39.865226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:39.866140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:39.893181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.895171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:39.896113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:39.896584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.037598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9023dd9b-66ef-48c5-ab45-842bf4ff5f15 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Calling method '.version_select at 0x7fabea32d820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.039753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:40.051316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:40.052966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:40.054906 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2c3aed9-278c-40d3-88b4-c46ac113f6d7 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.197350 Jul 02 21:08:40.056098 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 992/2064] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:39 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:40.058551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9023dd9b-66ef-48c5-ab45-842bf4ff5f15 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.059003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9023dd9b-66ef-48c5-ab45-842bf4ff5f15 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.070620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.071608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.085909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.086765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.087829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.088520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.097216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9023dd9b-66ef-48c5-ab45-842bf4ff5f15 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.097696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9023dd9b-66ef-48c5-ab45-842bf4ff5f15 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.123568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9023dd9b-66ef-48c5-ab45-842bf4ff5f15 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/7cd138b817eb422591e9bc94163efadd?start=2022-07-01T21%3A08%3A39.827700&end=2022-07-03T21%3A08%3A39.827700" status: 200 len: 695 microversion: 2.1 time: 0.288329 Jul 02 21:08:40.132716 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1073/2065] 10.222.0.43 () {58 vars in 1411 bytes} [Sat Jul 2 21:08:39 2022] GET /compute/v2.1/os-simple-tenant-usage/7cd138b817eb422591e9bc94163efadd?start=2022-07-01T21%3A08%3A39.827700&end=2022-07-03T21%3A08%3A39.827700 => generated 695 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:08:40.141595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.142566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.158494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.159294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.160393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.161067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.216793 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-88a2e391-788e-495a-9ae4-20c61f6faf4d tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079477 Jul 02 21:08:40.217474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1074/2066] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:08:40.231140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9c2902a-c578-4cec-8e23-a4c57f38db11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '.version_select at 0x7fabea2b1310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.244746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c2902a-c578-4cec-8e23-a4c57f38db11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.245209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c2902a-c578-4cec-8e23-a4c57f38db11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.258533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c2902a-c578-4cec-8e23-a4c57f38db11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.259012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9c2902a-c578-4cec-8e23-a4c57f38db11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.279344 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9c2902a-c578-4cec-8e23-a4c57f38db11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage/7cd138b817eb422591e9bc94163efadd?start=2022-07-01T21%3A08%3A39.827700&end=2022-07-03T21%3A08%3A39.827700" status: 200 len: 695 microversion: 2.1 time: 0.059378 Jul 02 21:08:40.287223 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1075/2067] 10.222.0.43 () {58 vars in 1411 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/os-simple-tenant-usage/7cd138b817eb422591e9bc94163efadd?start=2022-07-01T21%3A08%3A39.827700&end=2022-07-03T21%3A08%3A39.827700 => generated 695 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:40.310034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e2b4a52d-e0b2-4679-8102-ebb94d75ac7d req-fe2401cd-412d-473d-88aa-656576f6cffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0", "name": "network-vif-plugged", "status": "completed", "tag": "2173dcb0-34b1-4968-b27a-b806d4af1db4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:40.328158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e2b4a52d-e0b2-4679-8102-ebb94d75ac7d req-fe2401cd-412d-473d-88aa-656576f6cffd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.328798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e2b4a52d-e0b2-4679-8102-ebb94d75ac7d req-fe2401cd-412d-473d-88aa-656576f6cffd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.389641 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e2b4a52d-e0b2-4679-8102-ebb94d75ac7d req-fe2401cd-412d-473d-88aa-656576f6cffd service nova] Creating event network-vif-plugged:2173dcb0-34b1-4968-b27a-b806d4af1db4 for instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 on nch2-master-1 Jul 02 21:08:40.402673 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e2b4a52d-e0b2-4679-8102-ebb94d75ac7d req-fe2401cd-412d-473d-88aa-656576f6cffd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103242 Jul 02 21:08:40.403992 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1076/2068] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:40.412884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e4373c9-a56d-44da-82b4-235d1d8eefc9 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Calling method '.version_select at 0x7fabea2b11f0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.415337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:40.424897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c272cc22-324e-47b9-ad43-63bca61b811d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1310 microversion: 2.1 time: 0.367375 Jul 02 21:08:40.425374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e4373c9-a56d-44da-82b4-235d1d8eefc9 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.426018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e4373c9-a56d-44da-82b4-235d1d8eefc9 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.431749 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 993/2069] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1310 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:40.437019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.442903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.451597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.452443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.453532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.453806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e4373c9-a56d-44da-82b4-235d1d8eefc9 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.454257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e4373c9-a56d-44da-82b4-235d1d8eefc9 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.454726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.496519 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be5e717a-7951-4d11-bc0d-5601bdcd0208 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063497 Jul 02 21:08:40.497809 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 994/2070] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:08:40.572101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.573384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.586813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.587621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.588379 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1e4373c9-a56d-44da-82b4-235d1d8eefc9 tempest-TenantUsagesTestJSON-713252012 tempest-TenantUsagesTestJSON-713252012-project-admin] 10.222.0.43 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-01T21%3A08%3A39.827700&end=2022-07-03T21%3A08%3A39.827700&detailed=1" status: 200 len: 25173 microversion: 2.1 time: 0.182409 Jul 02 21:08:40.588849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.589392 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1077/2071] 10.222.0.43 () {58 vars in 1334 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-01T21%3A08%3A39.827700&end=2022-07-03T21%3A08%3A39.827700&detailed=1 => generated 25173 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:08:40.594324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.595056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.602498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.616856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.617553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.618669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.619117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.647277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:08:40.721087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:40.772385 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27edc554-4a53-4fcc-ae66-fb8eab668095 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 204 len: 0 microversion: 2.1 time: 0.203853 Jul 02 21:08:40.773165 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 995/2072] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:40 2022] DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:08:40.785579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.787166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.794361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:40.796741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.797548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.798071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:40.798363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.799001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.810932 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4fc7d2f8-2ddf-4176-8986-68b6fc0ec1df tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.220150 Jul 02 21:08:40.817539 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1078/2073] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:40.825359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:40.826481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:40.863715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:08:40.864366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:40.868172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.870230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.873570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:40.874253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:40.997931 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acfc7e2b-bcbb-4acb-a281-cb36c3324466 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 204 len: 0 microversion: 2.1 time: 0.221743 Jul 02 21:08:40.999084 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 996/2074] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:40 2022] DELETE /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:08:41.006626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:41.007518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:41.019002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.019637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.020582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.021137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.110324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:41.119263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-425c5f51-e27b-482e-b1eb-43f38a8d4421 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.299660 Jul 02 21:08:41.120611 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1079/2075] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:41.126366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:41.127307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:41.135952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.136528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.138011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.138812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.168346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:41.730670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:41.739280 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c98071a-bf7d-44ed-bb61-7b85f728f65f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1679 microversion: 2.1 time: 0.738912 Jul 02 21:08:41.749161 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 997/2076] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:40 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1679 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:41.749161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:41.749161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:41.761995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.762453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.763261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.763727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.773426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:41.789477 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a82f3568-ab83-4284-9801-ce82538eda11 tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1470 microversion: 2.1 time: 0.666895 Jul 02 21:08:41.790721 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1080/2077] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:41 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1470 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:41.803178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:41.804082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:41.817066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.818475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.819440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.820068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.902723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:41.912128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:41.913770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:41.915074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9d9ee7e-fe2f-435a-ab0e-5965da1dae88 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.173658 Jul 02 21:08:41.916650 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 998/2078] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:41 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:41.924034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:41.924797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:41.933650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.934215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:41.935725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:41.936306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.212616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:42.225479 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3bb4f439-9ca6-4f95-a10c-eab087e06e46 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1310 microversion: 2.1 time: 0.433147 Jul 02 21:08:42.243751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:42.250094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d7e853d-c034-43da-a49e-cc1d090b3e57 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.332132 Jul 02 21:08:42.250897 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 999/2079] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:41 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:42.255061 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1081/2080] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:41 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1310 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:42.287643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:42.292101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-25b7cc30-1270-40f5-8c9f-fbbcc353f37e req-a690a62c-034f-410f-bb8e-08f755754d65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e272da6-a951-495d-9da5-67cdd4dc16a2", "tag": "b8939438-c903-4d69-9051-69a74ad14f78"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:42.293775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:42.319188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.319555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.320375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.320811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.328190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25b7cc30-1270-40f5-8c9f-fbbcc353f37e req-a690a62c-034f-410f-bb8e-08f755754d65 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.329249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-25b7cc30-1270-40f5-8c9f-fbbcc353f37e req-a690a62c-034f-410f-bb8e-08f755754d65 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.360377 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-25b7cc30-1270-40f5-8c9f-fbbcc353f37e req-a690a62c-034f-410f-bb8e-08f755754d65 service nova] Creating event network-changed:b8939438-c903-4d69-9051-69a74ad14f78 for instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 on nch2-master-1 Jul 02 21:08:42.367189 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-25b7cc30-1270-40f5-8c9f-fbbcc353f37e req-a690a62c-034f-410f-bb8e-08f755754d65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115309 Jul 02 21:08:42.368141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1000/2081] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:42.534732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:42.544010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe173de7-6c62-46c8-a85d-adaf1c08f483 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.287931 Jul 02 21:08:42.544982 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1082/2082] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:42 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:42.757780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:42.758553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:42.765599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.765913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.766704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.767162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.807332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:42.807959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:42.816010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.816644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.817460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:42.817901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:42.982091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:42.990252 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b7f8d75-3da0-454c-ae8c-306d34008214 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1679 microversion: 2.1 time: 0.236959 Jul 02 21:08:42.991407 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1001/2083] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:42 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:42.996545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:42.997423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.005060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.005647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.006618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.007134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.013969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.023189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6575bd3f-554c-497d-8ec8-77a3a8b5ac0c tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1470 microversion: 2.1 time: 0.219775 Jul 02 21:08:43.024002 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1083/2084] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:42 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:43.080637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.088983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.090736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.091926 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-91ddeec5-c4fe-4bb4-a66f-152d62ab12b1 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.099503 Jul 02 21:08:43.103156 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1002/2085] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:42 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:43.243748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:43.244693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.252983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.253503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.254487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.255073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.267016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:43.267650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.274777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.275236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.276686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.277133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.467238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.473933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.476284 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32c672d6-7e70-4e3a-8f66-8081111e9564 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1493 microversion: 2.1 time: 0.237181 Jul 02 21:08:43.477214 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1084/2086] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:43 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:43.491997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d07ed420-9a4d-4e38-be1a-c9a79fec7b11 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.228779 Jul 02 21:08:43.492706 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1003/2087] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:43 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:43.494504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:43.495415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.502621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.503084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.503916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.504374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.563239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:43.564348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.572789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.573562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.574724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.575435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.650432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e6841a6-d9e0-4ccf-ba02-af758807d46e tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1644 microversion: 2.1 time: 0.160486 Jul 02 21:08:43.651517 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1085/2088] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:43 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1644 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:43.684897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:43.685983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.699968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.700518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.701547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.702058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.797224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:43.807959 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5011224-b091-420f-9b12-0cf0bcac3206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.249916 Jul 02 21:08:43.808929 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1004/2089] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:43 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:43.878398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94ec810c-921b-4c43-9521-e1ff535cb083 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1644 microversion: 2.1 time: 0.212389 Jul 02 21:08:43.879511 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1086/2090] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:43 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1644 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:43.894649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ccf6b542-5035-447e-bf0f-02ed7c7cf4b1 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:43.896406 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:08:43.896406 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:08:43.897963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf6b542-5035-447e-bf0f-02ed7c7cf4b1 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.898612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf6b542-5035-447e-bf0f-02ed7c7cf4b1 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.899634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf6b542-5035-447e-bf0f-02ed7c7cf4b1 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.900091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ccf6b542-5035-447e-bf0f-02ed7c7cf4b1 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.926252 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ccf6b542-5035-447e-bf0f-02ed7c7cf4b1 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035202 Jul 02 21:08:43.932663 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1005/2091] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:08:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:43.938837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:43.939551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:43.949202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.951714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:43.952697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:43.953386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.013343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:44.014989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:44.024958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.025758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.026177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.026612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.054482 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce8b5b90-eb5f-4bcc-a4fa-bba38dd34dd0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0/action" status: 202 len: 0 microversion: 2.1 time: 0.120165 Jul 02 21:08:44.057465 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1087/2092] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:08:43 2022] POST /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:44.074649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:44.078030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:44.101517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.102001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.102822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.103280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.325074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:44.345099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7904a9de-09df-4cc5-83d7-93867a9e54fe tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1679 microversion: 2.1 time: 0.341232 Jul 02 21:08:44.345700 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1006/2093] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:44 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1679 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:44.350558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:44.351317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:44.371605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.372099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.372974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.373794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.383512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:44.392661 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e84bea66-c2a8-4099-837e-07eb5d70730f tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1470 microversion: 2.1 time: 0.330513 Jul 02 21:08:44.400945 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1088/2094] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:44 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:44.406397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:44.410139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:44.425995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.426558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.427407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.427851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.560811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:44.575756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:44.577862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:44.579070 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b929d38c-4ba4-416a-be46-b2dc3297971d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.176735 Jul 02 21:08:44.588267 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1089/2095] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:44 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:44.599224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:44.599898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:44.611098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.611556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.612713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.613589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.726973 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf2ce819-aa7b-49eb-8a41-43686e87a430 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1629 microversion: 2.1 time: 0.380182 Jul 02 21:08:44.731164 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1007/2096] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:44 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1629 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:44.750163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:44.751754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:44.763432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.763890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.764743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:44.768793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:44.804836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lazy-loading 'flavor' on Instance uuid 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:44.819023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Going to try to live migrate instance to nch1-master-1 {{(pid=131044) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:08:44.997688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:45.012671 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d05aca44-67f3-4efb-83f5-3dbdb27c4be3 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.422432 Jul 02 21:08:45.023088 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1090/2097] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:44 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:45.027953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:45.028568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:45.030642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:45.038970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.039832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.040987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.041589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.335572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=22 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:45.398164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:45.418752 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8152e307-a676-486e-b85f-eb91b778df80 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.392223 Jul 02 21:08:45.419778 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1091/2098] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:45 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:45.431880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-809b2f04-9d60-456f-a9d5-b0af58f6b19c req-4cb033b0-a0ca-4998-aa80-374209e1c626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9ed4fc-927c-4e75-8a08-be711ea95c44", "name": "network-vif-deleted", "tag": "e5e604d4-5c03-46cb-99bd-50c8f490e477"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:45.444877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-809b2f04-9d60-456f-a9d5-b0af58f6b19c req-4cb033b0-a0ca-4998-aa80-374209e1c626 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.447121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-809b2f04-9d60-456f-a9d5-b0af58f6b19c req-4cb033b0-a0ca-4998-aa80-374209e1c626 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.463395 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-809b2f04-9d60-456f-a9d5-b0af58f6b19c req-4cb033b0-a0ca-4998-aa80-374209e1c626 service nova] Creating event network-vif-deleted:e5e604d4-5c03-46cb-99bd-50c8f490e477 for instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 on nch1-master-1 Jul 02 21:08:45.469382 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-809b2f04-9d60-456f-a9d5-b0af58f6b19c req-4cb033b0-a0ca-4998-aa80-374209e1c626 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042066 Jul 02 21:08:45.470259 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1092/2099] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:45.477216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:45.478692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:45.487142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.487970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.489087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.489832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.789942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:45.814385 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-659a5d5a-1f40-40a6-a0f7-4e4910531f16 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1679 microversion: 2.1 time: 0.342618 Jul 02 21:08:45.820587 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1093/2100] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:45 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:45.838335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:45.841173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:45.858569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.862249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.864020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.866141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.907410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:45.908415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:45.909159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lazy-loading 'fault' on Instance uuid 8d9ed4fc-927c-4e75-8a08-be711ea95c44 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:46.041897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75ae0c662e20465db6b854244a0a61f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cd138b817eb422591e9bc94163efadd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:46.051789 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20af06e1-495a-4ca4-830a-c3040bb598ca tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 200 len: 1304 microversion: 2.1 time: 0.226592 Jul 02 21:08:46.052739 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1094/2101] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:45 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:46.059635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:46.060611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:46.070778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:46.072675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:46.073780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:46.074297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:46.253800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:46.269944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:46.271930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:46.274682 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e37e6329-8615-4cb4-8c9f-ea262b5d1951 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.220712 Jul 02 21:08:46.275444 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1095/2102] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:46 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:46.293349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:46.294878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:46.305065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:46.305926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:46.306917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:46.307933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:46.358847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:46.718979 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bad2346-b7da-4d87-a20a-215fecae18a0 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0/action" status: 202 len: 0 microversion: 2.1 time: 1.972622 Jul 02 21:08:46.720003 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1008/2103] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:08:44 2022] POST /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0/action => generated 0 bytes in 1975 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:46.726470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:46.727599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:46.741227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:46.742043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:46.743107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:46.743760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.225741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.239907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.243624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:47.260978 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6a2b9e32-013b-4ff5-8ac2-cec50730c841 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.971059 Jul 02 21:08:47.261696 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1096/2104] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:46 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:47.267465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:47.267965 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78b2c4e3-9ad5-4fb9-a1e0-9725b1b18d91 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.534730 Jul 02 21:08:47.269139 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1009/2105] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:46 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:47.276284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:47.282223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:47.289754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:47.299440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.299440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.300148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.300728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.307458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.313824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.316831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.317291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.383548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.383997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.384481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lazy-loading 'fault' on Instance uuid 2a52e580-65f0-4113-bad0-009411076964 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:47.477153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '097020096c1c4ff2b67800be67cd708a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '426d63ca5cfa48e19a7156d1b848447e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.486410 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b274c2e5-5dab-4d72-8429-ad4f1309a098 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 200 len: 1331 microversion: 2.1 time: 0.216012 Jul 02 21:08:47.487269 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1010/2106] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:47 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:47.493632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:47.494523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] [instance: 8d9ed4fc-927c-4e75-8a08-be711ea95c44] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:47.505293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.505823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.506620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.507068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.522440 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] HTTP exception thrown: Instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 could not be found. Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Request method failure captured: Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 HTTP/1.1 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLO_yljkgXuhqvMiIEEOT7Enhdv4BXw__adEkUxD0N9NtKiRtDJILXcwygDuHBUU-Jq_FilvcbQO-2Q9o-qR14hJ9tCnW8R9rAH_OVRVXENZZeP55yFoNy5OWo-K7QfJJdO3yD1-KguRaKmZDNPvyfOYokPPx-tBX8CcKdGFvMN-jRY Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 7cd138b817eb422591e9bc94163efadd Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TenantUsagesTestJSON-960383538 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cd138b817eb422591e9bc94163efadd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7cd138b817eb422591e9bc94163efadd", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7cd138b817eb422591e9bc94163efadd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7cd138b817eb422591e9bc94163efadd"}]}] Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TenantUsagesTestJSON-960383538 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 7cd138b817eb422591e9bc94163efadd Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TenantUsagesTestJSON-960383538 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TenantUsagesTestJSON-960383538-project Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 75ae0c662e20465db6b854244a0a61f4 Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TenantUsagesTestJSON-960383538-project Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 could not be found. Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8d9ed4fc-927c-4e75-8a08-be711ea95c44'} Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 could not be found. Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 could not be found. Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:47.524138 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 could not be found. Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:47.529908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] Returning 404 to user: Instance 8d9ed4fc-927c-4e75-8a08-be711ea95c44 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:47.531690 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37834952-ccca-4237-a1a7-235615ec352e tempest-TenantUsagesTestJSON-960383538 tempest-TenantUsagesTestJSON-960383538-project] 10.222.0.43 "GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44" status: 404 len: 111 microversion: 2.1 time: 0.042550 Jul 02 21:08:47.532300 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1011/2107] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:47 2022] GET /compute/v2.1/servers/8d9ed4fc-927c-4e75-8a08-be711ea95c44 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:47.544634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-127725b4-e08c-4687-a577-d5cf17014504 req-4187a499-6157-4412-ba96-3870a9e5faca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a52e580-65f0-4113-bad0-009411076964", "name": "network-vif-deleted", "tag": "4d772c9f-4751-413b-b370-6aff3b44273b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:47.554941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-127725b4-e08c-4687-a577-d5cf17014504 req-4187a499-6157-4412-ba96-3870a9e5faca service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.555392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-127725b4-e08c-4687-a577-d5cf17014504 req-4187a499-6157-4412-ba96-3870a9e5faca service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.569443 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-127725b4-e08c-4687-a577-d5cf17014504 req-4187a499-6157-4412-ba96-3870a9e5faca service nova] Creating event network-vif-deleted:4d772c9f-4751-413b-b370-6aff3b44273b for instance 2a52e580-65f0-4113-bad0-009411076964 on nch1-master-1 Jul 02 21:08:47.575437 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-127725b4-e08c-4687-a577-d5cf17014504 req-4187a499-6157-4412-ba96-3870a9e5faca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041180 Jul 02 21:08:47.576473 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1012/2108] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:47.581657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:47.582889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:47.590513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.591305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.592772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:47.593580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:47.652275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.663212 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18c67599-2396-4139-90e7-85e64a31f2c9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.399990 Jul 02 21:08:47.663841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1097/2109] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:47 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:47.819071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.834285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.840149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:47.841869 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-476e39f5-0c27-4492-960d-f73d03317638 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.264281 Jul 02 21:08:47.845978 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1013/2110] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:47 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:48.279444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:48.284603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:48.288220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:48.288975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:48.300166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.301737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.302827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.304352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.316086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.317933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.328369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.329499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.752886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:48.760831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d916632-b6d6-43d9-9781-8f749faa0950 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.477176 Jul 02 21:08:48.766574 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1014/2111] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:48 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:48.779724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3c9db2d4-f36d-4105-8c32-26f981b2f584 req-576e1650-d888-46fb-9f10-f1b1ca1b3aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e272da6-a951-495d-9da5-67cdd4dc16a2", "name": "network-vif-plugged", "status": "completed", "tag": "b8939438-c903-4d69-9051-69a74ad14f78"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:48.789594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:48.798693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fae5a28e-97d1-44ce-8c41-3301bce77e3f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.523784 Jul 02 21:08:48.804553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c9db2d4-f36d-4105-8c32-26f981b2f584 req-576e1650-d888-46fb-9f10-f1b1ca1b3aad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.806707 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1098/2112] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:48 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:48.812824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:48.816803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c9db2d4-f36d-4105-8c32-26f981b2f584 req-576e1650-d888-46fb-9f10-f1b1ca1b3aad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.825832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:48.846423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.847187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.848559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.851488 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3c9db2d4-f36d-4105-8c32-26f981b2f584 req-576e1650-d888-46fb-9f10-f1b1ca1b3aad service nova] Creating event network-vif-plugged:b8939438-c903-4d69-9051-69a74ad14f78 for instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 on nch2-master-1 Jul 02 21:08:48.852593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.869852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3c9db2d4-f36d-4105-8c32-26f981b2f584 req-576e1650-d888-46fb-9f10-f1b1ca1b3aad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103069 Jul 02 21:08:48.871160 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1015/2113] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:48.886000 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] HTTP exception thrown: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:48.887234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:48.890165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Request method failure captured: Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 HTTP/1.1 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLMoWAIsMn52zJpS8Ul7C6hlGgLtzeot_2yX2iMjj5Eh_XWx0pxEGk4hQZ2uNMO9tFYnBEM3JXUxc1E5xKTCQZbbVjIKFV3gdYvvs2idZfc6n0uFkULAHrqiW8G4xpzgguAY53rewh6bDqvRtIk8x9MrRpCR8n3Qf4waVpiszRW6lOg Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 426d63ca5cfa48e19a7156d1b848447e Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/426d63ca5cfa48e19a7156d1b848447e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_426d63ca5cfa48e19a7156d1b848447e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/426d63ca5cfa48e19a7156d1b848447e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/426d63ca5cfa48e19a7156d1b848447e"}]}] Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 426d63ca5cfa48e19a7156d1b848447e Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachSCSIVolumeTestJSON-1715054636-project Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 097020096c1c4ff2b67800be67cd708a Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1715054636-project Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '2a52e580-65f0-4113-bad0-009411076964'} Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:48.891711 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:48.896839 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:08:48.902481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Returning 404 to user: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:48.903903 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c72ce28a-98d1-4589-b4c8-572efaeacc3b tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 404 len: 111 microversion: 2.1 time: 0.094837 Jul 02 21:08:48.911188 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1099/2114] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:48 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:48.919924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.925219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.927224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:48.929555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.931447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.932436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:48.950304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.955711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:48.961329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:48.964958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:49.231356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:49.240794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:49.262852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:49.264423 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1741654-eafe-40bd-9990-ee68bf7e52bf tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.350458 Jul 02 21:08:49.265394 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1100/2115] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:48 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:49.277737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc13dbc2-fb17-4b59-9065-fc4753c8bd1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '.version_select at 0x7fabea214040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:49.330068 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc13dbc2-fb17-4b59-9065-fc4753c8bd1f tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098367299" status: 202 len: 0 microversion: 2.1 time: 0.063190 Jul 02 21:08:49.333483 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1101/2116] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098367299 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:49.342311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5bdb12d1-d97e-4ef6-9f19-84a92f8376cc req-df0fc735-0a53-4cdc-8aac-5e469cd66b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0", "name": "network-vif-unplugged", "status": "completed", "tag": "2173dcb0-34b1-4968-b27a-b806d4af1db4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:49.358506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5bdb12d1-d97e-4ef6-9f19-84a92f8376cc req-df0fc735-0a53-4cdc-8aac-5e469cd66b9c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:49.359783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5bdb12d1-d97e-4ef6-9f19-84a92f8376cc req-df0fc735-0a53-4cdc-8aac-5e469cd66b9c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:49.377330 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5bdb12d1-d97e-4ef6-9f19-84a92f8376cc req-df0fc735-0a53-4cdc-8aac-5e469cd66b9c service nova] Creating event network-vif-unplugged:2173dcb0-34b1-4968-b27a-b806d4af1db4 for instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 on nch2-master-1 Jul 02 21:08:49.386535 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5bdb12d1-d97e-4ef6-9f19-84a92f8376cc req-df0fc735-0a53-4cdc-8aac-5e469cd66b9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050748 Jul 02 21:08:49.387731 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1102/2117] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:49.417153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:49.431262 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6635de0-4fcb-4f1b-80c4-8007ec47a327 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.558281 Jul 02 21:08:49.452863 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1016/2118] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:48 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:49.785440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:49.786261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:49.803985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:49.804629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:49.805353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:49.805990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:49.830404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:49.832422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:49.843815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:49.845009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:49.847544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:49.849206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:50.443440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:50.544120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:50.560276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1367fc4-0c10-44ed-823f-d9ab8500957b tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1315 microversion: 2.1 time: 0.776334 Jul 02 21:08:50.561195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1103/2119] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:49 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:50.572218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:50.581854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:50.582585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:50.594829 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4e9d0c3-a65c-446a-8f9a-8ee3cda96cda tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.773067 Jul 02 21:08:50.595445 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1017/2120] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:49 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:50.605866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:50.606392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:50.607218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:50.610674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:50.614503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:50.615531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:50.641861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:50.642863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:50.645552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:50.646229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:50.790890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:50.806535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:50.814142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:50.815709 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a52494a2-9487-407f-9118-2204d7104c03 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.253367 Jul 02 21:08:50.816924 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1104/2121] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:50 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:51.011402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:51.027411 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93c63b3c-cf7d-42b7-8959-ef0ff9912233 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.430852 Jul 02 21:08:51.041113 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1018/2122] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:50 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:51.446922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-34cc36fa-0261-43d2-a100-4ae6ff7f3de2 req-59e9f8a5-358c-4888-9009-573e16e38735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0", "tag": "2173dcb0-34b1-4968-b27a-b806d4af1db4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:51.463290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-34cc36fa-0261-43d2-a100-4ae6ff7f3de2 req-59e9f8a5-358c-4888-9009-573e16e38735 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:51.463742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-34cc36fa-0261-43d2-a100-4ae6ff7f3de2 req-59e9f8a5-358c-4888-9009-573e16e38735 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:51.506714 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-34cc36fa-0261-43d2-a100-4ae6ff7f3de2 req-59e9f8a5-358c-4888-9009-573e16e38735 service nova] Creating event network-changed:2173dcb0-34b1-4968-b27a-b806d4af1db4 for instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 on nch2-master-1 Jul 02 21:08:51.516814 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-34cc36fa-0261-43d2-a100-4ae6ff7f3de2 req-59e9f8a5-358c-4888-9009-573e16e38735 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072975 Jul 02 21:08:51.518712 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1105/2123] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:51.607704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:51.609526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:51.619262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:51.621278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:51.621859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:51.622136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:51.623692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:51.624341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:51.662288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:51.663407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:51.667223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:51.667830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.365032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:52.378813 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec887728-2010-4fe7-80c8-62177e78d0df tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1501 microversion: 2.1 time: 0.801939 Jul 02 21:08:52.391784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1019/2124] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:51 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1501 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:52.398205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:52.399900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:52.403974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:52.408305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.408966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.410293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.411132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.413055 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e4b9b42a-b6e4-4ec9-9a66-7ceaad5bbeec tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.802304 Jul 02 21:08:52.417381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1106/2125] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:51 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:52.429893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:52.432217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:52.442212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.449146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.452350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.453113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.531025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:52.545228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:52.548384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:52.549771 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-565afa1e-f8c1-4fd3-b1fe-0415b3e5904c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.155947 Jul 02 21:08:52.551233 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1020/2126] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:52 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:52.834567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd7fdfee-8085-4c3b-aee8-c3864ffac5ae tempest-AbsoluteLimitsTestJSON-1946827232 tempest-AbsoluteLimitsTestJSON-1946827232-project] Calling method '.version_select at 0x7fabe485c8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:52.863856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd7fdfee-8085-4c3b-aee8-c3864ffac5ae tempest-AbsoluteLimitsTestJSON-1946827232 tempest-AbsoluteLimitsTestJSON-1946827232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.864773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd7fdfee-8085-4c3b-aee8-c3864ffac5ae tempest-AbsoluteLimitsTestJSON-1946827232 tempest-AbsoluteLimitsTestJSON-1946827232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.865791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd7fdfee-8085-4c3b-aee8-c3864ffac5ae tempest-AbsoluteLimitsTestJSON-1946827232 tempest-AbsoluteLimitsTestJSON-1946827232-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.866403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd7fdfee-8085-4c3b-aee8-c3864ffac5ae tempest-AbsoluteLimitsTestJSON-1946827232 tempest-AbsoluteLimitsTestJSON-1946827232-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.895508 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd7fdfee-8085-4c3b-aee8-c3864ffac5ae tempest-AbsoluteLimitsTestJSON-1946827232 tempest-AbsoluteLimitsTestJSON-1946827232-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.342379 Jul 02 21:08:52.904816 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1021/2127] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:08:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:52.910631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:52.911819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:52.919361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.920178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.921267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:52.922240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:52.973982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lazy-loading 'flavor' on Instance uuid 0e272da6-a951-495d-9da5-67cdd4dc16a2 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:08:53.108722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:53.118823 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f10592fb-dd60-4ea2-a0d8-defffa78721b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.700151 Jul 02 21:08:53.129665 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1107/2128] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:52 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:53.180700 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ce68311-ae43-43c8-ab29-f2b2a4b9754e tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "POST /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2/action" status: 202 len: 0 microversion: 2.1 time: 0.273934 Jul 02 21:08:53.184738 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1022/2129] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:08:52 2022] POST /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:08:53.190157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:53.190760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:53.209375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.210533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.210934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.211386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.435250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:53.435956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:53.451370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.451816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.452635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.453069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.754150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:53.784424 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d87440aa-eeb9-4ab9-99a6-e4b73b3a4e85 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.353316 Jul 02 21:08:53.792562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:53.811139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f3a5de16-7700-4763-8d1f-b092f6888346 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1509 microversion: 2.1 time: 0.616581 Jul 02 21:08:53.822802 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1023/2130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:53 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:53.826051 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1108/2131] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:53 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1509 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:08:53.837592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:53.838213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:53.843626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:53.844311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:53.870242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.871647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.873750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.874461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.874915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.877531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.880160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.885012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.916321 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] HTTP exception thrown: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Request method failure captured: Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 HTTP/1.1 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLMoWAIsMn52zJpS8Ul7C6hlGgLtzeot_2yX2iMjj5Eh_XWx0pxEGk4hQZ2uNMO9tFYnBEM3JXUxc1E5xKTCQZbbVjIKFV3gdYvvs2idZfc6n0uFkULAHrqiW8G4xpzgguAY53rewh6bDqvRtIk8x9MrRpCR8n3Qf4waVpiszRW6lOg Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 426d63ca5cfa48e19a7156d1b848447e Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/426d63ca5cfa48e19a7156d1b848447e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_426d63ca5cfa48e19a7156d1b848447e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/426d63ca5cfa48e19a7156d1b848447e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/426d63ca5cfa48e19a7156d1b848447e"}]}] Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 426d63ca5cfa48e19a7156d1b848447e Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachSCSIVolumeTestJSON-1715054636-project Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 097020096c1c4ff2b67800be67cd708a Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1715054636-project Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2a52e580-65f0-4113-bad0-009411076964'} Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:53.917948 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Returning 404 to user: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb1107cc-6858-494b-b869-d63280f5747c tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 404 len: 111 microversion: 2.1 time: 0.095397 Jul 02 21:08:53.924945 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1024/2132] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:53 2022] DELETE /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:53.929944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:53.930565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] [instance: 2a52e580-65f0-4113-bad0-009411076964] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:53.940588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.941051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.941941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:53.942681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:53.964116 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] HTTP exception thrown: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Request method failure captured: Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 HTTP/1.1 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLMoWAIsMn52zJpS8Ul7C6hlGgLtzeot_2yX2iMjj5Eh_XWx0pxEGk4hQZ2uNMO9tFYnBEM3JXUxc1E5xKTCQZbbVjIKFV3gdYvvs2idZfc6n0uFkULAHrqiW8G4xpzgguAY53rewh6bDqvRtIk8x9MrRpCR8n3Qf4waVpiszRW6lOg Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 426d63ca5cfa48e19a7156d1b848447e Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/426d63ca5cfa48e19a7156d1b848447e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_426d63ca5cfa48e19a7156d1b848447e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/426d63ca5cfa48e19a7156d1b848447e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/426d63ca5cfa48e19a7156d1b848447e"}]}] Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 426d63ca5cfa48e19a7156d1b848447e Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1715054636 Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachSCSIVolumeTestJSON-1715054636-project Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 097020096c1c4ff2b67800be67cd708a Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1715054636-project Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2a52e580-65f0-4113-bad0-009411076964'} Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:08:53.965707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] Returning 404 to user: Instance 2a52e580-65f0-4113-bad0-009411076964 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc3f4ee7-2a2f-4eb0-8e40-c5a078f7f9e3 tempest-AttachSCSIVolumeTestJSON-1715054636 tempest-AttachSCSIVolumeTestJSON-1715054636-project] 10.222.0.43 "GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964" status: 404 len: 111 microversion: 2.1 time: 0.041042 Jul 02 21:08:53.970609 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1025/2133] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:53 2022] GET /compute/v2.1/servers/2a52e580-65f0-4113-bad0-009411076964 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:08:54.039732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:54.053304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:54.054950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:54.056203 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32d11537-e705-40c5-8d37-fb8adedcce3e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.228821 Jul 02 21:08:54.056773 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1109/2134] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:53 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:54.149017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:54.149756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:54.164812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:54.167613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:54.172530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:54.173103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:54.476839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:54.485700 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd6c2ade-664b-42b6-b4c8-b6cac38abb92 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.343041 Jul 02 21:08:54.486816 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1026/2135] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:54 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:54.790816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2120944247", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "a7ccdb17-5853-46d8-ac7b-46a7b535ef5b"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:54.830382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:54.831375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:54.855580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:54.856466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:54.859266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:54.863487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:54.926830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] validate_networks() for [('a7ccdb17-5853-46d8-ac7b-46a7b535ef5b', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:08:55.226632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:55.234669 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b86095f-fb1f-4ac1-9662-8c30755032c4 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1472 microversion: 2.1 time: 0.409732 Jul 02 21:08:55.235474 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1027/2136] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:54 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1472 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:55.244544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:55.246250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:55.254328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.255254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.256271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.256898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.281782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:55.467484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:55.478122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58e1ef9a-fe59-42e6-afc1-4036c26917e1 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1492 microversion: 2.1 time: 0.240919 Jul 02 21:08:55.493731 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1028/2137] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:55 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1492 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:55.503330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:55.504321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:55.512274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.513204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.514174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.516291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.647885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:55.658916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:55.661190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:55.662543 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6f61c70-b8c6-4317-bb75-18ebe2b5514d tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.167319 Jul 02 21:08:55.663542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1029/2138] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:55 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:55.696293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:08:55.696774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:08:55.697259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:08:55.697678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:08:55.698099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:08:55.708530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.709237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.710189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.710637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.749456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Getting quotas for project a54682a0b9f34993a0e616507695307e. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:08:55.756328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Getting quotas for user 62a0c1f583944bd092abc02293fcb316 and project a54682a0b9f34993a0e616507695307e. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:08:55.770293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:08:55.772989 ncdv-master-1 devstack@n-api.service[131045]: WARNING nova.utils [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2120944247 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-212094424 Jul 02 21:08:55.773886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:08:55.827705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11941145-f5c1-46fe-adc4-31c87c5acb9f tempest-AZV2TestJSON-2109979945 tempest-AZV2TestJSON-2109979945-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:55.829657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11941145-f5c1-46fe-adc4-31c87c5acb9f tempest-AZV2TestJSON-2109979945 tempest-AZV2TestJSON-2109979945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.830536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11941145-f5c1-46fe-adc4-31c87c5acb9f tempest-AZV2TestJSON-2109979945 tempest-AZV2TestJSON-2109979945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.831863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11941145-f5c1-46fe-adc4-31c87c5acb9f tempest-AZV2TestJSON-2109979945 tempest-AZV2TestJSON-2109979945-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.832759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11941145-f5c1-46fe-adc4-31c87c5acb9f tempest-AZV2TestJSON-2109979945 tempest-AZV2TestJSON-2109979945-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.840959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c81c323-39db-48b7-9fa8-c59be09bca3a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.435272 Jul 02 21:08:55.842442 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1110/2139] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:08:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:08:55.851778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:55.852642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:55.863728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.864229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.865313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.865720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.879972 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11941145-f5c1-46fe-adc4-31c87c5acb9f tempest-AZV2TestJSON-2109979945 tempest-AZV2TestJSON-2109979945-project] 10.222.0.43 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.215174 Jul 02 21:08:55.882863 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1030/2140] 10.222.0.43 () {58 vars in 1163 bytes} [Sat Jul 2 21:08:55 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:08:55.889421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:55.890474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:55.905566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.906023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.906970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:55.907468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:55.908784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:08:56.137270 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12178bea-6ee3-4da7-bed0-a83d5a0c11f7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 204 len: 0 microversion: 2.1 time: 0.291293 Jul 02 21:08:56.138435 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1111/2141] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:08:55 2022] DELETE /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:08:56.155788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c7427099-8118-4301-a02e-696ff8f7f46d tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:56.158141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c7427099-8118-4301-a02e-696ff8f7f46d tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:56.510357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:56.518542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1bb880d-f4bf-4492-aaf9-871d75d0f54c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.634323 Jul 02 21:08:56.522290 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1031/2142] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:55 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:56.532947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:56.533578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:56.576666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c7427099-8118-4301-a02e-696ff8f7f46d tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:56.579468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:56.579947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:56.581232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:56.581340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:56.590943 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c7427099-8118-4301-a02e-696ff8f7f46d tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1232 microversion: 2.1 time: 0.445676 Jul 02 21:08:56.591841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1112/2143] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:56 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1232 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:56.600157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:56.601119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:56.618803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:56.620489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:56.621502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:56.630376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:56.977140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:56.992590 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8d3fb942-cd1b-4730-a6de-f7e03ab60f6e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.399108 Jul 02 21:08:57.005306 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1113/2144] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:56 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:57.021184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:57.022020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:57.034175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:57.045476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:57.046571 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08a440e0-7e1f-4f8f-9e44-5d9d3487b226 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1498 microversion: 2.1 time: 0.523147 Jul 02 21:08:57.048150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:57.050448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:57.060229 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1032/2145] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:56 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1498 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:57.060966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:57.386125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:57.396927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:57.398855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:57.399617 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e92b165d-dbef-4c0b-99dc-94c65202dda8 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.389836 Jul 02 21:08:57.411735 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1114/2146] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:57 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:57.538050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:57.539120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:57.547656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:57.548900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:57.550326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:57.552404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:57.610766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:57.613573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:57.631216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:57.635857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:57.635857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:57.636630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:57.906770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:57.913678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:08:57.933055 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-81d037fc-f4c3-4966-93bd-4972f8004435 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1228 microversion: 2.1 time: 0.327685 Jul 02 21:08:57.933692 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1115/2147] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:57 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1228 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:58.011603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:58.012530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:58.022038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.027573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.028627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.030893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.204588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:58.213388 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dae6300-0952-48d1-8182-ef48eb90d842 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.679758 Jul 02 21:08:58.213980 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1033/2148] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:57 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:58.229543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:58.230621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:58.246946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.247850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.248924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.249534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.612295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:58.625036 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b19f161e-14db-4924-a560-9795a3e06a31 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.618137 Jul 02 21:08:58.641720 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1116/2149] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:58 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:58.649183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bf687dd1-c499-41cb-9fbe-cb2b73b9e7c7 req-c677d6f3-8e04-4fe4-8dd7-ead8f5dfbf52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0", "name": "network-vif-unplugged", "status": "completed", "tag": "2173dcb0-34b1-4968-b27a-b806d4af1db4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:08:58.687409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bf687dd1-c499-41cb-9fbe-cb2b73b9e7c7 req-c677d6f3-8e04-4fe4-8dd7-ead8f5dfbf52 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.701833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bf687dd1-c499-41cb-9fbe-cb2b73b9e7c7 req-c677d6f3-8e04-4fe4-8dd7-ead8f5dfbf52 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.735436 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bf687dd1-c499-41cb-9fbe-cb2b73b9e7c7 req-c677d6f3-8e04-4fe4-8dd7-ead8f5dfbf52 service nova] Creating event network-vif-unplugged:2173dcb0-34b1-4968-b27a-b806d4af1db4 for instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 on nch2-master-1 Jul 02 21:08:58.750629 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bf687dd1-c499-41cb-9fbe-cb2b73b9e7c7 req-c677d6f3-8e04-4fe4-8dd7-ead8f5dfbf52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107344 Jul 02 21:08:58.758305 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1117/2150] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:08:58.765441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:58.780607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:58.795538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.800612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.801735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:58.802349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:58.999914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fefe83ec0664f6188af74ea4b5c1291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8576652bfe8441e0985297d016a1ca9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:59.014997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e3d25a9-f8df-4b14-b2e7-9b6e64ecaaa7 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 200 len: 1498 microversion: 2.1 time: 0.782825 Jul 02 21:08:59.018955 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1034/2151] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:58 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 1498 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:59.029811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:59.031043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:59.044901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:59.045576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:59.046496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:59.047837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:59.054622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:59.088485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:59.101250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:59.102896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba7060e4-3641-4645-a6b5-f599e9fd97bb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.342996 Jul 02 21:08:59.103490 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1118/2152] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:08:58 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:08:59.173622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:59.191698 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ce0ad56-47ff-49f2-967b-58819dc2487e tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1228 microversion: 2.1 time: 0.167218 Jul 02 21:08:59.192471 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1035/2153] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:59 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1228 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:08:59.231417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:59.232054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:59.242828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:59.244436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:59.247490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:59.250042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:59.649878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:08:59.651182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:08:59.664386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:59.664850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:59.667085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:08:59.668729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:08:59.675529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:08:59.684705 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f6ae71c-9bd0-45bf-a592-0a37a804309f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.457642 Jul 02 21:08:59.685213 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1119/2154] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:59 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:00.036552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.037610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.048293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.049237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.050520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.051274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.071429 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 HTTP/1.1 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0e272da6-a951-495d-9da5-67cdd4dc16a2'} Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.078583 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.085115 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.090915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.092270 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b7812b9-8437-4f49-a57e-8917bc4fbbfd tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 404 len: 111 microversion: 2.1 time: 0.061164 Jul 02 21:09:00.092906 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1120/2155] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:09:00.105522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.106309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.113247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.114106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.116688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.117363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.132779 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 HTTP/1.1 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0e272da6-a951-495d-9da5-67cdd4dc16a2'} Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.134355 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1493680d-c0e3-4749-948c-3d5803e5619f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 404 len: 111 microversion: 2.1 time: 0.034333 Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1121/2156] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:00 2022] DELETE /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.142872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.148320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.148779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.149566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.150004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.306170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:00.315907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:00.317556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:00.318811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3d719c71-a247-4739-9206-bcc5f0cf851a tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.181468 Jul 02 21:09:00.319709 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1122/2157] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:00.325166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.326257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 0e272da6-a951-495d-9da5-67cdd4dc16a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.335635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.336116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.336885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.337316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.351945 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 HTTP/1.1 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0e272da6-a951-495d-9da5-67cdd4dc16a2'} Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.353529 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.360605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a88db953-a90d-4c88-817e-ca14a4b96bb4 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2" status: 404 len: 111 microversion: 2.1 time: 0.034955 Jul 02 21:09:00.362786 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1123/2158] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/0e272da6-a951-495d-9da5-67cdd4dc16a2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.370255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.371398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.380011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.381669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.383295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.384399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.446199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:00.456564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ce9c10c-cbf8-45c3-a62b-a89ed28806cf tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.811168 Jul 02 21:09:00.457966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1036/2159] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:08:59 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:00.472849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.473545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.481554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:00.483201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.484521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.485638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.486060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.514428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 HTTP/1.1 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9e924300-c50c-44b5-9a78-67a3904f0dc7'} Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.516430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0828d545-56f5-40a4-b017-58c61220b022 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 404 len: 111 microversion: 2.1 time: 0.058846 Jul 02 21:09:00.522111 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1037/2160] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:00 2022] DELETE /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.536496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.537192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9e924300-c50c-44b5-9a78-67a3904f0dc7] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.549548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.550171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.550958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.556535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.561325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:00.569370 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83387fb2-7213-4c27-bdb6-ae9392c9aa08 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1284 microversion: 2.1 time: 0.205458 Jul 02 21:09:00.579775 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1124/2161] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1284 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:00.581640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 HTTP/1.1 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9e924300-c50c-44b5-9a78-67a3904f0dc7'} Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.584476 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 9e924300-c50c-44b5-9a78-67a3904f0dc7 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a303a55b-412f-4d0c-b37c-d9232abef52d tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7" status: 404 len: 111 microversion: 2.1 time: 0.062621 Jul 02 21:09:00.591375 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1038/2162] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/9e924300-c50c-44b5-9a78-67a3904f0dc7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:09:00.601647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.602268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.609179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.609732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.610568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.611099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.626027 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b HTTP/1.1 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9dbd7119-38af-45a9-997f-2001926d852b'} Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.628096 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6f436962-e3d5-41ca-8722-b823f34c2206 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 404 len: 111 microversion: 2.1 time: 0.034088 Jul 02 21:09:00.633787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1125/2163] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:00 2022] DELETE /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.641294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.642254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 9dbd7119-38af-45a9-997f-2001926d852b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.652138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.652868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.653920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.656925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.676118 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b HTTP/1.1 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9dbd7119-38af-45a9-997f-2001926d852b'} Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.678214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.683695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 9dbd7119-38af-45a9-997f-2001926d852b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.684859 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a00994ef-e5b0-42b9-ad15-9a5ac2d3b89f tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b" status: 404 len: 111 microversion: 2.1 time: 0.046459 Jul 02 21:09:00.688209 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1039/2164] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/9dbd7119-38af-45a9-997f-2001926d852b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:09:00.697339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.698857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.707786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.708577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.714579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.715331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.717171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.719073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.720366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.720540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.723209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.726533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.743451 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 HTTP/1.1 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8438550e-5629-411b-af19-402f3032a1f2'} Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.745392 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.750435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.753069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.754106 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-816bb81a-96c8-4dc0-90d8-85283b5c0a9a tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 404 len: 111 microversion: 2.1 time: 0.063927 Jul 02 21:09:00.755355 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1126/2165] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:00 2022] DELETE /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.770159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.771004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 8438550e-5629-411b-af19-402f3032a1f2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.785999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.786460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.787256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.787697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.822185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 HTTP/1.1 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8438550e-5629-411b-af19-402f3032a1f2'} Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.826493 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. Jul 02 21:09:00.832083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.834031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 8438550e-5629-411b-af19-402f3032a1f2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.834929 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d04a7d8-1185-4dfc-a4e6-8dd4066ae5c2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2" status: 404 len: 111 microversion: 2.1 time: 0.075142 Jul 02 21:09:00.835405 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1127/2166] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/8438550e-5629-411b-af19-402f3032a1f2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.841939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-03bda2bd-473b-46cf-be35-2c0959deb383 req-78866f2e-67c1-4e3e-9616-11685d5047c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e272da6-a951-495d-9da5-67cdd4dc16a2", "name": "network-vif-deleted", "tag": "b8939438-c903-4d69-9051-69a74ad14f78"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:00.846153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:00.852716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-03bda2bd-473b-46cf-be35-2c0959deb383 req-78866f2e-67c1-4e3e-9616-11685d5047c9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:00.853588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-03bda2bd-473b-46cf-be35-2c0959deb383 req-78866f2e-67c1-4e3e-9616-11685d5047c9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:00.872426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-03bda2bd-473b-46cf-be35-2c0959deb383 req-78866f2e-67c1-4e3e-9616-11685d5047c9 service nova] Creating event network-vif-deleted:b8939438-c903-4d69-9051-69a74ad14f78 for instance 0e272da6-a951-495d-9da5-67cdd4dc16a2 on nch2-master-1 Jul 02 21:09:00.878386 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-03bda2bd-473b-46cf-be35-2c0959deb383 req-78866f2e-67c1-4e3e-9616-11685d5047c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041350 Jul 02 21:09:00.879673 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1128/2167] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:00.885684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-361ab1a9-6a8b-4bef-ad26-1881e15b4e09 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.886659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-361ab1a9-6a8b-4bef-ad26-1881e15b4e09 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.894697 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-361ab1a9-6a8b-4bef-ad26-1881e15b4e09 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-361ab1a9-6a8b-4bef-ad26-1881e15b4e09 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 HTTP/1.1 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4'} Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.897169 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.902029 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.906887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-361ab1a9-6a8b-4bef-ad26-1881e15b4e09 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.908258 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-361ab1a9-6a8b-4bef-ad26-1881e15b4e09 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4" status: 404 len: 111 microversion: 2.1 time: 0.027096 Jul 02 21:09:00.909488 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1129/2168] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:00 2022] DELETE /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:00.917578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48726e67-222e-4f89-9ebe-bafa24557ac6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:00.918550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48726e67-222e-4f89-9ebe-bafa24557ac6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:00.928006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-48726e67-222e-4f89-9ebe-bafa24557ac6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48726e67-222e-4f89-9ebe-bafa24557ac6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 HTTP/1.1 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4'} Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:00.929976 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:00.934650 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:00.934650 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:00.934650 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:00.934650 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. Jul 02 21:09:00.934650 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:00.934650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48726e67-222e-4f89-9ebe-bafa24557ac6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:00.936970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48726e67-222e-4f89-9ebe-bafa24557ac6 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4" status: 404 len: 111 microversion: 2.1 time: 0.022908 Jul 02 21:09:00.938378 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1130/2169] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/cd6a8ff2-2ac4-4a0d-a68d-d9b618b009f4 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:09:01.018392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0df0f1c4-d1e0-416a-9b84-07929c614925 req-7003aa47-ee72-4e59-922f-9f7f9084789f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "name": "network-vif-unplugged", "status": "completed", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:01.063975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0df0f1c4-d1e0-416a-9b84-07929c614925 req-7003aa47-ee72-4e59-922f-9f7f9084789f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.065758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0df0f1c4-d1e0-416a-9b84-07929c614925 req-7003aa47-ee72-4e59-922f-9f7f9084789f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.091063 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0df0f1c4-d1e0-416a-9b84-07929c614925 req-7003aa47-ee72-4e59-922f-9f7f9084789f service nova] Creating event network-vif-unplugged:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:09:01.104494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0df0f1c4-d1e0-416a-9b84-07929c614925 req-7003aa47-ee72-4e59-922f-9f7f9084789f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092299 Jul 02 21:09:01.106504 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1131/2170] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:01.306091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:01.315452 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62d2032d-3c40-4ed4-b269-2bb21855d84e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.614100 Jul 02 21:09:01.316835 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1040/2171] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:00 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:01.338998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:01.340103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:01.347437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.347839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.348963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.349644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.476968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:01.481585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:01.483407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:01.504182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:01.505726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.512280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.515622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:01.515910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.516581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.521396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27e4d85b-0a49-4a4b-aed8-11206d217948 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.183778 Jul 02 21:09:01.522818 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1132/2172] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:01 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:01.586945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:01.588133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:01.600442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.601257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.602478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:01.603244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:01.777390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:01.791566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-81663e78-dc93-437d-a1d4-1453fb26d7dc tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1290 microversion: 2.1 time: 0.207968 Jul 02 21:09:01.792564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1133/2173] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:01 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1290 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:01.935886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:01.946250 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-532a7b37-99d5-48c5-a8ea-89e6fe7ab02e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.474684 Jul 02 21:09:01.948121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1041/2174] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:01 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:02.214689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.215351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.241754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.242207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.242995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.243431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.279343 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c HTTP/1.1 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '613c35f3-cde8-4e12-962d-d43f9fed716c'} Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:02.281119 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-702e362d-f899-465c-b6cf-4fd383ef21e2 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 404 len: 111 microversion: 2.1 time: 0.074750 Jul 02 21:09:02.288445 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1134/2175] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:02 2022] DELETE /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:02.292280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.292900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 613c35f3-cde8-4e12-962d-d43f9fed716c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.304526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.304983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.305771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.306197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.337398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.338031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.358017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.358473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.359267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.359705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.375058 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c HTTP/1.1 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '613c35f3-cde8-4e12-962d-d43f9fed716c'} Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.390878 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 613c35f3-cde8-4e12-962d-d43f9fed716c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:02.397107 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c10ac1b-4fb9-4a15-99e1-718b8aa69634 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c" status: 404 len: 111 microversion: 2.1 time: 0.104798 Jul 02 21:09:02.408521 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1042/2176] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:02 2022] GET /compute/v2.1/servers/613c35f3-cde8-4e12-962d-d43f9fed716c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:02.433676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.434331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.442136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.443369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.444642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.445387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.485355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 HTTP/1.1 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '79d209e8-ea3a-4e2f-a8bf-4f55836f8647'} Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:02.496081 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.503068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.506398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:02.509512 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71e36f27-bcb7-418c-b3da-09a05ec2e594 tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "DELETE /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 404 len: 111 microversion: 2.1 time: 0.099868 Jul 02 21:09:02.511798 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1043/2177] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:02 2022] DELETE /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:02.531375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.533155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] [instance: 79d209e8-ea3a-4e2f-a8bf-4f55836f8647] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.548777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.549620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.550706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.551515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.579058 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] HTTP exception thrown: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Request method failure captured: Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 HTTP/1.1 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLLW8il5nUjtC1A_O2DgjRDILjQUlSZtYl1F1EWHZdZ66piKtxqCznIII2z9obykWWzlM-w9vAez4tNK1ka2BoJuYAhMD_O5uW4vJ6bxWPFp3IK40bbcH0SiSHe_zrf-DKXfYF4UkFgKAWQ3Cxa2Vj23npdjGcQZDpPJx2gkWZOfN2s Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8576652bfe8441e0985297d016a1ca9b", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8576652bfe8441e0985297d016a1ca9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8576652bfe8441e0985297d016a1ca9b"}]}] Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8576652bfe8441e0985297d016a1ca9b Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-1749805065 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3fefe83ec0664f6188af74ea4b5c1291 Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-1749805065-project Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '79d209e8-ea3a-4e2f-a8bf-4f55836f8647'} Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:02.582754 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. Jul 02 21:09:02.588647 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:02.591306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] Returning 404 to user: Instance 79d209e8-ea3a-4e2f-a8bf-4f55836f8647 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:02.592654 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-766fd7e6-4958-43be-a38b-4adb55f08adb tempest-DeleteServersTestJSON-1749805065 tempest-DeleteServersTestJSON-1749805065-project] 10.222.0.43 "GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647" status: 404 len: 111 microversion: 2.1 time: 0.075754 Jul 02 21:09:02.594215 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1044/2178] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:02 2022] GET /compute/v2.1/servers/79d209e8-ea3a-4e2f-a8bf-4f55836f8647 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:02.608897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.609522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.618056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.618803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.619765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.620392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.862672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:02.880403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:02.891791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:02.902576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:02.904665 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29d5b4b4-b0b9-4cfb-8eae-d87f94f2a5eb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.309083 Jul 02 21:09:02.905700 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1045/2179] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:02 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:02.913120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:02.914157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:02.922293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.923522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:02.930867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:02.931776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:03.119585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:03.128291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de237710-20c2-4fb7-99a4-6c3eec6cc69f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1503 microversion: 2.1 time: 0.794835 Jul 02 21:09:03.128877 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1135/2180] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:02 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1503 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:03.136262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:03.137129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:03.145052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:03.146457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:03.147645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:03.148347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:03.870419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:03.893731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-234b0b73-0885-4e77-937b-1c9d10b02999 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.985172 Jul 02 21:09:03.894357 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1046/2181] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:02 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:03.925072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:03.925687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:03.936570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:03.942966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:03.944160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:03.944757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.108749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:04.119148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:04.124600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:04.126179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:04.127629 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71bacc33-56d6-4632-96b9-f9e0a753ffc6 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.207665 Jul 02 21:09:04.135787 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1047/2182] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:03 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:04.145511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:04.146343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:04.152527 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-90c11cd4-8ab2-4724-80b3-8539b49fe6ed tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 1.022046 Jul 02 21:09:04.156477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1136/2183] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:03 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:04.160362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.160880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.161665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.166460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.636853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:04.649526 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb2855b0-7ad8-42ec-8c59-e6193f30f26c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1478 microversion: 2.1 time: 0.507846 Jul 02 21:09:04.664252 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1048/2184] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:04 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1478 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:04.684770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6cdcf3a0-d487-4994-bb59-1f440fa4b7e8 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '.version_select at 0x7fabea186b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:04.745571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cdcf3a0-d487-4994-bb59-1f440fa4b7e8 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.745571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cdcf3a0-d487-4994-bb59-1f440fa4b7e8 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.745571 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6cdcf3a0-d487-4994-bb59-1f440fa4b7e8 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 785 microversion: 2.1 time: 0.045199 Jul 02 21:09:04.745571 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1137/2185] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:09:04 2022] GET /compute/v2.1/os-migrations => generated 785 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:04.776798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:04.780768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:04.799300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.799770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.802129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.802129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.928900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:04.933907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:04.950127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.952880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:04.954114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:04.954783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:05.180722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:05.189885 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9469bfa3-06bd-4f8f-9d73-86a7cd3b3643 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1629 microversion: 2.1 time: 0.436130 Jul 02 21:09:05.207082 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1049/2186] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:04 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1629 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:05.215270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:05.216232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:05.223908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:05.224609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:05.225554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:05.226133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:05.392789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:05.407386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:05.408771 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ffcb4d3-2185-44d7-93d5-98d327b50077 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.501530 Jul 02 21:09:05.409487 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1138/2187] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:04 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:05.414439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:05.415843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:05.424781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:05.426727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:05.429511 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7912afa-4430-4721-af71-4beb5406ab63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.219266 Jul 02 21:09:05.433644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:05.441248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:05.442619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:05.443402 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1050/2188] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:05 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:05.443735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:05.452853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9cbc026-8b05-4f50-9852-8aea339cad6d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Action: 'create', calling method: .version_select at 0x7fabe42ad940>, body: {"keypair": {"name": "tempest-keypair-459305488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENaHawq0tZxcPXXzfAMFBJ212ANTeIuKOD+RIx8d1EaneybMTHWU7tpQCLuuZr+Z1F8DGFiI1DrhHotVONGIs8EGnLIWq2w9SqPIqeCckT+xK05bREyncyL6WGe8n6gFg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:05.490540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a9cbc026-8b05-4f50-9852-8aea339cad6d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for project 8c234eb1b17242368d279c164a6045d4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:05.500428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a9cbc026-8b05-4f50-9852-8aea339cad6d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for user 8b345a42784d4df79caab6d667117418 and project 8c234eb1b17242368d279c164a6045d4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:05.534184 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9cbc026-8b05-4f50-9852-8aea339cad6d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089439 Jul 02 21:09:05.535521 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1051/2189] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:09:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:05.730220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:05.853641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:05.861068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-871f7786-13c6-42a6-bc31-1750af91461d req-4150e778-2990-4fa2-b715-4c833151646b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c496d9-ac70-493d-aa84-383e61614284", "tag": "8715cf9f-be3b-4753-9d2f-c3a2496333de"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:05.889244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-871f7786-13c6-42a6-bc31-1750af91461d req-4150e778-2990-4fa2-b715-4c833151646b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:05.891610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-871f7786-13c6-42a6-bc31-1750af91461d req-4150e778-2990-4fa2-b715-4c833151646b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:05.926125 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-871f7786-13c6-42a6-bc31-1750af91461d req-4150e778-2990-4fa2-b715-4c833151646b service nova] Creating event network-changed:8715cf9f-be3b-4753-9d2f-c3a2496333de for instance c4c496d9-ac70-493d-aa84-383e61614284 on nch1-master-1 Jul 02 21:09:05.939162 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-871f7786-13c6-42a6-bc31-1750af91461d req-4150e778-2990-4fa2-b715-4c833151646b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086565 Jul 02 21:09:05.940143 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1052/2190] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:06.088634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:06.100422 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c4a0e8d-329a-4561-8dbc-cf1b87ecf98a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.689715 Jul 02 21:09:06.101635 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1139/2191] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:05 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:06.332154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d8ccf554-8c33-4ba4-b572-af978b691a8a req-75c9a827-8450-4994-b969-a78bc88a76db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "name": "network-vif-plugged", "status": "completed", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:06.344868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8ccf554-8c33-4ba4-b572-af978b691a8a req-75c9a827-8450-4994-b969-a78bc88a76db service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:06.351090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8ccf554-8c33-4ba4-b572-af978b691a8a req-75c9a827-8450-4994-b969-a78bc88a76db service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:06.384920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d8ccf554-8c33-4ba4-b572-af978b691a8a req-75c9a827-8450-4994-b969-a78bc88a76db service nova] Creating event network-vif-plugged:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:09:06.392643 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d8ccf554-8c33-4ba4-b572-af978b691a8a req-75c9a827-8450-4994-b969-a78bc88a76db service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064502 Jul 02 21:09:06.397733 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1053/2192] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:06.428111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:06.428866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:06.450899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:06.451606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:06.457736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:06.461050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:06.462229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:06.465427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:06.471690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:06.472733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:06.475372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:06.476597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:06.586220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:06.686703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:06.697818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:06.704355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:06.706212 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38cbefa5-52a3-4cf6-98df-ec62f53bb10f tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.262945 Jul 02 21:09:06.710188 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1054/2193] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:06 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:06.888255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:06.923688 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-623178d6-ee7d-4cac-8786-f33b9b5bda83 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.500313 Jul 02 21:09:06.933659 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1140/2194] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:06 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:07.125123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:07.126024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:07.148369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:07.149537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:07.150538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:07.154448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:07.592789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:07.601997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-655e496d-65a8-4fda-b617-9b50c53b6160 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.482242 Jul 02 21:09:07.611530 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1055/2195] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:07 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:07.727613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:07.728198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:07.738899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:07.739768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:07.740765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:07.741343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:07.849582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:07.857204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:07.866379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:07.874922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:07.877558 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-57738049-8e2a-451c-ac79-5fc120c1fb53 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.154466 Jul 02 21:09:07.880380 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1141/2196] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:07 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:07.944549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:07.946453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:07.964900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:07.967657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:07.968618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:07.969063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:08.618854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:08.625197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:08.651568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:08.652161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:08.654046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:08.655372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:08.655833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:08.662995 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-780cdffb-2231-4370-ae5f-cd3e725f3938 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.725289 Jul 02 21:09:08.668620 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1056/2197] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:07 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:08.897398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:08.898148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:08.906543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:08.911523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:08.912752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:08.915195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:09.168284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:09.178684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:09.186004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:09.188096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b79be751-f381-4edb-ba26-d8f1562488fc tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.294355 Jul 02 21:09:09.188200 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1057/2198] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:08 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:09.490677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:09.504014 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f7bb0e78-4b05-424c-8c18-ecc0bc2d8c3d tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.888921 Jul 02 21:09:09.511509 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1142/2199] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:08 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:09.686251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:09.688003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:09.717305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:09.717804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:09.718634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:09.719061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:09.939888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-191298375", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "2e05cfae-5311-414e-b03f-d5b620078b94"}], "security_groups": [{"name": "tempest-securitygroup--383894684"}], "key_name": "tempest-keypair-459305488", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:10.175887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:10.185827 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc57aac7-f189-4ddb-970a-aeb37d089b14 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.504409 Jul 02 21:09:10.187001 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1058/2200] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:09 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:10.210885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:10.211503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:10.219958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] validate_networks() for [('2e05cfae-5311-414e-b03f-d5b620078b94', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:09:10.223009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:10.223503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:10.224317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:10.224904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:10.429972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:10.440776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:10.444989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:10.449250 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-787b40c1-d74a-4e2c-9abb-c7e3bcb5d078 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.241743 Jul 02 21:09:10.451983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1059/2201] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:10 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:10.533133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:10.533779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:10.553626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:10.558388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:10.560785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:10.564438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:11.165514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:11.177519 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e5a5c09-577b-4ecc-a5b6-3d8cd0217193 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1478 microversion: 2.1 time: 0.653284 Jul 02 21:09:11.178522 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1060/2202] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:10 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1478 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:11.204003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:11.204816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:11.214014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:11.214473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:11.215259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:11.215693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:11.629154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:09:11.630529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:09:11.630797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:09:11.631220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:09:11.631783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:09:11.645677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:11.646171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:11.648868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:11.649348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:11.667369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:11.691885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for user 8b345a42784d4df79caab6d667117418 and project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:11.707530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:09:11.710350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:09:11.762354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:11.774814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c66e250c-628d-421d-94c2-8ab8e90eee76 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.575362 Jul 02 21:09:11.779929 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1061/2203] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:11 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:11.840655 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb816638-09d9-4b39-a8d1-1860497b395e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.904358 Jul 02 21:09:11.843245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1143/2204] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:09:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:09:11.853307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:11.856384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:11.870621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:11.873797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:11.876912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:11.880350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.055902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0daf70de-1579-4d1c-9787-42dccfdd5f62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Action: 'create', calling method: .version_select at 0x7fabe494cca0>, body: {"keypair": {"name": "tempest-keypair-2128598921", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInErtIa31AnnbnxRScWGON2JmZsKE9i+G2Bf0ck/kc2ZY5TmvEkleUN5hsA8i1A8A6+MvaOedG4pBh762W46T4az3pnv2u2T0cBRDMS4sI2DGwTfpsRbDodK2U1jtsC3g=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:12.066978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:12.080653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:12.082789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:12.085492 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d6c28d5-e926-41e0-8c62-df77c3f48adb tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1366 microversion: 2.47 time: 0.239513 Jul 02 21:09:12.097192 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1144/2205] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:11 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:12.123430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8fb6858-41ac-4b6a-b464-7f1649a7ecdd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:12.125382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0daf70de-1579-4d1c-9787-42dccfdd5f62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Getting quotas for project d93a2b945dc646148653736a366e67e7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:12.125972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e8fb6858-41ac-4b6a-b464-7f1649a7ecdd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:12.174539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0daf70de-1579-4d1c-9787-42dccfdd5f62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Getting quotas for user 1e4df9d2e6b7481f839f36b0ec557949 and project d93a2b945dc646148653736a366e67e7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:12.219405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e8fb6858-41ac-4b6a-b464-7f1649a7ecdd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:12.236265 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8fb6858-41ac-4b6a-b464-7f1649a7ecdd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1233 microversion: 2.1 time: 0.133667 Jul 02 21:09:12.239713 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1145/2206] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:12 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1233 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:12.253669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:12.255635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:12.268077 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0daf70de-1579-4d1c-9787-42dccfdd5f62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.483994 Jul 02 21:09:12.271924 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1062/2207] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:09:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:12.283546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.284091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.295875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.298551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.586312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:12.597487 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7514b835-15e8-458e-bfa5-9a396151e761 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1463 microversion: 2.1 time: 0.353432 Jul 02 21:09:12.598310 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1146/2208] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:12 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1463 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:12.626952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:12.629075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:12.650236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.652912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.659621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.661101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.794843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:12.795670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:12.814457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.815000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.817810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.819363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.876067 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-492243a5-2e02-4798-bc28-989ba5bd6f38 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 0 microversion: 2.1 time: 0.255156 Jul 02 21:09:12.879600 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1063/2209] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:12 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:09:12.885805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:12.886628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:12.898156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.902940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.905712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.906317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.989494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:12.990350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:12.990869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lazy-loading 'fault' on Instance uuid ef3bcf67-5b5e-4038-b770-6025197f7a96 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:09:13.268659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:13.281328 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef36aaa6-c521-488f-ac9b-0de78def571c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.491064 Jul 02 21:09:13.288865 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1147/2210] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:12 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:13.301492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:13.302403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:13.309733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.314322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.317713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.318404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.337549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4cdc1a6-35ae-47ab-b026-c4d7bad7250e tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1597 microversion: 2.1 time: 0.456380 Jul 02 21:09:13.354852 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1064/2211] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:12 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1597 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:13.367834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:13.373778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:13.386276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.386986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.387911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.388498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.464553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:13.474353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:13.485735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:13.491792 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49bf3909-39a7-4dad-86db-7a5d446633d4 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1372 microversion: 2.47 time: 0.196313 Jul 02 21:09:13.495787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1148/2212] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:13 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:13.517272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:13.522457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:13.543878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.546330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.549182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.553111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.634705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:13.648646 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d0af1c9-ccca-4ef9-9339-c8eb343ad82e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1237 microversion: 2.1 time: 0.292373 Jul 02 21:09:13.649246 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1065/2213] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:13 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1237 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:13.771627 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d27df83f-823c-4447-9626-43d61f251f89 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action" status: 202 len: 0 microversion: 2.1 time: 0.273740 Jul 02 21:09:13.772693 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1149/2214] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:13 2022] POST /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:09:13.780440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:13.781453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:13.793101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.793555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:13.794344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:13.794776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:14.113287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbd6f6fa-7071-4f3c-9c9f-f5731c038fd0 tempest-ServersAdminTestJSON-304936633 tempest-ServersAdminTestJSON-304936633-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1614 microversion: 2.1 time: 0.336465 Jul 02 21:09:14.115452 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1066/2215] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:13 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1614 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:14.131904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:14.132479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:14.142339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:14.142791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:14.143584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:14.144408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:14.214174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:14.311825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:14.320311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:14.351299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:14.352029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:14.352866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:14.356060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:14.462278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c59d07dd-940a-49c6-8766-a05c21a1e241 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 204 len: 0 microversion: 2.1 time: 0.332465 Jul 02 21:09:14.464926 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1150/2216] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:14 2022] DELETE /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:09:14.479738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:14.481718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:14.499764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:14.500639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:14.504349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:14.505251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.295015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.312162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.316920 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0e0bae76-1fb7-4ece-902b-3f61653adaea tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1469 microversion: 2.1 time: 0.831663 Jul 02 21:09:15.321577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62b2f531-85bf-4e35-855c-43a8f29fb5ea tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 1.020366 Jul 02 21:09:15.322628 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1151/2217] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:14 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1469 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:15.335185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:15.335185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:15.335969 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1067/2218] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:14 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:15.344293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:15.345186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:15.371542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.372700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.373643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.374218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.379161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.380884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:15.382861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.390287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.392249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.473192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.483938 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2f5ec96-9e06-4a3e-8686-d659d5ef5c10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1291 microversion: 2.1 time: 0.145797 Jul 02 21:09:15.485311 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1068/2219] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:15 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1291 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:15.598888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.610850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.613799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.615755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-47178b77-1bab-43a8-8dea-8f6b3c1e8a12 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1357 microversion: 2.47 time: 0.291748 Jul 02 21:09:15.616981 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1152/2220] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:15 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1357 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:15.622346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-eba1b9e5-bf65-4f0b-a8f1-a5f48cc7622c req-bc746996-a1c3-486c-8c78-fc4dbf1e79dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c496d9-ac70-493d-aa84-383e61614284", "name": "network-vif-plugged", "status": "completed", "tag": "8715cf9f-be3b-4753-9d2f-c3a2496333de"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:15.645865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-eba1b9e5-bf65-4f0b-a8f1-a5f48cc7622c req-bc746996-a1c3-486c-8c78-fc4dbf1e79dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.646753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-eba1b9e5-bf65-4f0b-a8f1-a5f48cc7622c req-bc746996-a1c3-486c-8c78-fc4dbf1e79dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.662952 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-eba1b9e5-bf65-4f0b-a8f1-a5f48cc7622c req-bc746996-a1c3-486c-8c78-fc4dbf1e79dd service nova] Creating event network-vif-plugged:8715cf9f-be3b-4753-9d2f-c3a2496333de for instance c4c496d9-ac70-493d-aa84-383e61614284 on nch1-master-1 Jul 02 21:09:15.668754 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-eba1b9e5-bf65-4f0b-a8f1-a5f48cc7622c req-bc746996-a1c3-486c-8c78-fc4dbf1e79dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050331 Jul 02 21:09:15.670091 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1153/2221] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:15.677572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:15.681267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:15.682466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Searching by: {'deleted': False, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:09:15.689637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.690289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:15.691822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:15.692516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:16.025526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfcdf27c-8ded-47cc-86a1-70faa50d7771 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Calling method '.version_select at 0x7fabd7f8ca60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:16.054152 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-cfcdf27c-8ded-47cc-86a1-70faa50d7771 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] HTTP exception thrown: Image not found. Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfcdf27c-8ded-47cc-86a1-70faa50d7771 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Request method failure captured: Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/7167ec5e-5f8c-4bed-bc06-264eb42e2944/metadata/os_distro HTTP/1.1 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLP7ZT5E4i1gj3gCWODG3QPVSyELleYWFshDkma9tUPowQjCje8X0rC4dDBqvgetT1_1HE3xGjo3xNEVI9yCKAWm9tR1fUdrh_B0Arsu9AuJjmHPdXg0xLXNhYq_oQhoRKitokCc9OPJ3zH1JsLsFGvxScIYXkMTLEzIVjaXDyRKW-Q Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8e7f077e621143d2b88d15523524a992", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8e7f077e621143d2b88d15523524a992"}]}] Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1cd6dc876f6a4812bcf1970c0afe86a7 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'image_id': '7167ec5e-5f8c-4bed-bc06-264eb42e2944', 'id': 'os_distro'} Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7167ec5e-5f8c-4bed-bc06-264eb42e2944 Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:09:16.060483 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7167ec5e-5f8c-4bed-bc06-264eb42e2944 could not be found. Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:09:16.064018 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.068066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfcdf27c-8ded-47cc-86a1-70faa50d7771 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:16.069152 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfcdf27c-8ded-47cc-86a1-70faa50d7771 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] 10.222.0.43 "DELETE /compute/v2.1/images/7167ec5e-5f8c-4bed-bc06-264eb42e2944/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.582771 Jul 02 21:09:16.070355 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1069/2222] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:09:15 2022] DELETE /compute/v2.1/images/7167ec5e-5f8c-4bed-bc06-264eb42e2944/metadata/os_distro => generated 62 bytes in 584 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:16.084655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1b6db17-31af-47d5-bb06-7ba33208557d tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Calling method '.version_select at 0x7fabe40759d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:16.104184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:09:16.129978 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c1b6db17-31af-47d5-bb06-7ba33208557d tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] HTTP exception thrown: Image not found. Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1b6db17-31af-47d5-bb06-7ba33208557d tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Request method failure captured: Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/7044a4d6-1b65-4a0d-8396-8407f06c1a7e/metadata/os_version HTTP/1.1 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLP7ZT5E4i1gj3gCWODG3QPVSyELleYWFshDkma9tUPowQjCje8X0rC4dDBqvgetT1_1HE3xGjo3xNEVI9yCKAWm9tR1fUdrh_B0Arsu9AuJjmHPdXg0xLXNhYq_oQhoRKitokCc9OPJ3zH1JsLsFGvxScIYXkMTLEzIVjaXDyRKW-Q Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8e7f077e621143d2b88d15523524a992", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8e7f077e621143d2b88d15523524a992"}]}] Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1cd6dc876f6a4812bcf1970c0afe86a7 Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'image_id': '7044a4d6-1b65-4a0d-8396-8407f06c1a7e', 'id': 'os_version'} Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7044a4d6-1b65-4a0d-8396-8407f06c1a7e Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:09:16.132162 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7044a4d6-1b65-4a0d-8396-8407f06c1a7e could not be found. Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1b6db17-31af-47d5-bb06-7ba33208557d tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1b6db17-31af-47d5-bb06-7ba33208557d tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] 10.222.0.43 "GET /compute/v2.1/images/7044a4d6-1b65-4a0d-8396-8407f06c1a7e/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.058064 Jul 02 21:09:16.135366 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1070/2223] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:09:16 2022] GET /compute/v2.1/images/7044a4d6-1b65-4a0d-8396-8407f06c1a7e/metadata/os_version => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:09:16.145866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7486a7e5-2dae-4da8-b9c6-45e088120254 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Calling method '.version_select at 0x7fabe40a0f70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:16.171409 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7486a7e5-2dae-4da8-b9c6-45e088120254 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] HTTP exception thrown: Image not found. Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7486a7e5-2dae-4da8-b9c6-45e088120254 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Request method failure captured: Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/203826ce-38df-4e71-b431-7634dc23342e/metadata HTTP/1.1 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLP7ZT5E4i1gj3gCWODG3QPVSyELleYWFshDkma9tUPowQjCje8X0rC4dDBqvgetT1_1HE3xGjo3xNEVI9yCKAWm9tR1fUdrh_B0Arsu9AuJjmHPdXg0xLXNhYq_oQhoRKitokCc9OPJ3zH1JsLsFGvxScIYXkMTLEzIVjaXDyRKW-Q Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8e7f077e621143d2b88d15523524a992", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8e7f077e621143d2b88d15523524a992"}]}] Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1cd6dc876f6a4812bcf1970c0afe86a7 Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'image_id': '203826ce-38df-4e71-b431-7634dc23342e'} Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 203826ce-38df-4e71-b431-7634dc23342e Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:09:16.173989 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 203826ce-38df-4e71-b431-7634dc23342e could not be found. Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7486a7e5-2dae-4da8-b9c6-45e088120254 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7486a7e5-2dae-4da8-b9c6-45e088120254 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] 10.222.0.43 "GET /compute/v2.1/images/203826ce-38df-4e71-b431-7634dc23342e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035172 Jul 02 21:09:16.177212 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1071/2224] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:09:16 2022] GET /compute/v2.1/images/203826ce-38df-4e71-b431-7634dc23342e/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:16.188750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-612b3bda-1cf5-486a-9c5d-eee062d72f61 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Action: 'update_all', calling method: .version_select at 0x7fabe40a0f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:16.220841 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-612b3bda-1cf5-486a-9c5d-eee062d72f61 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] HTTP exception thrown: Image not found. Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-612b3bda-1cf5-486a-9c5d-eee062d72f61 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Request method failure captured: Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/images/adcdc6eb-0968-4e01-bb83-e0b99eafcc96/metadata HTTP/1.1 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 57 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLP7ZT5E4i1gj3gCWODG3QPVSyELleYWFshDkma9tUPowQjCje8X0rC4dDBqvgetT1_1HE3xGjo3xNEVI9yCKAWm9tR1fUdrh_B0Arsu9AuJjmHPdXg0xLXNhYq_oQhoRKitokCc9OPJ3zH1JsLsFGvxScIYXkMTLEzIVjaXDyRKW-Q Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8e7f077e621143d2b88d15523524a992", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8e7f077e621143d2b88d15523524a992"}]}] Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1cd6dc876f6a4812bcf1970c0afe86a7 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'image_id': 'adcdc6eb-0968-4e01-bb83-e0b99eafcc96', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID adcdc6eb-0968-4e01-bb83-e0b99eafcc96 Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:09:16.223984 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image adcdc6eb-0968-4e01-bb83-e0b99eafcc96 could not be found. Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-612b3bda-1cf5-486a-9c5d-eee062d72f61 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-612b3bda-1cf5-486a-9c5d-eee062d72f61 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] 10.222.0.43 "PUT /compute/v2.1/images/adcdc6eb-0968-4e01-bb83-e0b99eafcc96/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043998 Jul 02 21:09:16.227180 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1072/2225] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:09:16 2022] PUT /compute/v2.1/images/adcdc6eb-0968-4e01-bb83-e0b99eafcc96/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:09:16.237433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:16.241460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2928bff-9166-43c3-b0d5-4206bd40db9c tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Action: 'update', calling method: .version_select at 0x7fabe4075550>, body: {"meta": {"os_distro": "alt"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:16.245562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:16.246257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:16.259464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:16.261031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:16.283986 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b2928bff-9166-43c3-b0d5-4206bd40db9c tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] HTTP exception thrown: Image not found. Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2928bff-9166-43c3-b0d5-4206bd40db9c tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Request method failure captured: Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/images/653eff2e-6695-4ea2-8be4-9029a61a19e1/metadata/os_distro HTTP/1.1 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 30 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLP7ZT5E4i1gj3gCWODG3QPVSyELleYWFshDkma9tUPowQjCje8X0rC4dDBqvgetT1_1HE3xGjo3xNEVI9yCKAWm9tR1fUdrh_B0Arsu9AuJjmHPdXg0xLXNhYq_oQhoRKitokCc9OPJ3zH1JsLsFGvxScIYXkMTLEzIVjaXDyRKW-Q Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8e7f077e621143d2b88d15523524a992", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8e7f077e621143d2b88d15523524a992"}]}] Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1cd6dc876f6a4812bcf1970c0afe86a7 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: {"meta": {"os_distro": "alt"}} Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'image_id': '653eff2e-6695-4ea2-8be4-9029a61a19e1', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 653eff2e-6695-4ea2-8be4-9029a61a19e1 Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:09:16.286509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 653eff2e-6695-4ea2-8be4-9029a61a19e1 could not be found. Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b2928bff-9166-43c3-b0d5-4206bd40db9c tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:16.292235 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b2928bff-9166-43c3-b0d5-4206bd40db9c tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] 10.222.0.43 "PUT /compute/v2.1/images/653eff2e-6695-4ea2-8be4-9029a61a19e1/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.058214 Jul 02 21:09:16.295864 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1073/2226] 10.222.0.43 () {60 vars in 1309 bytes} [Sat Jul 2 21:09:16 2022] PUT /compute/v2.1/images/653eff2e-6695-4ea2-8be4-9029a61a19e1/metadata/os_distro => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:16.304206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "3087759e-7dcb-4acb-bc76-b70866589937"}], "security_groups": [{"name": "tempest-securitygroup--1615027724"}], "key_name": "tempest-keypair-2128598921", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:16.343310 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34017853-0588-482c-92c6-214f038f55ef tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.671534 Jul 02 21:09:16.344507 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1154/2227] 10.222.0.43 () {60 vars in 1186 bytes} [Sat Jul 2 21:09:15 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:16.352667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0aa8cbdc-85e1-47d0-940d-8341f5655fb8 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Action: 'create', calling method: .version_select at 0x7fabea17c310>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:16.385634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0aa8cbdc-85e1-47d0-940d-8341f5655fb8 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] HTTP exception thrown: Image not found. Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0aa8cbdc-85e1-47d0-940d-8341f5655fb8 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Request method failure captured: Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/images/00bf1190-5635-4851-8780-c6ee0beeef05/metadata HTTP/1.1 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 57 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLP7ZT5E4i1gj3gCWODG3QPVSyELleYWFshDkma9tUPowQjCje8X0rC4dDBqvgetT1_1HE3xGjo3xNEVI9yCKAWm9tR1fUdrh_B0Arsu9AuJjmHPdXg0xLXNhYq_oQhoRKitokCc9OPJ3zH1JsLsFGvxScIYXkMTLEzIVjaXDyRKW-Q Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8e7f077e621143d2b88d15523524a992", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8e7f077e621143d2b88d15523524a992"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8e7f077e621143d2b88d15523524a992"}]}] Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8e7f077e621143d2b88d15523524a992 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-949028223 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1cd6dc876f6a4812bcf1970c0afe86a7 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-949028223-project Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'image_id': '00bf1190-5635-4851-8780-c6ee0beeef05', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 00bf1190-5635-4851-8780-c6ee0beeef05 Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:09:16.388816 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 00bf1190-5635-4851-8780-c6ee0beeef05 could not be found. Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0aa8cbdc-85e1-47d0-940d-8341f5655fb8 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0aa8cbdc-85e1-47d0-940d-8341f5655fb8 tempest-ImagesMetadataNegativeTestJSON-949028223 tempest-ImagesMetadataNegativeTestJSON-949028223-project] 10.222.0.43 "POST /compute/v2.1/images/00bf1190-5635-4851-8780-c6ee0beeef05/metadata" status: 404 len: 62 microversion: 2.1 time: 0.044069 Jul 02 21:09:16.392331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1155/2228] 10.222.0.43 () {60 vars in 1280 bytes} [Sat Jul 2 21:09:16 2022] POST /compute/v2.1/images/00bf1190-5635-4851-8780-c6ee0beeef05/metadata => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:16.405439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:16.407776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:16.419485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:16.420242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:16.421457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:16.422096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:16.715048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] validate_networks() for [('3087759e-7dcb-4acb-bc76-b70866589937', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:09:16.952523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:16.965566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44b7cd92-89a0-4591-b6e8-26b6eedaaa3c tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1469 microversion: 2.1 time: 0.569296 Jul 02 21:09:16.967706 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1156/2229] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:16 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1469 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:16.975086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:16.976056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:16.985959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:16.987216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:16.988318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:16.989848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.434695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:17.450076 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f9e493c-8333-4a2f-8ad1-335fd6858892 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1332 microversion: 2.1 time: 0.479929 Jul 02 21:09:17.451804 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1157/2230] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:16 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1332 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:17.458735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:17.459870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:17.469817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:17.470778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.472412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:17.473015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.478979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:17.508188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:17.665100 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d12eb437-4694-4eee-8658-b23316a04279 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "DELETE /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 204 len: 0 microversion: 2.47 time: 0.211155 Jul 02 21:09:17.666368 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1158/2231] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:09:17 2022] DELETE /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:09:17.681073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:17.686292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:17.704069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:17.704546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.705346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:17.709804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.843489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:09:17.844751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:09:17.845602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:09:17.846213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:09:17.846988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:09:17.867343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:17.868200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.869751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:17.870487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:17.905589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Getting quotas for project d93a2b945dc646148653736a366e67e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:17.915398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Getting quotas for user 1e4df9d2e6b7481f839f36b0ec557949 and project d93a2b945dc646148653736a366e67e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:17.939578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:09:17.942680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:09:17.984935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:18.012586 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f05fbb23-5e4b-4863-bf8f-edbcafe1cb40 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.714760 Jul 02 21:09:18.013510 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1074/2232] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:09:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:09:18.019329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:18.020336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:18.028206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.029039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.030068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.030749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.072262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.085392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-222d376c-197e-445e-9484-5929c99373af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1358 microversion: 2.1 time: 0.409538 Jul 02 21:09:18.086408 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1159/2233] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:17 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1358 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:18.102113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2d235b89-3499-4035-83e7-b6644f857285 req-417694bf-af87-46c2-828b-6d2b03dd07f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:18.114928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2d235b89-3499-4035-83e7-b6644f857285 req-417694bf-af87-46c2-828b-6d2b03dd07f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.115604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2d235b89-3499-4035-83e7-b6644f857285 req-417694bf-af87-46c2-828b-6d2b03dd07f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.138730 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2d235b89-3499-4035-83e7-b6644f857285 req-417694bf-af87-46c2-828b-6d2b03dd07f0 service nova] Creating event network-changed:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch2-master-1 Jul 02 21:09:18.157948 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2d235b89-3499-4035-83e7-b6644f857285 req-417694bf-af87-46c2-828b-6d2b03dd07f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070259 Jul 02 21:09:18.158763 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1160/2234] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:18.181901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:18.185099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:18.200722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.201183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.201980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.202421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.250219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.266827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.268504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.269697 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0892543-7484-432a-8b75-f6a364e3b80c tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1363 microversion: 2.47 time: 0.254778 Jul 02 21:09:18.274893 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1075/2235] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:18 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:18.286201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64192c77-ea66-41d2-af77-8d4980ec7068 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:18.287232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64192c77-ea66-41d2-af77-8d4980ec7068 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:18.528212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64192c77-ea66-41d2-af77-8d4980ec7068 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.543088 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64192c77-ea66-41d2-af77-8d4980ec7068 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1226 microversion: 2.1 time: 0.262955 Jul 02 21:09:18.545034 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1076/2236] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:18 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1226 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:18.562973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:18.565152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:18.585526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.586248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.587261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.587878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.670032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.684421 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-19d907aa-601c-4d0d-8eba-5039e1af2e13 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1427 microversion: 2.1 time: 0.517500 Jul 02 21:09:18.685631 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1161/2237] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:18 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1427 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:18.866791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-00886bed-90c5-443a-a55e-4fe54ca8e34b req-1b7b1b88-e3c0-456e-ab43-fffab2dac015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0088d04-8df6-4deb-8abe-630b761d2c39", "name": "network-vif-deleted", "tag": "b050c162-ea74-4a29-b0c0-c047c6ec2703"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:18.901902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-00886bed-90c5-443a-a55e-4fe54ca8e34b req-1b7b1b88-e3c0-456e-ab43-fffab2dac015 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:18.902768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-00886bed-90c5-443a-a55e-4fe54ca8e34b req-1b7b1b88-e3c0-456e-ab43-fffab2dac015 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:18.928898 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-00886bed-90c5-443a-a55e-4fe54ca8e34b req-1b7b1b88-e3c0-456e-ab43-fffab2dac015 service nova] Creating event network-vif-deleted:b050c162-ea74-4a29-b0c0-c047c6ec2703 for instance b0088d04-8df6-4deb-8abe-630b761d2c39 on nch1-master-1 Jul 02 21:09:18.939390 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-00886bed-90c5-443a-a55e-4fe54ca8e34b req-1b7b1b88-e3c0-456e-ab43-fffab2dac015 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082134 Jul 02 21:09:18.945110 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1162/2238] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:09:18.964315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:18.975254 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87b95b59-a8a9-4947-8083-ca06eb8727aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1535 microversion: 2.1 time: 0.427685 Jul 02 21:09:18.976524 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1077/2239] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:18 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1535 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:18.995127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a031703-0f64-4ec9-ab58-657e94e51c3f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'create', calling method: .version_select at 0x7fabea1aa0d0>, body: {"pool": "f531777e-f940-4d67-924e-573dd82b0c42"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:19.103005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:19.103823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:19.114490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:19.114946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:19.128130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:19.128890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:19.569787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:19.589781 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a82d4b0-54ce-4063-b95d-22b60d759875 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1358 microversion: 2.1 time: 0.490580 Jul 02 21:09:19.603446 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1078/2240] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:19 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1358 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:19.613633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:19.622209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:19.639595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:19.640443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:19.641452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:19.642428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:19.817634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:19.834405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:19.840699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:19.842514 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11546ed3-ac5f-4c15-969f-4a1ce13b147e tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1363 microversion: 2.47 time: 0.236901 Jul 02 21:09:19.855468 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1079/2241] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:19 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:19.859372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:19.860275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:19.869936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:19.870390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:19.871320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:19.871914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:19.962773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:19.976825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aed86088-e7bf-47b1-bd11-d4c405a8209e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1222 microversion: 2.1 time: 0.127434 Jul 02 21:09:19.979724 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1080/2242] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:19 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:19.990394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:19.992161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:20.013372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:20.015933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:20.018128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:20.018587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:20.066651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:20.067263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:20.068010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lazy-loading 'fault' on Instance uuid b0088d04-8df6-4deb-8abe-630b761d2c39 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:09:20.128241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:20.137153 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69a8a0e9-8bd3-4d9e-95f3-37656bcc0fab tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 200 len: 1304 microversion: 2.1 time: 0.156119 Jul 02 21:09:20.138173 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1081/2243] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:19 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:20.316382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e07e564-9b41-4a52-a18a-0d64f714eb87 tempest-ListImagesTestJSON-965828485 tempest-ListImagesTestJSON-965828485-project] Calling method '.version_select at 0x7fabe42ad430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:20.378118 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e07e564-9b41-4a52-a18a-0d64f714eb87 tempest-ListImagesTestJSON-965828485 tempest-ListImagesTestJSON-965828485-project] 10.222.0.43 "GET /compute/v2.1/images/e482b755-1c1a-4758-a7c0-b3edf1610541" status: 200 len: 784 microversion: 2.1 time: 0.238651 Jul 02 21:09:20.391096 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1082/2244] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:09:20 2022] GET /compute/v2.1/images/e482b755-1c1a-4758-a7c0-b3edf1610541 => generated 784 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:20.397665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81bcb050-5650-48c2-b3e5-e4ffc7ed7c91 tempest-ListImagesTestJSON-965828485 tempest-ListImagesTestJSON-965828485-project] Calling method '.version_select at 0x7fabe487c280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:20.510856 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81bcb050-5650-48c2-b3e5-e4ffc7ed7c91 tempest-ListImagesTestJSON-965828485 tempest-ListImagesTestJSON-965828485-project] 10.222.0.43 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.118217 Jul 02 21:09:20.512017 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1083/2245] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:20 2022] GET /compute/v2.1/images => generated 445 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:20.525047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7646bf40-658f-4eaf-a4bb-90245fccb151 tempest-ListImagesTestJSON-965828485 tempest-ListImagesTestJSON-965828485-project] Calling method '.version_select at 0x7fabe42adc10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:20.633788 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7646bf40-658f-4eaf-a4bb-90245fccb151 tempest-ListImagesTestJSON-965828485 tempest-ListImagesTestJSON-965828485-project] 10.222.0.43 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.112711 Jul 02 21:09:20.634701 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1084/2246] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:09:20 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:09:20.644171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:20.644812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:20.663811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:20.668183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:20.673723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:20.674379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:20.971968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:20.991817 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f079278c-2614-4fb8-8c3f-798ebf8669bf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1358 microversion: 2.1 time: 0.354980 Jul 02 21:09:20.995010 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1085/2247] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:20 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:21.006991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:21.008885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:21.026514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.027342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.028425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.029122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.112712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.114012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.114751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lazy-loading 'fault' on Instance uuid 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:09:21.229671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:21.254266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:21.262469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:21.263737 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edb3a578-0e45-4d9e-8b36-57a6806c0c63 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 200 len: 1368 microversion: 2.47 time: 0.266704 Jul 02 21:09:21.267842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1086/2248] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:20 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:21.279581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:21.281649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:21.305556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.308593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.309734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.311796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.501885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:21.517205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ad17f9b-dd43-401a-adae-69ee1e057f10 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1278 microversion: 2.1 time: 0.247898 Jul 02 21:09:21.518403 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1087/2249] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:21 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:21.523645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:21.524732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: b0088d04-8df6-4deb-8abe-630b761d2c39] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:21.532729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.533822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.535039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.537020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.559007 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] HTTP exception thrown: Instance b0088d04-8df6-4deb-8abe-630b761d2c39 could not be found. Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Request method failure captured: Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 HTTP/1.1 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLNpdF_QJxKFVVIN4QW4AwvvKEvNUkty-UN6FvgjLTXzMez-scMEEv-1UwR_5J6fgxvlflI04v-YqkBMOPpmi0uaMumI2cJxFGmK6SVn5mIteR2ClgwVXUBx59Aeqb-T-s7x1ZF_YoKnXBaIW0C8VtYqk9PXMQtcy8GR1Wyc3c2ozI4 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 381ec26b4d1240b4889b5ecfebf02610 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/381ec26b4d1240b4889b5ecfebf02610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_381ec26b4d1240b4889b5ecfebf02610", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/381ec26b4d1240b4889b5ecfebf02610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/381ec26b4d1240b4889b5ecfebf02610"}]}] Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 381ec26b4d1240b4889b5ecfebf02610 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminTestJSON-1470187372-project Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 5198cb44d38d495794cc8b0fc5d9d4c3 Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminTestJSON-1470187372-project Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b0088d04-8df6-4deb-8abe-630b761d2c39 could not be found. Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b0088d04-8df6-4deb-8abe-630b761d2c39'} Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0088d04-8df6-4deb-8abe-630b761d2c39 could not be found. Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0088d04-8df6-4deb-8abe-630b761d2c39 could not be found. Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:21.561017 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0088d04-8df6-4deb-8abe-630b761d2c39 could not be found. Jul 02 21:09:21.564383 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:21.566404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Returning 404 to user: Instance b0088d04-8df6-4deb-8abe-630b761d2c39 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:21.568058 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d9d0c2e-93f2-4995-85b5-2217be067007 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39" status: 404 len: 111 microversion: 2.1 time: 0.048321 Jul 02 21:09:21.569314 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1088/2250] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:21 2022] GET /compute/v2.1/servers/b0088d04-8df6-4deb-8abe-630b761d2c39 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:21.580299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:21.581349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:21.588693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.589547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.590552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.591197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.621800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:21.679602 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a031703-0f64-4ec9-ab58-657e94e51c3f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.690364 Jul 02 21:09:21.688652 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1163/2251] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:09:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:21.694979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'action', calling method: .version_select at 0x7fabe7476040>, body: {"addFloatingIp": {"address": "172.35.6.120"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:21.699617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:21.712721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.719649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.720893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.721620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.766129 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-184d25c3-0575-4c4f-90fc-0481ec61188a tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 204 len: 0 microversion: 2.1 time: 0.191695 Jul 02 21:09:21.766919 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1089/2252] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:21 2022] DELETE /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:09:21.780264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:21.781847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:21.796432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.798985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.800873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:21.801200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:21.906799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Acquired lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:09:22.157352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:22.170791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1572ca3b-93d6-47cb-bce2-6f8c8668c1c1 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1469 microversion: 2.1 time: 0.398491 Jul 02 21:09:22.171754 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1090/2253] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:21 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:22.176796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:22.177476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:22.189785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:22.192649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:22.194525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:22.195427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:22.506912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:22.515718 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09464127-bf8f-40ed-833a-d4d351c318b5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1358 microversion: 2.1 time: 0.342468 Jul 02 21:09:22.516004 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1091/2254] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:22 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:22.544169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:22.546893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:22.555961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:22.556817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:22.557819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:22.558461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:22.580165 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] HTTP exception thrown: Instance 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d could not be found. Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Request method failure captured: Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d HTTP/1.1 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPOpTfjPtpewOrSDwn9FRtAa4EMc1t5iFAZwXm7fmwzj1eR-Vntvn0vJakKnpeEKx9eEd_c3_wTecnOiMaSwaQSwmb4WdLZ49YMuxp-2U1oMQ1PP0xW0RLrEeGBp4xIkDpX6HmDIBkJ9hoGJEwyPfRmCa0epR485eRDdm60-XrSb4E Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.47 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 90cdcd51251b4b8b8b58802cdbc1713c Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerShowV247Test-1079190923 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90cdcd51251b4b8b8b58802cdbc1713c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_90cdcd51251b4b8b8b58802cdbc1713c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90cdcd51251b4b8b8b58802cdbc1713c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/90cdcd51251b4b8b8b58802cdbc1713c"}]}] Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerShowV247Test-1079190923 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 90cdcd51251b4b8b8b58802cdbc1713c Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerShowV247Test-1079190923 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerShowV247Test-1079190923-project Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8b412fbcf382468c97d7d4f688f5e5b3 Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerShowV247Test-1079190923-project Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d could not be found. Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '43209cc0-90b0-4ee1-bdf9-2eb761c7c76d'} Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d could not be found. Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d could not be found. Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:22.582430 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d could not be found. Jul 02 21:09:22.586609 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:22.587553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Returning 404 to user: Instance 43209cc0-90b0-4ee1-bdf9-2eb761c7c76d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:22.588543 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35f9743c-5a08-486a-9279-560de0701637 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d" status: 404 len: 111 microversion: 2.47 time: 0.056194 Jul 02 21:09:22.593628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1092/2255] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:22 2022] GET /compute/v2.1/servers/43209cc0-90b0-4ee1-bdf9-2eb761c7c76d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:09:22.600751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:22.601584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:22.609544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:22.610142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:22.611062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:22.611593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:22.632753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:23.081053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:23.090595 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-052ca23f-fbc4-4ddc-a6f9-bdc121991785 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1284 microversion: 2.1 time: 0.495697 Jul 02 21:09:23.104770 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1093/2256] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:22 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1284 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:23.109714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:23.110248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: e83447dc-efc9-4cb3-bb05-f2368fbd61a3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:23.122032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:23.126898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:23.127835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:23.128714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:23.185273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: e83447dc-efc9-4cb3-bb05-f2368fbd61a3] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:23.356079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33cde9ef-976c-4996-a6ac-30160f7259e3 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3" status: 204 len: 0 microversion: 2.47 time: 0.249115 Jul 02 21:09:23.359390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1094/2257] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:09:23 2022] DELETE /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:09:23.367027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:23.367956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:23.375491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:23.376244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:23.377248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:23.377828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:23.858980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:23.868406 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc9cb784-40d1-4e48-b9b2-22e2a6d878fb tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 200 len: 1469 microversion: 2.1 time: 0.507381 Jul 02 21:09:23.869899 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1095/2258] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:23 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 1469 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:23.875200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:23.876147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: e83447dc-efc9-4cb3-bb05-f2368fbd61a3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:23.883090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:23.884159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:23.885046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:23.885484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:24.055037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:24.065537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:24.066634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b412fbcf382468c97d7d4f688f5e5b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90cdcd51251b4b8b8b58802cdbc1713c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:24.071238 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6dab0ecb-9030-40a7-a63d-f2b7337b2ac5 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3" status: 200 len: 1363 microversion: 2.47 time: 0.196826 Jul 02 21:09:24.081476 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1096/2259] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:23 2022] GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:24.357803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1e94569-ed5c-4917-ab58-dd4f56240b60 tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Calling method '.version_select at 0x7fabe42a4b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:24.412269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e94569-ed5c-4917-ab58-dd4f56240b60 tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:24.426127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e94569-ed5c-4917-ab58-dd4f56240b60 tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:24.429772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e94569-ed5c-4917-ab58-dd4f56240b60 tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:24.430239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1e94569-ed5c-4917-ab58-dd4f56240b60 tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:24.512823 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1e94569-ed5c-4917-ab58-dd4f56240b60 tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] 10.222.0.43 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.435014 Jul 02 21:09:24.514033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1097/2260] 10.222.0.43 () {58 vars in 1121 bytes} [Sat Jul 2 21:09:24 2022] GET /compute/v2.1/limits => generated 511 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:24.549851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:24.554387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:24.582455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:24.587463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:24.591471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:24.594646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:24.800480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:09:24.952138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:24.968301 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d60f8573-b1ec-4d15-8778-1bfa4085fbd3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1358 microversion: 2.1 time: 0.452837 Jul 02 21:09:24.969294 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1098/2261] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:24 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1358 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:24.980631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:24.984492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:24.999680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:25.001052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:25.007147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:25.007814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:25.499732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:25.510725 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83b26443-784c-4501-8388-9620527ea832 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1352 microversion: 2.1 time: 0.539473 Jul 02 21:09:25.515760 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1099/2262] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:24 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1352 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:25.528196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1660001292", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:25.627800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:09:25.884768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:26.235242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:26.338230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Getting quotas for project 0f9d84cb672744259fd2e632c2374599. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:26.344848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Getting quotas for user acb734b254b64b87a38e22d98e929080 and project 0f9d84cb672744259fd2e632c2374599. Resources: dict_keys(['metadata_items']) {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:26.361141 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Request method failure captured: Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 1752 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQDY3SS4KO8Eq3AhRuFrgTgrODCXFs7FItfYFzxC3a-6n4ewr1L7h5DrEB_avqQVfo_VG4pu2a_qSp9BClJtwhdL1lslYF8NkgFhz0byB4WffllccEGLsA47amwr0EuVqomJCTWzF23NFjTrLMnevdzNyAlXNq0j9asg3B-NUEXJuE Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 0f9d84cb672744259fd2e632c2374599 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1691748564 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f9d84cb672744259fd2e632c2374599"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0f9d84cb672744259fd2e632c2374599", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0f9d84cb672744259fd2e632c2374599"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0f9d84cb672744259fd2e632c2374599"}]}] Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1691748564 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 0f9d84cb672744259fd2e632c2374599 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1691748564 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: acb734b254b64b87a38e22d98e929080 Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1660001292", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:26.363812 ncdv-master-1 devstack@n-api.service[131044]: exception: Maximum number of metadata items exceeds 128 Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1660001292', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:26.365793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 02 21:09:26.369599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.371947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:26.373241 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-438b02cf-3c42-4c4e-9df9-f351290f5b3a tempest-AbsoluteLimitsNegativeTestJSON-1691748564 tempest-AbsoluteLimitsNegativeTestJSON-1691748564-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.851793 Jul 02 21:09:26.374419 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1100/2263] 10.222.0.43 () {60 vars in 1147 bytes} [Sat Jul 2 21:09:25 2022] POST /compute/v2.1/servers => generated 87 bytes in 857 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:26.380127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ca845b5b-7d07-41ea-9699-585cbe044bd7 req-f584a8ff-57de-44d8-8158-50bc424cd161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c496d9-ac70-493d-aa84-383e61614284", "tag": "8715cf9f-be3b-4753-9d2f-c3a2496333de"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:26.390299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca845b5b-7d07-41ea-9699-585cbe044bd7 req-f584a8ff-57de-44d8-8158-50bc424cd161 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.392431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ca845b5b-7d07-41ea-9699-585cbe044bd7 req-f584a8ff-57de-44d8-8158-50bc424cd161 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.440994 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ca845b5b-7d07-41ea-9699-585cbe044bd7 req-f584a8ff-57de-44d8-8158-50bc424cd161 service nova] Creating event network-changed:8715cf9f-be3b-4753-9d2f-c3a2496333de for instance c4c496d9-ac70-493d-aa84-383e61614284 on nch1-master-1 Jul 02 21:09:26.457973 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ca845b5b-7d07-41ea-9699-585cbe044bd7 req-f584a8ff-57de-44d8-8158-50bc424cd161 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081858 Jul 02 21:09:26.463151 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1101/2264] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:26.476168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:26.476897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: 5e56357a-da4c-449a-841c-de49a1756c81] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:26.501514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Updating instance_info_cache with network_info: [{"id": "8715cf9f-be3b-4753-9d2f-c3a2496333de", "address": "fa:16:3e:4c:a1:eb", "network": {"id": "a7ccdb17-5853-46d8-ac7b-46a7b535ef5b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-449054535-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a54682a0b9f34993a0e616507695307e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8715cf9f-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:09:26.546406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.547038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.547904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.557644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.567324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Releasing lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:09:26.572441 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-077c3d33-d6cd-4164-88dc-1cb03c1b64ae tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action" status: 202 len: 0 microversion: 2.1 time: 4.882042 Jul 02 21:09:26.574245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1164/2265] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:21 2022] POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action => generated 0 bytes in 4884 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:09:26.592803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-557e202c-4571-48a5-8401-f2ee7ed2d346 req-ed2f5f36-506e-4858-b3f2-9ad03075c43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "name": "network-vif-plugged", "status": "completed", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:26.598159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:26.609527 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] HTTP exception thrown: Instance 5e56357a-da4c-449a-841c-de49a1756c81 could not be found. Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Request method failure captured: Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 HTTP/1.1 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLNpdF_QJxKFVVIN4QW4AwvvKEvNUkty-UN6FvgjLTXzMez-scMEEv-1UwR_5J6fgxvlflI04v-YqkBMOPpmi0uaMumI2cJxFGmK6SVn5mIteR2ClgwVXUBx59Aeqb-T-s7x1ZF_YoKnXBaIW0C8VtYqk9PXMQtcy8GR1Wyc3c2ozI4 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 381ec26b4d1240b4889b5ecfebf02610 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/381ec26b4d1240b4889b5ecfebf02610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_381ec26b4d1240b4889b5ecfebf02610", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/381ec26b4d1240b4889b5ecfebf02610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/381ec26b4d1240b4889b5ecfebf02610"}]}] Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 381ec26b4d1240b4889b5ecfebf02610 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminTestJSON-1470187372-project Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 5198cb44d38d495794cc8b0fc5d9d4c3 Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminTestJSON-1470187372-project Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 5e56357a-da4c-449a-841c-de49a1756c81 could not be found. Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5e56357a-da4c-449a-841c-de49a1756c81'} Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e56357a-da4c-449a-841c-de49a1756c81 could not be found. Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e56357a-da4c-449a-841c-de49a1756c81 could not be found. Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.623330 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e56357a-da4c-449a-841c-de49a1756c81 could not be found. Jul 02 21:09:26.627418 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.636233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Returning 404 to user: Instance 5e56357a-da4c-449a-841c-de49a1756c81 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:26.637638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-557e202c-4571-48a5-8401-f2ee7ed2d346 req-ed2f5f36-506e-4858-b3f2-9ad03075c43c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.638642 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-456e34ce-81b3-4e25-a2f7-1f50b215cb46 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81" status: 404 len: 111 microversion: 2.1 time: 0.172239 Jul 02 21:09:26.639357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-557e202c-4571-48a5-8401-f2ee7ed2d346 req-ed2f5f36-506e-4858-b3f2-9ad03075c43c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.640201 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1102/2266] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:26 2022] GET /compute/v2.1/servers/5e56357a-da4c-449a-841c-de49a1756c81 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:26.653681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:26.656534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] [instance: e83447dc-efc9-4cb3-bb05-f2368fbd61a3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:26.686224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-557e202c-4571-48a5-8401-f2ee7ed2d346 req-ed2f5f36-506e-4858-b3f2-9ad03075c43c service nova] Creating event network-vif-plugged:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch2-master-1 Jul 02 21:09:26.688330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.688967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.689822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.690272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.699349 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-557e202c-4571-48a5-8401-f2ee7ed2d346 req-ed2f5f36-506e-4858-b3f2-9ad03075c43c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123667 Jul 02 21:09:26.699958 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1165/2267] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:26.721513 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] HTTP exception thrown: Instance e83447dc-efc9-4cb3-bb05-f2368fbd61a3 could not be found. Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Request method failure captured: Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3 HTTP/1.1 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPOpTfjPtpewOrSDwn9FRtAa4EMc1t5iFAZwXm7fmwzj1eR-Vntvn0vJakKnpeEKx9eEd_c3_wTecnOiMaSwaQSwmb4WdLZ49YMuxp-2U1oMQ1PP0xW0RLrEeGBp4xIkDpX6HmDIBkJ9hoGJEwyPfRmCa0epR485eRDdm60-XrSb4E Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.47 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 90cdcd51251b4b8b8b58802cdbc1713c Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerShowV247Test-1079190923 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90cdcd51251b4b8b8b58802cdbc1713c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_90cdcd51251b4b8b8b58802cdbc1713c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90cdcd51251b4b8b8b58802cdbc1713c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/90cdcd51251b4b8b8b58802cdbc1713c"}]}] Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerShowV247Test-1079190923 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 90cdcd51251b4b8b8b58802cdbc1713c Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerShowV247Test-1079190923 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerShowV247Test-1079190923-project Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8b412fbcf382468c97d7d4f688f5e5b3 Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerShowV247Test-1079190923-project Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance e83447dc-efc9-4cb3-bb05-f2368fbd61a3 could not be found. Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'e83447dc-efc9-4cb3-bb05-f2368fbd61a3'} Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e83447dc-efc9-4cb3-bb05-f2368fbd61a3 could not be found. Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e83447dc-efc9-4cb3-bb05-f2368fbd61a3 could not be found. Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:26.723115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e83447dc-efc9-4cb3-bb05-f2368fbd61a3 could not be found. Jul 02 21:09:26.726632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:26.727014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:26.727014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:26.729265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] Returning 404 to user: Instance e83447dc-efc9-4cb3-bb05-f2368fbd61a3 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:26.730171 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6571e1c2-5107-4b6a-a169-8f4a519342f0 tempest-ServerShowV247Test-1079190923 tempest-ServerShowV247Test-1079190923-project] 10.222.0.43 "GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3" status: 404 len: 111 microversion: 2.47 time: 0.087809 Jul 02 21:09:26.730744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1103/2268] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:26 2022] GET /compute/v2.1/servers/e83447dc-efc9-4cb3-bb05-f2368fbd61a3 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:09:26.734763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.735599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.736504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.736951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.742109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:26.742735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:26.758801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.759265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:26.760088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:26.760538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:27.452514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:27.462326 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71603f5a-f156-4d77-9809-d42732e41db9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1358 microversion: 2.1 time: 0.761106 Jul 02 21:09:27.463677 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1166/2269] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:26 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1358 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:27.468854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e65b5801-0cba-42c6-8765-c4e07e481f1c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'create', calling method: .version_select at 0x7fabea17c820>, body: {"pool": "f531777e-f940-4d67-924e-573dd82b0c42"} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:27.475933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:27.488739 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3202d2ee-962c-4403-a785-803990ff379f tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1352 microversion: 2.1 time: 0.748976 Jul 02 21:09:27.490097 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1104/2270] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:26 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1352 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:27.775308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-280043790", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f2a9c719-8e72-43e6-a74a-e5e70d8bff16"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:27.833782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] validate_networks() for [('f2a9c719-8e72-43e6-a74a-e5e70d8bff16', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:09:29.442968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:09:29.443542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:09:29.444422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:09:29.445242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:09:29.460892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:09:29.474840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.476448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:29.478293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.479057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:29.505982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Getting quotas for project 90c7a815db0145889cf47ebcca5843f6. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:29.518167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Getting quotas for user ae104851a64c4638abd70af95f27d4fa and project 90c7a815db0145889cf47ebcca5843f6. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:29.536412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:09:29.538851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:09:29.550995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=95,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:29.593914 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-91436f74-6ad3-45e4-94a4-6f9bfa0dede9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.098593 Jul 02 21:09:29.595374 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1105/2271] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:09:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:09:29.614921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:29.615523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:29.627673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.627842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:29.628870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.629690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:29.667889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:29.786408 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbbb9cf7-eb27-40bd-9c54-254d0c070605 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 204 len: 0 microversion: 2.1 time: 0.181032 Jul 02 21:09:29.791636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1106/2272] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:29 2022] DELETE /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:09:29.797936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-236b2f1c-7ce1-498b-ab18-7e7487eaefb3 req-d16e9853-3121-4029-9ca4-3ae7d687383e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b4ef26-c265-451f-b265-fd4496b083b9", "tag": "9df4b96a-109f-4f80-bdef-6936978a9c4e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:29.808978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-236b2f1c-7ce1-498b-ab18-7e7487eaefb3 req-d16e9853-3121-4029-9ca4-3ae7d687383e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.809401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-236b2f1c-7ce1-498b-ab18-7e7487eaefb3 req-d16e9853-3121-4029-9ca4-3ae7d687383e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:29.831029 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-236b2f1c-7ce1-498b-ab18-7e7487eaefb3 req-d16e9853-3121-4029-9ca4-3ae7d687383e service nova] Creating event network-changed:9df4b96a-109f-4f80-bdef-6936978a9c4e for instance b4b4ef26-c265-451f-b265-fd4496b083b9 on nch2-master-1 Jul 02 21:09:29.845305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-236b2f1c-7ce1-498b-ab18-7e7487eaefb3 req-d16e9853-3121-4029-9ca4-3ae7d687383e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051829 Jul 02 21:09:29.850324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1107/2273] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:29.857583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:29.858541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:29.869526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.870236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:29.871344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:29.872019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:30.228116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:30.241082 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c762201a-8268-4215-9eab-5166b070c1b4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1542 microversion: 2.1 time: 0.389222 Jul 02 21:09:30.241873 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1108/2274] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:29 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1542 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:30.258829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ae50f4a2-fe6b-4f57-a1dd-38301b165f6a req-0493ab69-1c25-4c8e-92b9-637a2cb2e968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e56357a-da4c-449a-841c-de49a1756c81", "name": "network-vif-deleted", "tag": "43e2625c-2036-4486-9cdd-2894eeafca79"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:30.276002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae50f4a2-fe6b-4f57-a1dd-38301b165f6a req-0493ab69-1c25-4c8e-92b9-637a2cb2e968 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:30.278325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ae50f4a2-fe6b-4f57-a1dd-38301b165f6a req-0493ab69-1c25-4c8e-92b9-637a2cb2e968 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:30.315404 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ae50f4a2-fe6b-4f57-a1dd-38301b165f6a req-0493ab69-1c25-4c8e-92b9-637a2cb2e968 service nova] Creating event network-vif-deleted:43e2625c-2036-4486-9cdd-2894eeafca79 for instance 5e56357a-da4c-449a-841c-de49a1756c81 on nch1-master-1 Jul 02 21:09:30.327632 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ae50f4a2-fe6b-4f57-a1dd-38301b165f6a req-0493ab69-1c25-4c8e-92b9-637a2cb2e968 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072587 Jul 02 21:09:30.333028 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1109/2275] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:30.344265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:30.348145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:30.364766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:30.365709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:30.373201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:30.373769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:30.556074 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e65b5801-0cba-42c6-8765-c4e07e481f1c tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.091109 Jul 02 21:09:30.565281 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1167/2276] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:09:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:30.828992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:30.850023 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c86f838-5c44-4044-b829-8f4c4f1e5e62 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1352 microversion: 2.1 time: 0.515423 Jul 02 21:09:30.868084 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1110/2277] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:30 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1352 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:30.868084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:30.872447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:30.892840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:30.895039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:30.896856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:30.899583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:30.958915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1595968120", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": "none"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:31.015193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:31.037988 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d2c3d45-f0de-4a9f-940f-f4fc37e78888 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1276 microversion: 2.1 time: 0.178852 Jul 02 21:09:31.051686 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1111/2278] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:30 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1276 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:31.062678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:31.063319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:31.072256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.072715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.073621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.074059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.097726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:09:31.098165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:09:31.098803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:09:31.100111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:09:31.100544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:09:31.111445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:31.120100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.128838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.130050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.131505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.197346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Getting quotas for project 2652c1d42aaf4f12ae2561ce0574cd74. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:31.210651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Getting quotas for user 8aa30bbc54064a5492836308770c0131 and project 2652c1d42aaf4f12ae2561ce0574cd74. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:31.243374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:09:31.247775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:09:31.361396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76b159b9-4b2d-4c80-b0b7-cb73cac65956 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.790308 Jul 02 21:09:31.364324 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1168/2279] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:09:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:09:31.389814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:31.395880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:31.408878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.409780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.411288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.412006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.457433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:31.472920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-457342ef-aff1-42ba-9bf1-b34111b0ec4f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1469 microversion: 2.1 time: 0.418765 Jul 02 21:09:31.475406 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1112/2280] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:31 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1469 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:31.489827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'action', calling method: .version_select at 0x7fabe7472040>, body: {"addFloatingIp": {"address": "172.35.6.248"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:31.498880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:31.510680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.511130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.512777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.513387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.613306 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9eab374-ee0a-491f-88e8-51c29f723c13 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.247434 Jul 02 21:09:31.617084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Acquired lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:09:31.621458 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1169/2281] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:09:31 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:31.626472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d18e8e44-1c23-4da3-8e82-5506513e48bb tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:31.627096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d18e8e44-1c23-4da3-8e82-5506513e48bb tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:31.724850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d18e8e44-1c23-4da3-8e82-5506513e48bb tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:31.736546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d18e8e44-1c23-4da3-8e82-5506513e48bb tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:31.747364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d18e8e44-1c23-4da3-8e82-5506513e48bb tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:31.750981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d18e8e44-1c23-4da3-8e82-5506513e48bb tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1278 microversion: 2.54 time: 0.127357 Jul 02 21:09:31.752363 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1170/2282] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:31 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:31.889086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:31.890111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:31.899665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.900512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:31.901514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:31.902291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:32.403168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:32.421453 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2be3db6c-877f-424b-9cab-12107944d611 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1352 microversion: 2.1 time: 0.540250 Jul 02 21:09:32.422864 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1171/2283] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:31 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1352 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:32.428891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:32.429660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:32.437097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:32.438469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:32.439284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:32.439860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:32.629822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:32.643878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-438f7cbe-d1bd-4150-a5c4-124cbd57b041 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1282 microversion: 2.1 time: 0.219904 Jul 02 21:09:32.645723 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1172/2284] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:32 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:32.656323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:32.657295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:32.665873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:32.666983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:32.668009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:32.668789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:32.741391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42.", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:09:32.742596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Releasing lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:09:32.744199 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] HTTP exception thrown: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.744199 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Request method failure captured: Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action HTTP/1.1 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 46 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPmm3uJ8SwJh9nsG7QnJ16t29hlneAcMbJRAAyl5JH47b-jcumNWIfeHOIY8oycTdkKnH8X_nEyskhoPH_OUxqgjYhWfZEwc6uITEE5Ilg-eIZDN1RJSVq7fAmmFTnySyhzvNk52UH7wZ_oHQTTKuHXdvbW3FtOKIbOr1C1VuQzOT0 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a54682a0b9f34993a0e616507695307e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a54682a0b9f34993a0e616507695307e"}]}] Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 62a0c1f583944bd092abc02293fcb316 Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: {"addFloatingIp": {"address": "172.35.6.248"}} Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c4c496d9-ac70-493d-aa84-383e61614284', 'body': {'addFloatingIp': {'address': '172.35.6.248'}}} Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:09:32.746965 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] Jul 02 21:09:32.750792 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:32.757248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Returning 400 to user: Cannot associate floating IP 172.35.6.248 (956e6ffb-41fb-4e58-87c2-7344f493efdd) with port 8715cf9f-be3b-4753-9d2f-c3a2496333de using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network f531777e-f940-4d67-924e-573dd82b0c42. Jul 02 21:09:32.757248 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-17e37872-e7fb-4b5a-b06e-7ad3e45bc258'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:32.758572 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-548764f4-e190-43c6-8095-30ec8aa2f01a tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action" status: 400 len: 381 microversion: 2.1 time: 1.280053 Jul 02 21:09:32.759388 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1113/2285] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:31 2022] POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action => generated 381 bytes in 1281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:09:32.769491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e31bef1a-dd79-460e-82ba-2507d44a6dd6 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '.version_select at 0x7fabea1f2e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:33.190565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:33.200910 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8696ad65-4dd0-4dd2-88ff-ca57c645896f tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1469 microversion: 2.1 time: 0.553344 Jul 02 21:09:33.201768 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1173/2286] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:32 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1469 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:33.214450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:33.216614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:33.237002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:33.240877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:33.242806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:33.244695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:33.435746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:33.445208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:33.446981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:33.448476 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3552f6af-0a28-4b17-be29-22cf7965ac53 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1348 microversion: 2.54 time: 0.245110 Jul 02 21:09:33.459671 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1174/2287] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:33 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1348 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:33.469384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a7bbe5f7-f8c2-4959-a3a6-30c262d3037f req-47a79baf-1436-4fb5-a2b8-79bf59464c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b4ef26-c265-451f-b265-fd4496b083b9", "name": "network-vif-plugged", "status": "completed", "tag": "9df4b96a-109f-4f80-bdef-6936978a9c4e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:33.482519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a7bbe5f7-f8c2-4959-a3a6-30c262d3037f req-47a79baf-1436-4fb5-a2b8-79bf59464c88 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:33.483221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a7bbe5f7-f8c2-4959-a3a6-30c262d3037f req-47a79baf-1436-4fb5-a2b8-79bf59464c88 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:33.498285 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a7bbe5f7-f8c2-4959-a3a6-30c262d3037f req-47a79baf-1436-4fb5-a2b8-79bf59464c88 service nova] Creating event network-vif-plugged:9df4b96a-109f-4f80-bdef-6936978a9c4e for instance b4b4ef26-c265-451f-b265-fd4496b083b9 on nch2-master-1 Jul 02 21:09:33.504520 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a7bbe5f7-f8c2-4959-a3a6-30c262d3037f req-47a79baf-1436-4fb5-a2b8-79bf59464c88 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043283 Jul 02 21:09:33.506141 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1175/2288] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:33.513824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:33.514941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:33.524670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:33.525497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:33.526819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:33.527516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:34.411087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:34.421037 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20df51f5-b6ac-45b1-ae93-50ffb3193a01 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1352 microversion: 2.1 time: 0.913438 Jul 02 21:09:34.425829 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1176/2289] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:33 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1352 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:34.430916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:34.433815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:34.449350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:34.450889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:34.452635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:34.453896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:34.827684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:34.844209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-782cc9a3-ff6f-41f0-8159-ad8dacdf2c8b tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.416933 Jul 02 21:09:34.845360 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1177/2290] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:34 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:34.852516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3cf923a4-aa97-429f-8e9e-bf726a2a3f22 req-57951f92-15c2-41fe-9964-f4628530d707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:34.873482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3cf923a4-aa97-429f-8e9e-bf726a2a3f22 req-57951f92-15c2-41fe-9964-f4628530d707 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:34.874126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3cf923a4-aa97-429f-8e9e-bf726a2a3f22 req-57951f92-15c2-41fe-9964-f4628530d707 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:34.892802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3cf923a4-aa97-429f-8e9e-bf726a2a3f22 req-57951f92-15c2-41fe-9964-f4628530d707 service nova] Creating event network-changed:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch2-master-1 Jul 02 21:09:34.909369 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3cf923a4-aa97-429f-8e9e-bf726a2a3f22 req-57951f92-15c2-41fe-9964-f4628530d707 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058626 Jul 02 21:09:34.910981 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1178/2291] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:34.921002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a8a6066f-8459-4b3f-b222-b8eb744b6348 req-614e78e7-c577-4a2f-9e97-9181a80554f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef3bcf67-5b5e-4038-b770-6025197f7a96", "name": "network-vif-deleted", "tag": "1b7782a5-78bc-4512-9506-2488c7f81bc0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:34.943916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a8a6066f-8459-4b3f-b222-b8eb744b6348 req-614e78e7-c577-4a2f-9e97-9181a80554f8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:34.944753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a8a6066f-8459-4b3f-b222-b8eb744b6348 req-614e78e7-c577-4a2f-9e97-9181a80554f8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:34.973066 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a8a6066f-8459-4b3f-b222-b8eb744b6348 req-614e78e7-c577-4a2f-9e97-9181a80554f8 service nova] Creating event network-vif-deleted:1b7782a5-78bc-4512-9506-2488c7f81bc0 for instance ef3bcf67-5b5e-4038-b770-6025197f7a96 on nch1-master-1 Jul 02 21:09:34.982001 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a8a6066f-8459-4b3f-b222-b8eb744b6348 req-614e78e7-c577-4a2f-9e97-9181a80554f8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069273 Jul 02 21:09:34.985119 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1179/2292] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:34.998071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:35.001479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:35.015270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.018649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.019750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.020405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.034872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:35.184354 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e31bef1a-dd79-460e-82ba-2507d44a6dd6 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/956e6ffb-41fb-4e58-87c2-7344f493efdd" status: 202 len: 0 microversion: 2.1 time: 2.419484 Jul 02 21:09:35.185107 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1114/2293] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:09:32 2022] DELETE /compute/v2.1/os-floating-ips/956e6ffb-41fb-4e58-87c2-7344f493efdd => generated 0 bytes in 2422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:09:35.195336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:35.203992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:35.212712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.213820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.215097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.215917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.222165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:35.237312 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8dee7725-dc32-4087-9b98-ce45bd3a369e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1427 microversion: 2.1 time: 0.248096 Jul 02 21:09:35.239447 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1180/2294] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:34 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1427 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:35.250448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'action', calling method: .version_select at 0x7fabe7440b80>, body: {"removeFloatingIp": {"address": "172.35.6.120"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:35.419514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:35.434393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:35.443465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:35.445945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed8295ce-8899-460c-a79d-8f54805fddbd tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1336 microversion: 2.54 time: 0.255317 Jul 02 21:09:35.447132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1115/2295] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:35 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1336 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:35.453624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:35.454471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:35.464987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.465912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.466900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.470989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.588895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:35.597714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.598814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.602998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.605765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.883367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:35.892637 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ffeb541-b49e-403b-ba2d-a0164025152d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1542 microversion: 2.1 time: 0.444162 Jul 02 21:09:35.893825 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1116/2296] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:35 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1542 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:35.900802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:35.901866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:35.911554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.912424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:35.914089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:35.914702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.215565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Acquired lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:09:36.391536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:36.404974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d40a159c-cd95-4ef8-89df-2b2efe4ab049 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.509903 Jul 02 21:09:36.405955 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1117/2297] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:35 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:36.410787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:36.416910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:36.430555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.431012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.431803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.441016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.740312 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-806b23a8-f461-47da-b2e4-733c665e95eb tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.332854 Jul 02 21:09:36.740882 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1118/2298] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:09:36 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:36.745809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:36.746808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:36.761453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.762298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.764823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.765474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.839854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.840515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.843152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lazy-loading 'fault' on Instance uuid ef3bcf67-5b5e-4038-b770-6025197f7a96 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:09:36.953901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5198cb44d38d495794cc8b0fc5d9d4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '381ec26b4d1240b4889b5ecfebf02610', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:36.974852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-458c9304-53fd-4773-afd2-8174d2f7e61e tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 200 len: 1304 microversion: 2.1 time: 0.232414 Jul 02 21:09:36.976694 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1119/2299] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:36 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:36.986197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:36.986819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:36.995554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.996364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:36.997490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:36.998230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:37.247061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:37.258645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:37.264857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:37.266292 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f201daa-123b-475d-983b-5ebe941adfa0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1336 microversion: 2.54 time: 0.286086 Jul 02 21:09:37.278708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1120/2300] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:36 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:37.289809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ab080e6c-c212-4fa3-a96a-60b92d4b4667 req-4ded6277-d5c8-4a93-adec-0c1cd62534be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e626528-e544-489b-a728-8d29c464fb00", "tag": "cb5f6973-6da8-4133-8a89-ad40b35d002a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:37.301127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ab080e6c-c212-4fa3-a96a-60b92d4b4667 req-4ded6277-d5c8-4a93-adec-0c1cd62534be service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:37.301955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ab080e6c-c212-4fa3-a96a-60b92d4b4667 req-4ded6277-d5c8-4a93-adec-0c1cd62534be service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:37.320840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ab080e6c-c212-4fa3-a96a-60b92d4b4667 req-4ded6277-d5c8-4a93-adec-0c1cd62534be service nova] Creating event network-changed:cb5f6973-6da8-4133-8a89-ad40b35d002a for instance 5e626528-e544-489b-a728-8d29c464fb00 on nch2-master-1 Jul 02 21:09:37.328661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ab080e6c-c212-4fa3-a96a-60b92d4b4667 req-4ded6277-d5c8-4a93-adec-0c1cd62534be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042892 Jul 02 21:09:37.329722 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1121/2301] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:37.423396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:37.425897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:37.441953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:37.443134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:37.444453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:37.445080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.390978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:38.428461 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a320e320-5ba8-4e89-a7a6-b45686544aa0 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 1.010049 Jul 02 21:09:38.442406 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1122/2302] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:37 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:38.453955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:38.454732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] [instance: ef3bcf67-5b5e-4038-b770-6025197f7a96] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:38.462645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:38.463029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.463832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:38.464792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.499721 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] HTTP exception thrown: Instance ef3bcf67-5b5e-4038-b770-6025197f7a96 could not be found. Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Request method failure captured: Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 HTTP/1.1 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLNpdF_QJxKFVVIN4QW4AwvvKEvNUkty-UN6FvgjLTXzMez-scMEEv-1UwR_5J6fgxvlflI04v-YqkBMOPpmi0uaMumI2cJxFGmK6SVn5mIteR2ClgwVXUBx59Aeqb-T-s7x1ZF_YoKnXBaIW0C8VtYqk9PXMQtcy8GR1Wyc3c2ozI4 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 381ec26b4d1240b4889b5ecfebf02610 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/381ec26b4d1240b4889b5ecfebf02610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_381ec26b4d1240b4889b5ecfebf02610", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/381ec26b4d1240b4889b5ecfebf02610"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/381ec26b4d1240b4889b5ecfebf02610"}]}] Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 381ec26b4d1240b4889b5ecfebf02610 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminTestJSON-1470187372 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminTestJSON-1470187372-project Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 5198cb44d38d495794cc8b0fc5d9d4c3 Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminTestJSON-1470187372-project Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance ef3bcf67-5b5e-4038-b770-6025197f7a96 could not be found. Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'ef3bcf67-5b5e-4038-b770-6025197f7a96'} Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef3bcf67-5b5e-4038-b770-6025197f7a96 could not be found. Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef3bcf67-5b5e-4038-b770-6025197f7a96 could not be found. Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:38.502128 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef3bcf67-5b5e-4038-b770-6025197f7a96 could not be found. Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] Returning 404 to user: Instance ef3bcf67-5b5e-4038-b770-6025197f7a96 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-beb8029e-ed75-4383-9a5f-faafe43c9873 tempest-ServersAdminTestJSON-1470187372 tempest-ServersAdminTestJSON-1470187372-project] 10.222.0.43 "GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96" status: 404 len: 111 microversion: 2.1 time: 0.060012 Jul 02 21:09:38.505809 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1123/2303] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:38 2022] GET /compute/v2.1/servers/ef3bcf67-5b5e-4038-b770-6025197f7a96 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:38.510006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:38.510632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:38.520021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:38.520588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.522270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:38.523038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.667586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:38.681223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:38.682881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:38.685307 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11cfc67c-ba21-4617-97d9-d6e4927d03aa tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1357 microversion: 2.54 time: 0.179779 Jul 02 21:09:38.690842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1124/2304] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:38 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:38.711413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cda50112-70c1-45ca-b768-605d085547e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Action: 'create', calling method: .version_select at 0x7fabea228b80>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1813029450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN47k5JbSkHmfhQW/P8Y2OY+6rETgUYU8nXn42joMFvxkNHOJ8+H2r38wdqQ8Mx34ovBCpGLyfbCP2xlqlsYJEqCOlkRAb724rVzyR2mCiac3Xur2+708VWy8xQRVtKrog=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:38.728089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=29 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:38.732721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cda50112-70c1-45ca-b768-605d085547e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Getting quotas for project 2652c1d42aaf4f12ae2561ce0574cd74. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:38.737944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cda50112-70c1-45ca-b768-605d085547e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Getting quotas for user 8aa30bbc54064a5492836308770c0131 and project 2652c1d42aaf4f12ae2561ce0574cd74. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:38.781226 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cda50112-70c1-45ca-b768-605d085547e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.072535 Jul 02 21:09:38.782093 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1125/2305] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:09:38 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 76 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 02 21:09:38.794027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1813029450", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:38.798512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:38.814338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:38.816090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.816788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:38.818066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:38.838609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:09:38.987994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:09:38.988459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:09:38.990896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:09:38.991326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:09:38.993420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:09:39.138713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:39.147822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.148434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.149338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.149889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.188069 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-28882a98-88c9-4fc7-865f-2dc4f93c1ed4 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "POST /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9/action" status: 202 len: 1140 microversion: 2.54 time: 0.399560 Jul 02 21:09:39.189147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1126/2306] 10.222.0.43 () {62 vars in 1319 bytes} [Sat Jul 2 21:09:38 2022] POST /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9/action => generated 1140 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 02 21:09:39.209781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:39.210526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:39.223754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.225333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.226170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.226672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.485820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:39.494843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:39.496381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:39.497567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f21e33d-ace0-45ce-b0ab-87f45dcd6af0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.295698 Jul 02 21:09:39.498321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1127/2307] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:39 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:39.502536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-60551dbc-43ae-4f0e-9e27-4863fa3d6bc9 req-8ba252af-9f28-4b55-b5fb-f529cd91efaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c496d9-ac70-493d-aa84-383e61614284", "tag": "8715cf9f-be3b-4753-9d2f-c3a2496333de"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:39.525658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:39.535710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60551dbc-43ae-4f0e-9e27-4863fa3d6bc9 req-8ba252af-9f28-4b55-b5fb-f529cd91efaf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.539656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60551dbc-43ae-4f0e-9e27-4863fa3d6bc9 req-8ba252af-9f28-4b55-b5fb-f529cd91efaf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.566532 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-60551dbc-43ae-4f0e-9e27-4863fa3d6bc9 req-8ba252af-9f28-4b55-b5fb-f529cd91efaf service nova] Creating event network-changed:8715cf9f-be3b-4753-9d2f-c3a2496333de for instance c4c496d9-ac70-493d-aa84-383e61614284 on nch1-master-1 Jul 02 21:09:39.585072 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-60551dbc-43ae-4f0e-9e27-4863fa3d6bc9 req-8ba252af-9f28-4b55-b5fb-f529cd91efaf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081390 Jul 02 21:09:39.586074 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1128/2308] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:39.601797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:39.603903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:39.622489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.623419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.625816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:39.626899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:39.981116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:39.993337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82264c0d-9a3d-4325-8739-c0cb0afbda85 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.406000 Jul 02 21:09:40.003308 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1129/2309] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:39 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:40.517100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:40.517747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:40.531776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:40.533649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:40.534535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:40.535042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:40.734178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:40.751060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:40.756456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:40.757683 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23165412-381b-4bea-916e-ae1750ef523e tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.245307 Jul 02 21:09:40.761870 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1130/2310] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:40 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:40.790174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Updating instance_info_cache with network_info: [{"id": "8715cf9f-be3b-4753-9d2f-c3a2496333de", "address": "fa:16:3e:4c:a1:eb", "network": {"id": "a7ccdb17-5853-46d8-ac7b-46a7b535ef5b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-449054535-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a54682a0b9f34993a0e616507695307e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8715cf9f-be", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:09:40.817961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Releasing lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:09:40.823196 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b7d5fe89-2d2c-4ad2-9f11-04a88af018de tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action" status: 202 len: 0 microversion: 2.1 time: 5.578811 Jul 02 21:09:40.824321 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1181/2311] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:35 2022] POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action => generated 0 bytes in 5584 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:09:40.832988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8129e01-b169-4583-8c88-946689c6b65f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '.version_select at 0x7fabea1db430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:41.013894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:41.015657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:41.044141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:41.046914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:41.050787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:41.051956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:41.165963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:41.730652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:42.032768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:42.043031 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9005ad6-6a28-4c97-9d56-50dc9eda4366 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 1.036552 Jul 02 21:09:42.054768 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1182/2312] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:41 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:42.061175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-110f0b10-5a14-4db0-9341-a6aefec7f55d req-14a605df-3ec9-43d7-a466-4673bd0c4bba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b4ef26-c265-451f-b265-fd4496b083b9", "tag": "9df4b96a-109f-4f80-bdef-6936978a9c4e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:42.088844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-110f0b10-5a14-4db0-9341-a6aefec7f55d req-14a605df-3ec9-43d7-a466-4673bd0c4bba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:42.089948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-110f0b10-5a14-4db0-9341-a6aefec7f55d req-14a605df-3ec9-43d7-a466-4673bd0c4bba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:42.111987 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-110f0b10-5a14-4db0-9341-a6aefec7f55d req-14a605df-3ec9-43d7-a466-4673bd0c4bba service nova] Creating event network-changed:9df4b96a-109f-4f80-bdef-6936978a9c4e for instance b4b4ef26-c265-451f-b265-fd4496b083b9 on nch2-master-1 Jul 02 21:09:42.123567 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-110f0b10-5a14-4db0-9341-a6aefec7f55d req-14a605df-3ec9-43d7-a466-4673bd0c4bba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066603 Jul 02 21:09:42.125867 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1183/2313] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:42.135450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:42.138125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:42.148244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:42.149089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:42.150361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:42.151090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:42.421409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:42.435347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:42.443670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:42.445421 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b921ffc9-cfe6-4b6a-a806-ee665cda8149 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.317738 Jul 02 21:09:42.446488 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1184/2314] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:42 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:43.065537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:43.068372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:43.084217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.085090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.086209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.088449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.116117 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8129e01-b169-4583-8c88-946689c6b65f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/88bf05ee-c661-44ad-a3f3-6c88345c2c15" status: 202 len: 0 microversion: 2.1 time: 2.286074 Jul 02 21:09:43.117798 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1131/2315] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:09:40 2022] DELETE /compute/v2.1/os-floating-ips/88bf05ee-c661-44ad-a3f3-6c88345c2c15 => generated 0 bytes in 2290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:09:43.136365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d41714d3-a2ec-4ec2-81c8-1260c496e231 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d41714d3-a2ec-4ec2-81c8-1260c496e231 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Request method failure captured: Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action HTTP/1.1 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 34 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPmm3uJ8SwJh9nsG7QnJ16t29hlneAcMbJRAAyl5JH47b-jcumNWIfeHOIY8oycTdkKnH8X_nEyskhoPH_OUxqgjYhWfZEwc6uITEE5Ilg-eIZDN1RJSVq7fAmmFTnySyhzvNk52UH7wZ_oHQTTKuHXdvbW3FtOKIbOr1C1VuQzOT0 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a54682a0b9f34993a0e616507695307e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a54682a0b9f34993a0e616507695307e"}]}] Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 62a0c1f583944bd092abc02293fcb316 Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: {"addFloatingIp": {"address": ""}} Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c4c496d9-ac70-493d-aa84-383e61614284', 'body': {'addFloatingIp': {'address': ''}}} Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '' Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:09:43.148744 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 02 21:09:43.152460 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.153086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d41714d3-a2ec-4ec2-81c8-1260c496e231 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:43.160367 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d41714d3-a2ec-4ec2-81c8-1260c496e231 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action" status: 400 len: 142 microversion: 2.1 time: 0.035908 Jul 02 21:09:43.162474 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1132/2316] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:43 2022] POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action => generated 142 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:09:43.178881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:43.180223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:43.198522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.205693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.206859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.207369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.214926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:43.262830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Acquired lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:09:43.466568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:43.476741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-13a1df16-2642-441b-a052-b988119f5cfa tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.417991 Jul 02 21:09:43.485331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1185/2317] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:43 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:43.490552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:43.491361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:43.506296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.507004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.508472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.509655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.514960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Releasing lock "refresh_cache-c4c496d9-ac70-493d-aa84-383e61614284" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:09:43.516337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] HTTP exception thrown: floating IP not found Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Request method failure captured: Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action HTTP/1.1 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 41 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPmm3uJ8SwJh9nsG7QnJ16t29hlneAcMbJRAAyl5JH47b-jcumNWIfeHOIY8oycTdkKnH8X_nEyskhoPH_OUxqgjYhWfZEwc6uITEE5Ilg-eIZDN1RJSVq7fAmmFTnySyhzvNk52UH7wZ_oHQTTKuHXdvbW3FtOKIbOr1C1VuQzOT0 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a54682a0b9f34993a0e616507695307e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a54682a0b9f34993a0e616507695307e"}]}] Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 62a0c1f583944bd092abc02293fcb316 Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: exception: floating IP not found Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c4c496d9-ac70-493d-aa84-383e61614284', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 02 21:09:43.519147 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Returning 404 to user: floating IP not found {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:43.522852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef6b5a65-b369-43b9-a9de-4e92935b8d44 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action" status: 404 len: 67 microversion: 2.1 time: 0.353483 Jul 02 21:09:43.528561 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1133/2318] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:43 2022] POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action => generated 67 bytes in 361 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:43.535806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2a7e2e1-d516-49d4-9201-34a2d10d9545 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Action: 'action', calling method: .version_select at 0x7fabe743db80>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:43.626902 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e2a7e2e1-d516-49d4-9201-34a2d10d9545 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2a7e2e1-d516-49d4-9201-34a2d10d9545 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Request method failure captured: Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action HTTP/1.1 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 44 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPmm3uJ8SwJh9nsG7QnJ16t29hlneAcMbJRAAyl5JH47b-jcumNWIfeHOIY8oycTdkKnH8X_nEyskhoPH_OUxqgjYhWfZEwc6uITEE5Ilg-eIZDN1RJSVq7fAmmFTnySyhzvNk52UH7wZ_oHQTTKuHXdvbW3FtOKIbOr1C1VuQzOT0 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a54682a0b9f34993a0e616507695307e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a54682a0b9f34993a0e616507695307e"}]}] Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 62a0c1f583944bd092abc02293fcb316 Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: exception: Floating IP not found for address 0.0.0.0. Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c4c496d9-ac70-493d-aa84-383e61614284', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 02 21:09:43.629294 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 02 21:09:43.633631 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:43.637552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2a7e2e1-d516-49d4-9201-34a2d10d9545 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:43.638770 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2a7e2e1-d516-49d4-9201-34a2d10d9545 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action" status: 404 len: 88 microversion: 2.1 time: 0.108554 Jul 02 21:09:43.640058 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1134/2319] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:09:43 2022] POST /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284/action => generated 88 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:43.650145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:43.652054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:43.667277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.668328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.669823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.670955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.690439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:43.709701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:43.712683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:43.732004 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b444976-0aa6-4a0f-b31d-76a9e33b8032 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.244445 Jul 02 21:09:43.743283 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1186/2320] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:43 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:43.761370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:43.920797 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bc45a1d-9dac-4a58-965c-55d41d048259 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 204 len: 0 microversion: 2.1 time: 0.275196 Jul 02 21:09:43.924911 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1135/2321] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:43 2022] DELETE /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:09:43.931902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:43.932564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:43.940808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.941275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:43.942068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:43.942502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:44.525249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:44.532760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:44.562850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:44.563707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:44.566359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:44.566975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:44.587553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:44.604626 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eebd8eb7-f4ff-4884-bec7-efec1dfce219 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1541 microversion: 2.1 time: 0.675664 Jul 02 21:09:44.606242 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1187/2322] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:43 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1541 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:44.755005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:44.760145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:44.770299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:44.772630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:44.773628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:44.774841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:44.947793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:44.960779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:44.962258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:44.963483 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e36588d7-ded3-40d8-829d-85aa6c971339 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.212459 Jul 02 21:09:44.982339 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1188/2323] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:44 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:45.060078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:45.072811 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bccff44-8550-4570-a48d-0064150c17b4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.573169 Jul 02 21:09:45.089453 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1136/2324] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:44 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:45.592894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:45.593575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:45.614086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:45.614557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:45.617615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:45.621296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:45.623005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:45.623630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:45.639846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:45.648526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:45.649523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:45.649976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:45.686334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:45.875053 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2fea666d-7d99-4210-b634-a51b3cecc115 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "DELETE /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 204 len: 0 microversion: 2.42 time: 0.708231 Jul 02 21:09:45.876191 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1189/2325] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:09:45 2022] DELETE /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 0 bytes in 710 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:09:45.886264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:45.887427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:45.899509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:45.900345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:45.902375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:45.902823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:46.412633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.424111 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b41a5c0-5bf7-46dc-bb72-f681d28fb1aa tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1541 microversion: 2.1 time: 0.802898 Jul 02 21:09:46.425107 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1137/2326] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:45 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1541 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:46.431469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:46.432182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:46.462518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:46.462987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:46.463799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:46.464274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:46.517113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.534799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.536692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.543656 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e405a34-85b9-4834-b184-2a572c8efaeb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2952 microversion: 2.42 time: 0.661827 Jul 02 21:09:46.545648 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1190/2327] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:45 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2952 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:46.558140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:46.558943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:46.569357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:46.570078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:46.571153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:46.571927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:46.716822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.727188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.728722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.729899 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1d67d6b-a5d0-4ac2-a841-fbb9e3d38385 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.303852 Jul 02 21:09:46.730478 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1138/2328] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:46 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:46.983774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:46.993456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-57eae695-79ef-487c-8374-50e2b7f2a309 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.446553 Jul 02 21:09:46.998982 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1191/2329] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:46 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:47.291986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-931377c4-c15c-4796-939c-2586de137ffd req-f29bfeab-5e67-4141-8109-1cfa19312613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c496d9-ac70-493d-aa84-383e61614284", "name": "network-vif-deleted", "tag": "8715cf9f-be3b-4753-9d2f-c3a2496333de"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:47.316185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-931377c4-c15c-4796-939c-2586de137ffd req-f29bfeab-5e67-4141-8109-1cfa19312613 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:47.316977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-931377c4-c15c-4796-939c-2586de137ffd req-f29bfeab-5e67-4141-8109-1cfa19312613 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:47.366549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-931377c4-c15c-4796-939c-2586de137ffd req-f29bfeab-5e67-4141-8109-1cfa19312613 service nova] Creating event network-vif-deleted:8715cf9f-be3b-4753-9d2f-c3a2496333de for instance c4c496d9-ac70-493d-aa84-383e61614284 on nch1-master-1 Jul 02 21:09:47.382677 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-931377c4-c15c-4796-939c-2586de137ffd req-f29bfeab-5e67-4141-8109-1cfa19312613 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094670 Jul 02 21:09:47.392663 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1139/2330] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:47.443148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:47.443957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:47.455035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:47.459998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1355620026", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "e1ac99a9-c570-4f10-b595-971946dc9a39"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:47.461631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:47.465622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:47.466202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:47.553552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] validate_networks() for [('e1ac99a9-c570-4f10-b595-971946dc9a39', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:09:47.690545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62a0c1f583944bd092abc02293fcb316', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a54682a0b9f34993a0e616507695307e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:47.706224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9423559-053b-463c-bb63-f07858bd300f tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 200 len: 1499 microversion: 2.1 time: 0.267648 Jul 02 21:09:47.706836 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1140/2331] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:47 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:47.711976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:47.712821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:47.722044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:47.723157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:47.727341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:47.728163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:48.632088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:48.646119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:48.647994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:48.649465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-002d3b29-8298-4a39-9a66-51271b939a6a tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2952 microversion: 2.42 time: 0.941674 Jul 02 21:09:48.650147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1141/2332] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:47 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2952 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:48.664311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fd61b66e-3fd7-4291-9685-745555d41a82 req-ecae3d5d-c94d-477e-82e3-b894475445e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e626528-e544-489b-a728-8d29c464fb00", "name": "network-vif-plugged", "status": "completed", "tag": "cb5f6973-6da8-4133-8a89-ad40b35d002a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:48.673588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fd61b66e-3fd7-4291-9685-745555d41a82 req-ecae3d5d-c94d-477e-82e3-b894475445e4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:48.674728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fd61b66e-3fd7-4291-9685-745555d41a82 req-ecae3d5d-c94d-477e-82e3-b894475445e4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:48.688886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fd61b66e-3fd7-4291-9685-745555d41a82 req-ecae3d5d-c94d-477e-82e3-b894475445e4 service nova] Creating event network-vif-plugged:cb5f6973-6da8-4133-8a89-ad40b35d002a for instance 5e626528-e544-489b-a728-8d29c464fb00 on nch2-master-1 Jul 02 21:09:48.695464 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fd61b66e-3fd7-4291-9685-745555d41a82 req-ecae3d5d-c94d-477e-82e3-b894475445e4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043837 Jul 02 21:09:48.696892 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1142/2333] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:48.713803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:48.714762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:48.716955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:48.726012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:48.727183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:48.728804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:48.729716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:48.755339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:48.849825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:48.861150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:48.864339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:48.867714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cfd499d-8128-4402-abde-aa84cf0870b7 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.169485 Jul 02 21:09:48.870016 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1143/2334] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:48 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:48.883685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:48.884400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:48.896907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:48.897421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:48.900257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:48.901254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.240954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:09:49.242127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:09:49.243703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:09:49.244150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:09:49.249463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:09:49.286044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.287802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.291520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.293109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.347545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Getting quotas for project e463fddac31c452296829260cfacc694. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:09:49.354303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Getting quotas for user 7cac5256d6b6458899f85d8762a03d90 and project e463fddac31c452296829260cfacc694. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:09:49.376764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:09:49.381645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:09:49.396695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:49.407830 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f48d5fd5-7f0d-49fe-9e84-6352d4dedf9a tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1324 microversion: 2.1 time: 0.536485 Jul 02 21:09:49.423380 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1144/2335] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:48 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:49.433022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:49.434461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] [instance: c4c496d9-ac70-493d-aa84-383e61614284] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:49.451061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.451523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.452359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.453937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.476761 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] HTTP exception thrown: Instance c4c496d9-ac70-493d-aa84-383e61614284 could not be found. Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Request method failure captured: Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 HTTP/1.1 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLPmm3uJ8SwJh9nsG7QnJ16t29hlneAcMbJRAAyl5JH47b-jcumNWIfeHOIY8oycTdkKnH8X_nEyskhoPH_OUxqgjYhWfZEwc6uITEE5Ilg-eIZDN1RJSVq7fAmmFTnySyhzvNk52UH7wZ_oHQTTKuHXdvbW3FtOKIbOr1C1VuQzOT0 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a54682a0b9f34993a0e616507695307e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a54682a0b9f34993a0e616507695307e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a54682a0b9f34993a0e616507695307e"}]}] Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a54682a0b9f34993a0e616507695307e Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 62a0c1f583944bd092abc02293fcb316 Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance c4c496d9-ac70-493d-aa84-383e61614284 could not be found. Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c4c496d9-ac70-493d-aa84-383e61614284'} Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4c496d9-ac70-493d-aa84-383e61614284 could not be found. Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4c496d9-ac70-493d-aa84-383e61614284 could not be found. Jul 02 21:09:49.479016 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4c496d9-ac70-493d-aa84-383e61614284 could not be found. Jul 02 21:09:49.483150 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:49.484712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] Returning 404 to user: Instance c4c496d9-ac70-493d-aa84-383e61614284 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:49.485808 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba4d9117-00db-448a-b76d-bf2d2ce7c9b4 tempest-FloatingIPsAssociationNegativeTestJSON-890519840 tempest-FloatingIPsAssociationNegativeTestJSON-890519840-project] 10.222.0.43 "GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284" status: 404 len: 111 microversion: 2.1 time: 0.061266 Jul 02 21:09:49.486932 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1145/2336] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:49 2022] GET /compute/v2.1/servers/c4c496d9-ac70-493d-aa84-383e61614284 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:49.500280 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-300c7fbf-125d-494f-baeb-32c1890f89b5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.182649 Jul 02 21:09:49.501406 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1192/2337] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:09:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:09:49.528762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ce69f66-7767-46eb-9759-52540a8dfef1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:49.530917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ce69f66-7767-46eb-9759-52540a8dfef1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:49.672442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7ce69f66-7767-46eb-9759-52540a8dfef1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:49.676151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:49.676788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:49.688597 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ce69f66-7767-46eb-9759-52540a8dfef1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1228 microversion: 2.1 time: 0.170853 Jul 02 21:09:49.704382 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1146/2338] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:49 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1228 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:49.707617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.708108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.708943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.709398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.894005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:49.898255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:49.911889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.913879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:49.914876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:49.915557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.319712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.329678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.335081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.342241 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78f490b4-5b10-4407-9c65-ec979359b4a9 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.457007 Jul 02 21:09:50.360160 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1147/2339] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:49 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:50.429535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:50.430319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:50.440401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:50.444709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.445700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:50.446250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.549395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.562591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.569790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.571233 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c9c9d3ce-7c2d-4761-a06f-d7ecd683aa3b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2952 microversion: 2.42 time: 0.904617 Jul 02 21:09:50.571937 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1193/2340] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:49 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2952 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:50.708298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:50.709501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:50.723414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:50.725409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.726239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:50.726686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.924528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.942556 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acc5180c-1ab3-4b64-b75d-1937a3ec38b9 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1521 microversion: 2.1 time: 0.517108 Jul 02 21:09:50.943090 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1148/2341] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:50 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:50.956275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:50.962512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:50.963284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:50.971627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:50.974480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.977426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:50.978053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:50.984306 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-29d82119-d645-483d-acb5-a2351a6ef4c4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1280 microversion: 2.1 time: 0.276828 Jul 02 21:09:50.986992 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1194/2342] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:50 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:51.060269 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] HTTP exception thrown: Action 999 not found Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Request method failure captured: Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00/os-instance-actions/999 HTTP/1.1 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQGf47IeiwdfTvkGRReL4u415LclDowAXJqOfmrYGqGw48VYY5wDMqKhL4aRgpngyv_zll-pc77f-y4KyW7YvnsYko7UCK3fh-szBgwq3Fm-3uu6jB6TGrgLbwT2sXxpgjyUs6rtkx7YiwhbaGdk6dsT9HUJRRND3iPuekiUJP58V4 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 90c7a815db0145889cf47ebcca5843f6 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90c7a815db0145889cf47ebcca5843f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_90c7a815db0145889cf47ebcca5843f6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90c7a815db0145889cf47ebcca5843f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/90c7a815db0145889cf47ebcca5843f6"}]}] Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 90c7a815db0145889cf47ebcca5843f6 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsNegativeTestJSON-803204594-project Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: ae104851a64c4638abd70af95f27d4fa Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-803204594-project Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: exception: Action 999 not found Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'server_id': '5e626528-e544-489b-a728-8d29c464fb00', 'id': '999'} Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 02 21:09:51.076841 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.081439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Returning 404 to user: Action 999 not found {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:51.082453 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8a36617-7206-4428-bd48-d140f07c59d5 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.124367 Jul 02 21:09:51.083518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1149/2343] 10.222.0.43 () {58 vars in 1307 bytes} [Sat Jul 2 21:09:50 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00/os-instance-actions/999 => generated 66 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:09:51.101208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d083fac6-34a3-43a6-984d-6d46cac28c19 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '.version_select at 0x7fabea187160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:51.101921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d083fac6-34a3-43a6-984d-6d46cac28c19 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 0a7fa122-977d-4adb-a531-0a2d0b42b14e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:51.110401 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d083fac6-34a3-43a6-984d-6d46cac28c19 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] HTTP exception thrown: Instance 0a7fa122-977d-4adb-a531-0a2d0b42b14e could not be found. Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d083fac6-34a3-43a6-984d-6d46cac28c19 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Request method failure captured: Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/0a7fa122-977d-4adb-a531-0a2d0b42b14e/os-instance-actions HTTP/1.1 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQGf47IeiwdfTvkGRReL4u415LclDowAXJqOfmrYGqGw48VYY5wDMqKhL4aRgpngyv_zll-pc77f-y4KyW7YvnsYko7UCK3fh-szBgwq3Fm-3uu6jB6TGrgLbwT2sXxpgjyUs6rtkx7YiwhbaGdk6dsT9HUJRRND3iPuekiUJP58V4 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 90c7a815db0145889cf47ebcca5843f6 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90c7a815db0145889cf47ebcca5843f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_90c7a815db0145889cf47ebcca5843f6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90c7a815db0145889cf47ebcca5843f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/90c7a815db0145889cf47ebcca5843f6"}]}] Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 90c7a815db0145889cf47ebcca5843f6 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-InstanceActionsNegativeTestJSON-803204594-project Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ae104851a64c4638abd70af95f27d4fa Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-803204594-project Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0a7fa122-977d-4adb-a531-0a2d0b42b14e could not be found. Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'server_id': '0a7fa122-977d-4adb-a531-0a2d0b42b14e'} Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a7fa122-977d-4adb-a531-0a2d0b42b14e could not be found. Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:51.114928 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a7fa122-977d-4adb-a531-0a2d0b42b14e could not be found. Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a7fa122-977d-4adb-a531-0a2d0b42b14e could not be found. Jul 02 21:09:51.118687 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:51.135234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d083fac6-34a3-43a6-984d-6d46cac28c19 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Returning 404 to user: Instance 0a7fa122-977d-4adb-a531-0a2d0b42b14e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:51.145291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d083fac6-34a3-43a6-984d-6d46cac28c19 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/0a7fa122-977d-4adb-a531-0a2d0b42b14e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.054453 Jul 02 21:09:51.146293 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1195/2344] 10.222.0.43 () {58 vars in 1295 bytes} [Sat Jul 2 21:09:51 2022] GET /compute/v2.1/servers/0a7fa122-977d-4adb-a531-0a2d0b42b14e/os-instance-actions => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:09:51.158423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:51.159068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:51.177153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.177883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.179996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.183142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.245765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:09:51.366508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:51.367431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:51.375229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.390532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.394310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.395116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.402214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:51.504904 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c99bab0-69f2-43e8-b0ab-b2244e178e13 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 204 len: 0 microversion: 2.1 time: 0.351828 Jul 02 21:09:51.505657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1150/2345] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:09:51 2022] DELETE /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:09:51.514320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:51.515271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:51.532710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.533506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.534504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.538801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.605520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:51.612612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:51.618526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:51.630191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:51.638564 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20bf2c73-43da-4ac1-95b1-bfd91c98bdf1 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.275852 Jul 02 21:09:51.650608 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1196/2346] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:51 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:51.655654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:51.656533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:51.685944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.686689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:51.687915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:51.688529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:52.459888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.469092 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-293f3556-6c40-4984-bdf3-95cdfc7288a4 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1527 microversion: 2.1 time: 0.959078 Jul 02 21:09:52.472912 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1151/2347] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:51 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1527 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:52.481610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:52.488229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:52.503735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:52.504508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:52.505458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:52.506126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:52.575353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.585245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.587006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.588636 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ae619d38-aa0a-4feb-8776-e844a6a09cb6 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2952 microversion: 2.42 time: 0.936818 Jul 02 21:09:52.590169 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1197/2348] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:51 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2952 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:52.668456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:52.670299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:52.673852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:52.698588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:52.701436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:52.704199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:52.705002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:52.737483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.750439 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd943250-b489-4f08-a7b6-5c47e3ce6cb5 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1286 microversion: 2.1 time: 0.276138 Jul 02 21:09:52.754724 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1152/2349] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:52 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1286 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:52.868833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.880900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.888796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:52.896270 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-361638e9-07c3-485e-99e3-1470b64b593b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.233041 Jul 02 21:09:52.898487 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1198/2350] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:52 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:53.249849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a55095ca-d608-436e-8e2a-a4e43a6899ac req-b36921eb-8573-4491-be42-3c26d8605a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "308385e3-792d-4631-b8d7-c37d0374d7db"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:53.267816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a55095ca-d608-436e-8e2a-a4e43a6899ac req-b36921eb-8573-4491-be42-3c26d8605a79 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:53.272514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a55095ca-d608-436e-8e2a-a4e43a6899ac req-b36921eb-8573-4491-be42-3c26d8605a79 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:53.300549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a55095ca-d608-436e-8e2a-a4e43a6899ac req-b36921eb-8573-4491-be42-3c26d8605a79 service nova] Creating event network-vif-unplugged:308385e3-792d-4631-b8d7-c37d0374d7db for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:09:53.314486 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a55095ca-d608-436e-8e2a-a4e43a6899ac req-b36921eb-8573-4491-be42-3c26d8605a79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068908 Jul 02 21:09:53.316727 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1153/2351] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:53.490642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:53.491284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:53.501650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:53.505300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:53.507953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:53.508599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:53.611950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:53.613343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:53.620461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:53.621287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:53.622301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:53.622953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:54.351267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.364170 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd815699-a470-4b4b-924f-5b2408ab02e2 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1527 microversion: 2.1 time: 0.874626 Jul 02 21:09:54.365421 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1199/2352] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:53 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1527 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:54.378803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:54.379427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:54.386139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:54.386943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:54.387944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:54.388431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:54.563585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.577227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.578736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.580378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-562a5216-7a37-4fa2-b6f2-93110b368b2b tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2931 microversion: 2.42 time: 0.973369 Jul 02 21:09:54.580641 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1154/2353] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:53 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2931 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:54.589210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:54.594934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:54.602461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:54.603137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:54.604436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:54.605092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:54.778595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.789451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.791459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.792916 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69fcbd47-6326-43d6-aaab-a0d14e093616 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.207666 Jul 02 21:09:54.794979 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1155/2354] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:54 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:54.915663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:54.932886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44f5b59e-3d40-4158-a671-b9ce2916b42c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 0.566151 Jul 02 21:09:54.935939 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1200/2355] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:54 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:55.373467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-66e2e6a0-dc7c-4618-a11c-180ece9fd49b req-3c0911c7-ab8a-49d3-8ab6-b7cd0245f759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e626528-e544-489b-a728-8d29c464fb00", "name": "network-vif-deleted", "tag": "cb5f6973-6da8-4133-8a89-ad40b35d002a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:55.383117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:55.384504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:55.394907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.397023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:55.398795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-66e2e6a0-dc7c-4618-a11c-180ece9fd49b req-3c0911c7-ab8a-49d3-8ab6-b7cd0245f759 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.399963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.400639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:55.401313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-66e2e6a0-dc7c-4618-a11c-180ece9fd49b req-3c0911c7-ab8a-49d3-8ab6-b7cd0245f759 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:55.434041 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-66e2e6a0-dc7c-4618-a11c-180ece9fd49b req-3c0911c7-ab8a-49d3-8ab6-b7cd0245f759 service nova] Creating event network-vif-deleted:cb5f6973-6da8-4133-8a89-ad40b35d002a for instance 5e626528-e544-489b-a728-8d29c464fb00 on nch2-master-1 Jul 02 21:09:55.443233 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-66e2e6a0-dc7c-4618-a11c-180ece9fd49b req-3c0911c7-ab8a-49d3-8ab6-b7cd0245f759 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073611 Jul 02 21:09:55.448417 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1156/2356] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:55.601157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:55.602505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:55.644374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.645090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:55.646114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.649871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:55.725092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae104851a64c4638abd70af95f27d4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90c7a815db0145889cf47ebcca5843f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:55.733023 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-99615f30-ef9a-4450-bb4d-e2e736ec95a7 tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 200 len: 1309 microversion: 2.1 time: 0.354204 Jul 02 21:09:55.748799 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1201/2357] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:55 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:09:55.813809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:55.814591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:55.826112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.830199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:55.835699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:55.839269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.058437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.069429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.070949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.072203 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-668a6423-8e4f-4713-8134-ed94c1af27f8 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.262664 Jul 02 21:09:56.099755 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1202/2358] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:55 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:56.126430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:56.133076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:56.144412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:56.145231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.146412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:56.147085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.549974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.570350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.578058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.586476 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e7b0491-5356-4516-b8fb-a2fc201204cb tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2910 microversion: 2.42 time: 0.989592 Jul 02 21:09:56.603957 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1157/2359] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:55 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2910 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:56.632778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-723aefb1-c7b0-4373-b50c-dc0eddea69f4 req-9ddad677-154e-47b0-a362-7e106ae3023a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "53ab081d-a441-43ec-bea7-7a9b418c3546"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:56.654851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:56.656012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-723aefb1-c7b0-4373-b50c-dc0eddea69f4 req-9ddad677-154e-47b0-a362-7e106ae3023a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:56.658293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-723aefb1-c7b0-4373-b50c-dc0eddea69f4 req-9ddad677-154e-47b0-a362-7e106ae3023a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.667300 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a512be1c-c760-4427-8693-0ad179ac63cf tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 0.559057 Jul 02 21:09:56.667933 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1203/2360] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:56 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:56.693919 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-723aefb1-c7b0-4373-b50c-dc0eddea69f4 req-9ddad677-154e-47b0-a362-7e106ae3023a service nova] Creating event network-vif-unplugged:53ab081d-a441-43ec-bea7-7a9b418c3546 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:09:56.722303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-723aefb1-c7b0-4373-b50c-dc0eddea69f4 req-9ddad677-154e-47b0-a362-7e106ae3023a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115019 Jul 02 21:09:56.725365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1158/2361] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:56.765719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:56.766524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] [instance: 5e626528-e544-489b-a728-8d29c464fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:56.778310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-50424efa-42cd-4654-8d4b-08bd970f0353 req-ed0f4a45-f434-450a-b74c-b6e0b1a68db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc68bcb-2acb-4d63-bf37-223a0953e85a", "tag": "0ff21b37-21b9-4c6e-b493-f0b4c260d81e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:56.780111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:56.780569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.787844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:56.790236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.796425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-50424efa-42cd-4654-8d4b-08bd970f0353 req-ed0f4a45-f434-450a-b74c-b6e0b1a68db9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:56.797225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-50424efa-42cd-4654-8d4b-08bd970f0353 req-ed0f4a45-f434-450a-b74c-b6e0b1a68db9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:56.826066 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-50424efa-42cd-4654-8d4b-08bd970f0353 req-ed0f4a45-f434-450a-b74c-b6e0b1a68db9 service nova] Creating event network-changed:0ff21b37-21b9-4c6e-b493-f0b4c260d81e for instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a on nch2-master-1 Jul 02 21:09:56.833697 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-50424efa-42cd-4654-8d4b-08bd970f0353 req-ed0f4a45-f434-450a-b74c-b6e0b1a68db9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063463 Jul 02 21:09:56.835119 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1159/2362] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:56.871366 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] HTTP exception thrown: Instance 5e626528-e544-489b-a728-8d29c464fb00 could not be found. Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Request method failure captured: Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 HTTP/1.1 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQGf47IeiwdfTvkGRReL4u415LclDowAXJqOfmrYGqGw48VYY5wDMqKhL4aRgpngyv_zll-pc77f-y4KyW7YvnsYko7UCK3fh-szBgwq3Fm-3uu6jB6TGrgLbwT2sXxpgjyUs6rtkx7YiwhbaGdk6dsT9HUJRRND3iPuekiUJP58V4 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 90c7a815db0145889cf47ebcca5843f6 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90c7a815db0145889cf47ebcca5843f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_90c7a815db0145889cf47ebcca5843f6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/90c7a815db0145889cf47ebcca5843f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/90c7a815db0145889cf47ebcca5843f6"}]}] Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 90c7a815db0145889cf47ebcca5843f6 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-803204594 Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-InstanceActionsNegativeTestJSON-803204594-project Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ae104851a64c4638abd70af95f27d4fa Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-803204594-project Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 5e626528-e544-489b-a728-8d29c464fb00 could not be found. Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '5e626528-e544-489b-a728-8d29c464fb00'} Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e626528-e544-489b-a728-8d29c464fb00 could not be found. Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e626528-e544-489b-a728-8d29c464fb00 could not be found. Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:56.872970 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e626528-e544-489b-a728-8d29c464fb00 could not be found. Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] Returning 404 to user: Instance 5e626528-e544-489b-a728-8d29c464fb00 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b0681e72-1289-4656-be41-5a7c3b4787cd tempest-InstanceActionsNegativeTestJSON-803204594 tempest-InstanceActionsNegativeTestJSON-803204594-project] 10.222.0.43 "GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00" status: 404 len: 111 microversion: 2.1 time: 0.112834 Jul 02 21:09:56.880578 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1204/2363] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:56 2022] GET /compute/v2.1/servers/5e626528-e544-489b-a728-8d29c464fb00 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:09:57.114461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:57.115871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:57.128131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.128951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:57.130218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.131047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:57.310976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:57.320952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:57.325213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:57.328717 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e62b6a2-bd40-45e9-a377-9ecbef76e5d0 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.228939 Jul 02 21:09:57.345022 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1160/2364] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:57 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:57.601432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7bba54e7-314a-4833-bb7d-137dceb2b012 req-9c9433ee-1326-4696-84e3-6eea43aa5d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-deleted", "tag": "1afd4b1f-b58d-4f5d-a887-dc07fab9afe4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:57.610392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:57.611065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:57.631567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.633810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:57.634779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.635322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:57.639863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7bba54e7-314a-4833-bb7d-137dceb2b012 req-9c9433ee-1326-4696-84e3-6eea43aa5d11 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.643691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7bba54e7-314a-4833-bb7d-137dceb2b012 req-9c9433ee-1326-4696-84e3-6eea43aa5d11 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:57.696967 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7bba54e7-314a-4833-bb7d-137dceb2b012 req-9c9433ee-1326-4696-84e3-6eea43aa5d11 service nova] Creating event network-vif-deleted:1afd4b1f-b58d-4f5d-a887-dc07fab9afe4 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:09:57.719078 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7bba54e7-314a-4833-bb7d-137dceb2b012 req-9c9433ee-1326-4696-84e3-6eea43aa5d11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121675 Jul 02 21:09:57.720153 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1205/2365] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:09:57.738104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:57.744391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:57.762828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.767515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:57.768754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:57.771656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:58.736416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.750655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.754861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.758393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.762512 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-713cdfae-a6bc-4694-ad15-1db3294762bd tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2865 microversion: 2.42 time: 1.156141 Jul 02 21:09:58.763008 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ee88f4b-0690-4bdb-90bf-0ec36707d469 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 1.039801 Jul 02 21:09:58.765553 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1161/2366] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:57 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2865 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:09:58.765890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1206/2367] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:57 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:09:58.780132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:58.780974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:58.792854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:58.796195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:58.799811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:58.801865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:58.850431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e135a9c2-1686-4e0e-ae16-83ffb1f34ffe req-7d0f5c3b-880d-44b3-95a7-cc3863f706bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "1b833045-67de-490c-a1bc-7322fe6f685a"}, {"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-unplugged", "status": "completed", "tag": "4d668df7-a488-410e-b721-df9a93a7b149"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:58.863618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e135a9c2-1686-4e0e-ae16-83ffb1f34ffe req-7d0f5c3b-880d-44b3-95a7-cc3863f706bb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:58.864341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e135a9c2-1686-4e0e-ae16-83ffb1f34ffe req-7d0f5c3b-880d-44b3-95a7-cc3863f706bb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:58.877636 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e135a9c2-1686-4e0e-ae16-83ffb1f34ffe req-7d0f5c3b-880d-44b3-95a7-cc3863f706bb service nova] Creating event network-vif-unplugged:1b833045-67de-490c-a1bc-7322fe6f685a for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:09:58.878478 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e135a9c2-1686-4e0e-ae16-83ffb1f34ffe req-7d0f5c3b-880d-44b3-95a7-cc3863f706bb service nova] Creating event network-vif-unplugged:4d668df7-a488-410e-b721-df9a93a7b149 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:09:58.884936 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e135a9c2-1686-4e0e-ae16-83ffb1f34ffe req-7d0f5c3b-880d-44b3-95a7-cc3863f706bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.038141 Jul 02 21:09:58.885860 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1207/2368] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:09:58.960228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.970150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.971649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:09:58.973051 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f5c383f-e360-4c77-a0ec-76cbf960e364 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.206467 Jul 02 21:09:58.973891 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1162/2369] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:09:58 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:09:59.332502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:59.366441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:59.375123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-95554", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f32f817d-1623-4050-b8c2-1a51b0a242c7"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:09:59.444990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] validate_networks() for [('f32f817d-1623-4050-b8c2-1a51b0a242c7', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:09:59.782463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:09:59.783836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:09:59.791614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:09:59.795462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:59.796210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:09:59.797268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:09:59.798000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:00.428500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:00.444203 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f89673f-590e-4ab9-9ecc-96b079e301a1 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 0.666630 Jul 02 21:10:00.445358 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1163/2370] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:09:59 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:00.458641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:00.459585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:00.472667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:00.479983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:00.481016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:00.481622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.036420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:10:01.037925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:10:01.038589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:10:01.039253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:10:01.040563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:10:01.058308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.059306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.060912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.061725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.087359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for project dffcfd79372c47e89be4acbdc042d510. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:01.095716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for user b3b24a3216aa4eba8a9a90c109c3b491 and project dffcfd79372c47e89be4acbdc042d510. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:01.116235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:10:01.120233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:10:01.142445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:01.160895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:01.163071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:01.165398 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3280bfca-3ce9-4d9c-9b49-12ab78b80219 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2706 microversion: 2.42 time: 0.718385 Jul 02 21:10:01.166141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1164/2371] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:00 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2706 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:01.171573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:01.172484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:01.179877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.180730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.181959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.182717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.223522 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6cc11e50-51a4-4802-b792-925db4705bb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.007197 Jul 02 21:10:01.224203 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1208/2372] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:10:01.245094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7e3685e8-5723-4ab4-a821-dbd7bbfef6cc req-b7c3e760-567e-4ef8-a382-f02f2c5bcf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-deleted", "tag": "308385e3-792d-4631-b8d7-c37d0374d7db"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:01.259734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7e3685e8-5723-4ab4-a821-dbd7bbfef6cc req-b7c3e760-567e-4ef8-a382-f02f2c5bcf74 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.261019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7e3685e8-5723-4ab4-a821-dbd7bbfef6cc req-b7c3e760-567e-4ef8-a382-f02f2c5bcf74 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.288015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7e3685e8-5723-4ab4-a821-dbd7bbfef6cc req-b7c3e760-567e-4ef8-a382-f02f2c5bcf74 service nova] Creating event network-vif-deleted:308385e3-792d-4631-b8d7-c37d0374d7db for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:10:01.301504 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7e3685e8-5723-4ab4-a821-dbd7bbfef6cc req-b7c3e760-567e-4ef8-a382-f02f2c5bcf74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062363 Jul 02 21:10:01.302664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1209/2373] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:01.310249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8cb63bba-994f-4b18-9a38-29b07f1d3e06 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7849550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:01.384505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:01.398386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:01.400161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:01.401648 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-298c9f4d-dce4-4d68-a98f-1445de4f5937 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.234209 Jul 02 21:10:01.404839 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8cb63bba-994f-4b18-9a38-29b07f1d3e06 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/69319717-1981-4e9e-ae56-82cb08a882ce" status: 200 len: 661 microversion: 2.1 time: 0.099750 Jul 02 21:10:01.407440 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1210/2374] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:01 2022] GET /compute/v2.1/images/69319717-1981-4e9e-ae56-82cb08a882ce => generated 661 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:01.413710 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1165/2375] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:01 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:01.417100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b96bd15c-7013-46d2-83bc-b4455d4b7e20 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:01.418071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b96bd15c-7013-46d2-83bc-b4455d4b7e20 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:01.428404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df7b8528-f386-4771-8b89-fdd2f94078e9 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea1aaee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:01.486575 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df7b8528-f386-4771-8b89-fdd2f94078e9 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/69319717-1981-4e9e-ae56-82cb08a882ce" status: 200 len: 661 microversion: 2.1 time: 0.065445 Jul 02 21:10:01.494928 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1166/2376] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:01 2022] GET /compute/v2.1/images/69319717-1981-4e9e-ae56-82cb08a882ce => generated 661 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:01.502641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:01.503520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:01.512426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.513265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:01.515079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:01.516185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:02.115328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b96bd15c-7013-46d2-83bc-b4455d4b7e20 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.131506 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b96bd15c-7013-46d2-83bc-b4455d4b7e20 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1220 microversion: 2.1 time: 0.722491 Jul 02 21:10:02.132683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1211/2377] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:01 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1220 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:02.189549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:02.190182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:02.198381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:02.199630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:02.200421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:02.201727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:02.358523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.367195 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34aed015-a5b6-48a7-8e54-b839ede9239c tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 0.870454 Jul 02 21:10:02.368077 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1167/2378] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:01 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:02.421159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:02.422270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:02.432109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:02.433221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:02.434214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:02.435073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:02.586329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.598236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.601834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.623224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad14f62f-912f-46e2-b35d-fead8bf6ed1b tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.190015 Jul 02 21:10:02.625687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1168/2379] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:02 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:02.628741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.641499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.643019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:02.656673 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d168fdbd-04d0-4d2f-b51a-a744d7e32d81 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2370 microversion: 2.42 time: 0.459888 Jul 02 21:10:02.658383 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1212/2380] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:02 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:02.792431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fa9d65a4-a3de-4ec8-beb2-d85e716193c8 req-c249e58c-8822-4d03-9198-6bef52cd7b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc68bcb-2acb-4d63-bf37-223a0953e85a", "name": "network-vif-plugged", "status": "completed", "tag": "0ff21b37-21b9-4c6e-b493-f0b4c260d81e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:02.830230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa9d65a4-a3de-4ec8-beb2-d85e716193c8 req-c249e58c-8822-4d03-9198-6bef52cd7b39 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:02.830610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa9d65a4-a3de-4ec8-beb2-d85e716193c8 req-c249e58c-8822-4d03-9198-6bef52cd7b39 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:02.891846 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fa9d65a4-a3de-4ec8-beb2-d85e716193c8 req-c249e58c-8822-4d03-9198-6bef52cd7b39 service nova] Creating event network-vif-plugged:0ff21b37-21b9-4c6e-b493-f0b4c260d81e for instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a on nch2-master-1 Jul 02 21:10:02.909262 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fa9d65a4-a3de-4ec8-beb2-d85e716193c8 req-c249e58c-8822-4d03-9198-6bef52cd7b39 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120951 Jul 02 21:10:02.912956 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1169/2381] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:03.092654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce91038b-322a-4e4f-8fc0-29d40b849ba4 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea130040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:03.151209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce91038b-322a-4e4f-8fc0-29d40b849ba4 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/d4d37b0a-d868-4222-adfb-32f0cc3f8556" status: 200 len: 661 microversion: 2.1 time: 0.064153 Jul 02 21:10:03.155537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:03.155691 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1213/2382] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:03 2022] GET /compute/v2.1/images/d4d37b0a-d868-4222-adfb-32f0cc3f8556 => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:03.164449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:03.167641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3777e9b6-8cb2-4494-9460-970449bde91d tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd774edc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:03.172081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.172715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.176226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.176882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.237205 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3777e9b6-8cb2-4494-9460-970449bde91d tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/d4d37b0a-d868-4222-adfb-32f0cc3f8556" status: 200 len: 661 microversion: 2.1 time: 0.073303 Jul 02 21:10:03.238170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1214/2383] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:03 2022] GET /compute/v2.1/images/d4d37b0a-d868-4222-adfb-32f0cc3f8556 => generated 661 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:10:03.356275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-36b6a84a-fb7d-4188-94f9-9c0a2f677f28 req-564dc438-0066-452a-bf67-bcb8da10fc7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-deleted", "tag": "1b833045-67de-490c-a1bc-7322fe6f685a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:03.365880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-36b6a84a-fb7d-4188-94f9-9c0a2f677f28 req-564dc438-0066-452a-bf67-bcb8da10fc7d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.366505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-36b6a84a-fb7d-4188-94f9-9c0a2f677f28 req-564dc438-0066-452a-bf67-bcb8da10fc7d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.383385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:03.392813 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-36b6a84a-fb7d-4188-94f9-9c0a2f677f28 req-564dc438-0066-452a-bf67-bcb8da10fc7d service nova] Creating event network-vif-deleted:1b833045-67de-490c-a1bc-7322fe6f685a for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:10:03.403882 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0820609-588d-4aad-a377-24bd36cac523 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1278 microversion: 2.1 time: 0.258759 Jul 02 21:10:03.405349 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-36b6a84a-fb7d-4188-94f9-9c0a2f677f28 req-564dc438-0066-452a-bf67-bcb8da10fc7d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053966 Jul 02 21:10:03.408598 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1215/2384] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:03.413984 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1170/2385] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:03 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:03.422816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:03.424576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:03.434368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.434827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.435614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.436115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.645536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:03.647120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:03.653280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.654288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.655303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.656129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.733385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:03.747520 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51f5749e-92cb-44c0-b142-c5a62b025ac0 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 0.337467 Jul 02 21:10:03.749095 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1216/2386] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:03 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:03.760479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:03.764272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:03.777879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:03.781753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:03.786042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.788080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.789268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:03.790588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:03.795081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:03.798137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:03.805372 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8600ae9d-16c0-41cb-85a1-f9244a1ea6da tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.163722 Jul 02 21:10:03.808743 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1171/2387] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:03 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:10:04.023273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:04.039633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:04.042197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:04.043464 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e949f726-4988-4dec-9ad5-e99ee122dd23 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 2167 microversion: 2.42 time: 0.291559 Jul 02 21:10:04.044338 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1217/2388] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:03 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 2167 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:04.423781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:04.424442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:04.455140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:04.455598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:04.463002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:04.463969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:04.764825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:04.766139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:04.781951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:04.783471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:04.784313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:04.784770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:04.966463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:04.983564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3088013a-4596-4810-a7cd-4b2f623e20f7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.564303 Jul 02 21:10:04.984745 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1172/2389] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:04 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:04.990258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:04.991013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:04.997805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:04.998464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:04.999333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:04.999763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:05.087261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.096604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.099030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.100844 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18f4d3ed-ae3d-4745-9060-d4e19a8f1e08 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1409 microversion: 2.54 time: 0.114925 Jul 02 21:10:05.101477 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1173/2390] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:04 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:05.111491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6078031e-b7d2-44b1-910f-cc0736bae26c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea1aad30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:05.118390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.129369 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b5a6655b-572e-47c4-8fb4-8352ca62c301 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1328 microversion: 2.1 time: 0.368352 Jul 02 21:10:05.129955 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1218/2391] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:04 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1328 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:05.134759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:05.135366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:05.141386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:05.141843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:05.142610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:05.143040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:05.160173 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6078031e-b7d2-44b1-910f-cc0736bae26c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/c67baaea-d119-4f87-aeed-412f8580a041" status: 200 len: 662 microversion: 2.1 time: 0.057355 Jul 02 21:10:05.160840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1174/2392] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:05 2022] GET /compute/v2.1/images/c67baaea-d119-4f87-aeed-412f8580a041 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:05.172671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5681a64b-491a-4aa8-bfe5-f4cbdc7387d5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe491a940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:05.218745 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5681a64b-491a-4aa8-bfe5-f4cbdc7387d5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/c67baaea-d119-4f87-aeed-412f8580a041" status: 200 len: 662 microversion: 2.1 time: 0.049908 Jul 02 21:10:05.219533 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1175/2393] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:05 2022] GET /compute/v2.1/images/c67baaea-d119-4f87-aeed-412f8580a041 => generated 662 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:05.220941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.231691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.233311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45991293f65c4c22a91afa74cf8179ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63b8773841e44baab20aa0677e027de7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:05.234635 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f069459-63e3-40ea-ab59-4172c9c6fada tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 200 len: 1604 microversion: 2.42 time: 0.103479 Jul 02 21:10:05.240108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1219/2394] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:05 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:05.272851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-878674206", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:05.347614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:10:05.469817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0e3cd596-fda4-4dc2-aac2-69cd0a186792 req-a350d7f2-7f8e-44a4-870d-ccff89715c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-deleted", "tag": "4d668df7-a488-410e-b721-df9a93a7b149"}, {"server_uuid": "33272f5e-59db-43f5-bab0-ff18f0659b5c", "name": "network-vif-deleted", "tag": "53ab081d-a441-43ec-bea7-7a9b418c3546"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:05.480072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0e3cd596-fda4-4dc2-aac2-69cd0a186792 req-a350d7f2-7f8e-44a4-870d-ccff89715c24 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:05.481820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0e3cd596-fda4-4dc2-aac2-69cd0a186792 req-a350d7f2-7f8e-44a4-870d-ccff89715c24 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:05.497457 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0e3cd596-fda4-4dc2-aac2-69cd0a186792 req-a350d7f2-7f8e-44a4-870d-ccff89715c24 service nova] Creating event network-vif-deleted:4d668df7-a488-410e-b721-df9a93a7b149 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:10:05.498072 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0e3cd596-fda4-4dc2-aac2-69cd0a186792 req-a350d7f2-7f8e-44a4-870d-ccff89715c24 service nova] Creating event network-vif-deleted:53ab081d-a441-43ec-bea7-7a9b418c3546 for instance 33272f5e-59db-43f5-bab0-ff18f0659b5c on nch1-master-1 Jul 02 21:10:05.505986 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0e3cd596-fda4-4dc2-aac2-69cd0a186792 req-a350d7f2-7f8e-44a4-870d-ccff89715c24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041586 Jul 02 21:10:05.507294 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1220/2395] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:05.684331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:10:05.684820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:10:05.685216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:10:05.685619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:10:05.690655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:10:05.707594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:05.708085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:05.708869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:05.709465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:05.728831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Getting quotas for project c3f6b014bf864b6aa1a1d980f4dd70b0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:05.735407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Getting quotas for user e1eb8b2dbe5e4d1d96891039f146bffe and project c3f6b014bf864b6aa1a1d980f4dd70b0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:05.755809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:10:05.758251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:10:05.836537 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa616b1d-a1d4-4b21-bf2b-c2827f78e2bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567636 Jul 02 21:10:05.837772 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1176/2396] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:10:05.958601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1425679609", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:06.000838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:06.001457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:06.011907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.012572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.013318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.013755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.105947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:10:06.462186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:06.478932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc4516c7-855c-4bc3-aa20-a8e230e2efda tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.481973 Jul 02 21:10:06.479544 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1177/2397] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:05 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:06.486362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-39199c16-f192-4b53-83ba-fb691b3ca275 req-8d75ca48-0a59-437a-ac74-4d523b06c9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06bd67d8-1a44-442b-9b0d-7a473629e99c", "tag": "11875d38-05a7-4e53-a1d2-f496d1378110"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:06.510980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-39199c16-f192-4b53-83ba-fb691b3ca275 req-8d75ca48-0a59-437a-ac74-4d523b06c9c9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.511691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-39199c16-f192-4b53-83ba-fb691b3ca275 req-8d75ca48-0a59-437a-ac74-4d523b06c9c9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.542552 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-39199c16-f192-4b53-83ba-fb691b3ca275 req-8d75ca48-0a59-437a-ac74-4d523b06c9c9 service nova] Creating event network-changed:11875d38-05a7-4e53-a1d2-f496d1378110 for instance 06bd67d8-1a44-442b-9b0d-7a473629e99c on nch2-master-1 Jul 02 21:10:06.563327 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-39199c16-f192-4b53-83ba-fb691b3ca275 req-8d75ca48-0a59-437a-ac74-4d523b06c9c9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079697 Jul 02 21:10:06.564425 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1178/2398] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:06.576102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:06.580808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:06.594899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.595679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.596716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.597158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.653298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:10:06.653724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:10:06.654209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:10:06.654618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:10:06.655034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:10:06.666311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.666708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.667598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.668103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.742115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Getting quotas for project c3f6b014bf864b6aa1a1d980f4dd70b0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:06.752463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Getting quotas for user e1eb8b2dbe5e4d1d96891039f146bffe and project c3f6b014bf864b6aa1a1d980f4dd70b0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:06.768953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:10:06.771390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:10:06.771932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:06.782974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:06.785125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:06.786710 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2875151c-c9b9-43be-afe9-cd1547cb1c29 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1415 microversion: 2.54 time: 0.220830 Jul 02 21:10:06.787729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1179/2399] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:06 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1415 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:06.810371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:06.812725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:06.825826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.826670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.827740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.828514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.850709 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eaee3b87-3d3b-45f8-928a-da27b5a7a21b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900177 Jul 02 21:10:06.851365 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1221/2400] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:10:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:10:06.862471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:06.863095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:06.872851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.873220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.874991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:06.875587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:06.900358 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] HTTP exception thrown: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Request method failure captured: Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c HTTP/1.1 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLKQk4qtXqACZ11zVPaqBmxUEQyX3d59B-zBOR1Vkio0HAalMLVfuH36f5eaAX8nKCmrxFWtNDAL5nZ5yoST1A06L5gLxepBhd60ZNe8jjHQ3pA0xdYaNyr8LUvu5SGBHK0b4jfbrUeIaQ-6P8tY4GZfj7bpNVHqASqTKR2rWymnK9w Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.42 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 63b8773841e44baab20aa0677e027de7 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b8773841e44baab20aa0677e027de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63b8773841e44baab20aa0677e027de7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b8773841e44baab20aa0677e027de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63b8773841e44baab20aa0677e027de7"}]}] Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 63b8773841e44baab20aa0677e027de7 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TaggedBootDevicesTest_v242-1793629843-project Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 45991293f65c4c22a91afa74cf8179ce Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1793629843-project Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '33272f5e-59db-43f5-bab0-ff18f0659b5c'} Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:06.902248 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Returning 404 to user: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6b1bdd73-fc21-4255-b872-e9b0dfe68506 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 404 len: 111 microversion: 2.42 time: 0.051353 Jul 02 21:10:06.906963 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1222/2401] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:06 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:10:06.912395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c323b38-12c0-47f2-977f-b9efa8de35df tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:06.913061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c323b38-12c0-47f2-977f-b9efa8de35df tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:06.980464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c323b38-12c0-47f2-977f-b9efa8de35df tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:06.991036 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c323b38-12c0-47f2-977f-b9efa8de35df tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1218 microversion: 2.1 time: 0.080144 Jul 02 21:10:06.994517 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1223/2402] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:06 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:07.005550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55d58275-0363-4e04-8a60-b63c22f94f1f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '.version_select at 0x7fabea12f4c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.042036 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55d58275-0363-4e04-8a60-b63c22f94f1f tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018938237" status: 204 len: 0 microversion: 2.42 time: 0.043343 Jul 02 21:10:07.047928 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1224/2403] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:10:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018938237 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:10:07.115316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.123789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94ded71b-3fce-4de5-96b6-922287edc5e4 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1528 microversion: 2.1 time: 0.334623 Jul 02 21:10:07.124729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1180/2404] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:06 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1528 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:07.141981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.150465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.162450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.164278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.165576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.166890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.188832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:07.361469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.372011 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a1abfed8-13ca-4c05-81ea-6db516900955 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1528 microversion: 2.1 time: 0.235425 Jul 02 21:10:07.376887 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1225/2405] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:07 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1528 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:07.498661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.499862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.509063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.509940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.510988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.511559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.639957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.640494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.646965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.651326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.652189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.652641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.674489 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] HTTP exception thrown: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.674757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Request method failure captured: Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a HTTP/1.1 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQaLksJdBQRtCy__iGp_P5dt3lal0y8d-1WmCHZuoeBUzW-tM93ACOEq56ltZ_G8fAmqyV_kxfVB5FO6QF_OSns8b0O0CCGmluDdu1T4icBXT19jMvvZy-xLjT9BWLpFnqlLx0U6bMGkIXmKIKIWT1PbBDPSs2JbBeVWBAT8RBnNsg Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 078e36fe8f6a4a979b730924cf4c5650 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1574763984 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/078e36fe8f6a4a979b730924cf4c5650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_078e36fe8f6a4a979b730924cf4c5650", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/078e36fe8f6a4a979b730924cf4c5650"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/078e36fe8f6a4a979b730924cf4c5650"}]}] Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1574763984 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 078e36fe8f6a4a979b730924cf4c5650 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1574763984 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1574763984-project Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 2b47897146d948138d6a22dfffd7b8a1 Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1574763984-project Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5fc68bcb-2acb-4d63-bf37-223a0953e85a'} Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:07.676767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Returning 404 to user: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60909562-54ab-4a42-80ea-8626ac614e93 tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 404 len: 111 microversion: 2.1 time: 0.290075 Jul 02 21:10:07.684165 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1181/2406] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:10:07 2022] DELETE /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 111 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:07.689410 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18ec8941-8cb9-4464-ad3f-37ade71adcd9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.196571 Jul 02 21:10:07.689783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.690586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.699019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.699478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.699940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1226/2407] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:07 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:07.700424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.700862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.805901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.806542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.816443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.818351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.820187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.820851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.859233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.868211 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00df96b4-42ac-4d8c-923a-10bd8d9c5050 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1528 microversion: 2.1 time: 0.183269 Jul 02 21:10:07.869211 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1182/2408] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:07 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1528 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:07.886955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Action: 'update', calling method: >, body: {"server": {"name": "5fc68bcb-2acb-4d63-bf37-223a0953e85a_new"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:07.888314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.895645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.896354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.897394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.897996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.919460 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] HTTP exception thrown: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.919893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Request method failure captured: Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a HTTP/1.1 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 64 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQaLksJdBQRtCy__iGp_P5dt3lal0y8d-1WmCHZuoeBUzW-tM93ACOEq56ltZ_G8fAmqyV_kxfVB5FO6QF_OSns8b0O0CCGmluDdu1T4icBXT19jMvvZy-xLjT9BWLpFnqlLx0U6bMGkIXmKIKIWT1PbBDPSs2JbBeVWBAT8RBnNsg Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 078e36fe8f6a4a979b730924cf4c5650 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1574763984 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/078e36fe8f6a4a979b730924cf4c5650"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_078e36fe8f6a4a979b730924cf4c5650", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/078e36fe8f6a4a979b730924cf4c5650"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/078e36fe8f6a4a979b730924cf4c5650"}]}] Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1574763984 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 078e36fe8f6a4a979b730924cf4c5650 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1574763984 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1574763984-project Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 2b47897146d948138d6a22dfffd7b8a1 Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1574763984-project Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "5fc68bcb-2acb-4d63-bf37-223a0953e85a_new"}} Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5fc68bcb-2acb-4d63-bf37-223a0953e85a', 'body': {'server': {'name': '5fc68bcb-2acb-4d63-bf37-223a0953e85a_new'}}} Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:10:07.922049 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:07.928597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:07.931606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] Returning 404 to user: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:07.933378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-053a75a0-92ed-459f-91a0-2a70035e7f3f tempest-ServersNegativeTestMultiTenantJSON-1574763984 tempest-ServersNegativeTestMultiTenantJSON-1574763984-project] 10.222.0.43 "PUT /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 404 len: 111 microversion: 2.1 time: 0.051036 Jul 02 21:10:07.934568 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1183/2409] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:10:07 2022] PUT /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:07.938952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.938952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:07.940128 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a4a9df36-81fc-4681-9dd9-4050d3334446 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1415 microversion: 2.54 time: 0.137846 Jul 02 21:10:07.945439 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1227/2410] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:07 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1415 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:10:07.950208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:07.951515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:07.960386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.960856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.961623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:07.962208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:07.990321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:10:08.013921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:08.015416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:08.027723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.028526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.029721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.030820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.069562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:08.095228 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f04b164-cebc-408b-a849-71f6210b3e46 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 204 len: 0 microversion: 2.1 time: 0.151649 Jul 02 21:10:08.095989 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1184/2411] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:10:07 2022] DELETE /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:10:08.106515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:08.107372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:08.115105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.116188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.117119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.117714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.120371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:08.128792 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-040a08db-dcad-40eb-bc4d-423a002d1262 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1222 microversion: 2.1 time: 0.122685 Jul 02 21:10:08.129459 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1228/2412] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:08 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:08.345209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:08.354166 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7d52465-ae78-47ed-b980-76a8fe33a966 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1534 microversion: 2.1 time: 0.253230 Jul 02 21:10:08.354842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1185/2413] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:08 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1534 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:08.706451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:08.707076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:08.713720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.714186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.714972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.715405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.862211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:08.870158 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0e28679a-edf2-4c5a-8bdc-f65958da74b7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.167633 Jul 02 21:10:08.870752 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1229/2414] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:08 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:08.913664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:08.914325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:08.921675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.922337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.923129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.923574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.959385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:08.961075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:08.968248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.969034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:08.970000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:08.970626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.100087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:09.114921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:09.117039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:09.121910 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e052e4d9-2592-4a15-8336-2c650fed4d1a tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1415 microversion: 2.54 time: 0.164768 Jul 02 21:10:09.123079 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1230/2415] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:08 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1415 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:10:09.146250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:09.146941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:09.153295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.153751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.154724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.155176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.190594 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15f609ad-36b1-4719-a060-ab6e8d46917f tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1811 microversion: 2.1 time: 0.281184 Jul 02 21:10:09.196103 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1186/2416] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:08 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1811 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:09.212142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95264b46-70be-4c3d-bd20-2efd678229ad tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:09.214215 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:10:09.214215 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:10:09.215490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95264b46-70be-4c3d-bd20-2efd678229ad tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.215950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95264b46-70be-4c3d-bd20-2efd678229ad tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.216969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95264b46-70be-4c3d-bd20-2efd678229ad tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.217411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95264b46-70be-4c3d-bd20-2efd678229ad tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.236009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:09.246479 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b2ee7f6b-7616-4839-9d32-2f62d40e81bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1214 microversion: 2.1 time: 0.103968 Jul 02 21:10:09.247249 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1231/2417] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:09 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:09.251064 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95264b46-70be-4c3d-bd20-2efd678229ad tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046854 Jul 02 21:10:09.251667 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1187/2418] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:10:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:10:09.372093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:09.373094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:09.392469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.393915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.395150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.395602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.724512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:09.732608 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fe23308-73a8-480a-ae17-04cce8771de9 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1534 microversion: 2.1 time: 0.365490 Jul 02 21:10:09.733206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1232/2419] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:09 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1534 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:09.887054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:09.887681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:09.898102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.898850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:09.899810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:09.906889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.140579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:10.141319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:10.150920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.151733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.152772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.153417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.281659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:10.292390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:10.294177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:10.295569 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38511c8b-52d6-48f7-a5c8-89d8930ddd8c tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1415 microversion: 2.54 time: 0.159239 Jul 02 21:10:10.307408 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1233/2420] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:10 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1415 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:10:10.317369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:10.318100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:10.329443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:10.332470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.336373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.337479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.338087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.540146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:10.551324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f72e72a4-5ac5-4366-9bd8-3fd5ebfa5dd8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1270 microversion: 2.1 time: 0.241124 Jul 02 21:10:10.552191 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1234/2421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:10 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:10.565479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:10.574814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-879df637-f56e-4bea-bfa8-825128267c45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.691759 Jul 02 21:10:10.576091 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1188/2422] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:09 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:10.749846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:10.750467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:10.762133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.762599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.763400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.763835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.906838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "655b7662-f602-41a5-8354-63f38f63b21d", "device": "/dev/xvdb"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:10.908321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:10.925467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.926591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:10.927546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:10.935161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.406465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77e54e61-ee3e-40a2-8bd3-dad25ae499af tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "POST /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502721 Jul 02 21:10:11.408975 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1189/2423] 10.222.0.43 () {60 vars in 1322 bytes} [Sat Jul 2 21:10:10 2022] POST /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:10:11.418633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:11.420341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:11.432671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:11.433398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.434348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:11.435510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.629080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:11.634110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:11.660505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:11.665393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:11.666679 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-92648fdc-d929-4ca8-8820-62ddba481085 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1400 microversion: 2.54 time: 0.256270 Jul 02 21:10:11.682040 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1190/2424] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:11 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1400 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:11.699713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:11.701888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:11.719999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:11.722663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.723997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:11.724518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.729328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cac5256d6b6458899f85d8762a03d90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e463fddac31c452296829260cfacc694', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:11.741045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-40420e98-5c78-434f-93d9-32c500da2675 tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 200 len: 1534 microversion: 2.1 time: 0.994711 Jul 02 21:10:11.752779 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1235/2425] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:10 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 1534 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:11.761103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:11.761771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:11.779076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:11.782915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.784275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:11.784879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:11.938633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:11.958457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7317541c-dfae-4231-a3b8-3d7295b00506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1276 microversion: 2.1 time: 0.273052 Jul 02 21:10:11.967293 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1191/2426] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:11 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:11.977643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa72b42e-9235-4721-83f4-829215841fc3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '.version_select at 0x7fabea153af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:12.039983 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa72b42e-9235-4721-83f4-829215841fc3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1813029450" status: 204 len: 0 microversion: 2.54 time: 0.071249 Jul 02 21:10:12.041065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1192/2427] 10.222.0.43 () {60 vars in 1318 bytes} [Sat Jul 2 21:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1813029450 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:10:12.065156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a46e6bbd-f586-4b79-b4be-92bc263b0fb5 req-ed490845-667b-46f0-97bb-42727ffc2714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc68bcb-2acb-4d63-bf37-223a0953e85a", "name": "network-vif-deleted", "tag": "0ff21b37-21b9-4c6e-b493-f0b4c260d81e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:12.084524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a46e6bbd-f586-4b79-b4be-92bc263b0fb5 req-ed490845-667b-46f0-97bb-42727ffc2714 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.085215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a46e6bbd-f586-4b79-b4be-92bc263b0fb5 req-ed490845-667b-46f0-97bb-42727ffc2714 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.101449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a46e6bbd-f586-4b79-b4be-92bc263b0fb5 req-ed490845-667b-46f0-97bb-42727ffc2714 service nova] Creating event network-vif-deleted:0ff21b37-21b9-4c6e-b493-f0b4c260d81e for instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a on nch2-master-1 Jul 02 21:10:12.112783 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a46e6bbd-f586-4b79-b4be-92bc263b0fb5 req-ed490845-667b-46f0-97bb-42727ffc2714 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065477 Jul 02 21:10:12.117324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1193/2428] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:12.139369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:12.140233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:12.164595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.165529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.166614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.167521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.208942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:10:12.215602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:12.229203 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a8dd803-389a-471d-bb0a-30beabe203e7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.471894 Jul 02 21:10:12.230261 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1236/2429] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:11 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:12.347857 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfa891bb-0224-4ddb-b37a-e628f79d24b3 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "DELETE /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 204 len: 0 microversion: 2.54 time: 0.228343 Jul 02 21:10:12.348695 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1194/2430] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:10:12 2022] DELETE /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:10:12.357289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:12.358134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:12.365037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.365840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.366808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.367412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.473973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:12.489803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:12.491965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:12.493925 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3fed114b-03ec-4093-accf-c210b8cce3e5 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1406 microversion: 2.54 time: 0.140264 Jul 02 21:10:12.495093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1237/2431] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:12 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:10:12.759125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:12.760425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] [instance: 5fc68bcb-2acb-4d63-bf37-223a0953e85a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:12.774348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.774865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.775874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.776325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.798309 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] HTTP exception thrown: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Request method failure captured: Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a HTTP/1.1 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQS6dmQJN4CLtNBn6Xc8GBZTuJVTszNSs8bfJ8QkGSBkYSfxuH2tH-r4e3MdnW8-USt5MuRtRFnaluPTJE_05Y-wxaHNEIq2tsFBcl-7R8Uy9nRjITmzgbo1dNmpAqqss_UnimM22IxScrAfkOOxRjpfV9vUEmoYl1DHsKveIU148I Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: e463fddac31c452296829260cfacc694 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1632342042 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e463fddac31c452296829260cfacc694"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e463fddac31c452296829260cfacc694", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e463fddac31c452296829260cfacc694"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e463fddac31c452296829260cfacc694"}]}] Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1632342042 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: e463fddac31c452296829260cfacc694 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1632342042 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1632342042-project Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 7cac5256d6b6458899f85d8762a03d90 Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1632342042-project Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5fc68bcb-2acb-4d63-bf37-223a0953e85a'} Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:12.800253 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. Jul 02 21:10:12.805694 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:12.808296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] Returning 404 to user: Instance 5fc68bcb-2acb-4d63-bf37-223a0953e85a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:12.809419 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d842ba45-494b-4019-ab1a-4afe7bed104e tempest-ServersNegativeTestMultiTenantJSON-1632342042 tempest-ServersNegativeTestMultiTenantJSON-1632342042-project] 10.222.0.43 "GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a" status: 404 len: 111 microversion: 2.1 time: 0.055011 Jul 02 21:10:12.810512 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1195/2432] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:12 2022] GET /compute/v2.1/servers/5fc68bcb-2acb-4d63-bf37-223a0953e85a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:12.978763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:12.979411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:12.988730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.989188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:12.993793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:12.994460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:13.091855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:13.102271 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c59e2121-1631-42e1-8d36-c15197e3d44b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1276 microversion: 2.1 time: 0.128315 Jul 02 21:10:13.112251 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1238/2433] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:12 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:13.257374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:13.258642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:13.277641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:13.279671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:13.284066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:13.287871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:13.512790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:13.513789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:13.521522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:13.522272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:13.523250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:13.523876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:13.621291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:13.627366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:13.634279 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f91a778-1881-476d-9ab4-239cf646c5d0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.389054 Jul 02 21:10:13.635878 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1196/2434] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:13 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:13.639381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:13.641818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:13.643201 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8a4aeaea-6b72-4afe-b34e-79104fdd3453 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1406 microversion: 2.54 time: 0.134417 Jul 02 21:10:13.643979 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1239/2435] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:13 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1406 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:10:14.119412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:14.120030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:14.130777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.131663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.132733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.133443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.630172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:14.643656 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad20b6f0-f35b-4847-a8a4-1459c6b28eb1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 0.527218 Jul 02 21:10:14.651939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:14.653358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:14.658108 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1197/2436] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:14 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:14.665848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:14.668578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.668790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:14.669271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.671447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.671889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.698309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.698766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.699554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.699995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.827097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:14.827619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:14.828103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lazy-loading 'fault' on Instance uuid 461c1622-6484-45a1-bc8a-1845eba8d5d9 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:10:14.993786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:15.012602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:15.015041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8aa30bbc54064a5492836308770c0131', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2652c1d42aaf4f12ae2561ce0574cd74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:15.017478 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b96deabe-f30f-46e0-9fe8-31c73648f946 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 200 len: 1411 microversion: 2.54 time: 0.358010 Jul 02 21:10:15.042116 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1198/2437] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:14 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 1411 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:10:15.084666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:15.087464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:15.096698 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5765330-94a0-4e7c-80a4-931c88aaf3f1 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 0.447282 Jul 02 21:10:15.100290 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1240/2438] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:14 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:15.111757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:15.119489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.119489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.120292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.121125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.134940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:15.135604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:15.142216 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] HTTP exception thrown: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.146207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Request method failure captured: Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c HTTP/1.1 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKQk4qtXqACZ11zVPaqBmxUEQyX3d59B-zBOR1Vkio0HAalMLVfuH36f5eaAX8nKCmrxFWtNDAL5nZ5yoST1A06L5gLxepBhd60ZNe8jjHQ3pA0xdYaNyr8LUvu5SGBHK0b4jfbrUeIaQ-6P8tY4GZfj7bpNVHqASqTKR2rWymnK9w Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.42 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 63b8773841e44baab20aa0677e027de7 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b8773841e44baab20aa0677e027de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63b8773841e44baab20aa0677e027de7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b8773841e44baab20aa0677e027de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63b8773841e44baab20aa0677e027de7"}]}] Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 63b8773841e44baab20aa0677e027de7 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest_v242-1793629843-project Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 45991293f65c4c22a91afa74cf8179ce Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1793629843-project Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '33272f5e-59db-43f5-bab0-ff18f0659b5c'} Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:15.149700 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.154596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Returning 404 to user: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:15.156317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.156935 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87f7d7ab-5e0e-4d7e-bb03-253bbcc2d2a5 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "DELETE /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 404 len: 111 microversion: 2.42 time: 0.112019 Jul 02 21:10:15.159045 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1199/2439] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:10:15 2022] DELETE /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:10:15.159558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.160261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.170680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:15.171701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] [instance: 33272f5e-59db-43f5-bab0-ff18f0659b5c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:15.186199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.187904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.188881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.194394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.233279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:10:15.236737 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] HTTP exception thrown: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Request method failure captured: Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c HTTP/1.1 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLKQk4qtXqACZ11zVPaqBmxUEQyX3d59B-zBOR1Vkio0HAalMLVfuH36f5eaAX8nKCmrxFWtNDAL5nZ5yoST1A06L5gLxepBhd60ZNe8jjHQ3pA0xdYaNyr8LUvu5SGBHK0b4jfbrUeIaQ-6P8tY4GZfj7bpNVHqASqTKR2rWymnK9w Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.42 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 63b8773841e44baab20aa0677e027de7 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b8773841e44baab20aa0677e027de7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_63b8773841e44baab20aa0677e027de7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/63b8773841e44baab20aa0677e027de7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/63b8773841e44baab20aa0677e027de7"}]}] Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 63b8773841e44baab20aa0677e027de7 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1793629843 Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest_v242-1793629843-project Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 45991293f65c4c22a91afa74cf8179ce Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1793629843-project Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '33272f5e-59db-43f5-bab0-ff18f0659b5c'} Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.240501 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. Jul 02 21:10:15.244847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:15.245484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] Returning 404 to user: Instance 33272f5e-59db-43f5-bab0-ff18f0659b5c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:15.248888 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62301d22-61b5-4e77-aba2-54aba42547d8 tempest-TaggedBootDevicesTest_v242-1793629843 tempest-TaggedBootDevicesTest_v242-1793629843-project] 10.222.0.43 "GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c" status: 404 len: 111 microversion: 2.42 time: 0.083422 Jul 02 21:10:15.252558 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1200/2440] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:15 2022] GET /compute/v2.1/servers/33272f5e-59db-43f5-bab0-ff18f0659b5c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:10:15.276697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-62453d66-d84a-49ce-a104-01b9f6b7d4a7 req-9e9ec848-8457-43ee-994c-14b13180cead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bd67d8-1a44-442b-9b0d-7a473629e99c", "name": "network-vif-plugged", "status": "completed", "tag": "11875d38-05a7-4e53-a1d2-f496d1378110"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:15.301409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-62453d66-d84a-49ce-a104-01b9f6b7d4a7 req-9e9ec848-8457-43ee-994c-14b13180cead service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.302151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-62453d66-d84a-49ce-a104-01b9f6b7d4a7 req-9e9ec848-8457-43ee-994c-14b13180cead service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.326633 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-62453d66-d84a-49ce-a104-01b9f6b7d4a7 req-9e9ec848-8457-43ee-994c-14b13180cead service nova] Creating event network-vif-plugged:11875d38-05a7-4e53-a1d2-f496d1378110 for instance 06bd67d8-1a44-442b-9b0d-7a473629e99c on nch2-master-1 Jul 02 21:10:15.334845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:15.342172 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-62453d66-d84a-49ce-a104-01b9f6b7d4a7 req-9e9ec848-8457-43ee-994c-14b13180cead service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073885 Jul 02 21:10:15.343390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1201/2441] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:15.484818 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-662cf13b-71aa-4703-afee-344479da630a tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 204 len: 0 microversion: 2.1 time: 0.382458 Jul 02 21:10:15.485721 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1241/2442] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:10:15 2022] DELETE /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:10:15.494568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:15.495861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:15.510378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.510837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.511647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.512108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.666274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:15.668327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:15.675660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.676621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.677634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:15.678346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:15.744866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:16.012564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:16.022244 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2cc881a3-f506-4d31-9d38-276a023cd6d3 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1667 microversion: 2.1 time: 0.531791 Jul 02 21:10:16.027146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1202/2443] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:15 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1667 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:16.038308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:16.039789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] [instance: 461c1622-6484-45a1-bc8a-1845eba8d5d9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:16.053869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:16.054149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:16.070490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:16.070969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:16.102535 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] HTTP exception thrown: Instance 461c1622-6484-45a1-bc8a-1845eba8d5d9 could not be found. Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Request method failure captured: Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 HTTP/1.1 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQIvislKV63iXKiHDancD3zcWfpYV-fwx95hfqi5jB3-ef81GJtpMgBvs1DlpHK4V_SX2_9obn8cU1Q8QjypeSZnBO3oHSoo6VMO9OkDZkAnK08ENgxZwqU62GFRejAlqfpMu8XVE5vIsMR_ISBmQdpWkV9FmqrbV2U3P04u5t1My4 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.54 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 2652c1d42aaf4f12ae2561ce0574cd74 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerShowV254Test-597158714 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2652c1d42aaf4f12ae2561ce0574cd74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2652c1d42aaf4f12ae2561ce0574cd74", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2652c1d42aaf4f12ae2561ce0574cd74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2652c1d42aaf4f12ae2561ce0574cd74"}]}] Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerShowV254Test-597158714 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 2652c1d42aaf4f12ae2561ce0574cd74 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerShowV254Test-597158714 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerShowV254Test-597158714-project Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8aa30bbc54064a5492836308770c0131 Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerShowV254Test-597158714-project Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 461c1622-6484-45a1-bc8a-1845eba8d5d9 could not be found. Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '461c1622-6484-45a1-bc8a-1845eba8d5d9'} Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461c1622-6484-45a1-bc8a-1845eba8d5d9 could not be found. Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461c1622-6484-45a1-bc8a-1845eba8d5d9 could not be found. Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:16.106686 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461c1622-6484-45a1-bc8a-1845eba8d5d9 could not be found. Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] Returning 404 to user: Instance 461c1622-6484-45a1-bc8a-1845eba8d5d9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:16.111027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b50dff8-ea5a-4c9f-9148-dfeee8ed8356 tempest-ServerShowV254Test-597158714 tempest-ServerShowV254Test-597158714-project] 10.222.0.43 "GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9" status: 404 len: 111 microversion: 2.54 time: 0.074457 Jul 02 21:10:16.115429 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1203/2444] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:10:16 2022] GET /compute/v2.1/servers/461c1622-6484-45a1-bc8a-1845eba8d5d9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:10:16.126170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:16.127003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:16.140578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:16.141038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:16.141825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:16.142262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:16.265957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:16.285104 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3bf39e21-a909-4df1-8912-f370249408ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 0.627671 Jul 02 21:10:16.288397 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1242/2445] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:15 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:16.302307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:16.304272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:16.315135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:16.318892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:16.333483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:16.334383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:16.701956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:16.985276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:17.096728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f3f110a-124b-4c02-88e4-b2ab009b4f24 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1857 microversion: 2.1 time: 0.979810 Jul 02 21:10:17.111903 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1204/2446] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:16 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1857 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:17.124259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:17.126507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:17.144883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.145607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:17.146411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.151015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:17.281681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:17.299919 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d053fc54-b8b7-4196-b38c-0d6eefa115f2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1320 microversion: 2.1 time: 1.009268 Jul 02 21:10:17.300897 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1243/2447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:16 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1320 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:17.307927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:17.310402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:17.328126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.330269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:17.335071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.335769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:17.408721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lazy-loading 'flavor' on Instance uuid 195db841-91bd-42a6-95aa-986da8c9fb00 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:10:17.467820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Going to try to live migrate instance to nch1-master-1 {{(pid=131045) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:10:17.733315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:17.743148 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1200434-654b-401c-b000-3d85e09311a9 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1667 microversion: 2.1 time: 0.629967 Jul 02 21:10:17.743742 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1205/2448] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:17 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1667 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:17.757049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1331ec6b-ba45-4879-889c-28c022ac0282 req-7dbfa6d1-5a67-450b-baa1-1983e8424c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f04307a-39d1-4497-acb0-17ba192336bc", "tag": "77b42318-cb32-44f7-833d-f1bb938eae91"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:17.782797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1331ec6b-ba45-4879-889c-28c022ac0282 req-7dbfa6d1-5a67-450b-baa1-1983e8424c8b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.783526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1331ec6b-ba45-4879-889c-28c022ac0282 req-7dbfa6d1-5a67-450b-baa1-1983e8424c8b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:17.796453 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1331ec6b-ba45-4879-889c-28c022ac0282 req-7dbfa6d1-5a67-450b-baa1-1983e8424c8b service nova] Creating event network-changed:77b42318-cb32-44f7-833d-f1bb938eae91 for instance 6f04307a-39d1-4497-acb0-17ba192336bc on nch1-master-1 Jul 02 21:10:17.801887 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1331ec6b-ba45-4879-889c-28c022ac0282 req-7dbfa6d1-5a67-450b-baa1-1983e8424c8b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048422 Jul 02 21:10:17.802660 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1206/2449] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:17.820444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:17.821158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:17.827620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.828007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:17.828918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:17.829245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:18.863932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:18.874133 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67c4680c-3cce-40eb-9cfa-a08a7eb5e9a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 1.070005 Jul 02 21:10:18.885415 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1207/2450] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:17 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:18.905981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:18.906669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:18.938704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:18.939341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:18.940238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:18.940681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:19.223396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:19.728209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:19.740550 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a984ca5-2eb4-465d-8ab7-cb47e2d2edc9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 0.860549 Jul 02 21:10:19.741583 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1208/2451] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:18 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:19.761330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:19.762209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:19.792904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:19.793881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:19.798600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:19.799216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:20.343999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e4df9d2e6b7481f839f36b0ec557949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93a2b945dc646148653736a366e67e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:20.361279 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62ee5ea0-3f17-47d3-b820-7dadd4a6de1d tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 200 len: 1667 microversion: 2.1 time: 0.612363 Jul 02 21:10:20.364951 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1209/2452] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:19 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 1667 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:20.390560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:20.392940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:20.401209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:20.402433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:20.404600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:20.405635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:21.039960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:21.057907 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-180645e0-1baa-4a05-88e5-6f036f4608ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 0.680129 Jul 02 21:10:21.065472 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1210/2453] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:20 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:21.073511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:21.074612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:21.092062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:21.092796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:21.093836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:21.094616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:21.101280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:21.111276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6444786d-8638-481c-a9d7-2b3a2caabc51 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/action" status: 202 len: 0 microversion: 2.1 time: 3.808511 Jul 02 21:10:21.112408 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1244/2454] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:10:17 2022] POST /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/action => generated 0 bytes in 3810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:10:21.119151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-064edb0b-da86-444f-9059-240ba2afd83a req-2252b03e-8047-4843-b69b-f8323fc179d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:21.153174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-064edb0b-da86-444f-9059-240ba2afd83a req-2252b03e-8047-4843-b69b-f8323fc179d2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:21.154080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-064edb0b-da86-444f-9059-240ba2afd83a req-2252b03e-8047-4843-b69b-f8323fc179d2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:21.187802 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-064edb0b-da86-444f-9059-240ba2afd83a req-2252b03e-8047-4843-b69b-f8323fc179d2 service nova] Creating event network-changed:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:10:21.205332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-064edb0b-da86-444f-9059-240ba2afd83a req-2252b03e-8047-4843-b69b-f8323fc179d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091175 Jul 02 21:10:21.206346 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1245/2455] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:21.216807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a0cb915-2fdc-4614-bcaf-87c899371694 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1720730700", "metadata": {"": ""}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a0cb915-2fdc-4614-bcaf-87c899371694 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action HTTP/1.1 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 107 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1720730700", "metadata": {"": ""}}} Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1720730700', 'metadata': {'': ''}}}} Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'': ''} Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:21.222789 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a0cb915-2fdc-4614-bcaf-87c899371694 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a0cb915-2fdc-4614-bcaf-87c899371694 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action" status: 400 len: 170 microversion: 2.1 time: 0.016619 Jul 02 21:10:21.227352 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1246/2456] 10.222.0.43 () {60 vars in 1278 bytes} [Sat Jul 2 21:10:21 2022] POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action => generated 170 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:10:21.235451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:21.249201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:21.259312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:21.259771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:21.260652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:21.261090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.025255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:22.034227 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-488f1799-a8ba-467f-87f2-cbdadb56cd16 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 0.966213 Jul 02 21:10:22.034821 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1211/2457] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:21 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:22.051032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:22.052336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:22.075979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:22.076796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.078645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:22.079249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.304296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:22.316914 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d430f8fc-9940-42b8-ad1d-59dddabaca8c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 1.085836 Jul 02 21:10:22.317708 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1247/2458] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:21 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:22.332239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-28e63dd5-be26-42bc-8f2d-5dd066434940 req-580f49f1-ca73-4e8d-a4e7-3aac4f43c457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b4ef26-c265-451f-b265-fd4496b083b9", "name": "network-vif-deleted", "tag": "9df4b96a-109f-4f80-bdef-6936978a9c4e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:22.354231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-28e63dd5-be26-42bc-8f2d-5dd066434940 req-580f49f1-ca73-4e8d-a4e7-3aac4f43c457 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:22.359442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-28e63dd5-be26-42bc-8f2d-5dd066434940 req-580f49f1-ca73-4e8d-a4e7-3aac4f43c457 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.381949 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-28e63dd5-be26-42bc-8f2d-5dd066434940 req-580f49f1-ca73-4e8d-a4e7-3aac4f43c457 service nova] Creating event network-vif-deleted:9df4b96a-109f-4f80-bdef-6936978a9c4e for instance b4b4ef26-c265-451f-b265-fd4496b083b9 on nch2-master-1 Jul 02 21:10:22.392834 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-28e63dd5-be26-42bc-8f2d-5dd066434940 req-580f49f1-ca73-4e8d-a4e7-3aac4f43c457 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073718 Jul 02 21:10:22.400516 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1248/2459] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:22.407591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:22.421189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] [instance: b4b4ef26-c265-451f-b265-fd4496b083b9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:22.428907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:22.429564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.430527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:22.431123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.457517 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] HTTP exception thrown: Instance b4b4ef26-c265-451f-b265-fd4496b083b9 could not be found. Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Request method failure captured: Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 HTTP/1.1 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLP3ybEsdE_OK7IB4xa3MwW56LRssmaHZtOWVDLFX8R9PksF9Je4_WsCXOwkRw-zx-JLUyx4OPt9vi35t2UfbBWmlh4DlaP6iHBIXUTlu5Kcs0NZNdaER8qXG69qW2sEbuZtnTEEJsQndKkaBKzU7jyqJ5xBOGuijVaDlsHV_HibUs0 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d93a2b945dc646148653736a366e67e7 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestFqdnHostnames-1342929457 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d93a2b945dc646148653736a366e67e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d93a2b945dc646148653736a366e67e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d93a2b945dc646148653736a366e67e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d93a2b945dc646148653736a366e67e7"}]}] Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestFqdnHostnames-1342929457 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d93a2b945dc646148653736a366e67e7 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1342929457 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestFqdnHostnames-1342929457-project Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1e4df9d2e6b7481f839f36b0ec557949 Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestFqdnHostnames-1342929457-project Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance b4b4ef26-c265-451f-b265-fd4496b083b9 could not be found. Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b4b4ef26-c265-451f-b265-fd4496b083b9'} Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b4ef26-c265-451f-b265-fd4496b083b9 could not be found. Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b4ef26-c265-451f-b265-fd4496b083b9 could not be found. Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:22.459199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b4ef26-c265-451f-b265-fd4496b083b9 could not be found. Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Returning 404 to user: Instance b4b4ef26-c265-451f-b265-fd4496b083b9 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:22.463272 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-578e389a-991a-493b-809d-27efef614320 tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9" status: 404 len: 111 microversion: 2.1 time: 0.058459 Jul 02 21:10:22.468481 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1249/2460] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:22 2022] GET /compute/v2.1/servers/b4b4ef26-c265-451f-b265-fd4496b083b9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:22.687751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1421d49c-e76e-445c-82bc-2ee79044a5b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'create', calling method: .version_select at 0x7fabea130f70>, body: {"keypair": {"name": "tempest-keypair-1055412481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuEWL4DPo+P8sxq+fhDpWV+ZkVosoBXQ9oFD3virOsN/jlzab1+9E7jeBJCFO5n42haRUPEae7mTwC4MUw/6hU8JA70DYdWk1549Bx8YnkacHWpg8PONWWofrYGu+CpMQ=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:22.747165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1421d49c-e76e-445c-82bc-2ee79044a5b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for project 756410b2ad7345779f62a9db9835456f. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:22.762689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1421d49c-e76e-445c-82bc-2ee79044a5b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for user 419f3872408c4d8c9a2980d6397d0aea and project 756410b2ad7345779f62a9db9835456f. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:22.831355 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1421d49c-e76e-445c-82bc-2ee79044a5b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.361624 Jul 02 21:10:22.832112 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1250/2461] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:10:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:22.838850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-42ff5bd2-469c-45fc-9a3e-3391d57be01e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] Calling method '.version_select at 0x7fabea130040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:22.881256 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-42ff5bd2-469c-45fc-9a3e-3391d57be01e tempest-ServersTestFqdnHostnames-1342929457 tempest-ServersTestFqdnHostnames-1342929457-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128598921" status: 202 len: 0 microversion: 2.1 time: 0.047516 Jul 02 21:10:22.888186 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1251/2462] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:10:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128598921 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:10:22.951881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:22.960213 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62021378-d1ac-44d5-98c5-ad7bd1dc1c3d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 0.918546 Jul 02 21:10:22.975828 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1212/2463] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:22 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:22.985956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:22.986968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:22.998093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:22.998931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:22.999945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:23.000584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:23.050871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:23.052014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:23.065364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:23.066874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:23.067799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:23.074873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:24.037533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:24.054182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:24.057865 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf449f44-e7f9-4d82-b101-ee6001b48ea8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 1.010843 Jul 02 21:10:24.058776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1213/2464] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:23 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:24.063582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:24.064210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:24.069847 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-779ecb3e-4b8a-4126-8a59-095cb7dc42ea tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 1.087963 Jul 02 21:10:24.070669 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1252/2465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:22 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:24.081703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:24.081924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:24.082661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:24.083093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:24.095605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b78ea6d6-2d6c-428b-aa5c-b10d6f7dd22a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1183285024", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b78ea6d6-2d6c-428b-aa5c-b10d6f7dd22a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action HTTP/1.1 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 619 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1183285024", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1183285024', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:10:24.102383 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:10:24.104829 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:24.109779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b78ea6d6-2d6c-428b-aa5c-b10d6f7dd22a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:24.110985 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b78ea6d6-2d6c-428b-aa5c-b10d6f7dd22a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action" status: 400 len: 938 microversion: 2.1 time: 0.024866 Jul 02 21:10:24.114195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1253/2466] 10.222.0.43 () {60 vars in 1278 bytes} [Sat Jul 2 21:10:24 2022] POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action => generated 938 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:10:24.125605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:24.126591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:24.134401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:24.135198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:24.136253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:24.136934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:25.177847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:25.180950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:25.189793 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0cc0d9b9-6d71-4aa3-b3c5-826afb90a4ae tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 1.067382 Jul 02 21:10:25.190394 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1254/2467] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:24 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:25.196099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dcbeaab-78bc-47b3-98af-0a3a6d5450d0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 1.130147 Jul 02 21:10:25.197174 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1214/2468] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:24 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:25.211091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:25.211661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:25.211991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:25.212696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:25.221818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:25.222530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:25.224371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:25.225307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:25.228701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:25.229478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:25.230277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:25.232728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:26.250647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:26.260743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:26.277828 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce254171-20fe-4108-9e57-54a6b731fc18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 1.084944 Jul 02 21:10:26.278488 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1255/2469] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:25 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:26.283807 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24605cd8-0ae3-4edd-98d7-51e8f2405174 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 1.080308 Jul 02 21:10:26.289966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1215/2470] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:25 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:26.292852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:26.293669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:26.310661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-175a1138-2021-46c5-9185-e28d43c58b6e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-175a1138-2021-46c5-9185-e28d43c58b6e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action HTTP/1.1 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 285 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.313270 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-175a1138-2021-46c5-9185-e28d43c58b6e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-175a1138-2021-46c5-9185-e28d43c58b6e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action" status: 400 len: 619 microversion: 2.1 time: 0.008296 Jul 02 21:10:26.317537 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1216/2471] 10.222.0.43 () {60 vars in 1278 bytes} [Sat Jul 2 21:10:26 2022] POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:10:26.325684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:26.326416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:26.327618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:26.328274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:26.329250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:26.329895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:26.352105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:26.354418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:26.355622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:26.356302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:26.683000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:26.701971 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-97d21de8-4a60-43aa-8312-a1f82b061de4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.422477 Jul 02 21:10:26.702866 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1256/2472] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:26 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:26.824441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:26.832940 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-309f4911-8cf3-490b-b270-1017b329c76b tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 0.511634 Jul 02 21:10:26.839012 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1217/2473] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:26 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:26.850251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:26.851146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:26.858533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:26.858979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:26.859741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:26.866069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.156955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-125eec9b-e5fd-4f71-912a-4665972ebf55 req-4c701637-b053-427d-833a-d052aee4f48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f04307a-39d1-4497-acb0-17ba192336bc", "name": "network-vif-plugged", "status": "completed", "tag": "77b42318-cb32-44f7-833d-f1bb938eae91"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:27.166455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-125eec9b-e5fd-4f71-912a-4665972ebf55 req-4c701637-b053-427d-833a-d052aee4f48a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.167044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-125eec9b-e5fd-4f71-912a-4665972ebf55 req-4c701637-b053-427d-833a-d052aee4f48a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.187722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-125eec9b-e5fd-4f71-912a-4665972ebf55 req-4c701637-b053-427d-833a-d052aee4f48a service nova] Creating event network-vif-plugged:77b42318-cb32-44f7-833d-f1bb938eae91 for instance 6f04307a-39d1-4497-acb0-17ba192336bc on nch1-master-1 Jul 02 21:10:27.197627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-125eec9b-e5fd-4f71-912a-4665972ebf55 req-4c701637-b053-427d-833a-d052aee4f48a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044269 Jul 02 21:10:27.198728 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1218/2474] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:10:27.298113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:27.300318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:27.318666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.319582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.321032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.322913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.628277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:27.641886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3cb794c1-da8b-4fca-8a04-08ee2fd1a467 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 0.795391 Jul 02 21:10:27.643608 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1257/2475] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:26 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:27.661096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1494394872"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:27.662471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:27.677098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.677865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.680030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.680994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.846506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:27.859098 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39e52699-80d6-4992-9280-8ca880593566 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1318 microversion: 2.1 time: 0.566675 Jul 02 21:10:27.871231 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1219/2476] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:27 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:27.895890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:27.896089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:27.908785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.909470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:27.910409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:27.910995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:28.158288 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8a7f3e7c-484b-4b10-89cc-ba61ba861def tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action" status: 202 len: 0 microversion: 2.1 time: 0.502009 Jul 02 21:10:28.159789 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1258/2477] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:10:27 2022] POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 02 21:10:28.173529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1534638399"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:28.174929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:28.182303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:28.183057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:28.184006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:28.184631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:28.228877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:28.231881 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Cannot 'createImage' instance 06bd67d8-1a44-442b-9b0d-7a473629e99c while it is in task_state image_snapshot_pending Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action HTTP/1.1 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 85 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1534638399"}} Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'createImage' instance 06bd67d8-1a44-442b-9b0d-7a473629e99c while it is in task_state image_snapshot_pending Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1534638399'}}} Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:10:28.233912 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 06bd67d8-1a44-442b-9b0d-7a473629e99c while it is in task_state image_snapshot_pending Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 06bd67d8-1a44-442b-9b0d-7a473629e99c while it is in task_state image_snapshot_pending Jul 02 21:10:28.237831 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:28.248219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 409 to user: Cannot 'createImage' instance 06bd67d8-1a44-442b-9b0d-7a473629e99c while it is in task_state image_snapshot_pending {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:28.249117 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f041b17-1696-4d64-83fe-c7dc0b7ddcf4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action" status: 409 len: 167 microversion: 2.1 time: 0.080022 Jul 02 21:10:28.249916 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1259/2478] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:10:28 2022] POST /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c/action => generated 167 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:10:28.258407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd8889f8-7ece-4f65-9237-274c99c2da20 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '.version_select at 0x7fabd7832940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:28.464111 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd8889f8-7ece-4f65-9237-274c99c2da20 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/images/c76236a3-6f5f-4e54-9d34-88ccb872012b" status: 204 len: 0 microversion: 2.1 time: 0.209689 Jul 02 21:10:28.468304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1260/2479] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:28 2022] DELETE /compute/v2.1/images/c76236a3-6f5f-4e54-9d34-88ccb872012b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:10:28.473513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:28.474372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:28.481960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:28.482661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:28.483714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:28.484372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:29.001228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:29.016295 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e1e3996-be3c-4f3d-897e-776193825fdf tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 1.141825 Jul 02 21:10:29.017059 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1220/2480] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:27 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:29.032419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:29.040836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:29.072003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:29.084380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:29.085784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:29.086371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:29.462104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:29.469901 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-50a30a45-1354-45cf-bd89-b137958335e9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1529 microversion: 2.1 time: 1.000196 Jul 02 21:10:29.470583 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1261/2481] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:28 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1529 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:29.672696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:29.684781 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34119e0e-a153-476b-b59d-47271aec72b5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1468 microversion: 2.1 time: 0.656299 Jul 02 21:10:29.705549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:29.706166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:29.709347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1221/2482] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:29 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1468 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:29.715243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:29.715627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:29.721168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:29.721741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:29.988572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-993749310", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f9f01f3-6960-405f-bcaa-01885e028463"}], "security_groups": [{"name": "tempest-securitygroup--1189823057"}], "key_name": "tempest-keypair-1055412481", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:30.310110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:30.318447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] validate_networks() for [('8f9f01f3-6960-405f-bcaa-01885e028463', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:10:30.329204 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b1636888-0c8b-4ec3-a4f0-fd8ba72747bf tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1317 microversion: 2.1 time: 0.627391 Jul 02 21:10:30.341334 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1262/2483] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:29 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:30.351418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:30.352777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:30.372965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:30.373513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:30.376256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:30.377797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:30.901274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:30.922492 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4768ffaa-3ecf-4ee6-ba87-9b13fa92ae94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.581926 Jul 02 21:10:30.925099 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1263/2484] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:30 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:30.939381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:30.940487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:30.954055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:30.954825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:30.958109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:30.959015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:31.862431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:31.876664 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-846a1a55-7201-41a8-951c-883be735bbb7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1535 microversion: 2.1 time: 0.948693 Jul 02 21:10:31.878790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1264/2485] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:30 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1535 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:31.901934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-af6a81aa-9ba3-40b5-94f1-dc8930ffd997 req-f390f0f6-1aed-4336-96c2-4b559d599b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "name": "network-vif-plugged", "status": "completed", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:31.926032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-af6a81aa-9ba3-40b5-94f1-dc8930ffd997 req-f390f0f6-1aed-4336-96c2-4b559d599b93 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:31.927073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-af6a81aa-9ba3-40b5-94f1-dc8930ffd997 req-f390f0f6-1aed-4336-96c2-4b559d599b93 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:31.967705 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-af6a81aa-9ba3-40b5-94f1-dc8930ffd997 req-f390f0f6-1aed-4336-96c2-4b559d599b93 service nova] Creating event network-vif-plugged:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:10:31.980990 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-af6a81aa-9ba3-40b5-94f1-dc8930ffd997 req-f390f0f6-1aed-4336-96c2-4b559d599b93 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099270 Jul 02 21:10:31.981778 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1265/2486] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:31.988508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:31.989468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:31.998329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:31.999032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:32.000576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:32.001106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:32.388773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:10:32.389777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:10:32.390411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:10:32.390987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:10:32.391567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:10:32.406186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:32.406640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:32.414980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:32.415439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:32.443133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:32.450850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for user 419f3872408c4d8c9a2980d6397d0aea and project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:32.456582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:32.473806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:10:32.477049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:10:32.548216 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ac7349f-6f0d-47e8-9101-2a1ef127be06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.570810 Jul 02 21:10:32.549151 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1222/2487] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:10:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 2573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:10:32.563226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:32.564255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:32.573003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:32.573756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:32.574907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:32.576866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:32.633682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:32.642682 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d237083a-2bf8-4b90-b0ec-5f8999a1c8d1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1317 microversion: 2.1 time: 0.659474 Jul 02 21:10:32.646499 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1266/2488] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:31 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:32.668642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00dcab71-6615-403f-8da7-fed2c95ca86d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:32.669484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-00dcab71-6615-403f-8da7-fed2c95ca86d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:32.777080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:32.966673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-00dcab71-6615-403f-8da7-fed2c95ca86d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:32.976997 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-00dcab71-6615-403f-8da7-fed2c95ca86d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1238 microversion: 2.1 time: 0.315703 Jul 02 21:10:32.979260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1267/2489] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:32 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1238 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:32.989005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:33.009443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:33.039354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.039826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.045023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.045759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.342235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:33.353849 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fd14e3d-d43b-46e0-8a9b-6310afd46442 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.797396 Jul 02 21:10:33.354463 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1223/2490] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:32 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:33.496978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:33.505751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ea52220b-7c69-4df3-bf0b-1f19962577f8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1517 microversion: 2.1 time: 0.525108 Jul 02 21:10:33.527525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:33.528611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:33.533058 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1268/2491] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:32 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1517 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:33.547866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.548352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.549149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.549589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.668614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:33.669244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:33.682094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.682693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.684152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.684608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.686820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:10:33.925163 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0aea691-a8d0-4a36-88b5-3ee1a1086767 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 204 len: 0 microversion: 2.1 time: 0.399672 Jul 02 21:10:33.926869 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1224/2492] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:10:33 2022] DELETE /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:10:33.942924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:33.943887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:33.952155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.952884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:33.954069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:33.955046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:34.285764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:34.311584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0825d954-d5b5-4057-9c69-08f4a8cb3ecb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1317 microversion: 2.1 time: 0.645094 Jul 02 21:10:34.318834 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1269/2493] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:33 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1317 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:34.333258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:34.335314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:34.348724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:34.349765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:34.351158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:34.352445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:34.903966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:34.916794 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09b5a6ca-517d-4c6a-a829-4ae383bc8a45 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1523 microversion: 2.1 time: 0.982426 Jul 02 21:10:34.918665 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1225/2494] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:33 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1523 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:34.925500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-93e831e9-6c8e-480f-a2ff-ab8bc90e76b6 req-6329e020-f1ae-4b7d-8dd8-fec2a21d0230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bd67d8-1a44-442b-9b0d-7a473629e99c", "name": "network-vif-plugged", "status": "completed", "tag": "11875d38-05a7-4e53-a1d2-f496d1378110"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:34.936455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-93e831e9-6c8e-480f-a2ff-ab8bc90e76b6 req-6329e020-f1ae-4b7d-8dd8-fec2a21d0230 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:34.937305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-93e831e9-6c8e-480f-a2ff-ab8bc90e76b6 req-6329e020-f1ae-4b7d-8dd8-fec2a21d0230 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:34.979732 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-93e831e9-6c8e-480f-a2ff-ab8bc90e76b6 req-6329e020-f1ae-4b7d-8dd8-fec2a21d0230 service nova] Creating event network-vif-plugged:11875d38-05a7-4e53-a1d2-f496d1378110 for instance 06bd67d8-1a44-442b-9b0d-7a473629e99c on nch2-master-1 Jul 02 21:10:34.988255 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-93e831e9-6c8e-480f-a2ff-ab8bc90e76b6 req-6329e020-f1ae-4b7d-8dd8-fec2a21d0230 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067944 Jul 02 21:10:34.989185 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1226/2495] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:34.997415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:35.002712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:35.003448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:35.015726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.016651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:35.017681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.018310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:35.021908 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20cfc4a9-d09e-4d9e-8980-e7dc713bdc8b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1290 microversion: 2.1 time: 0.700730 Jul 02 21:10:35.028726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1270/2496] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:34 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1290 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:35.329571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:35.330218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:35.341211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.341711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:35.342731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.343319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:35.407258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:35.416874 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b96c072-ed88-4f15-bf32-9776dbb8963c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.426356 Jul 02 21:10:35.429268 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1227/2497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:34 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:35.494012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4c75f6b0-d853-4761-9be2-3cf8b8e73f72 req-ddb43b98-5c88-434e-8fa7-9c628df1aaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "name": "network-vif-unplugged", "status": "completed", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:35.505063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4c75f6b0-d853-4761-9be2-3cf8b8e73f72 req-ddb43b98-5c88-434e-8fa7-9c628df1aaaa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.505467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4c75f6b0-d853-4761-9be2-3cf8b8e73f72 req-ddb43b98-5c88-434e-8fa7-9c628df1aaaa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:35.521308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4c75f6b0-d853-4761-9be2-3cf8b8e73f72 req-ddb43b98-5c88-434e-8fa7-9c628df1aaaa service nova] Creating event network-vif-unplugged:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch2-master-1 Jul 02 21:10:35.526945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4c75f6b0-d853-4761-9be2-3cf8b8e73f72 req-ddb43b98-5c88-434e-8fa7-9c628df1aaaa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038017 Jul 02 21:10:35.527871 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1228/2498] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:10:35.936731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:35.938254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:35.956235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.956979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:35.959328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:35.961022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:36.665238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:36.673241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b66f453c-c6e1-4ddd-abf8-c390509c0df3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1467 microversion: 2.1 time: 1.347838 Jul 02 21:10:36.673830 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1271/2499] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:35 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1467 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:36.699649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:36.702433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:36.714775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:36.723341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:36.725214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:36.729499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:36.912224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:36.924464 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b358a1e0-c462-467e-a742-f220bcb59d1f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1296 microversion: 2.1 time: 0.234510 Jul 02 21:10:36.925192 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1272/2500] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:36 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:36.932400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:36.933415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:36.940964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:36.941497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:36.942426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:36.942981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:37.029843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:37.036989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:37.040157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35c31842-48ad-4fe5-bb10-6fd9e965ea5c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1523 microversion: 2.1 time: 1.109611 Jul 02 21:10:37.040740 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1229/2501] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:35 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1523 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:37.050158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-271743618"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:37.051215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:37.058887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:37.059336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:37.060183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:37.060614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:37.515613 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-420c87e5-d8ff-4c78-8a34-26b24a7fe7d8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "POST /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818/action" status: 202 len: 0 microversion: 2.1 time: 0.469349 Jul 02 21:10:37.522484 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1230/2502] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:10:37 2022] POST /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818/action => generated 0 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:10:37.528950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-21133e9b-1790-455d-ba81-98c1c38f3926 req-e44c8861-1e72-4bde-ac92-bf1d7091b794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bd67d8-1a44-442b-9b0d-7a473629e99c", "name": "network-vif-unplugged", "status": "completed", "tag": "11875d38-05a7-4e53-a1d2-f496d1378110"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:37.553739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:37.557280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21133e9b-1790-455d-ba81-98c1c38f3926 req-e44c8861-1e72-4bde-ac92-bf1d7091b794 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:37.558798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21133e9b-1790-455d-ba81-98c1c38f3926 req-e44c8861-1e72-4bde-ac92-bf1d7091b794 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:37.567973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8af8a62-1b54-44c6-b3e4-ea6f4f693cda tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.640845 Jul 02 21:10:37.570661 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1273/2503] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:36 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:37.585497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0621fce0-f94b-4bb9-9e29-11e2c2f049d7 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd77a6e50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:37.616098 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-21133e9b-1790-455d-ba81-98c1c38f3926 req-e44c8861-1e72-4bde-ac92-bf1d7091b794 service nova] Creating event network-vif-unplugged:11875d38-05a7-4e53-a1d2-f496d1378110 for instance 06bd67d8-1a44-442b-9b0d-7a473629e99c on nch2-master-1 Jul 02 21:10:37.636387 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-21133e9b-1790-455d-ba81-98c1c38f3926 req-e44c8861-1e72-4bde-ac92-bf1d7091b794 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112363 Jul 02 21:10:37.637166 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1231/2504] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:37.682193 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0621fce0-f94b-4bb9-9e29-11e2c2f049d7 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.110211 Jul 02 21:10:37.683794 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1274/2505] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:37 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:37.851529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:37.870479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:37.870912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:37.891071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] Creating event network-changed:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch2-master-1 Jul 02 21:10:37.916147 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069489 Jul 02 21:10:37.917348 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1232/2506] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:37.944401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:37.945359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:37.953962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:37.956389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:37.968972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:37.973381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:38.012512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:38.013671 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fb902315-f343-434d-a6d5-2ff053aa728a req-818f9170-9078-457e-9559-e3645e9c53bc service nova] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001758 Jul 02 21:10:38.015644 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1233/2507] 10.222.0.43 () {56 vars in 885 bytes} [Sat Jul 2 21:10:38 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 02 21:10:38.057576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:38.059416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:38.068210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:38.078528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:38.081679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:38.082355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:38.205354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:38.216975 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-edd81fa9-ffe9-4bf4-964f-02f66c699956 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1296 microversion: 2.1 time: 0.277057 Jul 02 21:10:38.220025 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1275/2508] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:37 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1296 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:38.428784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:38.441719 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f73fb577-24e3-4f21-abd5-00863123fd65 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1523 microversion: 2.1 time: 0.388848 Jul 02 21:10:38.454540 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1234/2509] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:38 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1523 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:38.587129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:38.587811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:38.609066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:38.609525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:38.610300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:38.610942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:38.695433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58406a1c-e52a-45b6-9082-bfab30a60db3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0fd040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:38.759305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58406a1c-e52a-45b6-9082-bfab30a60db3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.067539 Jul 02 21:10:38.759894 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1235/2510] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:38 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:39.201406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:39.210702 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c15a6fc1-70d6-40bd-8bfa-90665059a9a4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.628412 Jul 02 21:10:39.221520 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1276/2511] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:38 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:39.238251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:39.244565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:39.265216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:39.266056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:39.267084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:39.267721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:39.365732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3899a7de-f79c-4ed3-ab82-1ee5d10bc903 req-5449e4dc-f509-40d8-b7a3-4c07a4f9cf08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06bd67d8-1a44-442b-9b0d-7a473629e99c", "name": "network-vif-deleted", "tag": "11875d38-05a7-4e53-a1d2-f496d1378110"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:39.372851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:39.389594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3899a7de-f79c-4ed3-ab82-1ee5d10bc903 req-5449e4dc-f509-40d8-b7a3-4c07a4f9cf08 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:39.390612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3899a7de-f79c-4ed3-ab82-1ee5d10bc903 req-5449e4dc-f509-40d8-b7a3-4c07a4f9cf08 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:39.428777 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3899a7de-f79c-4ed3-ab82-1ee5d10bc903 req-5449e4dc-f509-40d8-b7a3-4c07a4f9cf08 service nova] Creating event network-vif-deleted:11875d38-05a7-4e53-a1d2-f496d1378110 for instance 06bd67d8-1a44-442b-9b0d-7a473629e99c on nch2-master-1 Jul 02 21:10:39.439160 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3899a7de-f79c-4ed3-ab82-1ee5d10bc903 req-5449e4dc-f509-40d8-b7a3-4c07a4f9cf08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077730 Jul 02 21:10:39.444206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1277/2512] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:39.461936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:39.463037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:39.501186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:39.504763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:39.508370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:39.508966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:39.665131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:39.665591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:39.666061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lazy-loading 'fault' on Instance uuid 06bd67d8-1a44-442b-9b0d-7a473629e99c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:10:39.923534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:39.939759 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30a54a5e-6a55-4992-b49e-6d0cc43ba522 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 0.702906 Jul 02 21:10:39.942055 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1236/2513] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:39 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:39.951123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60251161-1ec9-4082-a990-857470a5c788 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0fd940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:39.966498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:39.985360 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-57423b38-4cd0-43dc-9d64-248a6a90038f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 200 len: 1310 microversion: 2.1 time: 0.530007 Jul 02 21:10:39.995745 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1278/2514] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:39 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 1310 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:40.056086 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60251161-1ec9-4082-a990-857470a5c788 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.112513 Jul 02 21:10:40.056751 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1237/2515] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:39 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:40.239162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:40.241354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:40.252580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:40.253452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:40.255208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:40.257711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:40.964735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:40.965397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:40.993736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:40.994187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:40.994981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:40.995411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:41.545793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:41.574822 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-758c4d75-2637-41e8-bab9-160d9c985b03 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 1.341075 Jul 02 21:10:41.591632 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1279/2516] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:40 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:41.591632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:41.595584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:41.615004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:41.615548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:41.616873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:41.617008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:41.632895 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c HTTP/1.1 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c'} Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:41.635573 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:10:41.640221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:10:41.641774 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bbfb33ba-104e-4683-8e74-fe78ecb10e8a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 404 len: 111 microversion: 2.1 time: 0.055278 Jul 02 21:10:41.649730 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1280/2517] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:41 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:10:41.655845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76e17917-f889-4872-8ed7-ed788d76f37c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd772a3a0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:41.746588 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76e17917-f889-4872-8ed7-ed788d76f37c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.095360 Jul 02 21:10:41.747643 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1281/2518] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:41 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:41.757051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e66cbf72-159c-4d7e-b24c-7bccee36deed tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'create', calling method: .version_select at 0x7fabd771f790>, body: {"keypair": {"name": "tempest-keypair-1231841445", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLll/Ct3XEnRgAw/g6MA3w/t41IztodO6oDVzEEAqSKHpAhZmZ8DCECTKu5foj6sCPr3gznZbf8a0Stx+4Fetd+OdrIQ5Lb7/TrqffB06Iy0pRq3V21Fm3D/oQ+5+dmiqQ=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:41.775296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e66cbf72-159c-4d7e-b24c-7bccee36deed tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for project dffcfd79372c47e89be4acbdc042d510. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:41.782571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e66cbf72-159c-4d7e-b24c-7bccee36deed tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for user b3b24a3216aa4eba8a9a90c109c3b491 and project dffcfd79372c47e89be4acbdc042d510. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:41.828336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e66cbf72-159c-4d7e-b24c-7bccee36deed tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079200 Jul 02 21:10:41.829626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1282/2519] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:10:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:42.083183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:42.109422 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d639f43b-a805-4861-8b7d-b225b64fb4ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 1.153910 Jul 02 21:10:42.111171 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1238/2520] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:40 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:42.600573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:42.601781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:42.614720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:42.615561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:42.619281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:42.622473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:42.628859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:42.763369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a54bbcb-1bc3-47c5-8bac-a85e587efcd1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0b6700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:42.778794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:42.781937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:42.882708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a54bbcb-1bc3-47c5-8bac-a85e587efcd1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.126313 Jul 02 21:10:42.885426 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1239/2521] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:42 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:42.893708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-90494777-0e2f-4256-8125-1e12ae99ba93 req-b4f4c895-3491-4b60-a207-0ad976e5c52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:42.912467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-90494777-0e2f-4256-8125-1e12ae99ba93 req-b4f4c895-3491-4b60-a207-0ad976e5c52b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:42.913272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-90494777-0e2f-4256-8125-1e12ae99ba93 req-b4f4c895-3491-4b60-a207-0ad976e5c52b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:42.943231 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-90494777-0e2f-4256-8125-1e12ae99ba93 req-b4f4c895-3491-4b60-a207-0ad976e5c52b service nova] Creating event network-changed:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:10:42.952196 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-90494777-0e2f-4256-8125-1e12ae99ba93 req-b4f4c895-3491-4b60-a207-0ad976e5c52b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065432 Jul 02 21:10:42.953775 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1240/2522] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:43.128461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:43.129302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:43.139455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:43.140145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:43.141055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:43.141590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:43.725181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:43.736607 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-00011914-5d48-44ee-9f01-93591ceba581 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 1.141113 Jul 02 21:10:43.747534 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1283/2523] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:42 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:43.753556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ffe5bb9b-576a-4f52-8119-3a4985131348 req-0835b9c2-66ca-4d63-94ba-099b7a1100ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "name": "network-vif-plugged", "status": "completed", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:43.762514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ffe5bb9b-576a-4f52-8119-3a4985131348 req-0835b9c2-66ca-4d63-94ba-099b7a1100ad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:43.763191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ffe5bb9b-576a-4f52-8119-3a4985131348 req-0835b9c2-66ca-4d63-94ba-099b7a1100ad service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:43.785390 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ffe5bb9b-576a-4f52-8119-3a4985131348 req-0835b9c2-66ca-4d63-94ba-099b7a1100ad service nova] Creating event network-vif-plugged:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:10:43.790592 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ffe5bb9b-576a-4f52-8119-3a4985131348 req-0835b9c2-66ca-4d63-94ba-099b7a1100ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041072 Jul 02 21:10:43.791551 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1284/2524] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:43.816802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:43.825982 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17133c3c-1f12-43c4-8152-1d2ed40b2ae4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 0.702626 Jul 02 21:10:43.827220 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1241/2525] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:43 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:43.898257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ddc88d7e-e3f0-41a0-acaa-fe3049c19ae6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd78490d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:43.982933 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ddc88d7e-e3f0-41a0-acaa-fe3049c19ae6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.088458 Jul 02 21:10:43.984536 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1285/2526] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:43 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:44.754441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:44.755102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:44.777716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:44.778581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:44.779925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:44.780757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:44.845336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:44.846866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:44.857751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:44.858586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:44.859835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:44.860588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:45.389286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:45.413276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:45.425738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c9d66005-3248-4d9a-89a0-1c9c186252a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 0.585362 Jul 02 21:10:45.425958 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a66366c2-7a81-4241-bc40-2990fdc94eb3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.675381 Jul 02 21:10:45.427511 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1286/2527] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:44 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:45.434612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3079f6fb-7575-4b03-81af-9ae4fc95073a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7849940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:45.440869 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1242/2528] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:44 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:45.537526 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3079f6fb-7575-4b03-81af-9ae4fc95073a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.107386 Jul 02 21:10:45.538822 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1287/2529] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:45 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:46.444759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:46.445335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:46.452516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:46.457565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:46.459704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:46.460420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:46.464920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:46.465592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:46.475288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:46.478135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:46.479997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:46.482485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:47.157896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:47.179013 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-562421c0-703e-492a-99a6-c7e7dc0a914e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.738082 Jul 02 21:10:47.188178 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1288/2530] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:46 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:47.197762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b55da0b9-a235-436c-84ab-8c519248f8fa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd76ca280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:47.233747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:47.254569 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a2307cb-7c35-4b4d-ab41-894b96b6ffb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 0.803885 Jul 02 21:10:47.258404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1243/2531] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:46 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:47.309551 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b55da0b9-a235-436c-84ab-8c519248f8fa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.119713 Jul 02 21:10:47.310312 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1289/2532] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:47 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:47.726640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1819115559", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:47.889999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] validate_networks() for [('f32f817d-1623-4050-b8c2-1a51b0a242c7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:10:48.199928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:48.200641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:48.213543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:48.216336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:48.217378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:48.228800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:50.889292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:50.897852 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6d3dbe65-10ee-49e0-adec-e44cce6fe711 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 2.702703 Jul 02 21:10:50.908443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1290/2533] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:48 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 2714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:50.913944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:50.914824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:50.931970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:50.932837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:50.933873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:50.934526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:51.793271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:10:51.929868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:51.943668 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b312cde5-ba96-4184-8d9c-ce5522d602a5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 1.033756 Jul 02 21:10:51.948352 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1291/2534] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:50 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:51.962690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76c4e633-805d-4563-9551-912134949614 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd76ea430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:52.087069 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76c4e633-805d-4563-9551-912134949614 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.137078 Jul 02 21:10:52.088182 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1292/2535] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:51 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:52.100964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-796c20e0-7f77-4c1a-8c21-a0c62925ceb2 req-c8aa9e86-8432-4329-98b0-0ef75e2a6748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "name": "network-vif-unplugged", "status": "completed", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:52.111407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-796c20e0-7f77-4c1a-8c21-a0c62925ceb2 req-c8aa9e86-8432-4329-98b0-0ef75e2a6748 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:52.112167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-796c20e0-7f77-4c1a-8c21-a0c62925ceb2 req-c8aa9e86-8432-4329-98b0-0ef75e2a6748 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:52.127196 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-796c20e0-7f77-4c1a-8c21-a0c62925ceb2 req-c8aa9e86-8432-4329-98b0-0ef75e2a6748 service nova] Creating event network-vif-unplugged:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch2-master-1 Jul 02 21:10:52.134214 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-796c20e0-7f77-4c1a-8c21-a0c62925ceb2 req-c8aa9e86-8432-4329-98b0-0ef75e2a6748 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037277 Jul 02 21:10:52.135512 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1293/2536] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:52.144380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6e128406-bb9f-4157-a8cc-b7195e89bc50 req-691e8933-a6be-4957-a0a5-4fc4c51a80a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-plugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:52.154873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e128406-bb9f-4157-a8cc-b7195e89bc50 req-691e8933-a6be-4957-a0a5-4fc4c51a80a4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:52.155529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e128406-bb9f-4157-a8cc-b7195e89bc50 req-691e8933-a6be-4957-a0a5-4fc4c51a80a4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:52.171866 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6e128406-bb9f-4157-a8cc-b7195e89bc50 req-691e8933-a6be-4957-a0a5-4fc4c51a80a4 service nova] Creating event network-vif-plugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:10:52.179168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6e128406-bb9f-4157-a8cc-b7195e89bc50 req-691e8933-a6be-4957-a0a5-4fc4c51a80a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041383 Jul 02 21:10:52.186960 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1294/2537] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:52.200993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:52.219807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:52.265440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:52.266353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:52.267782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:52.268663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:52.632852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:10:52.633493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:10:52.634007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:10:52.634650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:10:52.635078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:10:52.668603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:52.671418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:52.672744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:52.673193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:52.756571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for project dffcfd79372c47e89be4acbdc042d510. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:52.773347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for user b3b24a3216aa4eba8a9a90c109c3b491 and project dffcfd79372c47e89be4acbdc042d510. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:52.828345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:10:52.833093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:10:52.951460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:52.962763 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb97c340-d197-457d-a2af-510c184146e8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.771429 Jul 02 21:10:52.966077 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1295/2538] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:52 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:52.971650 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6883c1af-afcd-4660-9045-5dc4d150fb89 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.250231 Jul 02 21:10:52.974302 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1244/2539] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:10:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 5253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:10:52.975363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:52.978041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:52.988715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17073784-8fe2-40b3-8a6f-039f24719a47 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:52.989359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17073784-8fe2-40b3-8a6f-039f24719a47 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:53.012452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:53.018016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:53.019951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:53.020604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:53.771294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17073784-8fe2-40b3-8a6f-039f24719a47 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:53.784488 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17073784-8fe2-40b3-8a6f-039f24719a47 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1225 microversion: 2.1 time: 0.803313 Jul 02 21:10:53.787009 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1245/2540] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:52 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1225 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:53.805581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46136d9b-d5f1-44ec-8816-0ef3d5ae9d80 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79c05e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:53.922037 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46136d9b-d5f1-44ec-8816-0ef3d5ae9d80 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.132324 Jul 02 21:10:53.922690 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1246/2541] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:53 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:53.981840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:53.982430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:54.002706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:54.005861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:54.008403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:54.011522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:54.340636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:54.365766 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7519bffb-e56f-49b6-a97d-66729e01e51e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1364 microversion: 2.1 time: 1.396570 Jul 02 21:10:54.369812 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1296/2542] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:52 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1364 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:54.427101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:54.443626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10e661ec-f815-4dbd-b01c-8ff68f90caa4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1716 microversion: 2.1 time: 0.466190 Jul 02 21:10:54.459241 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1247/2543] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:53 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1716 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:54.805266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:54.806355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:54.813900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:54.815081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:54.816139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:54.819119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:54.935695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-563d3faf-341d-40ce-bbb4-73383cb8132b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd799a0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:54.953927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:54.967003 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14cc5962-c304-47d4-8729-b023adaaa592 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1277 microversion: 2.1 time: 0.167289 Jul 02 21:10:54.973443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1297/2544] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:54 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:55.034158 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-563d3faf-341d-40ce-bbb4-73383cb8132b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.102872 Jul 02 21:10:55.038054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1248/2545] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:54 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:10:56.015004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe55b4c3-5129-4e4a-9ba6-303d11a45176 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Action: 'create', calling method: .version_select at 0x7fabd79df8b0>, body: {"keypair": {"name": "tempest-keypair-1645693155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2IAAA9KkZnKomVv/K9VPioIyNgtl8E5X6FGzmE1nsovsxl5SR2lgqUYVFI7FmzAt9MN+C2A7bAeiwO4SSZGOP1Z8NW1hyAMVKCuP6LfVZkA/9jeYRSkn4uI3oY5EXQPQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:10:56.016656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f067c05-c9fc-4db7-8ddd-735e5f6d0db3 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Calling method '.version_select at 0x7fabd7832b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:56.058607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fe55b4c3-5129-4e4a-9ba6-303d11a45176 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Getting quotas for project 116d106003e54750a7e57d37e6a8798a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:10:56.102271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fe55b4c3-5129-4e4a-9ba6-303d11a45176 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Getting quotas for user 1412af7535c24b5fa139fd87431375ca and project 116d106003e54750a7e57d37e6a8798a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:10:56.168085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe55b4c3-5129-4e4a-9ba6-303d11a45176 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.067276 Jul 02 21:10:56.170705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1249/2546] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:10:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:56.178313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:56.179407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:56.188495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:56.189493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:56.190691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:56.191420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:56.227690 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f067c05-c9fc-4db7-8ddd-735e5f6d0db3 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa/defaults" status: 200 len: 371 microversion: 2.1 time: 1.138498 Jul 02 21:10:56.228644 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1298/2547] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:10:55 2022] GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa/defaults => generated 371 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:56.241000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:56.244237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:56.268033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:56.268851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:56.269834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:56.270270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:56.492245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:56.510308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef3dd376-5c59-4025-b715-b90c1bc6e34f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1552 microversion: 2.1 time: 0.337504 Jul 02 21:10:56.514742 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1250/2548] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:56 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1552 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:56.531266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:56.536030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:56.555314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:56.558198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:56.561027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:56.563743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:57.582914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:57.599001 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f9f3721-5281-481a-b0e8-ee7ae0714083 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1706 microversion: 2.1 time: 1.369097 Jul 02 21:10:57.606496 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1299/2549] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:56 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1706 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:57.620568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a1d6557-a233-4986-829b-da07650f7743 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd772a4c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:57.736368 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a1d6557-a233-4986-829b-da07650f7743 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.128136 Jul 02 21:10:57.736962 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1300/2550] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:57 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:57.749921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-25f5a75a-198e-4f0a-a9de-23155dfbe156 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Calling method '.version_select at 0x7fabd7693430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.261787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-25f5a75a-198e-4f0a-a9de-23155dfbe156 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa" status: 200 len: 371 microversion: 2.1 time: 0.514188 Jul 02 21:10:58.262480 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1301/2551] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:10:57 2022] GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa => generated 371 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:58.278251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.278251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:58.302020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:58.303036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:58.305458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:58.306196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:58.323049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:10:58.341600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06f2c60a-18c0-4a37-98e2-5fff9683f9ca tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 1.817549 Jul 02 21:10:58.342820 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1251/2552] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:56 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:58.355977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adeee239-019b-46f4-ad50-ed518befb4f9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '.version_select at 0x7fabd79dfb80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.358804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeee239-019b-46f4-ad50-ed518befb4f9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:58.359508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adeee239-019b-46f4-ad50-ed518befb4f9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:58.381789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adeee239-019b-46f4-ad50-ed518befb4f9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1170 microversion: 2.1 time: 0.037655 Jul 02 21:10:58.382982 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1252/2553] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/os-migrations => generated 1170 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:58.392362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fccccd6d-e7fe-4c7f-9561-a2a34f8dc15c tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Calling method '.version_select at 0x7fabea0d1ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.544139 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fccccd6d-e7fe-4c7f-9561-a2a34f8dc15c tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa/defaults" status: 200 len: 371 microversion: 2.1 time: 0.159424 Jul 02 21:10:58.545442 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1253/2554] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa/defaults => generated 371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:58.553389 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f7400d8-80d8-4c25-9307-80ded06c6507 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285348 Jul 02 21:10:58.554706 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1302/2555] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/os-interface => generated 285 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:58.558651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.559759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-98800752-1de8-4845-a00b-8d03d72e5b29 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Calling method '.version_select at 0x7fabd76caca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.562064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:58.584110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:58.584898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:58.586157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:58.586831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:58.743305 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-98800752-1de8-4845-a00b-8d03d72e5b29 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa" status: 200 len: 371 microversion: 2.1 time: 0.187123 Jul 02 21:10:58.748755 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1303/2556] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:58.756588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5243e7cc-68d9-4fc2-8f81-c372b48625cb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd772a820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:58.890552 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5243e7cc-68d9-4fc2-8f81-c372b48625cb tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.140340 Jul 02 21:10:58.900014 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1304/2557] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:10:58.908965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-921d9d7b-4ed2-45c7-8e44-13ffb2b84f89 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] Calling method '.version_select at 0x7fabd77b8430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:59.069061 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-921d9d7b-4ed2-45c7-8e44-13ffb2b84f89 tempest-QuotasTestJSON-2040091806 tempest-QuotasTestJSON-2040091806-project] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa?user_id=43088fda1a024ace873c4a7db0bb5e39" status: 200 len: 371 microversion: 2.1 time: 0.166591 Jul 02 21:10:59.071726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1305/2558] 10.222.0.43 () {58 vars in 1322 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/os-quota-sets/3f17bacb94754dc58235cc9c7e6e9ffa?user_id=43088fda1a024ace873c4a7db0bb5e39 => generated 371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:10:59.361593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:10:59.362430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:10:59.383139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:59.385925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:10:59.386941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:10:59.390517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:01.483151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a99bf49-1146-41b2-b057-2b3b971f8200 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1857 microversion: 2.1 time: 2.936184 Jul 02 21:11:01.504354 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1254/2559] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:58 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1857 bytes in 2958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:01.524317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0938fb7-da83-4314-81bb-abec07ed41c6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0b1ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:01.602376 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0938fb7-da83-4314-81bb-abec07ed41c6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.096438 Jul 02 21:11:01.603796 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1255/2560] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:01 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:01.616862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:01.617526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:01.633378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:01.636529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:01.637443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:01.637900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:02.652167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:02.668007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b5ed4456-43d5-47e5-be2e-93654ac78c12 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 3.312919 Jul 02 21:11:02.669375 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1306/2561] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:10:59 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 3315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:02.688424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32a1af73-2517-4cc9-9a2b-60b2531e35a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7686430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:02.707993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:02.817634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32a1af73-2517-4cc9-9a2b-60b2531e35a6 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.147022 Jul 02 21:11:02.821147 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1307/2562] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:02 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:03.103643 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fc09a3b-9018-4e02-8957-0a336dd2f6ab tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1857 microversion: 2.1 time: 1.493520 Jul 02 21:11:03.104421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1256/2563] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:01 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1857 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:03.233689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:03.234458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:03.245109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:03.248632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:03.249651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:03.251629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:03.416289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lazy-loading 'services' on Instance uuid 195db841-91bd-42a6-95aa-986da8c9fb00 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:11:03.578958 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d7fb0084-c57c-45ef-8401-f536b9969ba5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments/655b7662-f602-41a5-8354-63f38f63b21d" status: 202 len: 0 microversion: 2.1 time: 0.349314 Jul 02 21:11:03.579962 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1308/2564] 10.222.0.43 () {58 vars in 1415 bytes} [Sat Jul 2 21:11:03 2022] DELETE /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments/655b7662-f602-41a5-8354-63f38f63b21d => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:11:03.589601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:03.596194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:03.603585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:03.604357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:03.605464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:03.606053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:03.639301 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-56859719-ce4b-4a62-834b-3db09082153e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054525 Jul 02 21:11:03.640593 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1309/2565] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:11:03 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:11:03.687801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:03.689198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:03.702912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:03.703722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:03.705802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:03.708523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:03.875471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1837dd84-a244-4808-8288-85bab3ff1b6c tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Action: 'create', calling method: .version_select at 0x7fabea174d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1095572702"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:04.600919 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1837dd84-a244-4808-8288-85bab3ff1b6c tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 1.032629 Jul 02 21:11:04.603044 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1257/2566] 10.222.0.43 () {60 vars in 1154 bytes} [Sat Jul 2 21:11:03 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 1036 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 02 21:11:04.608221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d20ff11-3129-4d8a-9426-780147fac1c1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0d1550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:04.691910 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d20ff11-3129-4d8a-9426-780147fac1c1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.087607 Jul 02 21:11:04.693065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1258/2567] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:04 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:04.709189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86879841-ff19-412a-933d-acfb190f2964 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd7995430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:04.803406 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86879841-ff19-412a-933d-acfb190f2964 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072" status: 200 len: 338 microversion: 2.1 time: 0.108826 Jul 02 21:11:04.804136 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1259/2568] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:11:04 2022] GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 => generated 338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:04.809027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:04.810077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:04.812150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:04.830176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:04.832646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:04.835674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:04.836400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:04.918546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8aa8a01-0eef-4de8-b3e0-7684bf965049 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104763 Jul 02 21:11:04.942266 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1260/2569] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:11:04 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:05.200367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:05.212970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-da9ce2c9-737c-4770-bb86-b669ecb7d88d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 1.525576 Jul 02 21:11:05.213975 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1310/2570] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:03 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:11:05.705384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87db69cc-322a-4cf3-8987-87848b8dc5cd tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79df550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:05.790339 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87db69cc-322a-4cf3-8987-87848b8dc5cd tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.089083 Jul 02 21:11:05.790934 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1261/2571] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:05 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:05.817067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-033aae0f-a3e8-4de5-bff4-3a9ea74e75cc tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd7686430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:05.859236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9d5575e4-9afb-4cc3-92f3-574971688ec5 req-dce6cf44-4195-4ef8-8b71-f9d628366bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fa2b45-ce8c-4055-9576-bf03a6b2a1ad", "tag": "6d4724a8-a78b-4ebe-b6b7-80f71e61daba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:05.891055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d5575e4-9afb-4cc3-92f3-574971688ec5 req-dce6cf44-4195-4ef8-8b71-f9d628366bb5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:05.891708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d5575e4-9afb-4cc3-92f3-574971688ec5 req-dce6cf44-4195-4ef8-8b71-f9d628366bb5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:05.933533 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9d5575e4-9afb-4cc3-92f3-574971688ec5 req-dce6cf44-4195-4ef8-8b71-f9d628366bb5 service nova] Creating event network-changed:6d4724a8-a78b-4ebe-b6b7-80f71e61daba for instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad on nch2-master-1 Jul 02 21:11:05.937397 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-033aae0f-a3e8-4de5-bff4-3a9ea74e75cc tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072" status: 200 len: 339 microversion: 2.1 time: 0.124510 Jul 02 21:11:05.938114 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1311/2572] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:11:05 2022] GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 => generated 339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:05.947977 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9d5575e4-9afb-4cc3-92f3-574971688ec5 req-dce6cf44-4195-4ef8-8b71-f9d628366bb5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094108 Jul 02 21:11:05.949830 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1262/2573] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:11:05.949949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f28603a-3fbf-4f12-9c3b-df6c68c758dd tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Action: 'create', calling method: .version_select at 0x7fabd7849790>, body: {"snapshot": {"volume_id": "f5accb98-0f42-4400-afaf-07719d59b072", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-220569153"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:05.955857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:05.957515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:05.966789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:05.967717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:05.968728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:05.969327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:06.018678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:06.063605 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87645510-b8be-420c-bdc1-f21f4d8dcf9d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.110632 Jul 02 21:11:06.065783 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1263/2574] 10.222.0.43 () {58 vars in 1301 bytes} [Sat Jul 2 21:11:05 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:11:06.232715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:06.233548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:06.261426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:06.274179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:06.276387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:06.279501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:06.285503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:06.644141 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f28603a-3fbf-4f12-9c3b-df6c68c758dd tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.698364 Jul 02 21:11:06.644839 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1312/2575] 10.222.0.43 () {60 vars in 1161 bytes} [Sat Jul 2 21:11:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:11:06.656494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-97a40a6e-8842-44b4-92cf-c2a5ef66b3e3 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd77a6280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:06.724624 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-97a40a6e-8842-44b4-92cf-c2a5ef66b3e3 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 200 len: 286 microversion: 2.1 time: 0.073498 Jul 02 21:11:06.725990 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1313/2576] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:06 2022] GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:11:06.738117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca5ea5de-ddcc-4c7f-9ef9-b6b48d398506 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd76865e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:06.803629 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca5ea5de-ddcc-4c7f-9ef9-b6b48d398506 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.071607 Jul 02 21:11:06.804563 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1314/2577] 10.222.0.43 () {58 vars in 1139 bytes} [Sat Jul 2 21:11:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:06.810783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-570e5191-80bd-45bd-ad2e-837a5cf93edd tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd77b8820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:07.045420 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-570e5191-80bd-45bd-ad2e-837a5cf93edd tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.236864 Jul 02 21:11:07.047050 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1315/2578] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:06 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:07.053788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2ffd543-453d-455a-8f93-5dc05d6efcb2 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd7686ca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:07.130664 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c2ffd543-453d-455a-8f93-5dc05d6efcb2 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 200 len: 286 microversion: 2.1 time: 0.081871 Jul 02 21:11:07.132260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1316/2579] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:07 2022] GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:07.466260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-260633840", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1cbf12cc-156d-42c2-aa26-641e02fbbc50"}], "security_groups": [{"name": "tempest-securitygroup--1547531879"}], "key_name": "tempest-keypair-1645693155", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:07.969113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:07.979464 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82aae677-c7af-4d8e-9e15-3976237edd8e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 1.751854 Jul 02 21:11:08.004245 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1264/2580] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:06 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 1778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:08.059409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4eb81c9f-1bae-4400-94e4-dcf8f1fc1a4c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7f8c310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:08.166760 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4eb81c9f-1bae-4400-94e4-dcf8f1fc1a4c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.111281 Jul 02 21:11:08.167480 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1265/2581] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:08 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:11:08.188594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edce6c9a-0e5a-44de-a302-fe7f8497d89a tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabea0b13a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:08.433134 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edce6c9a-0e5a-44de-a302-fe7f8497d89a tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 200 len: 287 microversion: 2.1 time: 0.259431 Jul 02 21:11:08.439753 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1266/2582] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:08 2022] GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 287 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:08.448177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c61991d-515e-4ea4-b4a4-7213c4dccb2b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd79df820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:08.659373 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c61991d-515e-4ea4-b4a4-7213c4dccb2b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 202 len: 0 microversion: 2.1 time: 0.217450 Jul 02 21:11:08.667304 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1267/2583] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:11:08 2022] DELETE /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:11:08.679445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d522439b-8821-4c32-acea-c2492514d671 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd799d1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:08.767021 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d522439b-8821-4c32-acea-c2492514d671 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 200 len: 286 microversion: 2.1 time: 0.098061 Jul 02 21:11:08.767821 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1268/2584] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:08 2022] GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:08.889056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] validate_networks() for [('1cbf12cc-156d-42c2-aa26-641e02fbbc50', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:11:08.944665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-92afff88-abbc-43cf-9df8-45a7f2012110 req-c87faea8-d4f9-45f5-aec5-d58d4b8c3e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:08.961599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-92afff88-abbc-43cf-9df8-45a7f2012110 req-c87faea8-d4f9-45f5-aec5-d58d4b8c3e28 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:08.965604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-92afff88-abbc-43cf-9df8-45a7f2012110 req-c87faea8-d4f9-45f5-aec5-d58d4b8c3e28 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:09.002128 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-92afff88-abbc-43cf-9df8-45a7f2012110 req-c87faea8-d4f9-45f5-aec5-d58d4b8c3e28 service nova] Creating event network-changed:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:11:09.013991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-92afff88-abbc-43cf-9df8-45a7f2012110 req-c87faea8-d4f9-45f5-aec5-d58d4b8c3e28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072135 Jul 02 21:11:09.017371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1269/2585] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:11:09.032581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:09.035506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:09.037302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:09.066364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:09.066820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:09.070526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:09.071000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:10.351724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:10.365894 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea60cf0c-0b88-4a97-accb-e63c32257b13 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 1.344614 Jul 02 21:11:10.371432 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1270/2586] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:09 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:10.388808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed525c8a-eed0-4ee9-9cd0-81d9a30c6d66 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79c54c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:10.520381 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed525c8a-eed0-4ee9-9cd0-81d9a30c6d66 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1452 microversion: 2.1 time: 0.144865 Jul 02 21:11:10.522372 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1271/2587] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:10 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:10.534981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ca1c064-1e4c-47b8-bcb1-cb4680f08ac3 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd7995700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:10.564116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:10.596683 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ca1c064-1e4c-47b8-bcb1-cb4680f08ac3 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 200 len: 286 microversion: 2.1 time: 0.072296 Jul 02 21:11:10.598499 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1272/2588] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:10 2022] GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:11.266315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-962734661", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "4b6ee380-796d-40b2-8537-e5a3940ff276"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:11.351993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] validate_networks() for [('4b6ee380-796d-40b2-8537-e5a3940ff276', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:11:11.722014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Getting quotas for project 116d106003e54750a7e57d37e6a8798a. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:11.730604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Getting quotas for user 1412af7535c24b5fa139fd87431375ca and project 116d106003e54750a7e57d37e6a8798a. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:11.744925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:11:11.745751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:11:11.746451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:11:11.747094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:11:11.747738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:11:11.758523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:11.759152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:11.760158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:11.760700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:11.782136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Getting quotas for project 116d106003e54750a7e57d37e6a8798a. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:11.792310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Getting quotas for user 1412af7535c24b5fa139fd87431375ca and project 116d106003e54750a7e57d37e6a8798a. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:11.823673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:11:11.826520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:11.893448 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8573d12a-69b4-44e9-81af-ef8aa68f23be tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.432916 Jul 02 21:11:11.899476 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1317/2589] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:11:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 4441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:11:11.905479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1133056107", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2e05cfae-5311-414e-b03f-d5b620078b94"}], "block_device_mapping_v2": [{"uuid": "a920da18-54ff-4013-859c-a7aab272a078", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:12.010533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] validate_networks() for [('2e05cfae-5311-414e-b03f-d5b620078b94', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:11:12.991884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:11:12.992427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:11:12.992835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:11:12.993209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:11:12.993620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:11:13.008410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:13.009163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:13.011066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:13.011703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:13.035309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Getting quotas for project d8523eb97eba43f4b819bc5d252bdcb7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:13.043050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Getting quotas for user d876976637504a83859b09a4ef0d3406 and project d8523eb97eba43f4b819bc5d252bdcb7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:13.060791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Going to run 3 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:11:13.064320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:13.133172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=26828266-c477-42c6-ac81-2283d61b7d0f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:13.184611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=740c4ead-8987-472d-be4b-affd0c8977b1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:13.271205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b950bd50-8b3b-42ea-89b3-c073129f39ef tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.137641 Jul 02 21:11:13.273117 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1273/2590] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:11:13.279967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:13.281126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:13.295523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:13.296541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:13.298014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:13.298895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:13.771868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:11:13.773209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:11:13.774179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:11:13.774889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:11:13.775459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:11:13.796814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:13.797999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:13.799239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:13.799871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:13.816356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:13.842225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:13.851537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Getting quotas for user 8b345a42784d4df79caab6d667117418 and project 8c234eb1b17242368d279c164a6045d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:13.853170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:13.871077 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc72a3ea-c938-4c23-a736-d4c0b9932161 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 0.589978 Jul 02 21:11:13.876015 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1274/2591] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:13 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:13.907131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef291214-23c7-46c5-8db1-19b6445d76f7 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7995c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.018908 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef291214-23c7-46c5-8db1-19b6445d76f7 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1461 microversion: 2.1 time: 0.140608 Jul 02 21:11:14.028162 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1275/2592] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:13 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1461 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:14.044818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:11:14.049175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a920da18-54ff-4013-859c-a7aab272a078',volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:14.061362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35286442-f27b-4030-bf6f-d4ac061c0d91 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabea1160d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.138645 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-35286442-f27b-4030-bf6f-d4ac061c0d91 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] HTTP exception thrown: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35286442-f27b-4030-bf6f-d4ac061c0d91 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Request method failure captured: Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e HTTP/1.1 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRnHMZj929rR9GUjJg4IwD48ed6GKAc2uwKgiUVDDZI97WcoJMclhjxyjbvBXOszpN3fkSsUExZDjnUdGKlOH_m46qVqe06ntqv1cFrEsHwTpmQQtJSc9jYdGtz602D4ySKGnD8aZvgp-1XQwxVOhrBSE2CaPM11Y4Uw43bojAfsd0 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_01a157232bd54d46ad99f8655ebb40b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/01a157232bd54d46ad99f8655ebb40b2"}]}] Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 094610d1808a479b99ce0fe5c2bac033 Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: exception: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c745f9d7-d8c8-4d01-b052-cc75922b374e'} Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. (HTTP 404) (Request-ID: req-867241f0-bdca-47de-a18b-6810c4c75083) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:11:14.146909 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35286442-f27b-4030-bf6f-d4ac061c0d91 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Returning 404 to user: Snapshot c745f9d7-d8c8-4d01-b052-cc75922b374e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35286442-f27b-4030-bf6f-d4ac061c0d91 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e" status: 404 len: 111 microversion: 2.1 time: 0.123727 Jul 02 21:11:14.152324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1276/2593] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/os-snapshots/c745f9d7-d8c8-4d01-b052-cc75922b374e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:14.169208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.171667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:14.186983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:14.187438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:14.188371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:14.188808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:14.358077 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d50dfc1c-0736-403e-8196-8171554238f0 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.457282 Jul 02 21:11:14.361291 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1318/2594] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:11:14.370532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:14.380245 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7628f76-b8d4-4338-84bc-6d34615535d1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1335 microversion: 2.1 time: 0.227435 Jul 02 21:11:14.382485 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1277/2595] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1335 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:14.383271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.386714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:14.387393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:14.392391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae13e0d2-32f4-4e33-89b8-0234f3c7867d tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7995040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.456076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:14.456535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:14.457344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:14.457781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:14.461580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae13e0d2-32f4-4e33-89b8-0234f3c7867d tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 200 len: 1461 microversion: 2.1 time: 0.076267 Jul 02 21:11:14.462209 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1278/2596] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 1461 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:14.535596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Listed batch of 2 results from cell out of 997 limit. Returned 2 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:11:14.608690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-975c46b2-c7d0-4bf0-9f9a-befb9b911f61 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'create', calling method: .version_select at 0x7fabea0fdb80>, body: {"keypair": {"name": "tempest-keypair-1244259102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoD84VWRNOhQegb+lq+11xzMJH8Byj61dC27qcI+ISQtT4e4sTbKQyK+5dZmpIi5mMSk2M0YjqWuokMVxKyX633bx1RuCEMhtnJz7JlpdFqYilOFJqhkk9Lp5oSsaz7fw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:14.632176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Listed batch of 1 results from cell out of 997 limit. Returned 3 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:11:14.646927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-975c46b2-c7d0-4bf0-9f9a-befb9b911f61 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for project f644f2d1c56c43cf851deb020af7161e. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:14.664390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-975c46b2-c7d0-4bf0-9f9a-befb9b911f61 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for user 984631f5a77a48c5a9619e33e608dd59 and project f644f2d1c56c43cf851deb020af7161e. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:14.709715 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9a03132-8da6-40b4-a376-0cd9b5debc50 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.344770 Jul 02 21:11:14.711278 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1319/2597] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/servers => generated 1015 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:14.724782 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-975c46b2-c7d0-4bf0-9f9a-befb9b911f61 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.258822 Jul 02 21:11:14.725794 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1279/2598] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:11:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 260 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:11:14.727506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b71ed23-52c6-4963-9b15-3fc9b42d2a2d tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd76a9f70>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.733066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be7f78b1-d960-41f4-b6e8-e18fd1d450ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.733955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be7f78b1-d960-41f4-b6e8-e18fd1d450ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:14.886568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b71ed23-52c6-4963-9b15-3fc9b42d2a2d tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072" status: 202 len: 0 microversion: 2.1 time: 0.171874 Jul 02 21:11:14.887728 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1320/2599] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:14 2022] DELETE /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:11:14.901283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.903742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:14.918918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:14.919726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:14.920905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:14.921556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:14.924989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be7f78b1-d960-41f4-b6e8-e18fd1d450ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:14.933356 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be7f78b1-d960-41f4-b6e8-e18fd1d450ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1053 microversion: 2.1 time: 0.206152 Jul 02 21:11:14.944208 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1280/2600] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1053 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:14.955887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:14.971908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:14.998986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:15.002113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:15.004547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:15.012780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:15.258223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:15.294867 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4270bfcc-e3f1-44ed-9809-6e935286261f tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1226 microversion: 2.1 time: 0.349026 Jul 02 21:11:15.295485 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1281/2601] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1226 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:15.321322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:15.321982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:15.351461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:15.352162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:15.358918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:15.359406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:15.756782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:15.768625 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8522128-3fa3-4c8c-8a24-52d75d95087e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1467 microversion: 2.1 time: 0.879730 Jul 02 21:11:15.769236 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1321/2602] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:14 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1467 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:15.782340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5149323f-7a6e-4e08-a918-2fc7c650260b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd7693820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:15.858663 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5149323f-7a6e-4e08-a918-2fc7c650260b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] HTTP exception thrown: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5149323f-7a6e-4e08-a918-2fc7c650260b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Request method failure captured: Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 HTTP/1.1 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRnHMZj929rR9GUjJg4IwD48ed6GKAc2uwKgiUVDDZI97WcoJMclhjxyjbvBXOszpN3fkSsUExZDjnUdGKlOH_m46qVqe06ntqv1cFrEsHwTpmQQtJSc9jYdGtz602D4ySKGnD8aZvgp-1XQwxVOhrBSE2CaPM11Y4Uw43bojAfsd0 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_01a157232bd54d46ad99f8655ebb40b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/01a157232bd54d46ad99f8655ebb40b2"}]}] Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 094610d1808a479b99ce0fe5c2bac033 Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: exception: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'f5accb98-0f42-4400-afaf-07719d59b072'} Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. (HTTP 404) (Request-ID: req-daf960c5-1343-487e-81c0-40a3c33f2e11) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:11:15.860800 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5149323f-7a6e-4e08-a918-2fc7c650260b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Returning 404 to user: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:15.865729 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5149323f-7a6e-4e08-a918-2fc7c650260b tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072" status: 404 len: 109 microversion: 2.1 time: 0.092367 Jul 02 21:11:15.870526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1322/2603] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:11:15 2022] GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:15.872850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:15.873479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:15.907334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:15.908012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:15.908643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:15.909087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:16.201325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:16.253005 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-967636ab-912e-465f-8755-b30ca4b1db9a tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 0.949277 Jul 02 21:11:16.258901 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1282/2604] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:15 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:16.275176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1778501024"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:16.277094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:16.326833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:16.330389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:16.337738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:16.343864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.027711 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bcc51221-aa03-47ad-8831-5b78b0f6bd67 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "POST /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc/action" status: 202 len: 0 microversion: 2.1 time: 0.765995 Jul 02 21:11:17.033855 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1283/2605] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:11:16 2022] POST /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:11:17.042902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fd09756-ab4d-4732-a99c-ca80f8468f2f tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd79a3160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:17.107811 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8fd09756-ab4d-4732-a99c-ca80f8468f2f tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] HTTP exception thrown: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fd09756-ab4d-4732-a99c-ca80f8468f2f tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Request method failure captured: Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 HTTP/1.1 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRnHMZj929rR9GUjJg4IwD48ed6GKAc2uwKgiUVDDZI97WcoJMclhjxyjbvBXOszpN3fkSsUExZDjnUdGKlOH_m46qVqe06ntqv1cFrEsHwTpmQQtJSc9jYdGtz602D4ySKGnD8aZvgp-1XQwxVOhrBSE2CaPM11Y4Uw43bojAfsd0 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_01a157232bd54d46ad99f8655ebb40b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/01a157232bd54d46ad99f8655ebb40b2"}]}] Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 094610d1808a479b99ce0fe5c2bac033 Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'f5accb98-0f42-4400-afaf-07719d59b072'} Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. (HTTP 404) (Request-ID: req-aaa56776-bf58-4e2b-8a94-92cde90d764d) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:11:17.110252 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.113985 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.118678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fd09756-ab4d-4732-a99c-ca80f8468f2f tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Returning 404 to user: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:17.119803 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fd09756-ab4d-4732-a99c-ca80f8468f2f tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072" status: 404 len: 109 microversion: 2.1 time: 0.084338 Jul 02 21:11:17.120610 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1284/2606] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:11:17 2022] DELETE /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:17.134602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:17.139908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:17.155783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.161425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.162608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.163401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.175235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:17.203547 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5378d329-af75-47c4-9aea-ae0d3607f0c0 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 1.329098 Jul 02 21:11:17.206715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1323/2607] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:15 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:17.226857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:17.233437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:17.257921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.259580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.260907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.261376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.421043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:17.430760 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-889deff1-3a42-47e2-bcad-80d8255978a7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1151 microversion: 2.1 time: 0.308868 Jul 02 21:11:17.438117 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1285/2608] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:17 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1151 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:17.452819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cac06afe-cc5c-4028-9de4-e66ea9598dc5 req-10aaca03-40ec-4d17-a96a-9419a31d581d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "name": "network-vif-unplugged", "status": "completed", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:17.472371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:17.479466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cac06afe-cc5c-4028-9de4-e66ea9598dc5 req-10aaca03-40ec-4d17-a96a-9419a31d581d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.479923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cac06afe-cc5c-4028-9de4-e66ea9598dc5 req-10aaca03-40ec-4d17-a96a-9419a31d581d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.486876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6a2faea0-52b2-4150-94db-2e28e7d954cc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1280 microversion: 2.1 time: 0.274916 Jul 02 21:11:17.487810 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1324/2609] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:17 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1280 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:17.505248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06e399d3-48ba-4228-b647-13c6ef79da90 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7849820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:17.524488 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cac06afe-cc5c-4028-9de4-e66ea9598dc5 req-10aaca03-40ec-4d17-a96a-9419a31d581d service nova] Creating event network-vif-unplugged:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:11:17.549095 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cac06afe-cc5c-4028-9de4-e66ea9598dc5 req-10aaca03-40ec-4d17-a96a-9419a31d581d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108501 Jul 02 21:11:17.556502 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1286/2610] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:17.564188 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06e399d3-48ba-4228-b647-13c6ef79da90 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.064970 Jul 02 21:11:17.565389 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1325/2611] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:17 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:17.572575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:17.573520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:17.573645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ed9a696-3187-42a3-b9f7-5095a56dad53 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Calling method '.version_select at 0x7fabd799d790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:17.581606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.582839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.584136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:17.584917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:17.659580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8ed9a696-3187-42a3-b9f7-5095a56dad53 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] HTTP exception thrown: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ed9a696-3187-42a3-b9f7-5095a56dad53 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Request method failure captured: Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 HTTP/1.1 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRnHMZj929rR9GUjJg4IwD48ed6GKAc2uwKgiUVDDZI97WcoJMclhjxyjbvBXOszpN3fkSsUExZDjnUdGKlOH_m46qVqe06ntqv1cFrEsHwTpmQQtJSc9jYdGtz602D4ySKGnD8aZvgp-1XQwxVOhrBSE2CaPM11Y4Uw43bojAfsd0 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_01a157232bd54d46ad99f8655ebb40b2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/01a157232bd54d46ad99f8655ebb40b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/01a157232bd54d46ad99f8655ebb40b2"}]}] Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 01a157232bd54d46ad99f8655ebb40b2 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-357739283 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 094610d1808a479b99ce0fe5c2bac033 Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesSnapshotsTestJSON-357739283-project Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'f5accb98-0f42-4400-afaf-07719d59b072'} Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. (HTTP 404) (Request-ID: req-6ecd45bd-2223-4a0b-8d6f-ae3f541271ca) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:11:17.662155 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ed9a696-3187-42a3-b9f7-5095a56dad53 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] Returning 404 to user: Volume f5accb98-0f42-4400-afaf-07719d59b072 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ed9a696-3187-42a3-b9f7-5095a56dad53 tempest-VolumesSnapshotsTestJSON-357739283 tempest-VolumesSnapshotsTestJSON-357739283-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072" status: 404 len: 109 microversion: 2.1 time: 0.105939 Jul 02 21:11:17.670068 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1287/2612] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:11:17 2022] GET /compute/v2.1/os-volumes/f5accb98-0f42-4400-afaf-07719d59b072 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:18.226502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:18.227549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:18.260677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:18.262113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:18.267870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:18.268356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:19.518759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:19.528753 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63808f53-fbf7-4a92-9708-6ceebdb673c4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 1.961367 Jul 02 21:11:19.529888 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1326/2613] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:17 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:19.535310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:19.535928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:19.551773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:19.552285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:19.553807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:19.554460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:19.730406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:19.738920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:19.749755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-162a6903-75ff-4cfb-8051-a1f9d93c0e0f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1169 microversion: 2.1 time: 0.216635 Jul 02 21:11:19.764147 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1327/2614] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:19 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1169 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:19.769688 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f875ae85-e02d-4879-b1f8-d39e2b3d2194 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 1.549379 Jul 02 21:11:19.771973 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1288/2615] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:18 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:19.781385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:19.782016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:19.785012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-570d9a72-648a-4d3d-9c01-34fd13f8ef01 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7995700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:19.810817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:19.812941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:19.813766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:19.814482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:19.938776 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-570d9a72-648a-4d3d-9c01-34fd13f8ef01 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.162428 Jul 02 21:11:19.946554 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1289/2616] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:19 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:19.971793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e73b3f9f-cf1f-4146-9d6f-c95c70f96e19 req-89a6c6ee-bbb3-428f-ab5b-1cc293cee147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fa2b45-ce8c-4055-9576-bf03a6b2a1ad", "name": "network-vif-plugged", "status": "completed", "tag": "6d4724a8-a78b-4ebe-b6b7-80f71e61daba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:20.013306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e73b3f9f-cf1f-4146-9d6f-c95c70f96e19 req-89a6c6ee-bbb3-428f-ab5b-1cc293cee147 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:20.021273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e73b3f9f-cf1f-4146-9d6f-c95c70f96e19 req-89a6c6ee-bbb3-428f-ab5b-1cc293cee147 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:20.056516 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e73b3f9f-cf1f-4146-9d6f-c95c70f96e19 req-89a6c6ee-bbb3-428f-ab5b-1cc293cee147 service nova] Creating event network-vif-plugged:6d4724a8-a78b-4ebe-b6b7-80f71e61daba for instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad on nch2-master-1 Jul 02 21:11:20.071108 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e73b3f9f-cf1f-4146-9d6f-c95c70f96e19 req-89a6c6ee-bbb3-428f-ab5b-1cc293cee147 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111433 Jul 02 21:11:20.107210 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1290/2617] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:20.148743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-427817666", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e2ccb6d-6e1d-4a18-8db3-7d2e53564721"}], "security_groups": [{"name": "tempest-securitygroup--387624968"}], "key_name": "tempest-keypair-1244259102", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:20.519599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] validate_networks() for [('4e2ccb6d-6e1d-4a18-8db3-7d2e53564721', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:11:20.684826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:20.711902 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-99ad1a3a-9d3b-477a-ab82-273e6d48bc9a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1280 microversion: 2.1 time: 0.934516 Jul 02 21:11:20.725579 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1328/2618] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:19 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1280 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:20.736294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:20.737291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:20.745078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:20.745900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:20.747057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:20.747462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:21.630764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:21.639797 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab9b1f48-a428-4154-b70e-8a9d34909245 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1325 microversion: 2.1 time: 0.912903 Jul 02 21:11:21.646618 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1329/2619] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:20 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1325 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:21.667939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:21.670558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:21.688409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:21.689005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:21.690732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:21.690732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:22.561633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:11:22.563136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:11:22.564851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:11:22.565469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:11:22.566926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:11:22.590007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:22.590784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:22.592497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:22.593252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:22.616853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for project f644f2d1c56c43cf851deb020af7161e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:22.623806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for user 984631f5a77a48c5a9619e33e608dd59 and project f644f2d1c56c43cf851deb020af7161e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:22.640166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:11:22.643131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:22.696758 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb92f6c3-862a-4379-94df-55e4c71279b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.553530 Jul 02 21:11:22.697678 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1291/2620] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:11:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 2556 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:11:22.706158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:22.707317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:22.715662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:22.716474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:22.717482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:22.718109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:22.754124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:22.770361 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ff17352-d833-496b-bb40-84daee281d68 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 1.121762 Jul 02 21:11:22.770963 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1330/2621] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:21 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:22.784647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0de233e6-8a8f-4aa5-9da2-791c5f33352e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd76ca430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:22.840729 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0de233e6-8a8f-4aa5-9da2-791c5f33352e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.068712 Jul 02 21:11:22.842456 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1331/2622] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:22 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:22.847215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:22.848276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:22.855270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:22.856085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:22.857773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:22.858621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.192693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:23.205344 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f68b7955-3da6-4644-9718-b9735ee002e7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.505310 Jul 02 21:11:23.206751 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1292/2623] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:22 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:23.349160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:23.363828 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-286ada34-65b7-44a3-8f7b-500f1aef2b6e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.520089 Jul 02 21:11:23.371604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1332/2624] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:22 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:23.379896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5534c66f-082a-43ab-9ec5-5beace94ea3a req-26dd3a89-9787-4c01-abe2-98e4093fff8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7346a39-12a0-4dfd-bcd7-d071903b31fa", "tag": "c65d66d3-c08d-4225-8f62-5bf5c3a1acf6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:23.409883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5534c66f-082a-43ab-9ec5-5beace94ea3a req-26dd3a89-9787-4c01-abe2-98e4093fff8f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:23.418775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5534c66f-082a-43ab-9ec5-5beace94ea3a req-26dd3a89-9787-4c01-abe2-98e4093fff8f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.478065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5534c66f-082a-43ab-9ec5-5beace94ea3a req-26dd3a89-9787-4c01-abe2-98e4093fff8f service nova] Creating event network-changed:c65d66d3-c08d-4225-8f62-5bf5c3a1acf6 for instance b7346a39-12a0-4dfd-bcd7-d071903b31fa on nch1-master-1 Jul 02 21:11:23.485721 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5534c66f-082a-43ab-9ec5-5beace94ea3a req-26dd3a89-9787-4c01-abe2-98e4093fff8f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112266 Jul 02 21:11:23.487081 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1333/2625] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:23.494996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:23.497281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:23.544946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:23.549166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.556349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:23.558021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.602342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c595306e-9b7d-4f17-9e7b-c1ad78a8ce7c req-6126f6d8-9482-49b2-b478-c5fc52ffa8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee72b452-80bd-4468-af1c-fd8177722316", "tag": "941d18af-3acd-4e23-9a90-9b6c5e6a1f84"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:23.634837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c595306e-9b7d-4f17-9e7b-c1ad78a8ce7c req-6126f6d8-9482-49b2-b478-c5fc52ffa8aa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:23.636414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c595306e-9b7d-4f17-9e7b-c1ad78a8ce7c req-6126f6d8-9482-49b2-b478-c5fc52ffa8aa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.668958 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c595306e-9b7d-4f17-9e7b-c1ad78a8ce7c req-6126f6d8-9482-49b2-b478-c5fc52ffa8aa service nova] Creating event network-changed:941d18af-3acd-4e23-9a90-9b6c5e6a1f84 for instance ee72b452-80bd-4468-af1c-fd8177722316 on nch2-master-1 Jul 02 21:11:23.679543 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c595306e-9b7d-4f17-9e7b-c1ad78a8ce7c req-6126f6d8-9482-49b2-b478-c5fc52ffa8aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.469917 Jul 02 21:11:23.686820 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1293/2626] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:23.722092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:23.723045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:23.741021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:23.741614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.742422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:23.744638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:23.869582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:24.213136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:24.226095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:24.227932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:24.230030 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-263767fe-6351-4fe9-a5da-3334202a4fe1 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1277 microversion: 2.20 time: 0.540227 Jul 02 21:11:24.231977 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1294/2627] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:23 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1277 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:24.257143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:24.258211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:24.292843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:24.293326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:24.294593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:24.295280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:24.492320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:24.702534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:24.706520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:24.710816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3be75aed-b240-4c14-a4a9-5a7e4f5caf95 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 0.458623 Jul 02 21:11:24.715078 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1295/2628] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:24 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:24.718390 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5a07302a-aaaf-4105-8407-403721a09bba tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1521 microversion: 2.1 time: 1.229440 Jul 02 21:11:24.721523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b73b8de-e4f5-414b-a01f-3c3cb255bcd3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79af820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:24.731386 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1334/2629] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:23 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1521 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:24.752854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:24.756328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:24.767640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:24.768416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:24.769359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:24.770042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:24.795596 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b73b8de-e4f5-414b-a01f-3c3cb255bcd3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.078762 Jul 02 21:11:24.802643 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1296/2630] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:24 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:24.815945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:24.817585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:24.838715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:24.841431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:24.842804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:24.843982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:24.869603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:25.230885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:25.247158 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2948fc65-d360-4524-bd86-31c26f9078f7 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.512542 Jul 02 21:11:25.250669 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1335/2631] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:24 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:25.255544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:25.256183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:25.276393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.277776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.279719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.282393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.335773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:25.345281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-447f6f5f-a91a-434c-b499-a121e5ff17aa tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.539250 Jul 02 21:11:25.348260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1297/2632] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:24 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:25.360575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a050157b-5380-4c57-8ec5-c5f9954852b2 req-d76fd34e-aa5a-4ef9-94c4-786739b5e6be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f04307a-39d1-4497-acb0-17ba192336bc", "name": "network-vif-plugged", "status": "completed", "tag": "77b42318-cb32-44f7-833d-f1bb938eae91"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:25.371065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a050157b-5380-4c57-8ec5-c5f9954852b2 req-d76fd34e-aa5a-4ef9-94c4-786739b5e6be service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.371541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a050157b-5380-4c57-8ec5-c5f9954852b2 req-d76fd34e-aa5a-4ef9-94c4-786739b5e6be service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.384451 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a050157b-5380-4c57-8ec5-c5f9954852b2 req-d76fd34e-aa5a-4ef9-94c4-786739b5e6be service nova] Creating event network-vif-plugged:77b42318-cb32-44f7-833d-f1bb938eae91 for instance 6f04307a-39d1-4497-acb0-17ba192336bc on nch1-master-1 Jul 02 21:11:25.389538 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a050157b-5380-4c57-8ec5-c5f9954852b2 req-d76fd34e-aa5a-4ef9-94c4-786739b5e6be service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039010 Jul 02 21:11:25.390228 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1298/2633] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:25.395703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:25.396439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:25.398555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:25.404904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.405438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.406216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.406654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.561233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:25.572305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:25.574007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:25.575233 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-012bcc4b-f929-4dad-a36b-d21af47d4581 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1341 microversion: 2.20 time: 0.183660 Jul 02 21:11:25.575878 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1299/2634] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:25 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:25.716606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:25.724585 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-873cb71a-8041-41df-9c97-ff7792febb3e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1521 microversion: 2.1 time: 0.472791 Jul 02 21:11:25.725367 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1336/2635] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:25 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:25.735947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:25.741429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2b9f6ced-0c4a-47a4-8c5c-b5f9e773968e req-fac5fa33-0d5c-4087-a144-8d8a16931e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26828266-c477-42c6-ac81-2283d61b7d0f", "tag": "44d6c19e-b2d8-4697-a88f-c34982008bfa"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:25.745014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:25.749766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2b9f6ced-0c4a-47a4-8c5c-b5f9e773968e req-fac5fa33-0d5c-4087-a144-8d8a16931e28 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.750213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2b9f6ced-0c4a-47a4-8c5c-b5f9e773968e req-fac5fa33-0d5c-4087-a144-8d8a16931e28 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.755507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.756130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.757200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.757844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.763562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2b9f6ced-0c4a-47a4-8c5c-b5f9e773968e req-fac5fa33-0d5c-4087-a144-8d8a16931e28 service nova] Creating event network-changed:44d6c19e-b2d8-4697-a88f-c34982008bfa for instance 26828266-c477-42c6-ac81-2283d61b7d0f on nch2-master-1 Jul 02 21:11:25.780958 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2b9f6ced-0c4a-47a4-8c5c-b5f9e773968e req-fac5fa33-0d5c-4087-a144-8d8a16931e28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043545 Jul 02 21:11:25.784142 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1337/2636] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:25.795167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-387936693"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:25.796975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:25.808571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.809216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:25.810201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:25.810835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.061834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:26.070018 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-767dd2f7-0054-4314-8c8f-b90f96d07d5f tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 0.339946 Jul 02 21:11:26.079188 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1300/2637] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:25 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:26.085044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5b5bdde-b0fb-43f0-a3c5-6d9bf82da0ee tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7f8c160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.085462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:26.152429 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5b5bdde-b0fb-43f0-a3c5-6d9bf82da0ee tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.080010 Jul 02 21:11:26.153441 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1301/2638] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:26 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:26.158753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0565bc98-10da-45d4-bcef-9c38293a52b6 req-6bf56e38-1b5e-4668-bb0c-c4b4662cde00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f40d87e-0e90-421d-b8b4-08f7935d0ed2", "tag": "43a57b84-c82a-4d4a-89a8-a574a846d8f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:26.168908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0565bc98-10da-45d4-bcef-9c38293a52b6 req-6bf56e38-1b5e-4668-bb0c-c4b4662cde00 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.169666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0565bc98-10da-45d4-bcef-9c38293a52b6 req-6bf56e38-1b5e-4668-bb0c-c4b4662cde00 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.187188 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0565bc98-10da-45d4-bcef-9c38293a52b6 req-6bf56e38-1b5e-4668-bb0c-c4b4662cde00 service nova] Creating event network-changed:43a57b84-c82a-4d4a-89a8-a574a846d8f8 for instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 on nch2-master-1 Jul 02 21:11:26.188274 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6683df86-4236-4d17-a9c5-9d3f46126380 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad/action" status: 202 len: 0 microversion: 2.1 time: 0.400381 Jul 02 21:11:26.189177 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1338/2639] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:11:25 2022] POST /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:11:26.201836 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0565bc98-10da-45d4-bcef-9c38293a52b6 req-6bf56e38-1b5e-4668-bb0c-c4b4662cde00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039838 Jul 02 21:11:26.203901 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1302/2640] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:26.204453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bef771b3-a0e1-4103-a13b-2feb6b441fc5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '.version_select at 0x7fabd78a1dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.266143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.268412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:26.282491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.283361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.303427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.303891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.418896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bef771b3-a0e1-4103-a13b-2feb6b441fc5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802" status: 204 len: 0 microversion: 2.1 time: 0.222671 Jul 02 21:11:26.419474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1339/2641] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:26 2022] DELETE /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:26.426388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.427522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:26.440558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.441018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.441999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.442439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.655701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:26.664482 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b559845-672d-44a9-9779-df935de92152 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.403190 Jul 02 21:11:26.665686 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1303/2642] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:26 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:26.670722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07ab172b-bf32-4eae-896b-fec5bc800a7d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '.version_select at 0x7fabea0d18b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.705398 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-07ab172b-bf32-4eae-896b-fec5bc800a7d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Image not found. Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07ab172b-bf32-4eae-896b-fec5bc800a7d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802 HTTP/1.1 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '0c0b5e9a-06f5-4898-8c10-d3d921a74802'} Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0c0b5e9a-06f5-4898-8c10-d3d921a74802 Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:11:26.709462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c0b5e9a-06f5-4898-8c10-d3d921a74802 could not be found. Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:11:26.714248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:26.718799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07ab172b-bf32-4eae-896b-fec5bc800a7d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:26.719849 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07ab172b-bf32-4eae-896b-fec5bc800a7d tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802" status: 404 len: 62 microversion: 2.1 time: 0.053028 Jul 02 21:11:26.720475 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1304/2643] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:26 2022] GET /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:11:26.728924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.730241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:26.732735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:26.740864 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49b7ede2-3f3b-41db-8f3b-72381705111a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.319889 Jul 02 21:11:26.741537 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1340/2644] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:26 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:26.743698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.744684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.745641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.747142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.755604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:26.756562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:26.763274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.764142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.765202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:26.765860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:26.874153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:26.888605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:26.891237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:26.894894 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07501772-1062-419b-9644-9faa1e4e0d34 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1341 microversion: 2.20 time: 0.171024 Jul 02 21:11:26.895557 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1305/2645] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:26 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:27.071535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:27.089352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:27.089970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:27.097009 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-240e8256-9f36-4d72-bfea-694570aafa91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1533 microversion: 2.1 time: 0.348474 Jul 02 21:11:27.097959 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1341/2646] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:26 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1533 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:27.108607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:27.109589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:27.110446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:27.110895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:27.168412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a258c824-cd2f-4f55-aafe-77f304d705e7 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd76ea550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:27.218393 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a258c824-cd2f-4f55-aafe-77f304d705e7 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.055556 Jul 02 21:11:27.219205 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1342/2647] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:27 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:27.373754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:27.381902 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54f828b8-af7f-4326-809e-e0b83752c343 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 0.297375 Jul 02 21:11:27.382484 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1306/2648] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:27 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:27.682930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:27.683586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:27.690943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:27.691405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:27.692317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:27.692953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:27.757986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:27.759266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:27.766687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:27.767371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:27.768403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:27.769003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.145041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.162346 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6866051e-ba34-4839-8c78-d22c5226eb7d tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.484677 Jul 02 21:11:28.163723 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1343/2649] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:27 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:28.168915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:28.169796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:28.176088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.176808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.177792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.178873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.336756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.345410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.347305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.348827 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76579c16-8e5f-435a-b885-dbe1dde39143 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1339 microversion: 2.20 time: 0.183767 Jul 02 21:11:28.360596 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1344/2650] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:28 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:28.365956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:28.366853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:28.374583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.375494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.377087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.377901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.513325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.523197 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46effd51-6a8b-4df2-85f5-f309d37a8d28 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.769281 Jul 02 21:11:28.523818 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1307/2651] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:27 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:28.528553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e06c9319-a210-4684-8804-6de0a774daab tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7995040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:28.576952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e06c9319-a210-4684-8804-6de0a774daab tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.051862 Jul 02 21:11:28.577730 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1308/2652] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:28 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:28.582709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-04ef7ba9-6293-4f37-9e87-33ca3749a8c8 req-7f07819d-c944-4cef-9586-f1588d5d2ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740c4ead-8987-472d-be4b-affd0c8977b1", "tag": "ed2daaf0-b76a-4200-8f10-f7dc286dbe4e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:28.583836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.595045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7433df86-0b7f-473d-ae88-adb9f2b4872e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1539 microversion: 2.1 time: 0.232314 Jul 02 21:11:28.595447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-04ef7ba9-6293-4f37-9e87-33ca3749a8c8 req-7f07819d-c944-4cef-9586-f1588d5d2ba5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.605700 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1345/2653] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:28 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1539 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:28.605920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-04ef7ba9-6293-4f37-9e87-33ca3749a8c8 req-7f07819d-c944-4cef-9586-f1588d5d2ba5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.606012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:28.606012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:28.610672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-04ef7ba9-6293-4f37-9e87-33ca3749a8c8 req-7f07819d-c944-4cef-9586-f1588d5d2ba5 service nova] Creating event network-changed:ed2daaf0-b76a-4200-8f10-f7dc286dbe4e for instance 740c4ead-8987-472d-be4b-affd0c8977b1 on nch1-master-1 Jul 02 21:11:28.616771 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-04ef7ba9-6293-4f37-9e87-33ca3749a8c8 req-7f07819d-c944-4cef-9586-f1588d5d2ba5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037575 Jul 02 21:11:28.618033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1309/2654] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:28.628410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.628987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.630001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:28.630509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:28.765846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:28.773911 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ff67bc3-7f0e-4d82-a8d4-8ccda79d77de tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 0.176906 Jul 02 21:11:28.774472 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1346/2655] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:28 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:29.180861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:29.182270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:29.189699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.190151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.190927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.191352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.339388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:29.347679 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eaf972c2-13a6-4fb5-bcc0-d46888827206 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.171295 Jul 02 21:11:29.348785 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1310/2656] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:29 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:29.372222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:29.373686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:29.381990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.382716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.383728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.384300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.465533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:29.475327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:29.477121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:29.479018 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3414dc05-7494-4c4f-b85b-adee1fa6a3ef tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1339 microversion: 2.20 time: 0.110271 Jul 02 21:11:29.479628 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1347/2657] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:29 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:29.539924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:29.540659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:29.547661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.548147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.548934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.549371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.590591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3653c5d1-1cd8-4099-99ed-91f500c2fc1e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd76ea550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:29.657725 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3653c5d1-1cd8-4099-99ed-91f500c2fc1e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.070718 Jul 02 21:11:29.658528 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1348/2658] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:29 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:11:29.669553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:29.670916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:29.682306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.683098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:29.684076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:29.685143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.179366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.189660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.194884 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bd13cd6-5d35-4fcd-ba35-c8967e5c6326 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.659046 Jul 02 21:11:30.202744 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5e1e33d8-ab6b-49a3-92d3-024affb4ffb8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1534 microversion: 2.1 time: 0.542932 Jul 02 21:11:30.204168 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1349/2659] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:29 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1534 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:30.208000 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1311/2660] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:29 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:30.209619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-9add7276-7b74-4328-aae4-8e35e03fe024 req-245d2177-23fe-4353-940a-cd9ed4e9233e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee72b452-80bd-4468-af1c-fd8177722316", "name": "network-vif-plugged", "status": "completed", "tag": "941d18af-3acd-4e23-9a90-9b6c5e6a1f84"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:30.212866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:30.213475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:30.221084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-9add7276-7b74-4328-aae4-8e35e03fe024 req-245d2177-23fe-4353-940a-cd9ed4e9233e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.221267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.221663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.222368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.222664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-9add7276-7b74-4328-aae4-8e35e03fe024 req-245d2177-23fe-4353-940a-cd9ed4e9233e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.222786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.244381 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-9add7276-7b74-4328-aae4-8e35e03fe024 req-245d2177-23fe-4353-940a-cd9ed4e9233e service nova] Creating event network-vif-plugged:941d18af-3acd-4e23-9a90-9b6c5e6a1f84 for instance ee72b452-80bd-4468-af1c-fd8177722316 on nch2-master-1 Jul 02 21:11:30.249345 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-9add7276-7b74-4328-aae4-8e35e03fe024 req-245d2177-23fe-4353-940a-cd9ed4e9233e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043396 Jul 02 21:11:30.249947 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1350/2661] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:30.367657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:30.368543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:30.377052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.377738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.379136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.379726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.420253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.428994 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d6ba753-3fc0-4430-9d8a-2f73a5a36e35 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 0.219831 Jul 02 21:11:30.429745 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1312/2662] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:30 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:30.498928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:30.499547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:30.505676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.506315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.507312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:30.507895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:30.593956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.600182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.606711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.608380 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b59ae653-5560-46a0-b623-b6ac7bc2da54 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.246695 Jul 02 21:11:30.609288 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1351/2663] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:30 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:11:30.609949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:30.611507 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e2c8efb-1d02-4646-8a7f-61c8f0192043 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1339 microversion: 2.20 time: 0.116355 Jul 02 21:11:30.612064 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1313/2664] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:30 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1339 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:11:30.672390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-61fc1b81-d16f-4ef3-80e6-bbf4d49e5031 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd76ea9d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:30.720775 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-61fc1b81-d16f-4ef3-80e6-bbf4d49e5031 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.053031 Jul 02 21:11:30.721447 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1352/2665] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:30 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:31.215557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:31.216292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:31.221174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:31.221869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:31.226453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.226453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.226453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.226453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.231524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.232075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.232993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.233504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.435640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:31.438943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:31.446105 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec82888f-39be-4f4a-9c46-e714c6cf5a90 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.235094 Jul 02 21:11:31.447572 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1314/2666] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:31 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:31.449325 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5b777cd-6e09-4311-a9f5-329019e7a30e tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1521 microversion: 2.1 time: 0.233464 Jul 02 21:11:31.454497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:31.455596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:31.456439 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1353/2667] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:31 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:31.464168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.464662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.465624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.467938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.479946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:31.481030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:31.493744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.495860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.498414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.502681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.565408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:11:31.788325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:31.798383 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c0faef64-faa1-472e-b8b6-d8a319b50e77 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 204 len: 0 microversion: 2.1 time: 0.336033 Jul 02 21:11:31.799294 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1354/2668] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:31 2022] DELETE /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:31.815193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:31.817385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:31.832525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.832981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.833781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.840353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.912090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:31.925706 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3737982b-5d31-462d-98bb-f9fb81c3097e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1199 microversion: 2.1 time: 0.475096 Jul 02 21:11:31.926767 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1315/2669] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:31 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1199 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:31.942185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:31.943255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:31.950524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.951267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:31.952296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:31.952941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.101996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:32.114603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:32.117508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:32.119057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f103e2d-1bf8-43ce-a4fa-21f560d18e84 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1339 microversion: 2.20 time: 0.189455 Jul 02 21:11:32.120351 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1316/2670] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:31 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1339 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:32.126251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42dd1091-d284-4f38-86e8-be37b52cd8ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd7995700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:32.198984 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42dd1091-d284-4f38-86e8-be37b52cd8ec tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.076463 Jul 02 21:11:32.201125 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1317/2671] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:32 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:32.206996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:32.212799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:32.220208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.222515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.223878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.224557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.424471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:32.458086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-296b1e25-3f62-4dd5-9938-d19319ed75bc tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.655866 Jul 02 21:11:32.461937 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1355/2672] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:31 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:32.477653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:32.478459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:32.494724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.496560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.497398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.497848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.604944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:32.634412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:32.680682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:32.692024 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c49118ca-5df7-4cd4-a797-e1af6e03c513 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1527 microversion: 2.1 time: 0.489613 Jul 02 21:11:32.695530 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1318/2673] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:32 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1527 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:32.701093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-677e97ca-b44c-453b-839c-30806022b365 req-617c4cf1-5e40-42ea-82ef-fbb5e57c3883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fa2b45-ce8c-4055-9576-bf03a6b2a1ad", "name": "network-vif-plugged", "status": "completed", "tag": "6d4724a8-a78b-4ebe-b6b7-80f71e61daba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:32.710711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-677e97ca-b44c-453b-839c-30806022b365 req-617c4cf1-5e40-42ea-82ef-fbb5e57c3883 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.711420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-677e97ca-b44c-453b-839c-30806022b365 req-617c4cf1-5e40-42ea-82ef-fbb5e57c3883 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.736334 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-677e97ca-b44c-453b-839c-30806022b365 req-617c4cf1-5e40-42ea-82ef-fbb5e57c3883 service nova] Creating event network-vif-plugged:6d4724a8-a78b-4ebe-b6b7-80f71e61daba for instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad on nch2-master-1 Jul 02 21:11:32.742373 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-677e97ca-b44c-453b-839c-30806022b365 req-617c4cf1-5e40-42ea-82ef-fbb5e57c3883 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045319 Jul 02 21:11:32.744393 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1319/2674] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:32.752583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:32.753751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:32.770469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.774031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.775123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.775748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.917806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:32.930311 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-35b29665-fb97-42f6-9f1d-e3821cbaed56 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.464811 Jul 02 21:11:32.935895 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1356/2675] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:32 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:32.944558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:32.948279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:32.959156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.959755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:32.960684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:32.961180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.044779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:33.044779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:33.056662 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e34ae85-eef3-467c-91bb-ffcc1a4af0f9 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.310745 Jul 02 21:11:33.057261 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1320/2676] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:32 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:33.068729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:33.069724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:33.081804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:33.082486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.083542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:33.084239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.331804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:33.341772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:33.348310 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8f323f8-56e0-408b-bed2-1a4f6540c784 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1382 microversion: 2.1 time: 0.408266 Jul 02 21:11:33.349453 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1357/2677] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:32 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1382 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:11:33.357058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:33.365085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93df2e04-4da7-42d4-878e-f1b06192fddf tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.306786 Jul 02 21:11:33.365709 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1321/2678] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:33 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:33.372005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3041865c-369b-4eea-8130-7b6e4d19b973 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79af0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:33.372851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:33.373478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:33.388624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:33.389585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.389871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:33.390312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.467154 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3041865c-369b-4eea-8130-7b6e4d19b973 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.099054 Jul 02 21:11:33.468130 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1322/2679] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:33 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:33.480350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:33.481184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:33.489520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:33.490335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.491334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:33.492344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:33.968121 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14728058-a6a3-4eb9-9f46-a95c7968c7d2 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1533 microversion: 2.1 time: 0.494562 Jul 02 21:11:33.979594 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1323/2680] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:33 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1533 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:33.984588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:33.985279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:33.993412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:34.009285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:34.010808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:34.011938 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e6df7c4-04b2-4b38-97d3-ae80345b5474 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.661111 Jul 02 21:11:34.020182 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1358/2681] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:33 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:34.029764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.030495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.031736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.032443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.034759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:34.036571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:34.052275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.053934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.054782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.057250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.556445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:34.583273 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7a7c85e-3337-4e8f-a555-3af37c6b2d4c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.600217 Jul 02 21:11:34.599259 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1324/2682] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:33 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:34.613115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:34.614004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:34.633410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.633410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.633784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.636411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.750392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:34.766654 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e32bde2-22cc-470b-9de3-5393bcf36601 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.743431 Jul 02 21:11:34.767245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1359/2683] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:34 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:34.778215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:34.779175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:34.786702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.787502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:34.788791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:34.789483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:35.395039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:35.407464 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec62601a-0d6c-40b7-86b5-9fbe8884020c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1527 microversion: 2.1 time: 0.806695 Jul 02 21:11:35.410818 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1325/2684] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:34 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1527 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:35.422895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:35.424748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:35.438190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:35.438655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:35.439442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:35.439865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:35.571739 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c637eba1-98fe-477e-92d8-c8531512bfc9 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1533 microversion: 2.1 time: 0.799601 Jul 02 21:11:35.574278 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1360/2685] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:34 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1533 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:35.590453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0055467-6b23-4386-9f3a-183a197a882c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea15ba60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:35.664815 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0055467-6b23-4386-9f3a-183a197a882c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.089313 Jul 02 21:11:35.665499 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1361/2686] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:35 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:35.679698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1591203133"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:35.682996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:35.701638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:35.702461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:35.703469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:35.704825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.172153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad236748-2fa7-4684-94c4-b64db2a72667 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.501612 Jul 02 21:11:36.178834 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1362/2687] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:11:35 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 02 21:11:36.209227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7346a39-12a0-4dfd-bcd7-d071903b31fa", "name": "network-vif-plugged", "status": "completed", "tag": "c65d66d3-c08d-4225-8f62-5bf5c3a1acf6"}, {"server_uuid": "26828266-c477-42c6-ac81-2283d61b7d0f", "name": "network-vif-plugged", "status": "completed", "tag": "44d6c19e-b2d8-4697-a88f-c34982008bfa"}, {"server_uuid": "9f40d87e-0e90-421d-b8b4-08f7935d0ed2", "name": "network-vif-plugged", "status": "completed", "tag": "43a57b84-c82a-4d4a-89a8-a574a846d8f8"}, {"server_uuid": "27fa2b45-ce8c-4055-9576-bf03a6b2a1ad", "name": "network-vif-unplugged", "status": "completed", "tag": "6d4724a8-a78b-4ebe-b6b7-80f71e61daba"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:36.232339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.232929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.284730 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Creating event network-vif-plugged:c65d66d3-c08d-4225-8f62-5bf5c3a1acf6 for instance b7346a39-12a0-4dfd-bcd7-d071903b31fa on nch1-master-1 Jul 02 21:11:36.286990 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Creating event network-vif-plugged:44d6c19e-b2d8-4697-a88f-c34982008bfa for instance 26828266-c477-42c6-ac81-2283d61b7d0f on nch2-master-1 Jul 02 21:11:36.299772 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Creating event network-vif-plugged:43a57b84-c82a-4d4a-89a8-a574a846d8f8 for instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 on nch2-master-1 Jul 02 21:11:36.300431 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] Creating event network-vif-unplugged:6d4724a8-a78b-4ebe-b6b7-80f71e61daba for instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad on nch2-master-1 Jul 02 21:11:36.358247 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1e52d2a4-1e06-40e3-b41a-cf7a69830142 req-8e198bf5-6ad5-43ec-b1f7-cc749d21e141 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.165994 Jul 02 21:11:36.359569 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1363/2688] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:36.369047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:36.377952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:36.416321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.419922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.423360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.426379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.687163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:36.717206 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a788c8f1-3f19-48ae-b4a5-b751fa50820e tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 1.304229 Jul 02 21:11:36.720325 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1326/2689] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:35 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:36.741259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f5f1ca0-0a3f-49ea-abaa-c358016b83dc tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:36.745688 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:11:36.745688 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:11:36.750143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f5f1ca0-0a3f-49ea-abaa-c358016b83dc tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.751920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f5f1ca0-0a3f-49ea-abaa-c358016b83dc tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.753519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f5f1ca0-0a3f-49ea-abaa-c358016b83dc tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.755903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f5f1ca0-0a3f-49ea-abaa-c358016b83dc tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.837241 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f5f1ca0-0a3f-49ea-abaa-c358016b83dc tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.112612 Jul 02 21:11:36.842264 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1327/2690] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:11:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:36.858268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:36.860167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:36.869910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.870492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:36.871340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:36.872295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.034604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:37.058511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:37.060175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:37.061471 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e69f6e0-615a-4b70-999a-361fe5f4a1bc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.700225 Jul 02 21:11:37.064208 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1364/2691] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:36 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:37.069001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c93b181f-1db9-469b-8489-0bc7519b2aea req-2508731a-8aa2-4d6d-9acc-39b9c7ae64a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fa2b45-ce8c-4055-9576-bf03a6b2a1ad", "name": "network-vif-deleted", "tag": "6d4724a8-a78b-4ebe-b6b7-80f71e61daba"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:37.090719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c93b181f-1db9-469b-8489-0bc7519b2aea req-2508731a-8aa2-4d6d-9acc-39b9c7ae64a7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.091527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c93b181f-1db9-469b-8489-0bc7519b2aea req-2508731a-8aa2-4d6d-9acc-39b9c7ae64a7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.106274 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c93b181f-1db9-469b-8489-0bc7519b2aea req-2508731a-8aa2-4d6d-9acc-39b9c7ae64a7 service nova] Creating event network-vif-deleted:6d4724a8-a78b-4ebe-b6b7-80f71e61daba for instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad on nch2-master-1 Jul 02 21:11:37.112103 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c93b181f-1db9-469b-8489-0bc7519b2aea req-2508731a-8aa2-4d6d-9acc-39b9c7ae64a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048502 Jul 02 21:11:37.112976 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1365/2692] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:37.120560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:37.121599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:37.129918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.130727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.131785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.132596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.171407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.171927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.172485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lazy-loading 'fault' on Instance uuid 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:11:37.279794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:37.294794 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ea813d3-3133-448b-a3ec-0bf92b16cccd tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 200 len: 1315 microversion: 2.1 time: 0.180203 Jul 02 21:11:37.305098 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1366/2693] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:37 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:37.305098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45b97bca-9704-401a-b404-06ea84cea506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea130d30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:37.362047 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45b97bca-9704-401a-b404-06ea84cea506 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.064664 Jul 02 21:11:37.363038 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1367/2694] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:37 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:37.373244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:37.384000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:37.384354 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2237fbc5-750e-4e96-ad3f-fd406c9b079e tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1403 microversion: 2.1 time: 0.538489 Jul 02 21:11:37.384868 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1328/2695] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:36 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1403 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:37.386395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:37.393642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.394502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.395589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.396538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.433527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lazy-loading 'flavor' on Instance uuid ee72b452-80bd-4468-af1c-fd8177722316 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:11:37.449048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Going to try to live migrate instance to nch1-master-1 {{(pid=131045) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:11:37.737980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:37.739254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:37.752835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.756783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:37.762088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:37.763311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.042190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:38.051721 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2b9ac18-4943-4d35-9c78-f60e3fcbfef7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1322 microversion: 2.1 time: 0.321773 Jul 02 21:11:38.055362 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1329/2696] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:37 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:38.085847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:38.117537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:38.143463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.144324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.149950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.151991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.388231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:38.401934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:38.403549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:38.405079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c1f6e83-b490-41e2-948a-84712666efbb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.330276 Jul 02 21:11:38.405742 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1330/2697] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:38 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:11:38.410700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:38.418900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:38.438174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.439202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.440300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.440974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.467661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad HTTP/1.1 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '27fa2b45-ce8c-4055-9576-bf03a6b2a1ad'} Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:38.470720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:38.475843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:38.477107 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a5c2b0a-82ee-445d-b464-d63f42a20849 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 404 len: 111 microversion: 2.1 time: 0.070198 Jul 02 21:11:38.478288 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1331/2698] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:38 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:38.483273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14d8ac00-8db3-420b-9f5a-49e6e11964f4 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea1535e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:38.575368 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14d8ac00-8db3-420b-9f5a-49e6e11964f4 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.095649 Jul 02 21:11:38.576363 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1332/2699] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:38 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:38.582354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-98154bca-2960-4a03-add4-361d6c60f706 req-4d32ccc2-77b6-4889-a1c4-1ef8d33d0c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740c4ead-8987-472d-be4b-affd0c8977b1", "name": "network-vif-plugged", "status": "completed", "tag": "ed2daaf0-b76a-4200-8f10-f7dc286dbe4e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:38.612751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-98154bca-2960-4a03-add4-361d6c60f706 req-4d32ccc2-77b6-4889-a1c4-1ef8d33d0c36 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.614464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-98154bca-2960-4a03-add4-361d6c60f706 req-4d32ccc2-77b6-4889-a1c4-1ef8d33d0c36 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.627784 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-98154bca-2960-4a03-add4-361d6c60f706 req-4d32ccc2-77b6-4889-a1c4-1ef8d33d0c36 service nova] Creating event network-vif-plugged:ed2daaf0-b76a-4200-8f10-f7dc286dbe4e for instance 740c4ead-8987-472d-be4b-affd0c8977b1 on nch1-master-1 Jul 02 21:11:38.635670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-98154bca-2960-4a03-add4-361d6c60f706 req-4d32ccc2-77b6-4889-a1c4-1ef8d33d0c36 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056858 Jul 02 21:11:38.636663 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1333/2700] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:38.644608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:38.646723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:38.658544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.659968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.661051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:38.661698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:38.911719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:38.944355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5d6b687-a98e-48d9-81dc-8e39f9d9c801 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1589 microversion: 2.1 time: 0.305676 Jul 02 21:11:38.949088 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1334/2701] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:38 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1589 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:38.976336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1153369425", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:39.040096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] validate_networks() for [('f32f817d-1623-4050-b8c2-1a51b0a242c7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:11:39.593334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:11:39.594326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:11:39.595251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:11:39.595862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:11:39.596632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:11:39.610845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:39.611904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:39.612962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:39.613629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:39.636646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for project dffcfd79372c47e89be4acbdc042d510. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:11:39.643576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Getting quotas for user b3b24a3216aa4eba8a9a90c109c3b491 and project dffcfd79372c47e89be4acbdc042d510. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:11:39.657833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:11:39.660812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:11:39.725653 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63cba224-0d7b-45c9-8335-25529f3f72fc tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.773704 Jul 02 21:11:39.727375 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1335/2702] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:11:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:11:39.733808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:39.734310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:39.743208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:39.743933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:39.744933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:39.745630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:39.850466 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-788b964f-1f3d-4f97-98ab-ea5b7a8e5da8 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121754 Jul 02 21:11:39.851686 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1336/2703] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:11:39 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:39.858959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:39.861266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:39.880601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:39.883846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:39.884933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:39.886605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.186879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:40.198251 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8720c14-35a9-40a2-ac54-3ac207bc05bf tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 200 len: 1515 microversion: 2.1 time: 0.344872 Jul 02 21:11:40.199188 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1337/2704] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:39 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 1515 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:40.203996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ce7473bf-ca5e-47f5-92ee-d217158fc96d req-a8d4ba2a-2b30-4330-8024-78c6e50ebff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:40.221465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ce7473bf-ca5e-47f5-92ee-d217158fc96d req-a8d4ba2a-2b30-4330-8024-78c6e50ebff2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.222282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ce7473bf-ca5e-47f5-92ee-d217158fc96d req-a8d4ba2a-2b30-4330-8024-78c6e50ebff2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.236150 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ce7473bf-ca5e-47f5-92ee-d217158fc96d req-a8d4ba2a-2b30-4330-8024-78c6e50ebff2 service nova] Creating event network-changed:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:11:40.244271 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ce7473bf-ca5e-47f5-92ee-d217158fc96d req-a8d4ba2a-2b30-4330-8024-78c6e50ebff2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043527 Jul 02 21:11:40.246764 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1338/2705] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:40.259167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:40.260404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:40.269269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.270262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.272735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.273496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.591567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:40.603264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:40.606333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:40.622772 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47a74f39-66d8-411f-bf4b-a35088a471b5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.364014 Jul 02 21:11:40.634692 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1339/2706] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:40 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:40.643129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-341a06d5-53ed-48ce-bef6-83a57624198f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0b13a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:40.717116 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-341a06d5-53ed-48ce-bef6-83a57624198f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1453 microversion: 2.1 time: 0.080870 Jul 02 21:11:40.718068 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1340/2707] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:40 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:40.724216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:40.725087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:40.735924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.736982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.738252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.739048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.921556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:40.933894 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d3500a1-c560-4433-84f8-ee95c17d27d7 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1229 microversion: 2.1 time: 0.214363 Jul 02 21:11:40.945239 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1341/2708] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:40 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1229 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:40.951953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:40.953838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:40.961886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.962992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:40.964349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:40.965285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:41.144704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:41.162439 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c9f25ec-6f19-4a34-9614-88e574398d65 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 200 len: 1322 microversion: 2.1 time: 0.215877 Jul 02 21:11:41.165144 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1342/2709] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:40 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:41.641078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:41.642433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:41.668893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:41.670030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:41.672326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:41.674704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:42.098067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:42.106708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:42.108248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:42.109769 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df2c45ca-2460-40b8-8b08-6d308fc19f06 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.474002 Jul 02 21:11:42.110485 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1343/2710] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:41 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:11:42.126943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2e20160-5c88-40bf-a0f0-7f957486af3f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79af3a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:43.713109 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1670f79b-83da-488f-98dd-2dc9f4b85b5d tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316/action" status: 202 len: 0 microversion: 2.1 time: 6.348031 Jul 02 21:11:43.714390 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1368/2711] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:11:37 2022] POST /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316/action => generated 0 bytes in 6350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:11:43.725644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:43.747955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:43.775374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:43.791218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:43.794144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:43.796388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:45.527226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:45.543827 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-15d0ab7d-b122-45f1-9fba-dc3347ace42f tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1589 microversion: 2.1 time: 1.827692 Jul 02 21:11:45.545647 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1369/2712] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:43 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1589 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:45.558656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-81e3e8ac-b10a-43b7-b58b-f2d56774a523 req-defdf32e-24e9-4854-963f-e2fb9636ef38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7346a39-12a0-4dfd-bcd7-d071903b31fa", "tag": "c65d66d3-c08d-4225-8f62-5bf5c3a1acf6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:45.581206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-81e3e8ac-b10a-43b7-b58b-f2d56774a523 req-defdf32e-24e9-4854-963f-e2fb9636ef38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:45.583356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-81e3e8ac-b10a-43b7-b58b-f2d56774a523 req-defdf32e-24e9-4854-963f-e2fb9636ef38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:45.616956 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-81e3e8ac-b10a-43b7-b58b-f2d56774a523 req-defdf32e-24e9-4854-963f-e2fb9636ef38 service nova] Creating event network-changed:c65d66d3-c08d-4225-8f62-5bf5c3a1acf6 for instance b7346a39-12a0-4dfd-bcd7-d071903b31fa on nch1-master-1 Jul 02 21:11:45.631517 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-81e3e8ac-b10a-43b7-b58b-f2d56774a523 req-defdf32e-24e9-4854-963f-e2fb9636ef38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083955 Jul 02 21:11:45.639493 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1370/2713] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:45.646496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:45.650118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:45.672405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:45.675547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:45.680769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:45.681649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:47.552709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:47.572279 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-943cd79f-f577-4aec-9c4b-ccb5803ce8ab tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 1.926688 Jul 02 21:11:47.573564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1371/2714] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:45 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:47.599468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ff865b93-6918-4c2a-8079-f4ea4df2a232 req-78c48812-eed5-4def-b17d-712e341581e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-plugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:47.761198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ff865b93-6918-4c2a-8079-f4ea4df2a232 req-78c48812-eed5-4def-b17d-712e341581e3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:47.761768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ff865b93-6918-4c2a-8079-f4ea4df2a232 req-78c48812-eed5-4def-b17d-712e341581e3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:47.780368 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ff865b93-6918-4c2a-8079-f4ea4df2a232 req-78c48812-eed5-4def-b17d-712e341581e3 service nova] Creating event network-vif-plugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:11:47.799065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ff865b93-6918-4c2a-8079-f4ea4df2a232 req-78c48812-eed5-4def-b17d-712e341581e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219106 Jul 02 21:11:47.802260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1372/2715] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:47.815650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:47.819877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:47.833447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:47.834246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:47.835373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:47.838201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:48.302060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:48.344508 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cbc433ae-e8d7-4d4e-811a-2ac9c2d7c3b8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 200 len: 1516 microversion: 2.1 time: 0.513869 Jul 02 21:11:48.348234 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1373/2716] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:47 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 1516 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:48.371523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:48.374264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:48.424240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:48.424824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:48.431055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:48.436688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:49.398496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:49.414754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:49.416333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:49.419276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd78dd6b-5bcc-477e-a9f5-28fb474641be tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 1.066349 Jul 02 21:11:49.422314 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1374/2717] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:48 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:49.443491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:49.444456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:49.465188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:49.466708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:49.470178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:49.471267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:49.501239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:49.627887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:49.652320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:49.848086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:49.871217 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a366db1b-6053-4c71-9b47-18761ab37bd2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.436899 Jul 02 21:11:49.873085 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1375/2718] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:49 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:49.882803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:49.884545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:49.901812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:49.905241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:49.906992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:49.908993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.315711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:50.325653 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-636634b0-cfdd-4e85-bea6-b433225760bc tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 200 len: 1516 microversion: 2.1 time: 0.451096 Jul 02 21:11:50.339263 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1376/2719] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:49 2022] GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 1516 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:50.351301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2eb82b0f-9ade-4d63-8ef9-ae58ef6be92f req-67eb80f1-f968-460d-a782-9185826742b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7accf6a8-277e-4f91-ae02-b25ba6e600a9", "tag": "ce919a9a-b4bd-4d1a-a83b-bc6e634bb993"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:50.378855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2eb82b0f-9ade-4d63-8ef9-ae58ef6be92f req-67eb80f1-f968-460d-a782-9185826742b6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:50.379715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2eb82b0f-9ade-4d63-8ef9-ae58ef6be92f req-67eb80f1-f968-460d-a782-9185826742b6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.403854 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2eb82b0f-9ade-4d63-8ef9-ae58ef6be92f req-67eb80f1-f968-460d-a782-9185826742b6 service nova] Creating event network-changed:ce919a9a-b4bd-4d1a-a83b-bc6e634bb993 for instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 on nch2-master-1 Jul 02 21:11:50.413276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2eb82b0f-9ade-4d63-8ef9-ae58ef6be92f req-67eb80f1-f968-460d-a782-9185826742b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070972 Jul 02 21:11:50.414568 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1377/2720] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:50.421225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:50.422200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:50.430869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:50.431879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.432939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:50.433519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.710484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:50.718514 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5e301dd2-54ff-4b72-9899-2f9363384ce4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.302533 Jul 02 21:11:50.730443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1378/2721] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:50 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:50.741101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7bd523c4-0eb9-49d2-96a6-73b4f0f65b25 req-4b34c1ec-aa96-4c5c-b8a7-57d5a9147bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "name": "network-vif-plugged", "status": "completed", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:50.763144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7bd523c4-0eb9-49d2-96a6-73b4f0f65b25 req-4b34c1ec-aa96-4c5c-b8a7-57d5a9147bb1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:50.763861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7bd523c4-0eb9-49d2-96a6-73b4f0f65b25 req-4b34c1ec-aa96-4c5c-b8a7-57d5a9147bb1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.806606 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7bd523c4-0eb9-49d2-96a6-73b4f0f65b25 req-4b34c1ec-aa96-4c5c-b8a7-57d5a9147bb1 service nova] Creating event network-vif-plugged:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:11:50.838298 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7bd523c4-0eb9-49d2-96a6-73b4f0f65b25 req-4b34c1ec-aa96-4c5c-b8a7-57d5a9147bb1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091891 Jul 02 21:11:50.838970 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1379/2722] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:50.862562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:50.863813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:50.870740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:50.871422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.876354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:50.877004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:50.968234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:11:51.121620 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2c04d0ce-3193-4892-b234-e771109da1ca tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "DELETE /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 204 len: 0 microversion: 2.1 time: 0.279670 Jul 02 21:11:51.125748 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1380/2723] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:50 2022] DELETE /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:51.130735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:51.131729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:51.138668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.139687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.141525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.143534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.341990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:51.355703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:51.357805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:51.360661 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-31ef95ae-04bd-4ead-b240-10ff304a01d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.234927 Jul 02 21:11:51.372738 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1381/2724] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:51 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:51.376697 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2e20160-5c88-40bf-a0f0-7f957486af3f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1462 microversion: 2.1 time: 9.254504 Jul 02 21:11:51.378387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:51.379002 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1344/2725] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:42 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1462 bytes in 9257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:51.379397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:51.390087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.390541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.391461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.391911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.398256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:51.399320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:51.418641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.420327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.421371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.423441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.447476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:51.726979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:51.735987 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a07aa91a-cf80-4533-b275-141676186126 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 200 len: 1522 microversion: 2.1 time: 0.347971 Jul 02 21:11:51.736931 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1345/2726] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:51 2022] GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:51.743293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83bc3bb2-c3c1-49c8-ad94-9dd8a88decb8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea26a9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:51.764369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:51.772952 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3fd0aaa6-3c85-43af-8cbf-ef52191cb96e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.398934 Jul 02 21:11:51.774062 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1382/2727] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:51 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:51.779250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:51.779857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:51.792938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.793478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.794186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.794808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.834859 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83bc3bb2-c3c1-49c8-ad94-9dd8a88decb8 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 200 len: 1462 microversion: 2.1 time: 0.091100 Jul 02 21:11:51.835752 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1346/2728] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:51 2022] GET /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 1462 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:51.852658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:51.858699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:51.876322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.876775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:51.877558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:51.877993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:52.109298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:52.119495 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ec8726d8-da4d-4b47-96c0-42a564b3c204 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.344168 Jul 02 21:11:52.120609 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1383/2729] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:51 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:52.159483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:52.169318 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-982ffb6a-6eef-47f1-b3f6-c261b072f330 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1481 microversion: 2.1 time: 0.320013 Jul 02 21:11:52.179683 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1347/2730] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:51 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1481 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:52.379652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:52.380351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:52.390477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:52.391080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:52.391929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:52.392445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:52.609993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:52.619621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:52.621220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:52.622642 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db9c178b-789d-4d7c-b55c-c474fbf4f43a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 0.247518 Jul 02 21:11:52.632766 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1384/2731] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:52 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:11:52.753541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:52.754259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:52.765938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:52.766848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:52.767722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:52.768461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:52.793191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:52.794496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:52.808650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:52.809598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:52.810756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:52.813192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:53.172525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:53.186848 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0b6dff7-c71b-4ba7-a2cc-511e0f4c8ef6 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.399280 Jul 02 21:11:53.193607 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1385/2732] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:52 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:53.202893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:53.205508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:53.214747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:53.215346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:53.216694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:53.217261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:53.389924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:53.400362 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dc9b2bc-f810-47df-99e1-747c9d7c5b26 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 200 len: 1522 microversion: 2.1 time: 0.651852 Jul 02 21:11:53.408473 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1348/2733] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:52 2022] GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:53.424472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:53.427082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:53.463537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:53.464293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:53.465991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:53.471426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:53.522488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:53.530956 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ac9b152-a5f3-45ee-af36-ee479ed839b4 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.334212 Jul 02 21:11:53.531554 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1386/2734] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:53 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:53.647585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:53.649293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:53.675892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:53.680173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:53.681062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:53.681515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:54.867240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:54.884339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:54.895578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:54.899396 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-277d466f-25f7-4f80-a262-d3fd17276aaa tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1468 microversion: 2.1 time: 1.489540 Jul 02 21:11:54.902581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1349/2735] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:53 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1468 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:54.906119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:54.908920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:54.909827 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-58385240-5b73-4f71-9dea-230a409e54e2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1406 microversion: 2.20 time: 1.269018 Jul 02 21:11:54.910441 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1387/2736] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:53 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1406 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:11:54.912470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:54.914794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:54.926486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:54.927377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:54.928914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:54.929887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:54.940073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-63cee83e-b3d3-46d7-8c2e-23d6436a5f26 req-2b2be3a6-6243-4efa-83c5-e5f0151b9c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26828266-c477-42c6-ac81-2283d61b7d0f", "name": "network-vif-deleted", "tag": "44d6c19e-b2d8-4697-a88f-c34982008bfa"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:54.968561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63cee83e-b3d3-46d7-8c2e-23d6436a5f26 req-2b2be3a6-6243-4efa-83c5-e5f0151b9c3b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:54.969047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63cee83e-b3d3-46d7-8c2e-23d6436a5f26 req-2b2be3a6-6243-4efa-83c5-e5f0151b9c3b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:54.999717 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-63cee83e-b3d3-46d7-8c2e-23d6436a5f26 req-2b2be3a6-6243-4efa-83c5-e5f0151b9c3b service nova] Creating event network-vif-deleted:44d6c19e-b2d8-4697-a88f-c34982008bfa for instance 26828266-c477-42c6-ac81-2283d61b7d0f on nch2-master-1 Jul 02 21:11:55.006489 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-63cee83e-b3d3-46d7-8c2e-23d6436a5f26 req-2b2be3a6-6243-4efa-83c5-e5f0151b9c3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080579 Jul 02 21:11:55.008886 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1388/2737] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:55.017669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:55.019375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:55.028492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.029199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.030906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.037560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.106548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.107413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.108458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lazy-loading 'fault' on Instance uuid 26828266-c477-42c6-ac81-2283d61b7d0f {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:11:55.193966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:55.202999 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9db4674-6e93-4a52-8929-b1837edb7624 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 200 len: 1312 microversion: 2.1 time: 0.192415 Jul 02 21:11:55.204875 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1389/2738] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:55 2022] GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:55.222179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:55.223787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:55.232303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.233127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.234122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.234892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.379954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:55.394097 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6caf1f1b-b314-4f05-9e5c-c49193bee1bd tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.490070 Jul 02 21:11:55.395568 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1350/2739] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:54 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:55.404508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1077189280"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:55.406053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:55.413679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.414464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.415794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.417300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.522497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:55.532187 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7b2d6ddd-c652-4cd2-b4e8-178ab54da9c8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.325809 Jul 02 21:11:55.544451 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1390/2740] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:55 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:55.549510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a6b30ac7-3fed-464f-94db-15c8dbf98be8 req-133e92e4-6ade-4ba9-b320-b6da9c343685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee72b452-80bd-4468-af1c-fd8177722316", "name": "network-vif-unplugged", "status": "completed", "tag": "941d18af-3acd-4e23-9a90-9b6c5e6a1f84"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:55.572020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a6b30ac7-3fed-464f-94db-15c8dbf98be8 req-133e92e4-6ade-4ba9-b320-b6da9c343685 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.572497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a6b30ac7-3fed-464f-94db-15c8dbf98be8 req-133e92e4-6ade-4ba9-b320-b6da9c343685 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.601262 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a6b30ac7-3fed-464f-94db-15c8dbf98be8 req-133e92e4-6ade-4ba9-b320-b6da9c343685 service nova] Creating event network-vif-unplugged:941d18af-3acd-4e23-9a90-9b6c5e6a1f84 for instance ee72b452-80bd-4468-af1c-fd8177722316 on nch2-master-1 Jul 02 21:11:55.622106 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a6b30ac7-3fed-464f-94db-15c8dbf98be8 req-133e92e4-6ade-4ba9-b320-b6da9c343685 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076206 Jul 02 21:11:55.623084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1391/2741] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:55.931658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:55.933251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:55.951802 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34074fca-2497-49c7-a2c4-6cf7aaefd450 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "POST /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818/action" status: 202 len: 0 microversion: 2.1 time: 0.554468 Jul 02 21:11:55.959122 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1351/2742] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:11:55 2022] POST /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:11:55.959998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.960501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.961492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:55.962127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:55.966573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-739f247b-1f9b-4cbf-ac48-18bd9e746e18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea206280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.064853 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-739f247b-1f9b-4cbf-ac48-18bd9e746e18 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.102032 Jul 02 21:11:56.073847 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1352/2743] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:55 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:56.222519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.224231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:56.248871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:56.251903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:56.262233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:56.264688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:56.266341 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca63494c-4b3a-4185-8808-aa421450e1b7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1598 microversion: 2.20 time: 0.341568 Jul 02 21:11:56.272117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.272666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.273529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.276392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.280666 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1392/2744] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:11:55 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1598 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:11:56.288860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.289763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:56.297471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.298178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.299150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.299610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.314466 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] HTTP exception thrown: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f HTTP/1.1 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '26828266-c477-42c6-ac81-2283d61b7d0f'} Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:56.316931 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:56.322669 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.325127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 404 to user: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:56.326351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-535e80d5-aec9-4a67-a640-cf1bca8ef10d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 404 len: 111 microversion: 2.1 time: 0.108262 Jul 02 21:11:56.328150 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1353/2745] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:56 2022] GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:56.350926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.356105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:56.357275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:56.368406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.369195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.370645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.371369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.440787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e9e17ea-ede4-43b7-a855-e52c7fbd7e0f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158774 Jul 02 21:11:56.448156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1393/2746] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:11:56 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:11:56.454988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.458827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:56.467032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.467875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.469002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.469590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.521087 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87b944e0-2d58-44cc-afe7-f029fb0b0032 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.187846 Jul 02 21:11:56.521695 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1354/2747] 10.222.0.43 () {58 vars in 1229 bytes} [Sat Jul 2 21:11:56 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:11:56.548491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08778d1b-090a-4ad1-a02c-2d3b0fd158cb tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08778d1b-090a-4ad1-a02c-2d3b0fd158cb tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 02 21:11:56.551345 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08778d1b-090a-4ad1-a02c-2d3b0fd158cb tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:56.556571 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08778d1b-090a-4ad1-a02c-2d3b0fd158cb tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011966 Jul 02 21:11:56.564309 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1355/2748] 10.222.0.43 () {58 vars in 1181 bytes} [Sat Jul 2 21:11:56 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:11:56.570790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:56.571410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:56.593271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.593725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:56.607220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:56.607850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:57.078442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:57.102729 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02d1b25c-1c08-42d5-b87c-85c1f381ca54 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.536902 Jul 02 21:11:57.104425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:57.106625 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1356/2749] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:56 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:57.120171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:57.123699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:57.134412 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0059042c-01ee-48b2-aaac-c1be748acb7d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.684749 Jul 02 21:11:57.135674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:57.136591 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1394/2750] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:56 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:57.152405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:57.153131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:57.154112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:57.156653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:57.228076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:11:57.267795 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a5b864a-0624-4331-b950-740bd9bf9b99 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.159890 Jul 02 21:11:57.268891 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1357/2751] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/servers => generated 681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:57.284414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5534f136-49af-4962-aeb6-9d5e6152736f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79a3e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:57.343102 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5534f136-49af-4962-aeb6-9d5e6152736f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.071909 Jul 02 21:11:57.344387 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1358/2752] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:57.349642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:57.353633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:57.354482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Removing options 'limit' from query {{(pid=131044) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 02 21:11:57.355357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:57.362450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:57.363164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:57.364492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:57.365099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:57.429730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:11:57.515543 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a607e36-8013-4cfa-9707-7e2a6829be7c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.169457 Jul 02 21:11:57.521505 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1359/2753] 10.222.0.43 () {58 vars in 1143 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:57.549953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba83b247-9e96-437b-b1aa-ba1a3bcc14e3 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba83b247-9e96-437b-b1aa-ba1a3bcc14e3 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '-1' Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 02 21:11:57.553908 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 02 21:11:57.558393 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.564376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba83b247-9e96-437b-b1aa-ba1a3bcc14e3 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:57.568289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba83b247-9e96-437b-b1aa-ba1a3bcc14e3 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.020673 Jul 02 21:11:57.569872 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1360/2754] 10.222.0.43 () {58 vars in 1141 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:11:57.648147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97c96937-9be4-4f9a-a857-9a2293641257 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97c96937-9be4-4f9a-a857-9a2293641257 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: action_args: {} Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'testing' Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 02 21:11:57.651379 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97c96937-9be4-4f9a-a857-9a2293641257 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97c96937-9be4-4f9a-a857-9a2293641257 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.051350 Jul 02 21:11:57.667675 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1361/2755] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:11:57.690270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db0d560c-7565-4352-a06e-0d09fc2ad388 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:57.694539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db0d560c-7565-4352-a06e-0d09fc2ad388 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:57.696592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db0d560c-7565-4352-a06e-0d09fc2ad388 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:57.770770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.servers [None req-db0d560c-7565-4352-a06e-0d09fc2ad388 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Flavor 'non_existing_flavor' could not be found {{(pid=131044) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 02 21:11:57.778967 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db0d560c-7565-4352-a06e-0d09fc2ad388 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.117871 Jul 02 21:11:57.780207 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1362/2756] 10.222.0.43 () {58 vars in 1177 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:11:57.884126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-20511969-174a-4aaf-a6c7-9e182aac5f3c req-631229eb-cbf1-4cbe-9b52-deab363fed74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7accf6a8-277e-4f91-ae02-b25ba6e600a9", "name": "network-vif-plugged", "status": "completed", "tag": "ce919a9a-b4bd-4d1a-a83b-bc6e634bb993"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:57.916997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-20511969-174a-4aaf-a6c7-9e182aac5f3c req-631229eb-cbf1-4cbe-9b52-deab363fed74 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:57.918033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-20511969-174a-4aaf-a6c7-9e182aac5f3c req-631229eb-cbf1-4cbe-9b52-deab363fed74 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:57.949575 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-20511969-174a-4aaf-a6c7-9e182aac5f3c req-631229eb-cbf1-4cbe-9b52-deab363fed74 service nova] Creating event network-vif-plugged:ce919a9a-b4bd-4d1a-a83b-bc6e634bb993 for instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 on nch2-master-1 Jul 02 21:11:57.963577 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-20511969-174a-4aaf-a6c7-9e182aac5f3c req-631229eb-cbf1-4cbe-9b52-deab363fed74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.825463 Jul 02 21:11:57.968000 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1395/2757] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:58.007401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:58.017468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:58.018469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:58.021702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-981ceb6b-dbeb-4e6c-9630-e47c7ffe4829 req-abeca94f-8bc0-4e7c-8115-87df7bdf7427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee72b452-80bd-4468-af1c-fd8177722316", "tag": "941d18af-3acd-4e23-9a90-9b6c5e6a1f84"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:11:58.025456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.026248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.027507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.028156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.050823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-981ceb6b-dbeb-4e6c-9630-e47c7ffe4829 req-abeca94f-8bc0-4e7c-8115-87df7bdf7427 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.061215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-981ceb6b-dbeb-4e6c-9630-e47c7ffe4829 req-abeca94f-8bc0-4e7c-8115-87df7bdf7427 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.127596 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-981ceb6b-dbeb-4e6c-9630-e47c7ffe4829 req-abeca94f-8bc0-4e7c-8115-87df7bdf7427 service nova] Creating event network-changed:941d18af-3acd-4e23-9a90-9b6c5e6a1f84 for instance ee72b452-80bd-4468-af1c-fd8177722316 on nch2-master-1 Jul 02 21:11:58.137098 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-981ceb6b-dbeb-4e6c-9630-e47c7ffe4829 req-abeca94f-8bc0-4e7c-8115-87df7bdf7427 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355620 Jul 02 21:11:58.137999 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1363/2758] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:58.144151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:58.145044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:58.153472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.154255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.155457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.156066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.260645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-435cc88e-f61d-407b-9209-c829729b00b5 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.282566 Jul 02 21:11:58.262079 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1396/2759] 10.222.0.43 () {58 vars in 1173 bytes} [Sat Jul 2 21:11:57 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:11:58.267594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:58.268654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:58.276689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.277525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.278576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.279662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.592877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:58.608504 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6719a42-3aa2-4058-b24a-9ffec6517fc2 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.469043 Jul 02 21:11:58.609092 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1364/2760] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:58 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:58.613834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:58.631011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:58.632997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:58.639151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.639824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.640817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.649635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.788131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:58.796940 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4428c6ab-7856-412f-82c9-45c73392eb94 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.533350 Jul 02 21:11:58.800944 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1397/2761] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:58 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:58.813429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d021cfc-13cd-454d-ac7c-d3f36b43b71e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd78a1280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:58.838738 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-666860a3-6b93-4400-b3d2-12ea47f73b2a tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.228268 Jul 02 21:11:58.840289 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1365/2762] 10.222.0.43 () {58 vars in 1183 bytes} [Sat Jul 2 21:11:58 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:11:58.853653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:58.860382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:58.861372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:58.869227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.870211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.871243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.871867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:58.891979 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d021cfc-13cd-454d-ac7c-d3f36b43b71e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.086841 Jul 02 21:11:58.892613 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1398/2763] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:11:58 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:58.913553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:11:58.981696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:58.994816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:58.996455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.293688 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-201a85c4-b95e-4f49-8dab-ffb414b6a473 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.444775 Jul 02 21:11:59.294384 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1366/2764] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:11:58 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:59.315513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a7a62b2f-46d3-4fae-840f-6d7d8b6b049d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.318982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a7a62b2f-46d3-4fae-840f-6d7d8b6b049d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:59.320286 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a7a62b2f-46d3-4fae-840f-6d7d8b6b049d tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.009879 Jul 02 21:11:59.321321 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1399/2765] 10.222.0.43 () {58 vars in 1177 bytes} [Sat Jul 2 21:11:59 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:11:59.336621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.340525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:59.341547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Searching by: {'deleted': False, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:11:59.347364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.359489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.362366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.364937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.411344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:11:59.463116 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df927878-151f-4881-8342-ec20dafe139c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.133776 Jul 02 21:11:59.472404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1367/2766] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:11:59 2022] GET /compute/v2.1/servers => generated 681 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:11:59.477964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.478493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:59.489730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.490320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.491301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.492163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.518932 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] HTTP exception thrown: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f HTTP/1.1 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '26828266-c477-42c6-ac81-2283d61b7d0f'} Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:11:59.520891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:11:59.525435 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:11:59.526881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 404 to user: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:11:59.527910 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59c064a2-6339-4a54-9727-8ae63664e238 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "DELETE /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 404 len: 111 microversion: 2.1 time: 0.054301 Jul 02 21:11:59.528651 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1400/2767] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:59 2022] DELETE /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:11:59.537681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.538347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:59.544861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.545421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.546334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.546847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.563031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:59.579026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:11:59.625674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.626310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:59.634755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.635211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.635998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.636462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.719001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0206a7db-0a4f-4cd2-bafe-dd0f674a97b0 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "DELETE /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 204 len: 0 microversion: 2.1 time: 0.185397 Jul 02 21:11:59.722950 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1368/2768] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:59 2022] DELETE /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:11:59.728603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.729217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:59.742316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.742781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.743588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.744021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.780234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:11:59.883798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:11:59.895396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2dcaed55-100a-4d32-be04-33b07a498139 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1325 microversion: 2.1 time: 0.273545 Jul 02 21:11:59.897174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1401/2769] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:59 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1325 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:11:59.908313 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6808673-aba9-40f8-aad0-d3cc201acf14 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 204 len: 0 microversion: 2.1 time: 0.183779 Jul 02 21:11:59.909244 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1369/2770] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:11:59 2022] DELETE /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:11:59.914971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.915689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:59.921851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:11:59.924452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:11:59.945906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.948689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.949861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:11:59.950893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.953380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.965555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.966281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:11:59.967271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:11:59.967879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.251044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:00.261622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bda9bb95-64b1-493a-9693-8312883d5cd8 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.350896 Jul 02 21:12:00.273069 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1370/2771] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:59 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:00.277769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:00.292650 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d6015c43-c56c-438c-a6ff-e348e6ffa5ab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.393653 Jul 02 21:12:00.295046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1299aafb-28a0-41de-b874-ccefe9514ea1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0c1940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:00.299676 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1402/2772] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:11:59 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:00.305731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:00.308743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 26828266-c477-42c6-ac81-2283d61b7d0f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:00.322173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.322741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.323605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.325061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.348815 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] HTTP exception thrown: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f HTTP/1.1 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '26828266-c477-42c6-ac81-2283d61b7d0f'} Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:00.350819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. Jul 02 21:12:00.355368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:00.357629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 404 to user: Instance 26828266-c477-42c6-ac81-2283d61b7d0f could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:00.358675 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6dc7cd7-e90b-4a44-94d7-23ea4cae5df7 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f" status: 404 len: 111 microversion: 2.1 time: 0.057686 Jul 02 21:12:00.359354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1403/2773] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:00 2022] GET /compute/v2.1/servers/26828266-c477-42c6-ac81-2283d61b7d0f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:00.365538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-33dc975c-1d61-4f18-b7b5-b1f2e3d5044f req-f7f2f20e-ad39-4d32-86ad-b17ad6a1d491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f04307a-39d1-4497-acb0-17ba192336bc", "name": "network-vif-unplugged", "status": "completed", "tag": "77b42318-cb32-44f7-833d-f1bb938eae91"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:00.376215 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1299aafb-28a0-41de-b874-ccefe9514ea1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.090530 Jul 02 21:12:00.380325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-33dc975c-1d61-4f18-b7b5-b1f2e3d5044f req-f7f2f20e-ad39-4d32-86ad-b17ad6a1d491 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.380474 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1371/2774] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:00 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:00.380573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-33dc975c-1d61-4f18-b7b5-b1f2e3d5044f req-f7f2f20e-ad39-4d32-86ad-b17ad6a1d491 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.384268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5818211d-51a4-4338-807f-339ea2edeb0b req-d22bacf3-c534-493f-9378-4adbdc1e2bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:00.391216 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-33dc975c-1d61-4f18-b7b5-b1f2e3d5044f req-f7f2f20e-ad39-4d32-86ad-b17ad6a1d491 service nova] Creating event network-vif-unplugged:77b42318-cb32-44f7-833d-f1bb938eae91 for instance 6f04307a-39d1-4497-acb0-17ba192336bc on nch1-master-1 Jul 02 21:12:00.392535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5818211d-51a4-4338-807f-339ea2edeb0b req-d22bacf3-c534-493f-9378-4adbdc1e2bc1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.393127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5818211d-51a4-4338-807f-339ea2edeb0b req-d22bacf3-c534-493f-9378-4adbdc1e2bc1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.396642 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-33dc975c-1d61-4f18-b7b5-b1f2e3d5044f req-f7f2f20e-ad39-4d32-86ad-b17ad6a1d491 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035679 Jul 02 21:12:00.397848 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1404/2775] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:00.404469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-49217768"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:00.406247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:00.408179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5818211d-51a4-4338-807f-339ea2edeb0b req-d22bacf3-c534-493f-9378-4adbdc1e2bc1 service nova] Creating event network-changed:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:12:00.413462 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5818211d-51a4-4338-807f-339ea2edeb0b req-d22bacf3-c534-493f-9378-4adbdc1e2bc1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035459 Jul 02 21:12:00.414425 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1372/2776] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:00.419747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:00.420293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:00.420520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.421574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.422388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.422836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.426629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.427088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.427871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.428341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.599196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:00.611334 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ba51fbf-40ee-419f-919b-4a951d4abf5c tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 200 len: 1522 microversion: 2.1 time: 0.194693 Jul 02 21:12:00.613401 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1373/2777] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:00 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:00.785030 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94649cfd-6851-4d7a-9168-7f28d4d585fb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.385558 Jul 02 21:12:00.785709 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1405/2778] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:12:00 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 02 21:12:00.912985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:00.913644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:00.920329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.920784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:00.921559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:00.921992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.063226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:01.071262 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5714eea-a9e2-471c-830a-15cbcb1e9b81 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1522 microversion: 2.1 time: 0.162146 Jul 02 21:12:01.072197 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1374/2779] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:00 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:01.094169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:01.095158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:01.103158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.103721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.104407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.105379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.133877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:01.228530 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-95b2b02a-6be5-476d-b1a7-b9810b934e91 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 204 len: 0 microversion: 2.1 time: 0.139993 Jul 02 21:12:01.229454 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1406/2780] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:01 2022] DELETE /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:01.237597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:01.238216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:01.245470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.245932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.246712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.247155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.279851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:01.280903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:01.289258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.289817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.290754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.291434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.502349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:01.513454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc2c8bee-16ba-4971-a3b5-2700d24dedb3 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1528 microversion: 2.1 time: 0.279538 Jul 02 21:12:01.514498 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1375/2781] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:01 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1528 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:01.518133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:01.520325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea68a79e-8708-4727-a166-8c96c082af8e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea0c1c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:01.532878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb4921c7-9585-45a7-a540-fcacab68c0a2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.257118 Jul 02 21:12:01.533574 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1407/2782] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:01 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:01.568963 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea68a79e-8708-4727-a166-8c96c082af8e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.053246 Jul 02 21:12:01.569699 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1376/2783] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:01 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:01.630901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:01.631572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:01.638088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.638616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.639393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:01.639829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:01.786093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:01.794460 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f90e3ba0-7a40-4d2a-bc83-c96f90ad0096 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 200 len: 1522 microversion: 2.1 time: 0.168632 Jul 02 21:12:01.795151 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1408/2784] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:01 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:02.532941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:02.534346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:02.544805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:02.545851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:02.548573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:02.549765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:02.553207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:02.554564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:02.569119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:02.569580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:02.599395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:02.599395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:03.214928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:03.224791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47d814e2-fad0-445c-9f1b-08236a1ef8f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1528 microversion: 2.1 time: 0.697364 Jul 02 21:12:03.226886 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1377/2785] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:02 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1528 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:03.231925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e83927c0-b244-46ba-8b69-986e1f339828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd79af040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:03.274920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:03.285521 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c06907f-a211-4aca-87fa-dd1164dffca3 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.736459 Jul 02 21:12:03.296308 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1409/2786] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:02 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:03.296478 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e83927c0-b244-46ba-8b69-986e1f339828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.059391 Jul 02 21:12:03.296478 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1378/2787] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:03 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:03.300691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1e413fb5-47ea-47ab-b50b-890957700574 req-2a6fbe8f-262c-48c4-a77c-bc1f841e5ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee72b452-80bd-4468-af1c-fd8177722316", "name": "network-vif-unplugged", "status": "completed", "tag": "941d18af-3acd-4e23-9a90-9b6c5e6a1f84"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:03.300835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:03.301452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:03.308900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e413fb5-47ea-47ab-b50b-890957700574 req-2a6fbe8f-262c-48c4-a77c-bc1f841e5ed2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:03.309352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e413fb5-47ea-47ab-b50b-890957700574 req-2a6fbe8f-262c-48c4-a77c-bc1f841e5ed2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:03.316824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:03.317329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:03.318804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:03.319443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:03.324786 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1e413fb5-47ea-47ab-b50b-890957700574 req-2a6fbe8f-262c-48c4-a77c-bc1f841e5ed2 service nova] Creating event network-vif-unplugged:941d18af-3acd-4e23-9a90-9b6c5e6a1f84 for instance ee72b452-80bd-4468-af1c-fd8177722316 on nch2-master-1 Jul 02 21:12:03.331954 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1e413fb5-47ea-47ab-b50b-890957700574 req-2a6fbe8f-262c-48c4-a77c-bc1f841e5ed2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036711 Jul 02 21:12:03.333052 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1379/2788] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:03.749725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:03.771019 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-769323c2-7aac-4faf-9347-e07bd7405dcd tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 200 len: 1522 microversion: 2.1 time: 0.483055 Jul 02 21:12:03.771622 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1410/2789] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:03 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:04.246422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:04.247262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:04.264100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.264562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.265361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.265806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.268839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a02b345d-560c-46f1-afde-e98060cb8d52 req-b2cc1954-6508-44de-ac47-8fd464b9fa0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-unplugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:04.306709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a02b345d-560c-46f1-afde-e98060cb8d52 req-b2cc1954-6508-44de-ac47-8fd464b9fa0f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.308876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a02b345d-560c-46f1-afde-e98060cb8d52 req-b2cc1954-6508-44de-ac47-8fd464b9fa0f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.383584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a02b345d-560c-46f1-afde-e98060cb8d52 req-b2cc1954-6508-44de-ac47-8fd464b9fa0f service nova] Creating event network-vif-unplugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:12:04.397045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a02b345d-560c-46f1-afde-e98060cb8d52 req-b2cc1954-6508-44de-ac47-8fd464b9fa0f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132868 Jul 02 21:12:04.398371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1411/2790] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:04.404707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ec63f2a-1e57-4a95-9ede-673ccf90d396 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea15bdc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:04.517551 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ec63f2a-1e57-4a95-9ede-673ccf90d396 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.117592 Jul 02 21:12:04.518880 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1412/2791] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:04 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:04.532403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:04.534456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:04.540411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b24a3216aa4eba8a9a90c109c3b491', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffcfd79372c47e89be4acbdc042d510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:04.551410 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bb9f29b-8421-41fa-8d4a-3901e78c1be5 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 200 len: 1310 microversion: 2.1 time: 0.311425 Jul 02 21:12:04.563349 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1380/2792] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:04 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 1310 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:04.578521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.581575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.582484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.582947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.689167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-61473e9a-68d2-4d73-824c-7b5bd74f8c05 req-ea7d2042-ec63-4d37-9f15-0e5048c60a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f40d87e-0e90-421d-b8b4-08f7935d0ed2", "name": "network-vif-deleted", "tag": "43a57b84-c82a-4d4a-89a8-a574a846d8f8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:04.708169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-61473e9a-68d2-4d73-824c-7b5bd74f8c05 req-ea7d2042-ec63-4d37-9f15-0e5048c60a6d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.708626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-61473e9a-68d2-4d73-824c-7b5bd74f8c05 req-ea7d2042-ec63-4d37-9f15-0e5048c60a6d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.744599 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-61473e9a-68d2-4d73-824c-7b5bd74f8c05 req-ea7d2042-ec63-4d37-9f15-0e5048c60a6d service nova] Creating event network-vif-deleted:43a57b84-c82a-4d4a-89a8-a574a846d8f8 for instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 on nch2-master-1 Jul 02 21:12:04.760194 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-61473e9a-68d2-4d73-824c-7b5bd74f8c05 req-ea7d2042-ec63-4d37-9f15-0e5048c60a6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076039 Jul 02 21:12:04.764385 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1381/2793] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:12:04.790342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:04.791438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:04.812929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.813720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.814720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.815368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.930566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:04.931323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:04.935051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lazy-loading 'fault' on Instance uuid 740c4ead-8987-472d-be4b-affd0c8977b1 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:12:05.054146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd876976637504a83859b09a4ef0d3406', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8523eb97eba43f4b819bc5d252bdcb7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:05.061842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e77eaa0-8021-4705-9a5d-a8b6d1b50807 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 200 len: 1312 microversion: 2.1 time: 0.277019 Jul 02 21:12:05.062437 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1382/2794] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:04 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:05.102211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:05.104617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:05.113085 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9155e8a-b874-4623-b4ab-2608a3b2a726 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1392 microversion: 2.1 time: 0.593034 Jul 02 21:12:05.114001 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1413/2795] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:04 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1392 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:05.353246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-21ff5c18-9690-4c1e-83f8-5d73324fadbc req-23a80fff-51b1-4b14-a3e9-87a4199b7ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7accf6a8-277e-4f91-ae02-b25ba6e600a9", "name": "network-vif-deleted", "tag": "ce919a9a-b4bd-4d1a-a83b-bc6e634bb993"}, {"server_uuid": "740c4ead-8987-472d-be4b-affd0c8977b1", "name": "network-vif-deleted", "tag": "ed2daaf0-b76a-4200-8f10-f7dc286dbe4e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:05.364472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21ff5c18-9690-4c1e-83f8-5d73324fadbc req-23a80fff-51b1-4b14-a3e9-87a4199b7ea6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.364959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-21ff5c18-9690-4c1e-83f8-5d73324fadbc req-23a80fff-51b1-4b14-a3e9-87a4199b7ea6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.391549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-21ff5c18-9690-4c1e-83f8-5d73324fadbc req-23a80fff-51b1-4b14-a3e9-87a4199b7ea6 service nova] Creating event network-vif-deleted:ce919a9a-b4bd-4d1a-a83b-bc6e634bb993 for instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 on nch2-master-1 Jul 02 21:12:05.393815 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-21ff5c18-9690-4c1e-83f8-5d73324fadbc req-23a80fff-51b1-4b14-a3e9-87a4199b7ea6 service nova] Creating event network-vif-deleted:ed2daaf0-b76a-4200-8f10-f7dc286dbe4e for instance 740c4ead-8987-472d-be4b-affd0c8977b1 on nch1-master-1 Jul 02 21:12:05.411883 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-21ff5c18-9690-4c1e-83f8-5d73324fadbc req-23a80fff-51b1-4b14-a3e9-87a4199b7ea6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061760 Jul 02 21:12:05.412990 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1383/2796] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:05.531407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-47c540c8-58a6-4bf4-9570-96c9bf9a22e5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabd77b8c10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:05.573449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:05.576745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 7accf6a8-277e-4f91-ae02-b25ba6e600a9] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:05.582043 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-47c540c8-58a6-4bf4-9570-96c9bf9a22e5 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.054878 Jul 02 21:12:05.582891 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1414/2797] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:05 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:05.590817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.591395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.592931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.593714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.611618 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 could not be found. Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 HTTP/1.1 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 could not be found. Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7accf6a8-277e-4f91-ae02-b25ba6e600a9'} Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 could not be found. Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 could not be found. Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.613701 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 could not be found. Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 7accf6a8-277e-4f91-ae02-b25ba6e600a9 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ba16d48-3513-485b-b92d-7bb05c9f90f9 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9" status: 404 len: 111 microversion: 2.1 time: 0.049069 Jul 02 21:12:05.618708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1384/2798] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:05 2022] GET /compute/v2.1/servers/7accf6a8-277e-4f91-ae02-b25ba6e600a9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:05.625374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71b1d519-dea2-4b8e-9553-024f1c37d8d8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '.version_select at 0x7fabea2b3550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:05.648488 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-71b1d519-dea2-4b8e-9553-024f1c37d8d8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Image not found. Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71b1d519-dea2-4b8e-9553-024f1c37d8d8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802 HTTP/1.1 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0c0b5e9a-06f5-4898-8c10-d3d921a74802'} Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c0b5e9a-06f5-4898-8c10-d3d921a74802 to delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c0b5e9a-06f5-4898-8c10-d3d921a74802 could not be found. Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.650786 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71b1d519-dea2-4b8e-9553-024f1c37d8d8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71b1d519-dea2-4b8e-9553-024f1c37d8d8 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802" status: 404 len: 62 microversion: 2.1 time: 0.031496 Jul 02 21:12:05.655335 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1415/2799] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:05 2022] DELETE /compute/v2.1/images/0c0b5e9a-06f5-4898-8c10-d3d921a74802 => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:12:05.661936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:05.662446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:05.668577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.669035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.669819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.670264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.686521 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad HTTP/1.1 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '27fa2b45-ce8c-4055-9576-bf03a6b2a1ad'} Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:05.688370 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:05.692847 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-01c32186-fddc-40b3-bea0-7e981ec27d67 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 404 len: 111 microversion: 2.1 time: 0.032426 Jul 02 21:12:05.694444 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1385/2800] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:05 2022] DELETE /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:05.700218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:05.700840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:05.707342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.707780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.708788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:05.709231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:05.728310 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad HTTP/1.1 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '27fa2b45-ce8c-4055-9576-bf03a6b2a1ad'} Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.729989 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 27fa2b45-ce8c-4055-9576-bf03a6b2a1ad could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:05.733956 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1e8b18fd-d78d-443a-9a10-dda6cf1eafa0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad" status: 404 len: 111 microversion: 2.1 time: 0.036484 Jul 02 21:12:05.736999 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1416/2801] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:05 2022] GET /compute/v2.1/servers/27fa2b45-ce8c-4055-9576-bf03a6b2a1ad => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:12:05.744630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53552bb9-0efd-4c27-80f9-377e5f3d296c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '.version_select at 0x7fabe45b2430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:05.769086 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53552bb9-0efd-4c27-80f9-377e5f3d296c tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231841445" status: 202 len: 0 microversion: 2.1 time: 0.030030 Jul 02 21:12:05.770116 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1386/2802] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:12:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231841445 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:12:06.087380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.098647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 740c4ead-8987-472d-be4b-affd0c8977b1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.105635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.106835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.108191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.108671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.131383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.132345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.133319 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] HTTP exception thrown: Instance 740c4ead-8987-472d-be4b-affd0c8977b1 could not be found. Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 HTTP/1.1 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 740c4ead-8987-472d-be4b-affd0c8977b1 could not be found. Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '740c4ead-8987-472d-be4b-affd0c8977b1'} Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740c4ead-8987-472d-be4b-affd0c8977b1 could not be found. Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740c4ead-8987-472d-be4b-affd0c8977b1 could not be found. Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.134899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740c4ead-8987-472d-be4b-affd0c8977b1 could not be found. Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 404 to user: Instance 740c4ead-8987-472d-be4b-affd0c8977b1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c2d429f-6d1b-42a9-855e-3a40dc45d938 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1" status: 404 len: 111 microversion: 2.1 time: 0.053813 Jul 02 21:12:06.138972 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1417/2803] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/servers/740c4ead-8987-472d-be4b-affd0c8977b1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:06.145100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.145697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.147534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.148299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.154502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.155131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] [instance: 9f40d87e-0e90-421d-b8b4-08f7935d0ed2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.170232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.170726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.171521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.171967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.209680 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] HTTP exception thrown: Instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 could not be found. Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Request method failure captured: Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 HTTP/1.1 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRuuVhDg_d87YC4eX40vLY_5J-CR5eu8ZXimJw8noB2kdD8etIsP2-2YRE8R5ZM0dbybv3vi4dPcZ_pD9ICrjbf3GVKSER35D01wzRxC4-4mMqgLKhm8_zCW44-53HeBsitlkHpd1Azcw5TW8uxoRBIco1dwCAgI1xF5lDgBAw2x-s Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8523eb97eba43f4b819bc5d252bdcb7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8523eb97eba43f4b819bc5d252bdcb7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8523eb97eba43f4b819bc5d252bdcb7"}]}] Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d8523eb97eba43f4b819bc5d252bdcb7 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2102067265 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: d876976637504a83859b09a4ef0d3406 Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListServersNegativeTestJSON-2102067265-project Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 could not be found. Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9f40d87e-0e90-421d-b8b4-08f7935d0ed2'} Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 could not be found. Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 could not be found. Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.213588 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 could not be found. Jul 02 21:12:06.217720 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.221089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] Returning 404 to user: Instance 9f40d87e-0e90-421d-b8b4-08f7935d0ed2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:06.222116 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ded1b3af-9c46-4016-9b42-c0c5df2e36a8 tempest-ListServersNegativeTestJSON-2102067265 tempest-ListServersNegativeTestJSON-2102067265-project] 10.222.0.43 "GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2" status: 404 len: 111 microversion: 2.1 time: 0.074512 Jul 02 21:12:06.225574 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1418/2804] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/servers/9f40d87e-0e90-421d-b8b4-08f7935d0ed2 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:06.405338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:06.418799 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bbbbb1c-4c5e-4f27-97c6-021710075401 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1382 microversion: 2.1 time: 0.291455 Jul 02 21:12:06.430073 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1387/2805] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1382 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:06.430251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-63cad252-ff89-45ec-b4a9-9b64a11e8c42 req-1bff3cf0-0a81-42bd-9217-c49b8d7bd1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "name": "network-vif-plugged", "status": "completed", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:06.437209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09327f25-b15c-4a9a-a70a-01336d374745 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '.version_select at 0x7fabe45b21f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.440461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09327f25-b15c-4a9a-a70a-01336d374745 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.441456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09327f25-b15c-4a9a-a70a-01336d374745 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.442525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63cad252-ff89-45ec-b4a9-9b64a11e8c42 req-1bff3cf0-0a81-42bd-9217-c49b8d7bd1f2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.444502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63cad252-ff89-45ec-b4a9-9b64a11e8c42 req-1bff3cf0-0a81-42bd-9217-c49b8d7bd1f2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.457925 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09327f25-b15c-4a9a-a70a-01336d374745 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.025024 Jul 02 21:12:06.459279 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1388/2806] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:06.467438 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-63cad252-ff89-45ec-b4a9-9b64a11e8c42 req-1bff3cf0-0a81-42bd-9217-c49b8d7bd1f2 service nova] Creating event network-vif-plugged:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:12:06.473552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.474760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.481248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-63cad252-ff89-45ec-b4a9-9b64a11e8c42 req-1bff3cf0-0a81-42bd-9217-c49b8d7bd1f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065166 Jul 02 21:12:06.483972 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1419/2807] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:06.492712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.493358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.494227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.494833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.599196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63ca9833-a925-4a3d-a569-80b978baffe0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2b3940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.664294 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63ca9833-a925-4a3d-a569-80b978baffe0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.071927 Jul 02 21:12:06.664890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1420/2808] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:06.743678 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-611c7ba1-eb67-4407-b138-9ef67f221368 tempest-LiveMigrationTest-855187274 tempest-LiveMigrationTest-855187274-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1533 microversion: 2.1 time: 0.275207 Jul 02 21:12:06.744967 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1389/2809] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1533 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:06.767412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.768015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.773029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-350ab7a0-78b0-466c-9e0c-4dfd3e914516 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '.version_select at 0x7fabea2bb550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.775741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.776343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.777398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.778046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.781499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:06.817178 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-350ab7a0-78b0-466c-9e0c-4dfd3e914516 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Image not found. Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-350ab7a0-78b0-466c-9e0c-4dfd3e914516 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/images/c76236a3-6f5f-4e54-9d34-88ccb872012b HTTP/1.1 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c76236a3-6f5f-4e54-9d34-88ccb872012b'} Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c76236a3-6f5f-4e54-9d34-88ccb872012b to delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c76236a3-6f5f-4e54-9d34-88ccb872012b could not be found. Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.823872 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-350ab7a0-78b0-466c-9e0c-4dfd3e914516 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-350ab7a0-78b0-466c-9e0c-4dfd3e914516 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/images/c76236a3-6f5f-4e54-9d34-88ccb872012b" status: 404 len: 62 microversion: 2.1 time: 0.062901 Jul 02 21:12:06.831940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1421/2810] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:06 2022] DELETE /compute/v2.1/images/c76236a3-6f5f-4e54-9d34-88ccb872012b => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:12:06.838753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:06.847339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.847980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.862258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.862705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.869042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.870687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.901838 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c HTTP/1.1 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c'} Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:06.904495 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.909648 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.924778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:06.927803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a4c57a6-b6d8-4139-8883-af50cefc134f tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "DELETE /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 404 len: 111 microversion: 2.1 time: 0.087846 Jul 02 21:12:06.930733 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1422/2811] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:06 2022] DELETE /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:06.943710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:06.946134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] [instance: 06bd67d8-1a44-442b-9b0d-7a473629e99c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:06.961112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.961811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.962813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:06.963446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:06.981366 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] HTTP exception thrown: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Request method failure captured: Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c HTTP/1.1 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQnOqj_gSVXVHFrWLhOY0Iz19bibsinfdvtwwoitoQeHuvXtJxFHUmaQOteXYkIbfLknFuyDZj7VG5hKcSdwXxRMAg_-lfYYKABj0EAYLfFSndfkM8PgKXVmqSTtMaLdHV5PvA5ezZ58SPAhM6NFrSNWVcwJukJT0I-K3jbhwA3WOg Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dffcfd79372c47e89be4acbdc042d510", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dffcfd79372c47e89be4acbdc042d510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dffcfd79372c47e89be4acbdc042d510"}]}] Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: dffcfd79372c47e89be4acbdc042d510 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b3b24a3216aa4eba8a9a90c109c3b491 Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1852684696-project Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '06bd67d8-1a44-442b-9b0d-7a473629e99c'} Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.983660 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. Jul 02 21:12:06.987768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:06.989098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] Returning 404 to user: Instance 06bd67d8-1a44-442b-9b0d-7a473629e99c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:06.992028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ddfe31e-f408-4811-a736-3fcb06b3e3f0 tempest-ImagesOneServerNegativeTestJSON-1852684696 tempest-ImagesOneServerNegativeTestJSON-1852684696-project] 10.222.0.43 "GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c" status: 404 len: 111 microversion: 2.1 time: 0.056016 Jul 02 21:12:06.992902 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1423/2812] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:06 2022] GET /compute/v2.1/servers/06bd67d8-1a44-442b-9b0d-7a473629e99c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:07.000646 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-276933dd-4295-4dd1-84f8-4f8bce8be5ee tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 204 len: 0 microversion: 2.1 time: 0.237281 Jul 02 21:12:07.001434 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1390/2813] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:06 2022] DELETE /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:07.011014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:07.013913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:07.030248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:07.030796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:07.031557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:07.032201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:07.339984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:07.352911 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a360427b-ee45-4b03-8d71-7c3196d1b661 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1388 microversion: 2.1 time: 0.346614 Jul 02 21:12:07.355177 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1424/2814] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:07 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1388 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:07.680604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4d766e7-3586-4051-a86d-10a0007d9570 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe4153670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:07.775111 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4d766e7-3586-4051-a86d-10a0007d9570 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.100983 Jul 02 21:12:07.779198 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1391/2815] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:07 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:08.376790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:08.378790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:08.390334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:08.393587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:08.394883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:08.396393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:08.397003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:08.499763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-88c9cf9c-9abd-4102-8b19-8285b753f667 req-e5032ac1-dbb6-42c5-93b8-fed929b7d915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-plugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:08.511494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88c9cf9c-9abd-4102-8b19-8285b753f667 req-e5032ac1-dbb6-42c5-93b8-fed929b7d915 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:08.512333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88c9cf9c-9abd-4102-8b19-8285b753f667 req-e5032ac1-dbb6-42c5-93b8-fed929b7d915 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:08.524013 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-88c9cf9c-9abd-4102-8b19-8285b753f667 req-e5032ac1-dbb6-42c5-93b8-fed929b7d915 service nova] Creating event network-vif-plugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:12:08.530227 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-88c9cf9c-9abd-4102-8b19-8285b753f667 req-e5032ac1-dbb6-42c5-93b8-fed929b7d915 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034173 Jul 02 21:12:08.531887 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1392/2816] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:08.661283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:08.674276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-35351728-a007-4f26-acd6-a75c27c844d2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1388 microversion: 2.1 time: 0.300100 Jul 02 21:12:08.675844 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1425/2817] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:08 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1388 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:08.794447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b0575bb-505d-4b95-8f3e-5ec52c2552bd tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2060d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:08.898437 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b0575bb-505d-4b95-8f3e-5ec52c2552bd tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.109941 Jul 02 21:12:08.899613 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1393/2818] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:08 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:09.639178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-826adf82-3d87-4a77-94c8-39a7701421a9 req-b420d030-c057-4b37-8379-1ee6895b0a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee72b452-80bd-4468-af1c-fd8177722316", "name": "network-vif-deleted", "tag": "941d18af-3acd-4e23-9a90-9b6c5e6a1f84"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:09.684229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-826adf82-3d87-4a77-94c8-39a7701421a9 req-b420d030-c057-4b37-8379-1ee6895b0a05 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:09.686316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-826adf82-3d87-4a77-94c8-39a7701421a9 req-b420d030-c057-4b37-8379-1ee6895b0a05 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:09.692012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:09.693387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:09.697586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:09.698544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:09.729855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:09.732261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:09.733454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:09.734476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:09.737232 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-826adf82-3d87-4a77-94c8-39a7701421a9 req-b420d030-c057-4b37-8379-1ee6895b0a05 service nova] Creating event network-vif-deleted:941d18af-3acd-4e23-9a90-9b6c5e6a1f84 for instance ee72b452-80bd-4468-af1c-fd8177722316 on nch1-master-1 Jul 02 21:12:09.751900 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-826adf82-3d87-4a77-94c8-39a7701421a9 req-b420d030-c057-4b37-8379-1ee6895b0a05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118085 Jul 02 21:12:09.753223 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1426/2819] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:09.917793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8aedfc1f-4c30-4643-85b2-732a5ec46634 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea15b040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:09.995129 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8aedfc1f-4c30-4643-85b2-732a5ec46634 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.086564 Jul 02 21:12:10.001317 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1427/2820] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:09 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:10.063515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:10.072300 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-efcd8084-8586-41d6-95bf-3030c7d0a657 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 200 len: 1184 microversion: 2.1 time: 0.384143 Jul 02 21:12:10.074072 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1394/2821] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:09 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 1184 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:11.014130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-335c9c85-4187-4281-9d0e-29d441edd831 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea257040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:11.092977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:11.094531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: ee72b452-80bd-4468-af1c-fd8177722316] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:11.110679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:11.113694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:11.116165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:11.116165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:11.150428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] HTTP exception thrown: Instance ee72b452-80bd-4468-af1c-fd8177722316 could not be found. Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Request method failure captured: Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 HTTP/1.1 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLOQgn29nvNJlGhMh7DLmvNhzbQXsTvpmczq7pnm85tpHc1Hj39DaKHOy-keaYSRl7pcJYOfYQtjDHN7Y9SftRpsf6IxgkN6YbdfWRUrIjLbbTdQmKv_CtlOlMxZAv01NW_wX-L-ia1MZ182W3xhiAZ5PAYB6iSHsxZMrUuf0b6vF5w Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c234eb1b17242368d279c164a6045d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c234eb1b17242368d279c164a6045d4"}]}] Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8b345a42784d4df79caab6d667117418 Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance ee72b452-80bd-4468-af1c-fd8177722316 could not be found. Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'ee72b452-80bd-4468-af1c-fd8177722316'} Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee72b452-80bd-4468-af1c-fd8177722316 could not be found. Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee72b452-80bd-4468-af1c-fd8177722316 could not be found. Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:11.156289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee72b452-80bd-4468-af1c-fd8177722316 could not be found. Jul 02 21:12:11.160799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:11.162372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Returning 404 to user: Instance ee72b452-80bd-4468-af1c-fd8177722316 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:11.163518 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5825f476-b60e-4997-8641-2b5ab1a1b266 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316" status: 404 len: 111 microversion: 2.1 time: 0.076338 Jul 02 21:12:11.164779 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1395/2822] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:11 2022] GET /compute/v2.1/servers/ee72b452-80bd-4468-af1c-fd8177722316 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:13.531748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:13.532452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:13.544391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:13.544870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:13.545652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:13.556281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:13.616836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:13.789223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:13.814365 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77452ecb-703c-4a34-a50b-f6ca0772002c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 204 len: 0 microversion: 2.1 time: 0.287357 Jul 02 21:12:13.815741 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1396/2823] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:13 2022] DELETE /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:13.836229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:13.849088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:13.882973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:13.888785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:13.893165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:13.893872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:14.356084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:14.375705 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca142511-5401-4f0e-b301-e25aa8747583 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1666 microversion: 2.1 time: 0.552006 Jul 02 21:12:14.377180 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1397/2824] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:13 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1666 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:15.395681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:15.396728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:15.429826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:15.430914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:15.441532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:15.442221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:16.034834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:16.049669 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39d07b61-445c-4182-a35d-5a913053d211 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1666 microversion: 2.1 time: 0.653183 Jul 02 21:12:16.053573 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1398/2825] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:15 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1666 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:17.071057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:17.071782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:17.104997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:17.106277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:17.114995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:17.118337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:17.366848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:17.378594 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dccc3fc2-e38b-4986-b91e-c183cd5710d7 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1599 microversion: 2.1 time: 0.312561 Jul 02 21:12:17.383049 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1399/2826] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:17 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1599 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:17.874160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-feb3a18f-3275-4b5a-a210-81ab7c13396d req-962b4ad3-8dbe-46e9-9c35-daa671cad43c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195db841-91bd-42a6-95aa-986da8c9fb00", "name": "network-vif-deleted", "tag": "d5575aa0-4558-46e9-bd96-754d1771ca4f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:17.889366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-feb3a18f-3275-4b5a-a210-81ab7c13396d req-962b4ad3-8dbe-46e9-9c35-daa671cad43c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:17.889813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-feb3a18f-3275-4b5a-a210-81ab7c13396d req-962b4ad3-8dbe-46e9-9c35-daa671cad43c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:17.933546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-feb3a18f-3275-4b5a-a210-81ab7c13396d req-962b4ad3-8dbe-46e9-9c35-daa671cad43c service nova] Creating event network-vif-deleted:d5575aa0-4558-46e9-bd96-754d1771ca4f for instance 195db841-91bd-42a6-95aa-986da8c9fb00 on nch1-master-1 Jul 02 21:12:17.942465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-feb3a18f-3275-4b5a-a210-81ab7c13396d req-962b4ad3-8dbe-46e9-9c35-daa671cad43c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074249 Jul 02 21:12:17.949932 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1400/2827] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:12:18.396623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:18.397376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:18.425511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:18.425981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:18.426805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:18.427246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:18.504451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:18.505240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:18.507635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lazy-loading 'fault' on Instance uuid 195db841-91bd-42a6-95aa-986da8c9fb00 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:12:18.603027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:18.611257 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d109780e-aee0-4a89-895a-4d8372a5487d tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 200 len: 1323 microversion: 2.1 time: 0.218996 Jul 02 21:12:18.622701 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1401/2828] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:18 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:19.681628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:19.719574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=27 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:19.900887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5aa35c6c-ad64-491c-95a7-0dc8a5edf3be tempest-ListImageFiltersNegativeTestJSON-827330099 tempest-ListImageFiltersNegativeTestJSON-827330099-project] Calling method '.version_select at 0x7fabe4786d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:25.525273 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5aa35c6c-ad64-491c-95a7-0dc8a5edf3be tempest-ListImageFiltersNegativeTestJSON-827330099 tempest-ListImageFiltersNegativeTestJSON-827330099-project] HTTP exception thrown: Image not found. Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5aa35c6c-ad64-491c-95a7-0dc8a5edf3be tempest-ListImageFiltersNegativeTestJSON-827330099 tempest-ListImageFiltersNegativeTestJSON-827330099-project] Request method failure captured: Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/e2b4d941-3209-490f-9e00-52f06344307f HTTP/1.1 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLSziEzEchpYYcxN3ipKUszPQDwCcQkbWhWVorF-fP8vt0NUnqQeOU8gaDRfW0bPxfDYB5DeBF2SvOhZ8vl7YVRYNeWsTuI-5Ql-q_K7v0xi-P9HyZieJSU5FweX82yJOEqyRI2Cy-j6A3HMJtcr461VAbeT-logfscWd9844Z39ULI Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 66e4808fc53c4fea8a84d0ff8c58c718 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-827330099 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66e4808fc53c4fea8a84d0ff8c58c718"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_66e4808fc53c4fea8a84d0ff8c58c718", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/66e4808fc53c4fea8a84d0ff8c58c718"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/66e4808fc53c4fea8a84d0ff8c58c718"}]}] Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-827330099 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 66e4808fc53c4fea8a84d0ff8c58c718 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-827330099 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListImageFiltersNegativeTestJSON-827330099-project Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 841970d31bb3498eb7daef3c915ade39 Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-827330099-project Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'e2b4d941-3209-490f-9e00-52f06344307f'} Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e2b4d941-3209-490f-9e00-52f06344307f Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:12:25.528610 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2b4d941-3209-490f-9e00-52f06344307f could not be found. Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5aa35c6c-ad64-491c-95a7-0dc8a5edf3be tempest-ListImageFiltersNegativeTestJSON-827330099 tempest-ListImageFiltersNegativeTestJSON-827330099-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5aa35c6c-ad64-491c-95a7-0dc8a5edf3be tempest-ListImageFiltersNegativeTestJSON-827330099 tempest-ListImageFiltersNegativeTestJSON-827330099-project] 10.222.0.43 "GET /compute/v2.1/images/e2b4d941-3209-490f-9e00-52f06344307f" status: 404 len: 62 microversion: 2.1 time: 5.903569 Jul 02 21:12:25.533427 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1402/2829] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:19 2022] GET /compute/v2.1/images/e2b4d941-3209-490f-9e00-52f06344307f => generated 62 bytes in 5905 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:12:25.538897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:25.539340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 195db841-91bd-42a6-95aa-986da8c9fb00] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:25.559679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:25.560197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:25.563942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:25.564428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:25.606331 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-335c9c85-4187-4281-9d0e-29d441edd831 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 14.601754 Jul 02 21:12:25.607011 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1428/2830] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:11 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 14603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:25.619175 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] HTTP exception thrown: Instance 195db841-91bd-42a6-95aa-986da8c9fb00 could not be found. Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Request method failure captured: Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 HTTP/1.1 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLOQgn29nvNJlGhMh7DLmvNhzbQXsTvpmczq7pnm85tpHc1Hj39DaKHOy-keaYSRl7pcJYOfYQtjDHN7Y9SftRpsf6IxgkN6YbdfWRUrIjLbbTdQmKv_CtlOlMxZAv01NW_wX-L-ia1MZ182W3xhiAZ5PAYB6iSHsxZMrUuf0b6vF5w Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c234eb1b17242368d279c164a6045d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c234eb1b17242368d279c164a6045d4"}]}] Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8b345a42784d4df79caab6d667117418 Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 195db841-91bd-42a6-95aa-986da8c9fb00 could not be found. Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '195db841-91bd-42a6-95aa-986da8c9fb00'} Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195db841-91bd-42a6-95aa-986da8c9fb00 could not be found. Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195db841-91bd-42a6-95aa-986da8c9fb00 could not be found. Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:25.627638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195db841-91bd-42a6-95aa-986da8c9fb00 could not be found. Jul 02 21:12:25.632788 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:25.637833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Returning 404 to user: Instance 195db841-91bd-42a6-95aa-986da8c9fb00 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:25.638916 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2c1fda5-a6b5-4458-b62e-874931a41b6c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00" status: 404 len: 111 microversion: 2.1 time: 0.107283 Jul 02 21:12:25.642729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1403/2831] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:25 2022] GET /compute/v2.1/servers/195db841-91bd-42a6-95aa-986da8c9fb00 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:25.649149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44e5530b-6c42-46b9-8dab-711d3583a19b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '.version_select at 0x7fabd76ca1f0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:25.696072 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44e5530b-6c42-46b9-8dab-711d3583a19b tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459305488" status: 202 len: 0 microversion: 2.1 time: 0.051326 Jul 02 21:12:25.700481 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1429/2832] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459305488 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:12:25.737582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:25.738500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:25.765994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:25.768635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:25.771692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:25.774633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:25.822463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5cf5f232-a9a4-46f3-b5e1-f8bee4e3a965 tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Action: 'create', calling method: .version_select at 0x7fabe4569160>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:25.842622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5cf5f232-a9a4-46f3-b5e1-f8bee4e3a965 tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Getting quotas for project f41113b377ec49a5a23587dd0d67f440. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:25.851893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5cf5f232-a9a4-46f3-b5e1-f8bee4e3a965 tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Getting quotas for user bf59cddfcf2a4e9eb7f1e94f553b118b and project f41113b377ec49a5a23587dd0d67f440. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:25.932611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5cf5f232-a9a4-46f3-b5e1-f8bee4e3a965 tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Getting quotas for project f41113b377ec49a5a23587dd0d67f440. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:25.939674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5cf5f232-a9a4-46f3-b5e1-f8bee4e3a965 tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Getting quotas for user bf59cddfcf2a4e9eb7f1e94f553b118b and project f41113b377ec49a5a23587dd0d67f440. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:25.962317 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5cf5f232-a9a4-46f3-b5e1-f8bee4e3a965 tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.252324 Jul 02 21:12:25.963575 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1404/2833] 10.222.0.43 () {62 vars in 1213 bytes} [Sat Jul 2 21:12:25 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:12:25.991822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f691255-664b-4da8-b19c-f3aed97eb24b tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:26.014242 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f691255-664b-4da8-b19c-f3aed97eb24b tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.037054 Jul 02 21:12:26.015664 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1405/2834] 10.222.0.43 () {60 vars in 1192 bytes} [Sat Jul 2 21:12:25 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:12:26.027670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18d9f922-b88b-4183-b0a9-174682568c7a tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:26.045119 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18d9f922-b88b-4183-b0a9-174682568c7a tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a" status: 200 len: 235 microversion: 2.64 time: 0.023204 Jul 02 21:12:26.050390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1406/2835] 10.222.0.43 () {60 vars in 1303 bytes} [Sat Jul 2 21:12:26 2022] GET /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a => generated 235 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:12:26.063054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5fdca669-a231-4052-898b-e67c6c31757a tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:26.114524 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5fdca669-a231-4052-898b-e67c6c31757a tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a" status: 204 len: 0 microversion: 2.64 time: 0.057309 Jul 02 21:12:26.116384 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1407/2836] 10.222.0.43 () {60 vars in 1306 bytes} [Sat Jul 2 21:12:26 2022] DELETE /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:12:26.129666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aeb091a9-fcd8-40c1-8878-771c75534b5f tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:26.147885 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-aeb091a9-fcd8-40c1-8878-771c75534b5f tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] HTTP exception thrown: Instance group fd8b4436-71d8-47c7-b82c-b684f106889a could not be found. Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aeb091a9-fcd8-40c1-8878-771c75534b5f tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Request method failure captured: Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a HTTP/1.1 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLS5DGqfEF2noFXfpaNoSdycFJ314IMytwaXa98PgAD2fwzgl2sCQQXgyq54AgHpEM9KHbAzEM4Zoj3VspYvSSW0G_YR3PkxuaPEs_VnaEd_OU3eYin32hGocyuwLRIxdBqKA_jnCNqQDNoQ0rLgAbNz6wX1f6J-ZRh9tU-tuR655pQ Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.64 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f41113b377ec49a5a23587dd0d67f440 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerGroup264TestJSON-350428604 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f41113b377ec49a5a23587dd0d67f440"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f41113b377ec49a5a23587dd0d67f440", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f41113b377ec49a5a23587dd0d67f440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f41113b377ec49a5a23587dd0d67f440"}]}] Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerGroup264TestJSON-350428604 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f41113b377ec49a5a23587dd0d67f440 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerGroup264TestJSON-350428604 Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerGroup264TestJSON-350428604-project Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: bf59cddfcf2a4e9eb7f1e94f553b118b Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerGroup264TestJSON-350428604-project Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance group fd8b4436-71d8-47c7-b82c-b684f106889a could not be found. Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'fd8b4436-71d8-47c7-b82c-b684f106889a'} Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fd8b4436-71d8-47c7-b82c-b684f106889a could not be found. Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fd8b4436-71d8-47c7-b82c-b684f106889a could not be found. Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:26.153799 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fd8b4436-71d8-47c7-b82c-b684f106889a could not be found. Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aeb091a9-fcd8-40c1-8878-771c75534b5f tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] Returning 404 to user: Instance group fd8b4436-71d8-47c7-b82c-b684f106889a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aeb091a9-fcd8-40c1-8878-771c75534b5f tempest-ServerGroup264TestJSON-350428604 tempest-ServerGroup264TestJSON-350428604-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a" status: 404 len: 117 microversion: 2.64 time: 0.035731 Jul 02 21:12:26.162844 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1408/2837] 10.222.0.43 () {60 vars in 1306 bytes} [Sat Jul 2 21:12:26 2022] DELETE /compute/v2.1/os-server-groups/fd8b4436-71d8-47c7-b82c-b684f106889a => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:12:26.282742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:26.293752 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9974ddf9-1df9-4b11-8022-6f09d2a21232 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.562161 Jul 02 21:12:26.294676 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1430/2838] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:25 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:26.622991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bfb73fd-190b-4cfe-b70e-fe9b18f14757 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe45b2ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:26.683561 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bfb73fd-190b-4cfe-b70e-fe9b18f14757 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.067398 Jul 02 21:12:26.684619 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1409/2839] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:26 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:27.223104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:27.224381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:27.253499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:27.254213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:27.255383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:27.256658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:27.294524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:27.311141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:27.311852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:27.320269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:27.320725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:27.321517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:27.321955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:27.443584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6aab5b4c-e835-4c2a-81f0-5ec1bf6ee1d4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 204 len: 0 microversion: 2.1 time: 0.224626 Jul 02 21:12:27.445385 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1431/2840] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:27 2022] DELETE /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:27.461227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:27.462734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:27.486925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:27.488670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:27.489825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:27.490473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:27.944609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:27.957331 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18d01ec6-0d5a-444c-93d0-c429a7401cb4 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1484 microversion: 2.1 time: 0.507325 Jul 02 21:12:27.957944 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1432/2841] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:27 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1484 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:27.974976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a77d9e79-6e76-4684-bb5e-466c9b6812ea tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe4694940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:28.021739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:28.034889 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9638ace7-2f5a-4f03-a656-90dee006d3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.727831 Jul 02 21:12:28.038474 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1410/2842] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:27 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:28.052733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2051529071"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:28.054614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:28.109771 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a77d9e79-6e76-4684-bb5e-466c9b6812ea tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.145231 Jul 02 21:12:28.113718 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1433/2843] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:27 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:28.123226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:28.124163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:28.125183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:28.125788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:28.765763 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-efaa24e1-9471-48b2-98f8-d306d3f878db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.715080 Jul 02 21:12:28.771246 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1411/2844] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:12:28 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 02 21:12:28.780107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:28.780736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:28.800925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:28.801627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:28.802638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:28.803296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:28.978889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:28.979718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:28.994768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:28.995236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:29.005666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:29.006028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:29.149715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:29.190650 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f1a76c1b-a09e-4a0d-a1f4-388bbd27819d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.413888 Jul 02 21:12:29.195146 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1434/2845] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:28 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:29.212465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bbd28477-fb78-4d9a-beac-f8cb07ef488c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea186160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:29.284392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bbd28477-fb78-4d9a-beac-f8cb07ef488c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1453 microversion: 2.1 time: 0.085505 Jul 02 21:12:29.285140 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1435/2846] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:29 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:29.380157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:29.380157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c68bb70-9a5b-4c30-b31a-92ed0e2376c5 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1484 microversion: 2.1 time: 0.366955 Jul 02 21:12:29.380157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1412/2847] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:28 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1484 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:29.810439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5d208143-2c54-4e68-8882-942440cc39fb req-12dff7c6-d318-4882-86e7-4d3a384c3757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0", "name": "network-vif-deleted", "tag": "2173dcb0-34b1-4968-b27a-b806d4af1db4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:29.832743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5d208143-2c54-4e68-8882-942440cc39fb req-12dff7c6-d318-4882-86e7-4d3a384c3757 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:29.833199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5d208143-2c54-4e68-8882-942440cc39fb req-12dff7c6-d318-4882-86e7-4d3a384c3757 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:29.865690 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5d208143-2c54-4e68-8882-942440cc39fb req-12dff7c6-d318-4882-86e7-4d3a384c3757 service nova] Creating event network-vif-deleted:2173dcb0-34b1-4968-b27a-b806d4af1db4 for instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 on nch1-master-1 Jul 02 21:12:29.888409 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5d208143-2c54-4e68-8882-942440cc39fb req-12dff7c6-d318-4882-86e7-4d3a384c3757 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080559 Jul 02 21:12:29.894393 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1436/2848] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:30.216992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:30.218158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:30.233006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.235628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.236700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.237147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.302099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0dbb2f3b-892a-4ae3-bb51-3f19d8abd4a1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2c1940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:30.305469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:30.410796 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0dbb2f3b-892a-4ae3-bb51-3f19d8abd4a1 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1462 microversion: 2.1 time: 0.116937 Jul 02 21:12:30.412028 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1437/2849] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:30 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:30.430039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:30.431118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:30.455794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.456290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.461547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.462014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.524014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.524896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.525646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lazy-loading 'fault' on Instance uuid 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:12:30.684092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:30.698869 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71b70f3e-97af-471e-9275-222c8499ed10 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 200 len: 1300 microversion: 2.1 time: 0.284903 Jul 02 21:12:30.700133 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1438/2850] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:30 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 1300 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:30.718737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0d2bccd2-77e6-4ff6-9566-0a43c3d5ba28 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea1860d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:30.813373 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0d2bccd2-77e6-4ff6-9566-0a43c3d5ba28 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 200 len: 1462 microversion: 2.1 time: 0.111934 Jul 02 21:12:30.815029 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1439/2851] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:30 2022] GET /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:30.844925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c4af1693-b3d7-4676-95d4-2fd6ffb2e447 req-2a4c9ad4-af61-4c8c-b334-176bb05805b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-unplugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:30.876895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c4af1693-b3d7-4676-95d4-2fd6ffb2e447 req-2a4c9ad4-af61-4c8c-b334-176bb05805b1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.882928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c4af1693-b3d7-4676-95d4-2fd6ffb2e447 req-2a4c9ad4-af61-4c8c-b334-176bb05805b1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.891240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:30.900292 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b462954e-53c7-4e96-a423-06fd8e049839 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.688103 Jul 02 21:12:30.907345 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1413/2852] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:30 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:30.917025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:30.923104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:30.954659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.954888 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c4af1693-b3d7-4676-95d4-2fd6ffb2e447 req-2a4c9ad4-af61-4c8c-b334-176bb05805b1 service nova] Creating event network-vif-unplugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:12:30.957740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.959500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:30.962838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:30.972224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c4af1693-b3d7-4676-95d4-2fd6ffb2e447 req-2a4c9ad4-af61-4c8c-b334-176bb05805b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156281 Jul 02 21:12:30.973205 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1440/2853] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:31.169851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:31.183905 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e672cf1c-7663-484e-9cef-87a78bc4a44a tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1467 microversion: 2.1 time: 0.272585 Jul 02 21:12:31.187577 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1414/2854] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:30 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1467 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:31.206712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e46528fc-390f-4103-8ac2-81ff980aa8e0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea1e6040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.373124 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e46528fc-390f-4103-8ac2-81ff980aa8e0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?changes-since=2022-07-02T21%3A10%3A03Z" status: 200 len: 2375 microversion: 2.1 time: 0.171427 Jul 02 21:12:31.380794 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1441/2855] 10.222.0.43 () {58 vars in 1198 bytes} [Sat Jul 2 21:12:31 2022] GET /compute/v2.1/images?changes-since=2022-07-02T21%3A10%3A03Z => generated 2375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:31.396269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2d96ce4-fe0d-40a1-b549-53c46b3cf56c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe47c55e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.539685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2d96ce4-fe0d-40a1-b549-53c46b3cf56c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-832496503" status: 200 len: 484 microversion: 2.1 time: 0.149171 Jul 02 21:12:31.541211 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1415/2856] 10.222.0.43 () {58 vars in 1228 bytes} [Sat Jul 2 21:12:31 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-832496503 => generated 484 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:31.554701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-90e39d1d-3c5a-48e0-ae2e-70f5cf6e4a8f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea186040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.707386 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-90e39d1d-3c5a-48e0-ae2e-70f5cf6e4a8f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?server=9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 957 microversion: 2.1 time: 0.157972 Jul 02 21:12:31.708314 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1442/2857] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:12:31 2022] GET /compute/v2.1/images?server=9997129c-feb7-429e-8575-41ef0af25818 => generated 957 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:31.720874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.721502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:31.722774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a92f8242-c2b6-43d9-b8a3-759420fad97b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea257040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.748393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:31.748852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:31.755300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:31.758741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:31.780974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] HTTP exception thrown: Instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 could not be found. Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Request method failure captured: Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 HTTP/1.1 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLOQgn29nvNJlGhMh7DLmvNhzbQXsTvpmczq7pnm85tpHc1Hj39DaKHOy-keaYSRl7pcJYOfYQtjDHN7Y9SftRpsf6IxgkN6YbdfWRUrIjLbbTdQmKv_CtlOlMxZAv01NW_wX-L-ia1MZ182W3xhiAZ5PAYB6iSHsxZMrUuf0b6vF5w Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c234eb1b17242368d279c164a6045d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c234eb1b17242368d279c164a6045d4"}]}] Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8b345a42784d4df79caab6d667117418 Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 could not be found. Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0'} Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 could not be found. Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 could not be found. Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:31.784566 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 could not be found. Jul 02 21:12:31.790665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:31.801027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Returning 404 to user: Instance 8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:31.802403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbfa797f-5c4d-4591-9def-010918650ec2 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0" status: 404 len: 111 microversion: 2.1 time: 0.088614 Jul 02 21:12:31.803304 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1416/2858] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:31 2022] GET /compute/v2.1/servers/8141c52f-5cb8-40f5-a2bb-ec0e47e88cb0 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:31.820278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.824497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:31.825222 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a92f8242-c2b6-43d9-b8a3-759420fad97b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 485 microversion: 2.1 time: 0.106895 Jul 02 21:12:31.826270 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1443/2859] 10.222.0.43 () {58 vars in 1316 bytes} [Sat Jul 2 21:12:31 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:31.835649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:31.837747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:31.839451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:31.841399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:31.843306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d79341a9-82ee-44b4-b989-b58e4b742a1c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea186790>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:31.916534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:32.088738 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5b0688d-21f2-421a-a525-2b717629a21c tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 204 len: 0 microversion: 2.1 time: 0.280311 Jul 02 21:12:32.093506 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1417/2860] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:31 2022] DELETE /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:32.101781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:32.105704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:32.134700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:32.135642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:32.137514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:32.138417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:32.322060 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d79341a9-82ee-44b4-b989-b58e4b742a1c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 485 microversion: 2.1 time: 0.488297 Jul 02 21:12:32.322680 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1444/2861] 10.222.0.43 () {58 vars in 1302 bytes} [Sat Jul 2 21:12:31 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc => generated 485 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:12:32.336374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:32.338122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:32.360264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:32.369232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:32.370232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:32.370672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:32.779379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:32.790257 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5a1ef67-308a-43f4-8457-70db8715c635 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1689 microversion: 2.1 time: 0.698045 Jul 02 21:12:32.795024 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1418/2862] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:32 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1689 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:32.801090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef069a35-808e-4012-8b9b-5e049fa2723c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe409de50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:32.897883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:32.913844 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45ad8cb5-90a1-4f74-bb9c-3fc793ee79b9 tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1501 microversion: 2.1 time: 0.590007 Jul 02 21:12:32.914519 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1445/2863] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:32 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1501 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:32.968699 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef069a35-808e-4012-8b9b-5e049fa2723c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.171923 Jul 02 21:12:32.970038 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1419/2864] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:12:32 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:32.987513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3de72a2a-3db6-42f7-9d13-56bc4e94de2f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2bd310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.085994 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3de72a2a-3db6-42f7-9d13-56bc4e94de2f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.102367 Jul 02 21:12:33.086614 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1446/2865] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:12:32 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:33.102422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47739840-2a7d-43a3-b649-e1e23c27f2c9 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe456b550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.146621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6219c84e-acbe-4fd8-9fd1-b838f73b4f27 req-fac07684-2291-4f70-8381-2f782bb3d9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "name": "network-vif-unplugged", "status": "completed", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:33.164968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6219c84e-acbe-4fd8-9fd1-b838f73b4f27 req-fac07684-2291-4f70-8381-2f782bb3d9c2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:33.173340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6219c84e-acbe-4fd8-9fd1-b838f73b4f27 req-fac07684-2291-4f70-8381-2f782bb3d9c2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:33.192796 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47739840-2a7d-43a3-b649-e1e23c27f2c9 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.094481 Jul 02 21:12:33.195499 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1420/2866] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:12:33.207328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad3af17d-cbfa-480d-ad84-9e502600d0ee tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe456bf70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.211630 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6219c84e-acbe-4fd8-9fd1-b838f73b4f27 req-fac07684-2291-4f70-8381-2f782bb3d9c2 service nova] Creating event network-vif-unplugged:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:12:33.223790 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6219c84e-acbe-4fd8-9fd1-b838f73b4f27 req-fac07684-2291-4f70-8381-2f782bb3d9c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080838 Jul 02 21:12:33.242909 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1447/2867] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:12:33.358151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad3af17d-cbfa-480d-ad84-9e502600d0ee tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?changes-since=2022-07-02T21%3A09%3A59Z" status: 200 len: 6327 microversion: 2.1 time: 0.154861 Jul 02 21:12:33.376484 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1421/2868] 10.222.0.43 () {58 vars in 1219 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-02T21%3A09%3A59Z => generated 6327 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:33.394578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-845d92a6-012f-44ee-928c-2634fbe3da57 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2bdf70>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.504166 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-845d92a6-012f-44ee-928c-2634fbe3da57 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-832496503" status: 200 len: 664 microversion: 2.1 time: 0.117127 Jul 02 21:12:33.504840 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1448/2869] 10.222.0.43 () {58 vars in 1249 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-832496503 => generated 664 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:33.518587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8919cbfb-5440-4a60-808a-6c4bddbff983 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe4598b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.646712 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8919cbfb-5440-4a60-808a-6c4bddbff983 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1465 microversion: 2.1 time: 0.132949 Jul 02 21:12:33.648514 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1422/2870] 10.222.0.43 () {58 vars in 1337 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fv2.1%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc => generated 1465 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:33.662259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd9e6f5a-0464-4b30-a030-3ac6fafe68bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe4694e50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.817900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:33.818757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:33.837678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:33.838393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:33.840992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:33.853329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:33.899536 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd9e6f5a-0464-4b30-a030-3ac6fafe68bc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1465 microversion: 2.1 time: 0.241958 Jul 02 21:12:33.908351 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1449/2871] 10.222.0.43 () {58 vars in 1323 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.43%2Fcompute%2Fservers%2F6f04307a-39d1-4497-acb0-17ba192336bc => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:33.931953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38c54396-a8d7-46e7-9420-c8e464b5de3c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2bd790>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:34.493950 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38c54396-a8d7-46e7-9420-c8e464b5de3c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.569497 Jul 02 21:12:34.504933 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1450/2872] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:34.510603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:34.525587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:34.561107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:34.562102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:34.563589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:34.565191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:34.616314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:34.626626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-335811ca-e508-4ba5-bc78-426b4e1cebb0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.813076 Jul 02 21:12:34.629405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1423/2873] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:33 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:34.643175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4692bc03-3223-421f-afd9-62cbaa6d0e33 req-2e6d6609-f6f3-4cd7-b8f7-f6384f746d6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c992b533-5d21-4815-b979-65f3b530d668", "name": "network-vif-deleted", "tag": "a0fea10f-d8e2-4a88-beca-9f5c01a675d1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:34.662566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4692bc03-3223-421f-afd9-62cbaa6d0e33 req-2e6d6609-f6f3-4cd7-b8f7-f6384f746d6b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:34.666081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4692bc03-3223-421f-afd9-62cbaa6d0e33 req-2e6d6609-f6f3-4cd7-b8f7-f6384f746d6b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:34.695173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:34.695690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:34.695941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4692bc03-3223-421f-afd9-62cbaa6d0e33 req-2e6d6609-f6f3-4cd7-b8f7-f6384f746d6b service nova] Creating event network-vif-deleted:a0fea10f-d8e2-4a88-beca-9f5c01a675d1 for instance c992b533-5d21-4815-b979-65f3b530d668 on nch1-master-1 Jul 02 21:12:34.696367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lazy-loading 'fault' on Instance uuid c992b533-5d21-4815-b979-65f3b530d668 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:12:34.708202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4692bc03-3223-421f-afd9-62cbaa6d0e33 req-2e6d6609-f6f3-4cd7-b8f7-f6384f746d6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075692 Jul 02 21:12:34.709870 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1424/2874] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:34.724366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-100619c5-f16f-416b-a54b-b6fc3dffd3e3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe45694c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:34.847074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-100619c5-f16f-416b-a54b-b6fc3dffd3e3 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.134872 Jul 02 21:12:34.847681 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1425/2875] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:12:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:34.864169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f77b731-a066-4287-8354-1cc31d20cb73 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe4786ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:34.967126 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f77b731-a066-4287-8354-1cc31d20cb73 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/e482b755-1c1a-4758-a7c0-b3edf1610541" status: 200 len: 784 microversion: 2.1 time: 0.109926 Jul 02 21:12:34.974478 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1426/2876] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:12:34 2022] GET /compute/v2.1/images/e482b755-1c1a-4758-a7c0-b3edf1610541 => generated 784 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:34.991323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74d367e0-4740-4d79-9e12-ff194165ffcc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe47c1550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:34.996145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b345a42784d4df79caab6d667117418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c234eb1b17242368d279c164a6045d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:35.009252 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd0e3eab-c97e-46f7-a380-c4ad7223ba5a tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 200 len: 1301 microversion: 2.1 time: 0.507782 Jul 02 21:12:35.014591 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1451/2877] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:34 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 1301 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:35.085232 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74d367e0-4740-4d79-9e12-ff194165ffcc tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.101609 Jul 02 21:12:35.087210 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1427/2878] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:12:34 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:35.118873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e394757-9996-4e84-8594-70cf96cd1bff tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2bb670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:35.650965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:35.651910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:35.665912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:35.667119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:35.668448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:35.669559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:35.953101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:36.102841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:36.107268 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e394757-9996-4e84-8594-70cf96cd1bff tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e" status: 204 len: 0 microversion: 2.1 time: 1.011400 Jul 02 21:12:36.108066 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1452/2879] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:35 2022] DELETE /compute/v2.1/images/ba422e4c-aa9c-4b57-bbff-eb6e29e19e3e => generated 0 bytes in 1013 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:36.116466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:36.117096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] [instance: c992b533-5d21-4815-b979-65f3b530d668] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:36.117714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b066c41-82f1-4299-ae01-f01ed2aa8b2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.474540 Jul 02 21:12:36.118790 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1428/2880] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:35 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:36.125279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1e46312-faa0-4d96-bb97-8e9a16d98a62 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe47448b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:36.184096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:36.184561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:36.185365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:36.185803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:36.263045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] HTTP exception thrown: Instance c992b533-5d21-4815-b979-65f3b530d668 could not be found. Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Request method failure captured: Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 HTTP/1.1 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLOQgn29nvNJlGhMh7DLmvNhzbQXsTvpmczq7pnm85tpHc1Hj39DaKHOy-keaYSRl7pcJYOfYQtjDHN7Y9SftRpsf6IxgkN6YbdfWRUrIjLbbTdQmKv_CtlOlMxZAv01NW_wX-L-ia1MZ182W3xhiAZ5PAYB6iSHsxZMrUuf0b6vF5w Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8c234eb1b17242368d279c164a6045d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8c234eb1b17242368d279c164a6045d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8c234eb1b17242368d279c164a6045d4"}]}] Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8c234eb1b17242368d279c164a6045d4 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-LiveMigrationTest-1775332521 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8b345a42784d4df79caab6d667117418 Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-LiveMigrationTest-1775332521-project Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c992b533-5d21-4815-b979-65f3b530d668 could not be found. Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c992b533-5d21-4815-b979-65f3b530d668'} Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c992b533-5d21-4815-b979-65f3b530d668 could not be found. Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c992b533-5d21-4815-b979-65f3b530d668 could not be found. Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:36.270453 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c992b533-5d21-4815-b979-65f3b530d668 could not be found. Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] Returning 404 to user: Instance c992b533-5d21-4815-b979-65f3b530d668 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a02392af-844a-4a7d-8ab2-e6286652cc3e tempest-LiveMigrationTest-1775332521 tempest-LiveMigrationTest-1775332521-project] 10.222.0.43 "GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668" status: 404 len: 111 microversion: 2.1 time: 0.167085 Jul 02 21:12:36.285425 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1453/2881] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:36 2022] GET /compute/v2.1/servers/c992b533-5d21-4815-b979-65f3b530d668 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:36.764360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b5185484-9d25-42f5-8385-14c5e5c8f3de req-29e58717-ea5e-4320-9d35-181dd98cf404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-plugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:36.786244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b5185484-9d25-42f5-8385-14c5e5c8f3de req-29e58717-ea5e-4320-9d35-181dd98cf404 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:36.787038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b5185484-9d25-42f5-8385-14c5e5c8f3de req-29e58717-ea5e-4320-9d35-181dd98cf404 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:36.824309 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b5185484-9d25-42f5-8385-14c5e5c8f3de req-29e58717-ea5e-4320-9d35-181dd98cf404 service nova] Creating event network-vif-plugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:12:36.837570 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b5185484-9d25-42f5-8385-14c5e5c8f3de req-29e58717-ea5e-4320-9d35-181dd98cf404 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075723 Jul 02 21:12:36.838800 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1454/2882] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:37.142107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:37.143112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:37.159210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:37.164355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:37.165452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:37.168934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:37.630529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1e46312-faa0-4d96-bb97-8e9a16d98a62 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8" status: 204 len: 0 microversion: 2.1 time: 1.509338 Jul 02 21:12:37.631425 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1429/2883] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:36 2022] DELETE /compute/v2.1/images/60ca3bad-9351-4bcd-99fa-a7cfd9d10ae8 => generated 0 bytes in 1511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:37.641104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96724d14-95a2-402e-ac25-a2f314833c66 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe47c54c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:37.702262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:37.717526 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7f6ea0e5-8dcc-469a-8e7d-69a3a78a2c34 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.581337 Jul 02 21:12:37.737842 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1455/2884] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:37 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:38.750866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:38.751677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:38.779826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:38.781085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:38.787012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:38.788309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:39.449789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96724d14-95a2-402e-ac25-a2f314833c66 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2" status: 204 len: 0 microversion: 2.1 time: 1.814125 Jul 02 21:12:39.450423 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1430/2885] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:37 2022] DELETE /compute/v2.1/images/2a8702d7-10dc-4229-b9db-d111bf2a4bd2 => generated 0 bytes in 1816 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:12:39.459399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:39.459922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:39.491201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:39.491667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:39.498590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:39.499234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:39.551956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:39.572616 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79a9aa39-c500-40b0-9214-37b03a7f7766 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.833142 Jul 02 21:12:39.573250 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1456/2886] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:38 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:39.599810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:39.802788 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6e45112-1d7f-42f5-bd45-4a27bbbc425c tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 204 len: 0 microversion: 2.1 time: 0.347708 Jul 02 21:12:39.804394 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1431/2887] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:39 2022] DELETE /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:12:39.817224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:39.817861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:39.838472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:39.838939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:39.844144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:39.844617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:40.592096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:40.593426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:40.618739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:40.625066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:40.629299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:40.630750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:41.303290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:41.337878 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e93e944-91b6-4cb3-89e0-7a50f3eb4c86 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.750674 Jul 02 21:12:41.338538 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1432/2888] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:40 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:41.738292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:41.753096 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8095223-3630-494a-b56d-0c5df58361d0 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1474 microversion: 2.1 time: 1.944449 Jul 02 21:12:41.760602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1457/2889] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:39 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1474 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:42.357020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:42.357850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:42.394866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:42.395355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:42.399306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:42.403989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:42.662710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:42.672723 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7df6570c-7bb3-401e-95e3-10f7bf85f0d2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.320319 Jul 02 21:12:42.673910 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1433/2890] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:42 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:42.771445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:42.772316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:42.804487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:42.806870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:42.810206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:42.811137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:43.136065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1fa93d2-825e-4629-8cec-27967a65e4cf tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabea2bd4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-538932955", "description": "tempest-description-811899782"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:43.309860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:43.322245 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6e9ed2c7-01fd-4e41-9ab0-d9483912a3e2 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1474 microversion: 2.1 time: 0.555262 Jul 02 21:12:43.323423 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1434/2891] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:42 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1474 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:43.629077 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1fa93d2-825e-4629-8cec-27967a65e4cf tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.885448 Jul 02 21:12:43.629704 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1458/2892] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:12:42 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:43.642459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-725253d9-e07b-4a92-9b71-259e045db131 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabea2063a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-729403758", "description": "tempest-description-44871855"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:43.690624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:43.691587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:43.714227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:43.715741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:43.719217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:43.719865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:44.032467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-725253d9-e07b-4a92-9b71-259e045db131 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.390074 Jul 02 21:12:44.032467 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1435/2893] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:12:43 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:44.145055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:44.153562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-98e99b62-ecf4-4023-a11c-9882de7b2680 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.466975 Jul 02 21:12:44.157300 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1459/2894] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:43 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:44.181738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-67108279", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ca4f0c76-2326-4860-85e6-44a9e2329bcf"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:44.200888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e178cee4-9d8f-4d3d-9737-04afd0de9444 req-f8206f63-dbd9-479f-a8e9-c1b18b28cd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f04307a-39d1-4497-acb0-17ba192336bc", "name": "network-vif-deleted", "tag": "77b42318-cb32-44f7-833d-f1bb938eae91"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:44.222678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:44.230703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e178cee4-9d8f-4d3d-9737-04afd0de9444 req-f8206f63-dbd9-479f-a8e9-c1b18b28cd90 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:44.232457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e178cee4-9d8f-4d3d-9737-04afd0de9444 req-f8206f63-dbd9-479f-a8e9-c1b18b28cd90 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:44.316946 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e178cee4-9d8f-4d3d-9737-04afd0de9444 req-f8206f63-dbd9-479f-a8e9-c1b18b28cd90 service nova] Creating event network-vif-deleted:77b42318-cb32-44f7-833d-f1bb938eae91 for instance 6f04307a-39d1-4497-acb0-17ba192336bc on nch1-master-1 Jul 02 21:12:44.341032 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e178cee4-9d8f-4d3d-9737-04afd0de9444 req-f8206f63-dbd9-479f-a8e9-c1b18b28cd90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144044 Jul 02 21:12:44.344530 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1460/2895] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:44.370641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:44.373298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:44.395124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:44.403370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:44.404969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:44.407159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:44.502493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:44.503432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:44.504304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lazy-loading 'fault' on Instance uuid 6f04307a-39d1-4497-acb0-17ba192336bc {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:12:44.677680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:44.687149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:44.698728 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-561f451c-8fc5-432b-b9fe-7bf7d0e35e7e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 200 len: 1308 microversion: 2.1 time: 0.347912 Jul 02 21:12:44.703929 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1461/2896] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:44 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 1308 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:45.180393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:45.181155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:45.197487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:45.212061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:45.214924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:45.217412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:45.245271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] validate_networks() for [('ca4f0c76-2326-4860-85e6-44a9e2329bcf', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:12:46.232280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:46.243503 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-518ee7d5-82c1-4774-9e4d-2866bff7ed9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 1.067158 Jul 02 21:12:46.246797 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1462/2897] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:45 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:46.273781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:46.274551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 6f04307a-39d1-4497-acb0-17ba192336bc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:46.292823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.295887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.297619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.306021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.341695 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] HTTP exception thrown: Instance 6f04307a-39d1-4497-acb0-17ba192336bc could not be found. Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Request method failure captured: Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc HTTP/1.1 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQm_RPsiKtnQ6Q4s3gMQr8AuQ0FcQf5PFBsrsbyEwaN7kPHhLBUN-1ENhtGLVkEGBkxl23SVjUvYg2b3Qp-R6a-Fd3UvG__E3G4ccyI2ymFA_TcPr8dRS_o-0c08-E0oiHYR09dbG7lzLvWNus2WX4H-qqvnJNi_KoAMjVRjjLqhNc Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c3f6b014bf864b6aa1a1d980f4dd70b0 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ListImageFiltersTestJSON-311458210 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3f6b014bf864b6aa1a1d980f4dd70b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3f6b014bf864b6aa1a1d980f4dd70b0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3f6b014bf864b6aa1a1d980f4dd70b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3f6b014bf864b6aa1a1d980f4dd70b0"}]}] Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ListImageFiltersTestJSON-311458210 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c3f6b014bf864b6aa1a1d980f4dd70b0 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-311458210 Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ListImageFiltersTestJSON-311458210-project Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: e1eb8b2dbe5e4d1d96891039f146bffe Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ListImageFiltersTestJSON-311458210-project Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 6f04307a-39d1-4497-acb0-17ba192336bc could not be found. Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '6f04307a-39d1-4497-acb0-17ba192336bc'} Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f04307a-39d1-4497-acb0-17ba192336bc could not be found. Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f04307a-39d1-4497-acb0-17ba192336bc could not be found. Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:46.344405 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f04307a-39d1-4497-acb0-17ba192336bc could not be found. Jul 02 21:12:46.349636 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:12:46.353789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Returning 404 to user: Instance 6f04307a-39d1-4497-acb0-17ba192336bc could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:46.357985 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0df46529-59d7-4c66-b067-a68376fc0828 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc" status: 404 len: 111 microversion: 2.1 time: 0.095856 Jul 02 21:12:46.358931 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1463/2898] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:46 2022] GET /compute/v2.1/servers/6f04307a-39d1-4497-acb0-17ba192336bc => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:46.368358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:46.373723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:46.385725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.388077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.390565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.395401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.463460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:12:46.691850 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-867e8839-c9e7-4250-8bd9-260891165032 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 204 len: 0 microversion: 2.1 time: 0.325557 Jul 02 21:12:46.695795 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1464/2899] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:12:46 2022] DELETE /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:46.715534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:46.716483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:46.734474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.735199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.741419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.742170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.941471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:12:46.942485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:12:46.943156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:12:46.943794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:12:46.944433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:12:46.963372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.966215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:46.967567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:46.968262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:47.021695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Getting quotas for project 27477995aa5c488bb3a2b414a540ceba. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:47.032320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Getting quotas for user 365ef707d87d4d5d818a7e9388c65fa0 and project 27477995aa5c488bb3a2b414a540ceba. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:47.087174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:12:47.092807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:12:47.237900 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5971914b-2b0b-4032-837e-50bc94325317 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.060698 Jul 02 21:12:47.239964 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1436/2900] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:12:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:12:47.258785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ea853a3-1544-4ee3-880e-0f07e8dd80b5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:47.259420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ea853a3-1544-4ee3-880e-0f07e8dd80b5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:47.364337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:47.383299 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dbc45cfc-035e-4e7a-90bf-02b22735d15b tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1473 microversion: 2.1 time: 0.682896 Jul 02 21:12:47.387945 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1465/2901] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:46 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1473 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:47.409511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:47.417436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:47.442959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:47.442959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:47.442959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:47.442959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:47.529318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ea853a3-1544-4ee3-880e-0f07e8dd80b5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:47.544223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ea853a3-1544-4ee3-880e-0f07e8dd80b5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1214 microversion: 2.1 time: 0.297697 Jul 02 21:12:47.548859 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1437/2902] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:47 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1214 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:48.227361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:48.245177 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acdcfa8d-4473-481f-81cc-0f19cc20a510 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.854419 Jul 02 21:12:48.252728 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1466/2903] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:47 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:48.404156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:48.405464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:48.415856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:48.416338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:48.417134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:48.435282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:48.572836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:48.574140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:48.598559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:48.599397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:48.601307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:48.602959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:48.792882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:48.804458 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f79b9c0-0932-4d4c-872e-3f9ec2f490be tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1218 microversion: 2.1 time: 0.242299 Jul 02 21:12:48.824728 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1467/2904] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:48 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1218 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:49.263714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:49.264458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:49.277642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:49.279223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:49.290024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:49.290513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:49.387994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:49.406428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2aae77d-0eee-4178-bf38-879dfd4a1f2e tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1473 microversion: 2.1 time: 1.006787 Jul 02 21:12:49.414896 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1438/2905] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:48 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1473 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:49.834571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:49.835603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:49.869553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:49.870211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:49.871091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:49.878528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:49.994802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:50.009266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bdc20c94-aa2e-4ca5-b74e-47e8b616d894 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.744953 Jul 02 21:12:50.013860 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1468/2906] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:49 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:50.431572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:50.432237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:50.463094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:50.480914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:50.481535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:50.482449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:50.490460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:50.744642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:50.761622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3242cf46-5eee-48c7-ac50-4b73ffd4be45 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1272 microversion: 2.1 time: 0.934580 Jul 02 21:12:50.767837 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1439/2907] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:49 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1272 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:51.034148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:51.035037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:51.051689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:51.053798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:51.056263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:51.059626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:51.452193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1eb8b2dbe5e4d1d96891039f146bffe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6b014bf864b6aa1a1d980f4dd70b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:51.462293 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e5e7085-7d04-4801-bb17-165ccd32efac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 200 len: 1473 microversion: 2.1 time: 1.035060 Jul 02 21:12:51.486962 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1469/2908] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:50 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 1473 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:51.512418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-164948ef-4e7b-42a8-9662-3b068ed6d591 req-d8d04fdd-7aee-4dd1-b21c-d86b571cff7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9997129c-feb7-429e-8575-41ef0af25818", "name": "network-vif-deleted", "tag": "5d182a12-3308-4156-a628-6cb67a5388e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:51.535805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-164948ef-4e7b-42a8-9662-3b068ed6d591 req-d8d04fdd-7aee-4dd1-b21c-d86b571cff7a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:51.536287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-164948ef-4e7b-42a8-9662-3b068ed6d591 req-d8d04fdd-7aee-4dd1-b21c-d86b571cff7a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:51.583090 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-164948ef-4e7b-42a8-9662-3b068ed6d591 req-d8d04fdd-7aee-4dd1-b21c-d86b571cff7a service nova] Creating event network-vif-deleted:5d182a12-3308-4156-a628-6cb67a5388e5 for instance 9997129c-feb7-429e-8575-41ef0af25818 on nch1-master-1 Jul 02 21:12:51.621562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-164948ef-4e7b-42a8-9662-3b068ed6d591 req-d8d04fdd-7aee-4dd1-b21c-d86b571cff7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140958 Jul 02 21:12:51.627814 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1470/2909] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:51.785413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:51.786378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:51.796483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:51.805963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:51.812892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:51.813627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:52.146042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:52.148475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:52.159106 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec3c64b8-0e34-4b4a-bf07-eb61a14db25d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 1.133739 Jul 02 21:12:52.159713 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1440/2910] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:51 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:52.160795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:52.177362 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c2601baa-491d-4ec1-9bdf-512ad66322ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1272 microversion: 2.1 time: 0.396068 Jul 02 21:12:52.191071 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1471/2911] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:51 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1272 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:52.495150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:52.496902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] [instance: 9997129c-feb7-429e-8575-41ef0af25818] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:52.528091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:52.530430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:52.533140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:52.535562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:52.569530 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] HTTP exception thrown: Instance 9997129c-feb7-429e-8575-41ef0af25818 could not be found. Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Request method failure captured: Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 HTTP/1.1 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQm_RPsiKtnQ6Q4s3gMQr8AuQ0FcQf5PFBsrsbyEwaN7kPHhLBUN-1ENhtGLVkEGBkxl23SVjUvYg2b3Qp-R6a-Fd3UvG__E3G4ccyI2ymFA_TcPr8dRS_o-0c08-E0oiHYR09dbG7lzLvWNus2WX4H-qqvnJNi_KoAMjVRjjLqhNc Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: c3f6b014bf864b6aa1a1d980f4dd70b0 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ListImageFiltersTestJSON-311458210 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3f6b014bf864b6aa1a1d980f4dd70b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c3f6b014bf864b6aa1a1d980f4dd70b0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c3f6b014bf864b6aa1a1d980f4dd70b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c3f6b014bf864b6aa1a1d980f4dd70b0"}]}] Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ListImageFiltersTestJSON-311458210 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: c3f6b014bf864b6aa1a1d980f4dd70b0 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-311458210 Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ListImageFiltersTestJSON-311458210-project Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e1eb8b2dbe5e4d1d96891039f146bffe Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ListImageFiltersTestJSON-311458210-project Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9997129c-feb7-429e-8575-41ef0af25818 could not be found. Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9997129c-feb7-429e-8575-41ef0af25818'} Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9997129c-feb7-429e-8575-41ef0af25818 could not be found. Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9997129c-feb7-429e-8575-41ef0af25818 could not be found. Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:12:52.585260 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9997129c-feb7-429e-8575-41ef0af25818 could not be found. Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Returning 404 to user: Instance 9997129c-feb7-429e-8575-41ef0af25818 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:12:52.590115 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5554da98-ef74-4f02-a52c-c2123035c8ac tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818" status: 404 len: 111 microversion: 2.1 time: 0.095542 Jul 02 21:12:52.592578 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1441/2912] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:52 2022] GET /compute/v2.1/servers/9997129c-feb7-429e-8575-41ef0af25818 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:12:52.597007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44863e52-fd1c-438f-aee1-74911d25224f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2bbb80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:53.177239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:53.178083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:53.187676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:53.198570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:53.199523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:53.202808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:53.422445 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44863e52-fd1c-438f-aee1-74911d25224f tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/images/c67baaea-d119-4f87-aeed-412f8580a041" status: 204 len: 0 microversion: 2.1 time: 0.830594 Jul 02 21:12:53.426582 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1472/2913] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:52 2022] DELETE /compute/v2.1/images/c67baaea-d119-4f87-aeed-412f8580a041 => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:53.435884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:53.436566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:53.452068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:53.452837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:53.453848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:53.454570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:53.991437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:54.017904 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5558f7a-4ae1-46b1-b6ed-8ae9d7ff04ab tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 0.590043 Jul 02 21:12:54.018916 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1473/2914] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:53 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:54.035253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-daf42912-fdd4-456d-bf85-acae14351489 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabe4cb25e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:54.044624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:54.069904 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86efcf13-33f2-4a38-ac20-7a5d9bce5831 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.896636 Jul 02 21:12:54.072365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1442/2915] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:53 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:12:54.670549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39ce79d0-7d82-4aad-9ed2-8bb39aa5d19c tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Action: 'create', calling method: .version_select at 0x7fabe48d1280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-250185882", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:54.720643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-39ce79d0-7d82-4aad-9ed2-8bb39aa5d19c tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:54.738598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-39ce79d0-7d82-4aad-9ed2-8bb39aa5d19c tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:54.859690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-39ce79d0-7d82-4aad-9ed2-8bb39aa5d19c tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:54.872999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-39ce79d0-7d82-4aad-9ed2-8bb39aa5d19c tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:54.904073 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39ce79d0-7d82-4aad-9ed2-8bb39aa5d19c tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.830332 Jul 02 21:12:54.910489 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1443/2916] 10.222.0.43 () {60 vars in 1173 bytes} [Sat Jul 2 21:12:54 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:54.922723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed4ee947-e50c-44f7-b3b1-f220e5357ec3 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Action: 'create', calling method: .version_select at 0x7fabe48d1700>, body: {"server_group": {"name": "tempest-server-group-706603495", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:54.962921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed4ee947-e50c-44f7-b3b1-f220e5357ec3 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:54.981340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed4ee947-e50c-44f7-b3b1-f220e5357ec3 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:55.100087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed4ee947-e50c-44f7-b3b1-f220e5357ec3 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:55.118924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed4ee947-e50c-44f7-b3b1-f220e5357ec3 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:55.167232 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed4ee947-e50c-44f7-b3b1-f220e5357ec3 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.250555 Jul 02 21:12:55.173311 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1444/2917] 10.222.0.43 () {60 vars in 1172 bytes} [Sat Jul 2 21:12:54 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:55.185819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:55.191506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:55.200946 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-daf42912-fdd4-456d-bf85-acae14351489 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/images/d4d37b0a-d868-4222-adfb-32f0cc3f8556" status: 204 len: 0 microversion: 2.1 time: 1.178788 Jul 02 21:12:55.204689 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1474/2918] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:54 2022] DELETE /compute/v2.1/images/d4d37b0a-d868-4222-adfb-32f0cc3f8556 => generated 0 bytes in 1181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:55.210618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:55.211273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:55.235401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:55.238702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:55.241618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:55.244559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:55.249109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:55.249821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:55.250952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:55.251555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:56.037117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:56.045088 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b813b98d-6ed0-411f-964f-e219564869bd tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 0.870670 Jul 02 21:12:56.050291 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1445/2919] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:55 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:56.058402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:56.066069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcce9bca-e620-4afd-a651-6c31ebcbcb49 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Action: 'create', calling method: .version_select at 0x7fabe48d1e50>, body: {"server_group": {"name": "tempest-server-group-706603495", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:56.075900 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-479ffeba-333b-4771-82a0-107dca339930 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.868992 Jul 02 21:12:56.076906 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1475/2920] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:55 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:56.086766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-68563094-632c-4c10-9220-115f024a5d39 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] Calling method '.version_select at 0x7fabea2b3940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:56.126296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dcce9bca-e620-4afd-a651-6c31ebcbcb49 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:56.139548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dcce9bca-e620-4afd-a651-6c31ebcbcb49 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:56.195317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:56.255378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dcce9bca-e620-4afd-a651-6c31ebcbcb49 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:56.293287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dcce9bca-e620-4afd-a651-6c31ebcbcb49 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:56.329293 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcce9bca-e620-4afd-a651-6c31ebcbcb49 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.277810 Jul 02 21:12:56.332775 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1446/2921] 10.222.0.43 () {60 vars in 1172 bytes} [Sat Jul 2 21:12:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:56.342794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f58ceadb-9421-4740-b5f0-2b77974f6728 req-8723147f-46a8-4769-a390-bd471866487a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3", "tag": "bf76ff61-209b-4571-a4f4-62e2dbd2ccf8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:56.374053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f58ceadb-9421-4740-b5f0-2b77974f6728 req-8723147f-46a8-4769-a390-bd471866487a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:56.374530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f58ceadb-9421-4740-b5f0-2b77974f6728 req-8723147f-46a8-4769-a390-bd471866487a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:56.410165 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f58ceadb-9421-4740-b5f0-2b77974f6728 req-8723147f-46a8-4769-a390-bd471866487a service nova] Creating event network-changed:bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 for instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 on nch2-master-1 Jul 02 21:12:56.426358 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f58ceadb-9421-4740-b5f0-2b77974f6728 req-8723147f-46a8-4769-a390-bd471866487a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088520 Jul 02 21:12:56.428817 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1447/2922] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:56.443324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d91607bd-64b7-44e9-ba9f-7b9b83421985 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:56.519055 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d91607bd-64b7-44e9-ba9f-7b9b83421985 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/165cec7d-2bc8-40c7-a8b1-8a951d7e4774" status: 204 len: 0 microversion: 2.1 time: 0.088402 Jul 02 21:12:56.522775 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1448/2923] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:12:56 2022] DELETE /compute/v2.1/os-server-groups/165cec7d-2bc8-40c7-a8b1-8a951d7e4774 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:56.531624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d9a88d5-a2ed-4ad5-a0db-d1884c01ffe6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:56.546459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d9a88d5-a2ed-4ad5-a0db-d1884c01ffe6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.019328 Jul 02 21:12:56.547371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1449/2924] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:12:56 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:12:56.571369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be3271a5-98d5-473a-94af-a203a2e45e4d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:56.633636 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be3271a5-98d5-473a-94af-a203a2e45e4d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/7b79a16b-ac5d-48b5-9b56-e3b08f4886b2" status: 204 len: 0 microversion: 2.1 time: 0.080456 Jul 02 21:12:56.640479 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1450/2925] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:12:56 2022] DELETE /compute/v2.1/os-server-groups/7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:56.659811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97a10557-79ba-4f84-8c97-9ef25885c35a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:56.682282 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97a10557-79ba-4f84-8c97-9ef25885c35a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040213 Jul 02 21:12:56.694176 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1451/2926] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:12:56 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:56.701964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1ff3953-0c89-4bb6-a8fd-a40d38cfbeb6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Action: 'create', calling method: .version_select at 0x7fabe4a4a1f0>, body: {"server_group": {"name": "tempest-server-group-1957591708", "policies": ["affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:56.743271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e1ff3953-0c89-4bb6-a8fd-a40d38cfbeb6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:56.756353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e1ff3953-0c89-4bb6-a8fd-a40d38cfbeb6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:56.864868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e1ff3953-0c89-4bb6-a8fd-a40d38cfbeb6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:56.877967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e1ff3953-0c89-4bb6-a8fd-a40d38cfbeb6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:56.913650 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1ff3953-0c89-4bb6-a8fd-a40d38cfbeb6 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.218244 Jul 02 21:12:56.914702 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1452/2927] 10.222.0.43 () {60 vars in 1172 bytes} [Sat Jul 2 21:12:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:56.924218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16d0a560-ad08-466e-9ea7-ad162621e31a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:56.992173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:57.001071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16d0a560-ad08-466e-9ea7-ad162621e31a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab" status: 204 len: 0 microversion: 2.1 time: 0.080719 Jul 02 21:12:57.001658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1453/2928] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:12:56 2022] DELETE /compute/v2.1/os-server-groups/2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:12:57.024106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25c5cc6e-a0c0-4062-9028-7ac8cfe40628 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:57.039451 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25c5cc6e-a0c0-4062-9028-7ac8cfe40628 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.025836 Jul 02 21:12:57.047796 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1454/2929] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:12:57 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:57.052993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e332741-0800-4545-8875-17842bdec02a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Action: 'create', calling method: .version_select at 0x7fabe48d1430>, body: {"server_group": {"name": "tempest-server-group-1021517790", "policies": ["anti-affinity"]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:57.123920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0e332741-0800-4545-8875-17842bdec02a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:57.138219 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-68563094-632c-4c10-9220-115f024a5d39 tempest-ListImageFiltersTestJSON-311458210 tempest-ListImageFiltersTestJSON-311458210-project] 10.222.0.43 "DELETE /compute/v2.1/images/69319717-1981-4e9e-ae56-82cb08a882ce" status: 204 len: 0 microversion: 2.1 time: 1.060064 Jul 02 21:12:57.139658 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1476/2930] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:56 2022] DELETE /compute/v2.1/images/69319717-1981-4e9e-ae56-82cb08a882ce => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:57.149009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:57.151970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0e332741-0800-4545-8875-17842bdec02a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:57.152995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:57.180940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:57.187929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:57.189884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:57.200823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:57.232812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0e332741-0800-4545-8875-17842bdec02a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:12:57.240520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0e332741-0800-4545-8875-17842bdec02a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_groups'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:12:57.261289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e332741-0800-4545-8875-17842bdec02a tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.212197 Jul 02 21:12:57.268088 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1455/2931] 10.222.0.43 () {60 vars in 1172 bytes} [Sat Jul 2 21:12:57 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:57.273664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:57.274696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:57.290403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:12:57.306086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:57.310212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:57.311573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:57.312573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:58.136810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:58.146740 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55e5df27-18be-4d7f-9bb8-8881588fd849 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.876959 Jul 02 21:12:58.150688 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1456/2932] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:57 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:58.163041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-668f2fc6-3dc9-4fec-a1b4-3e71b7765b54 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:58.186867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:12:58.195855 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b65abbfe-859f-4cc3-84c3-b5d724dfd39b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 1.054880 Jul 02 21:12:58.203427 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1477/2933] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:57 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:12:58.218834 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-668f2fc6-3dc9-4fec-a1b4-3e71b7765b54 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/af6520a1-8c6c-4380-acf1-baabe9453779" status: 204 len: 0 microversion: 2.1 time: 0.064710 Jul 02 21:12:58.219455 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1457/2934] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:12:58 2022] DELETE /compute/v2.1/os-server-groups/af6520a1-8c6c-4380-acf1-baabe9453779 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:12:58.232670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6c623263-1320-438b-9c0a-9d4756d3a894 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:58.266170 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6c623263-1320-438b-9c0a-9d4756d3a894 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042300 Jul 02 21:12:58.278116 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1478/2935] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:12:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:12:58.465958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1585832969", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "93660087-7e70-4416-afcf-176a779dcdf7"}]}, "os:scheduler_hints": {"group": "daa43afa-9118-4434-a90b-391abbf6280d"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:12:58.690196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] validate_networks() for [('93660087-7e70-4416-afcf-176a779dcdf7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:12:59.168560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:12:59.169237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:12:59.203183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:59.204382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:12:59.207610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:12:59.211234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:00.105521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:00.130869 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3da68fd-1816-4b40-b600-a91c3bc4fac5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1684 microversion: 2.1 time: 0.966793 Jul 02 21:13:00.134444 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1479/2936] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:12:59 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1684 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:00.173304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:00.175766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:00.184680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:13:00.188368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:13:00.189271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:13:00.189786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:13:00.190424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:13:00.201421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:00.202151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:00.202943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:00.203395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:00.251619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:00.252103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:00.252912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:00.253555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:00.278822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:00.291524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:00.317745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:13:00.320468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:13:00.438555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:00.468923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:00.582674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:00.607997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Getting quotas for user 70f29fd685a149ea85207f47fcbb59d1 and project 4874e0d6bff34bfc9e2672caafad9556. Resources: {'server_group_members'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:00.673085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0bcb3c29-5119-400f-80e9-f5da3455b457 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.211972 Jul 02 21:13:00.676933 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1458/2937] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:13:00.688380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5c38b46-4397-42fc-9144-afd1cdd645e1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:00.691402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5c38b46-4397-42fc-9144-afd1cdd645e1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:00.959173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f5c38b46-4397-42fc-9144-afd1cdd645e1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:00.974810 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5c38b46-4397-42fc-9144-afd1cdd645e1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1213 microversion: 2.1 time: 0.291958 Jul 02 21:13:00.975419 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1459/2938] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:00 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1213 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:01.002331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:01.014324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f7023d16-4b27-4cdf-9e20-01570af90e18 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 0.878438 Jul 02 21:13:01.017806 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1480/2939] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:00 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:01.151802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:01.152781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:01.181560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:01.183604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:01.188957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:01.190250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:01.420311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-124ed03e-ec14-456c-970c-dd16691edb78 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabd7686820>, body: {"keypair": {"name": "tempest-keypair-880937954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2FI73Bk33TsiW4rUIGlXhSva1euhzGI6KeDmaO+aSHwP6iWo2/o71e/uZLc8KVpBX567/dFBYb2bxFBQd5eF2A8vbu9Khv15zuf2FbMdd68ahGyl6PtQY+6wxQmn4kyg=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:01.441947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-124ed03e-ec14-456c-970c-dd16691edb78 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:01.451356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-124ed03e-ec14-456c-970c-dd16691edb78 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:01.500989 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-124ed03e-ec14-456c-970c-dd16691edb78 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.308284 Jul 02 21:13:01.502906 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1481/2940] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 311 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:01.515646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-248a9414-7cfd-46bc-8208-f5cd54584025 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd7686700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:01.525287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-248a9414-7cfd-46bc-8208-f5cd54584025 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-880937954" status: 200 len: 512 microversion: 2.2 time: 0.014107 Jul 02 21:13:01.526478 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1482/2941] 10.222.0.43 () {60 vars in 1254 bytes} [Sat Jul 2 21:13:01 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-880937954 => generated 512 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:01.539760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a889dc1b-e5e2-42ec-98c5-f5579a846587 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd7ea6280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:01.564436 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a889dc1b-e5e2-42ec-98c5-f5579a846587 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880937954" status: 204 len: 0 microversion: 2.2 time: 0.030826 Jul 02 21:13:01.566328 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1483/2942] 10.222.0.43 () {60 vars in 1257 bytes} [Sat Jul 2 21:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880937954 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:01.598196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-afd1a2c6-3aa8-4d47-9e84-b92481d6e692 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabe4694d30>, body: {"keypair": {"name": "tempest-keypair-749210840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHJ+dC2fs6XPW7PBt613+YvOlixVLyKQxZIYhwxX+C23r1w/JeMQG0+o4sO0+dcBxe3w2qG2K/IL7nIb8B2xtlxxb+Wy/S/+iZw2W7v5ixgH0cuLj/5I9XlEpkEf0PAow=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:01.618514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-afd1a2c6-3aa8-4d47-9e84-b92481d6e692 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:01.629512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-afd1a2c6-3aa8-4d47-9e84-b92481d6e692 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:01.754232 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-afd1a2c6-3aa8-4d47-9e84-b92481d6e692 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.172354 Jul 02 21:13:01.755042 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1484/2943] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 174 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:01.768356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b494c7b5-08ea-4534-96d2-878ade165ec5 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd780e040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:01.780851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:01.801528 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8797ccef-c04b-4ea1-b33a-4bc160ea8c8c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.654764 Jul 02 21:13:01.808028 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1460/2944] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:01 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:01.811875 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b494c7b5-08ea-4534-96d2-878ade165ec5 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-749210840" status: 204 len: 0 microversion: 2.2 time: 0.048960 Jul 02 21:13:01.813265 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1485/2945] 10.222.0.43 () {60 vars in 1257 bytes} [Sat Jul 2 21:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-749210840 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:01.863683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5e80fbf-ae59-4f94-a03a-108954733fe0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabea206820>, body: {"keypair": {"name": "tempest-keypair-776575237", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:01.901456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e5e80fbf-ae59-4f94-a03a-108954733fe0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:01.907627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e5e80fbf-ae59-4f94-a03a-108954733fe0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:01.964900 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5e80fbf-ae59-4f94-a03a-108954733fe0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.111156 Jul 02 21:13:01.974594 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1461/2946] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:01 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:01.977647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18a4a482-2b5e-4c7c-84c1-5e2f7cdfaee0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd7ea69d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.019176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.032861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:02.058640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:02.059109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:02.059925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:02.060577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:02.070287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18a4a482-2b5e-4c7c-84c1-5e2f7cdfaee0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-776575237" status: 204 len: 0 microversion: 2.2 time: 0.098642 Jul 02 21:13:02.071206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1486/2947] 10.222.0.43 () {60 vars in 1257 bytes} [Sat Jul 2 21:13:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-776575237 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:13:02.082540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.083653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:02.124231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:02.125451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:02.126669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:02.128101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:02.182829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:02.196771 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a073d70b-d89b-4a01-bee7-e5dcbe13302b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1265 microversion: 2.1 time: 0.201989 Jul 02 21:13:02.207100 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1462/2948] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:01 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:02.212641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ff7374c9-9506-4093-bb1d-4cf2eb20bc52 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabe45b2550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-903780592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLpNrS5ySvqKRcmUGhP4XNEz6vbm1q7cmS7FUK26E7phANxeNDfQ39UbBDyWZOhZPVMBlPakNSpTcZ51DEPy6FjoqYLQd6ZkUHzbbVFY1MJHSZE/cbRqfU96l/uCzNrLA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:02.255450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ff7374c9-9506-4093-bb1d-4cf2eb20bc52 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:02.291842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ff7374c9-9506-4093-bb1d-4cf2eb20bc52 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:02.343018 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ff7374c9-9506-4093-bb1d-4cf2eb20bc52 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.134579 Jul 02 21:13:02.343777 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1463/2949] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:02 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:02.356616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebaab27f-3081-416a-a9f1-6949f0d46bd3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabe42a4670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-368032894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIGrrtQmN5N1OxyhkWKjAo3CptAexkS9C03jawkzTGlXRMfi3u6prls1ZojnEqwaKfVoNlEwLpqqAy9ssAT2BOxZEAWatGUEeM4R38ekLj5ZoHCPPLMUaREwXmxC20SEVg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:02.386837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ebaab27f-3081-416a-a9f1-6949f0d46bd3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:02.393564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ebaab27f-3081-416a-a9f1-6949f0d46bd3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:02.447693 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebaab27f-3081-416a-a9f1-6949f0d46bd3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.095319 Jul 02 21:13:02.449261 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1464/2950] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:02 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:02.461534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f239c2-d100-4017-9891-696dae23868a tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabe48d1430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-191173429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIiba+SYX4XJFqME701Uy4f1YZNCYc77Ed42+68LO+8XCI0SKIfCK2deNBz9Bwf6ia50OSu2iRjJUOcs+s4FelO/gLP/EsOyB/ac/g1EUmQI3bzbeYj8MVL7HuwQf/MNw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:02.495461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-84f239c2-d100-4017-9891-696dae23868a tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:02.499634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=3,nova_api:INSERT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:02.504859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-84f239c2-d100-4017-9891-696dae23868a tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:02.514851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:02.540199 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc7d4359-d2f6-4900-9d24-84b26e0a696f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 0.466196 Jul 02 21:13:02.542986 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1487/2951] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:02 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:02.580423 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84f239c2-d100-4017-9891-696dae23868a tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.122864 Jul 02 21:13:02.581937 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1465/2952] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:02 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:02.593468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e153e17b-148b-43aa-8c4e-45a8cb8a9083 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd7ea6b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.596841 ncdv-master-1 devstack@n-api.service[131045]: WARNING oslo_db.sqlalchemy.utils [None req-e153e17b-148b-43aa-8c4e-45a8cb8a9083 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 02 21:13:02.609423 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e153e17b-148b-43aa-8c4e-45a8cb8a9083 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.021006 Jul 02 21:13:02.610562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1488/2953] 10.222.0.43 () {60 vars in 1176 bytes} [Sat Jul 2 21:13:02 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:02.622223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56b8abbf-d51b-452d-bebd-25816b8d8b38 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabe456bca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.666091 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56b8abbf-d51b-452d-bebd-25816b8d8b38 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-191173429" status: 204 len: 0 microversion: 2.2 time: 0.047231 Jul 02 21:13:02.677098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46e9a88a-74da-4950-bba2-0c08da3f5f65 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabe46945e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.685132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1466/2954] 10.222.0.43 () {60 vars in 1317 bytes} [Sat Jul 2 21:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-191173429 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:02.718372 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-46e9a88a-74da-4950-bba2-0c08da3f5f65 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-368032894" status: 204 len: 0 microversion: 2.2 time: 0.042577 Jul 02 21:13:02.725080 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1489/2955] 10.222.0.43 () {60 vars in 1317 bytes} [Sat Jul 2 21:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-368032894 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:02.733373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22bd4c46-73fd-4a93-acab-8429f98f63f0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabe487d670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.780358 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22bd4c46-73fd-4a93-acab-8429f98f63f0 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-903780592" status: 204 len: 0 microversion: 2.2 time: 0.055013 Jul 02 21:13:02.781595 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1467/2956] 10.222.0.43 () {60 vars in 1317 bytes} [Sat Jul 2 21:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-903780592 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:02.797068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d952015e-1b9d-4746-af29-2c3de5960428 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabea2bd790>, body: {"keypair": {"name": "tempest-keypair-655877552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4N0FbJNUrGkPn1TYRFqsLDlakvwVl8tdGtpUPoAstgHIn8HO+WLBSK75gslRBiHyu/Lps8TsDnmK4CpOqYXn8zdyO6sLT2nu46CxOlZ9iLTZK3ASRmZsTOsRH20L1fnw=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:02.826222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d952015e-1b9d-4746-af29-2c3de5960428 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:02.836636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d952015e-1b9d-4746-af29-2c3de5960428 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:02.876346 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d952015e-1b9d-4746-af29-2c3de5960428 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.085051 Jul 02 21:13:02.883162 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1490/2957] 10.222.0.43 () {62 vars in 1198 bytes} [Sat Jul 2 21:13:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 94 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 02 21:13:02.889978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beb495a9-de14-40c8-9a15-4c0c21b8c228 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabe47c1160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.900408 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-beb495a9-de14-40c8-9a15-4c0c21b8c228 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-655877552" status: 200 len: 512 microversion: 2.2 time: 0.015974 Jul 02 21:13:02.901369 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1468/2958] 10.222.0.43 () {60 vars in 1254 bytes} [Sat Jul 2 21:13:02 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-655877552 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:02.914407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e450fed-b5d9-4631-9e89-ca530c6180ae tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd7ea6ca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.919793 ncdv-master-1 devstack@n-api.service[131045]: WARNING oslo_db.sqlalchemy.utils [None req-4e450fed-b5d9-4631-9e89-ca530c6180ae tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 02 21:13:02.927038 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e450fed-b5d9-4631-9e89-ca530c6180ae tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.017745 Jul 02 21:13:02.934566 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1491/2959] 10.222.0.43 () {60 vars in 1176 bytes} [Sat Jul 2 21:13:02 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:02.940536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9dc4fa10-5756-449d-80a1-c6a469a5b15d tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabe487ddc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:02.977094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9dc4fa10-5756-449d-80a1-c6a469a5b15d tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-655877552" status: 204 len: 0 microversion: 2.2 time: 0.041685 Jul 02 21:13:02.978276 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1469/2960] 10.222.0.43 () {60 vars in 1257 bytes} [Sat Jul 2 21:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-655877552 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:02.988231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Action: 'create', calling method: .version_select at 0x7fabea2bb940>, body: {"keypair": {"name": "tempest-keypair-341744910", "type": "x509"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:03.007368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:03.014308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:03.053709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.processutils [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp79iik5c3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp79iik5c3/temp.key -subj /CN=08656d37cd7148fc82b2629d814fcaf2 -extensions v3_req_client {{(pid=131045) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 02 21:13:03.083671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:03.084432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:03.101410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:03.102219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:03.103308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:03.103914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:03.348615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:03.361114 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c11b2bb0-9909-4984-86f8-a9c3a9f72686 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.294002 Jul 02 21:13:03.372381 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1470/2961] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:03 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:03.383063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:03.383063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:03.393093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:03.393572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:03.394956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:03.395418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:03.539711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:03.550801 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3136e40f-1a1a-4a3a-9721-8062adae80b1 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1271 microversion: 2.1 time: 0.176483 Jul 02 21:13:03.555038 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1471/2962] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:03 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:03.560152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:03.560951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:03.570207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.processutils [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp79iik5c3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp79iik5c3/temp.key -subj /CN=08656d37cd7148fc82b2629d814fcaf2 -extensions v3_req_client" returned: 0 in 0.516s {{(pid=131045) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 02 21:13:03.570755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:03.571884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.processutils [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp79iik5c3/temp.key -password pass: {{(pid=131045) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 02 21:13:03.572628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:03.576016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:03.576682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:03.624103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.processutils [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp79iik5c3/temp.key -password pass:" returned: 0 in 0.051s {{(pid=131045) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 02 21:13:03.694334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:03.702026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Getting quotas for user 08656d37cd7148fc82b2629d814fcaf2 and project 763faa5aa9894c6993b26c59764cdf4a. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:03.736473 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fc51a2b-cb9c-4293-a9f6-0f746ceb6ba1 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.751579 Jul 02 21:13:03.742785 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1492/2963] 10.222.0.43 () {62 vars in 1197 bytes} [Sat Jul 2 21:13:02 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 759 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:03.750400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce520882-dc2d-4e40-8156-5f964595c610 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabea2bb700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:03.756654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:03.761241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce520882-dc2d-4e40-8156-5f964595c610 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs/tempest-keypair-341744910" status: 200 len: 1533 microversion: 2.2 time: 0.016499 Jul 02 21:13:03.769572 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1493/2964] 10.222.0.43 () {60 vars in 1254 bytes} [Sat Jul 2 21:13:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-341744910 => generated 1533 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:03.780883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9a83bbb-dd89-4a47-a644-ac776cc912e3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabd7ea6ee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:03.784667 ncdv-master-1 devstack@n-api.service[131045]: WARNING oslo_db.sqlalchemy.utils [None req-b9a83bbb-dd89-4a47-a644-ac776cc912e3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 02 21:13:03.789828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:03.793970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9a83bbb-dd89-4a47-a644-ac776cc912e3 tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.022764 Jul 02 21:13:03.799356 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1494/2965] 10.222.0.43 () {60 vars in 1176 bytes} [Sat Jul 2 21:13:03 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:03.803274 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98217519-c463-40e1-b86c-aa9b81913899 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 0.246968 Jul 02 21:13:03.803878 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1472/2966] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:03 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:03.806578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b61f75ca-6bad-4640-82c9-e1b3b461e09a tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] Calling method '.version_select at 0x7fabea2bd310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:03.830557 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b61f75ca-6bad-4640-82c9-e1b3b461e09a tempest-KeyPairsV22TestJSON-173999617 tempest-KeyPairsV22TestJSON-173999617-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-341744910" status: 204 len: 0 microversion: 2.2 time: 0.029280 Jul 02 21:13:03.862084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1495/2967] 10.222.0.43 () {60 vars in 1257 bytes} [Sat Jul 2 21:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-341744910 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:04.369016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5b24e096-edc1-4ee2-b76e-73deabedc42e req-0b287582-79d4-44e7-adc0-fbdc605df268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3", "name": "network-vif-plugged", "status": "completed", "tag": "bf76ff61-209b-4571-a4f4-62e2dbd2ccf8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:04.401040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b24e096-edc1-4ee2-b76e-73deabedc42e req-0b287582-79d4-44e7-adc0-fbdc605df268 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:04.402105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b24e096-edc1-4ee2-b76e-73deabedc42e req-0b287582-79d4-44e7-adc0-fbdc605df268 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:04.440817 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5b24e096-edc1-4ee2-b76e-73deabedc42e req-0b287582-79d4-44e7-adc0-fbdc605df268 service nova] Creating event network-vif-plugged:bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 for instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 on nch2-master-1 Jul 02 21:13:04.448954 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5b24e096-edc1-4ee2-b76e-73deabedc42e req-0b287582-79d4-44e7-adc0-fbdc605df268 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084460 Jul 02 21:13:04.450308 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1473/2968] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:04.571461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:04.572845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:04.611329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:04.613690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:04.616759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:04.618173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:04.632022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:04.826395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:04.827158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:04.846003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:04.846459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:04.850759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:04.851260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:05.140203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:05.150073 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ce72eba-6ab2-437a-bc5f-6376c4011387 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1313 microversion: 2.1 time: 0.583898 Jul 02 21:13:05.160427 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1496/2969] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:04 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:05.175265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d84208fe-383b-4386-bf69-0e2d96abb212 req-ca57d294-3c8d-4b4a-9516-58775f605ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fce3bc6-ab40-4471-acb2-a78a1acdd9db", "tag": "4d24f486-f833-431e-9582-83ce4c3fbc44"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:05.198931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d84208fe-383b-4386-bf69-0e2d96abb212 req-ca57d294-3c8d-4b4a-9516-58775f605ad4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:05.199599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d84208fe-383b-4386-bf69-0e2d96abb212 req-ca57d294-3c8d-4b4a-9516-58775f605ad4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:05.229263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d84208fe-383b-4386-bf69-0e2d96abb212 req-ca57d294-3c8d-4b4a-9516-58775f605ad4 service nova] Creating event network-changed:4d24f486-f833-431e-9582-83ce4c3fbc44 for instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db on nch1-master-1 Jul 02 21:13:05.243194 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d84208fe-383b-4386-bf69-0e2d96abb212 req-ca57d294-3c8d-4b4a-9516-58775f605ad4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071957 Jul 02 21:13:05.244364 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1497/2970] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:05.259696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:05.267579 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ce96a60-c74d-419a-94e2-2ffb9a7b0ee7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1314 microversion: 2.1 time: 0.446512 Jul 02 21:13:05.268226 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1474/2971] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:04 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:06.026915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:06.027707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.034302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.034764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.035554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.036001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.177268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:06.178885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.187015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.187456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.188706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.189871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.198523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:06.207219 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d3b87c4f-c544-4c1b-8476-e38608095ff0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.186297 Jul 02 21:13:06.207833 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1498/2972] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:06 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:06.223821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:06.224642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.231911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.232669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.233824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.234536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.440963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:06.453430 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7e5f97b-eaeb-4034-af09-fe7404781621 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1313 microversion: 2.1 time: 0.280113 Jul 02 21:13:06.454948 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1475/2973] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:06 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:06.461875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:06.463200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.475266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.475736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.476239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:06.476560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.477000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.495018 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb1eda7e-3714-4924-bc3f-5bb3c9280702 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.275153 Jul 02 21:13:06.495623 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1499/2974] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:06 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:06.510821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:06.511909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.518156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.518601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.519675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.520151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.720329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:06.729714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-287d1ab5-fdcc-4abe-ba2b-308fb0445d60 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1502 microversion: 2.1 time: 0.273136 Jul 02 21:13:06.730257 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1476/2975] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:06 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1502 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:06.735966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8622bbc4-4f99-4d8f-b4bc-ac935d241528 req-09842d07-ecaf-4b32-b2e0-3f5180483669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-unplugged", "status": "completed", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:06.744661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8622bbc4-4f99-4d8f-b4bc-ac935d241528 req-09842d07-ecaf-4b32-b2e0-3f5180483669 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.745174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8622bbc4-4f99-4d8f-b4bc-ac935d241528 req-09842d07-ecaf-4b32-b2e0-3f5180483669 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.755295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:06.759251 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8622bbc4-4f99-4d8f-b4bc-ac935d241528 req-09842d07-ecaf-4b32-b2e0-3f5180483669 service nova] Creating event network-vif-unplugged:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:13:06.772348 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba93a873-cb61-4e0d-a803-94c21664b0f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.257102 Jul 02 21:13:06.772348 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1500/2976] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:06 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:06.772630 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8622bbc4-4f99-4d8f-b4bc-ac935d241528 req-09842d07-ecaf-4b32-b2e0-3f5180483669 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034680 Jul 02 21:13:06.772630 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1477/2977] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:06.772778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-538932955"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:06.772778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.781717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.782365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.783158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.783602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.792263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:06.793331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.802849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.804002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.806189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.806970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.913067 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24c4ed4b-ccbb-4ca9-a349-36399e79266d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.125069 Jul 02 21:13:06.914799 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1478/2978] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:06 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:13:06.925409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:06.926604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:06.939580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.940317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.941829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:06.942898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:06.947775 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.security_group_api [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Adding security group caf622f1-f551-4de4-b666-57f8df970b89 to port bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 Jul 02 21:13:07.311741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:07.327298 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1abef820-3177-464e-9371-3dbb5835b5de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1673 microversion: 2.1 time: 0.406697 Jul 02 21:13:07.328583 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1479/2979] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:06 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1673 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:07.470978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:07.471608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:07.480205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:07.480666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:07.481469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:07.483608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:07.878169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:07.904492 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-25e87d1e-f178-48ce-a44d-1ba7498ede8b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3/action" status: 202 len: 0 microversion: 2.1 time: 1.137421 Jul 02 21:13:07.905724 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1501/2980] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:06 2022] POST /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3/action => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:07.917394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:07.936864 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37b94a37-d2cc-47f3-9105-e33e4ff296c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1313 microversion: 2.1 time: 0.469515 Jul 02 21:13:07.938337 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1480/2981] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:07 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:07.958279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5a7a518c-6690-4ff0-ba64-d993759171c8 req-e8ea7033-555f-448b-b42e-708ace2e1d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3", "tag": "bf76ff61-209b-4571-a4f4-62e2dbd2ccf8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:07.975656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a7a518c-6690-4ff0-ba64-d993759171c8 req-e8ea7033-555f-448b-b42e-708ace2e1d69 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:07.976741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a7a518c-6690-4ff0-ba64-d993759171c8 req-e8ea7033-555f-448b-b42e-708ace2e1d69 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:08.007828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5a7a518c-6690-4ff0-ba64-d993759171c8 req-e8ea7033-555f-448b-b42e-708ace2e1d69 service nova] Creating event network-changed:bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 for instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 on nch2-master-1 Jul 02 21:13:08.020301 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5a7a518c-6690-4ff0-ba64-d993759171c8 req-e8ea7033-555f-448b-b42e-708ace2e1d69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079772 Jul 02 21:13:08.020935 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1481/2982] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:08.038551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-729403758"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:08.042072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:08.057427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:08.057799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:08.069576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:08.070099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:08.136386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-828349373", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:08.228869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:13:08.656459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.network.security_group_api [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Adding security group 07772168-ec52-4286-828f-e43ade9fea88 to port bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 Jul 02 21:13:08.820831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:13:08.821331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:13:08.821923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:13:08.822548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:13:08.823085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:13:08.835139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:08.835983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:08.837032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:08.837474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:08.860289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Getting quotas for project 79a9f342331e41468cfbf45d04f8d623. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:08.866973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Getting quotas for user 19fe81e09ba144b393a3809b89c6f8d5 and project 79a9f342331e41468cfbf45d04f8d623. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:08.883072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:13:08.885710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:13:08.943453 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-675b8c87-078b-41e0-8de1-a0da10fc8c95 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035774 Jul 02 21:13:08.945544 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1502/2983] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:13:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:13:08.957806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:08.958887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:08.971686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:08.972919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:08.976774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:08.977428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:09.619008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:09.627623 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f0d0fa8-ee94-45ad-b76c-20e4a8b8826c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1678 microversion: 2.1 time: 0.680610 Jul 02 21:13:09.636236 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1503/2984] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:08 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1678 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:09.645444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:09.646072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:09.670450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:09.673580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:09.678444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:09.680409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:09.972003 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0afbef56-2782-4981-807c-a961d5491411 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3/action" status: 202 len: 0 microversion: 2.1 time: 1.947210 Jul 02 21:13:09.972659 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1482/2985] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:08 2022] POST /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3/action => generated 0 bytes in 1951 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:09.983873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:09.984788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:09.996024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:09.997450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:09.998396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:09.999018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:10.227392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:10.237086 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e459f9ec-b054-4fce-bea8-5362e6c3a8cb tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1270 microversion: 2.1 time: 0.263291 Jul 02 21:13:10.244137 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1483/2986] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:09 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1270 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:10.252409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:10.256020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:10.273257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:10.273733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:10.286326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:10.286826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:10.289653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:10.607384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:10.620342 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-deb84387-b05b-40fc-bb4a-2326e5e10fd7 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1313 microversion: 2.1 time: 0.978630 Jul 02 21:13:10.621629 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1504/2987] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:09 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1313 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:10.627271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-07b09050-4dbf-4371-b22a-9cc2c910950f req-7eb9a577-e42a-4aa6-84e1-9fa7a30784ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3", "tag": "bf76ff61-209b-4571-a4f4-62e2dbd2ccf8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:10.647234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-07b09050-4dbf-4371-b22a-9cc2c910950f req-7eb9a577-e42a-4aa6-84e1-9fa7a30784ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:10.648279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-07b09050-4dbf-4371-b22a-9cc2c910950f req-7eb9a577-e42a-4aa6-84e1-9fa7a30784ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:10.662758 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-07b09050-4dbf-4371-b22a-9cc2c910950f req-7eb9a577-e42a-4aa6-84e1-9fa7a30784ce service nova] Creating event network-changed:bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 for instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 on nch2-master-1 Jul 02 21:13:10.668980 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-07b09050-4dbf-4371-b22a-9cc2c910950f req-7eb9a577-e42a-4aa6-84e1-9fa7a30784ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045788 Jul 02 21:13:10.670437 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1505/2988] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:10.675855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:10.677918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:10.687311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:10.688362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:10.690501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:10.692125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:11.424927 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8823b6b-ea62-4ced-9d15-1acf68465ad1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 1.179453 Jul 02 21:13:11.426805 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1484/2989] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:13:10 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3/os-security-groups => generated 1154 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:11.433439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:11.434443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:11.444217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:11.444814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:11.455934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:11.456776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:11.573893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:11.586800 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-23bfb5e5-d3f2-4d2f-93e3-7181c16a7b77 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.914974 Jul 02 21:13:11.588003 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1506/2990] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:10 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:11.602482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b7a435a-0818-4650-b996-26a53882646f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabe46d3c10>, body: {"security_group": {"name": " tempest-securitygroup -406377594 ", "description": "tempest-description-628421107"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:11.980341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:11.991195 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8864dcd0-6b85-4c7a-8b78-117886ab530d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1318 microversion: 2.1 time: 0.562267 Jul 02 21:13:12.004322 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1485/2991] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:11 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1318 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:12.010537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:12.011753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:12.028033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.028955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.030623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.032366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.089662 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f405b9b6-41b4-451d-8318-488c47bf0cec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 200 len: 322 microversion: 2.1 time: 0.083619 Jul 02 21:13:12.091070 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1486/2992] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:12 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 322 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:12.098015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:12.099957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:12.114501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.115302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.118806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.119608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.517345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:12.531519 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a02b755-7f3c-4247-b4ae-775f855e2d10 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1313 microversion: 2.1 time: 0.437558 Jul 02 21:13:12.534252 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1487/2993] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:12 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:12.546484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:12.547315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:12.558814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=80 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:12.561281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.561648 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b7a435a-0818-4650-b996-26a53882646f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.972384 Jul 02 21:13:12.562400 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1507/2994] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:11 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:12.568229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ff6feffe-c405-4476-8c29-7f67a82654ad req-d434ec04-af21-481a-894c-51062ab6e047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83b84bf7-6cdb-4210-af84-cb6a31f12be1", "tag": "677d764f-fd62-47ee-b02c-8b2c5d07ed96"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:12.570366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.575475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.577041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.593423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ff6feffe-c405-4476-8c29-7f67a82654ad req-d434ec04-af21-481a-894c-51062ab6e047 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.593911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ff6feffe-c405-4476-8c29-7f67a82654ad req-d434ec04-af21-481a-894c-51062ab6e047 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.620490 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ff6feffe-c405-4476-8c29-7f67a82654ad req-d434ec04-af21-481a-894c-51062ab6e047 service nova] Creating event network-changed:677d764f-fd62-47ee-b02c-8b2c5d07ed96 for instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 on nch2-master-1 Jul 02 21:13:12.626139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ff6feffe-c405-4476-8c29-7f67a82654ad req-d434ec04-af21-481a-894c-51062ab6e047 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062235 Jul 02 21:13:12.626766 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1508/2995] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:12.641404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3b96a0a3-9b60-4b5f-8104-1c4a89c783a2 req-9745103a-7aec-4302-90c0-5eecb4121469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fce3bc6-ab40-4471-acb2-a78a1acdd9db", "name": "network-vif-plugged", "status": "completed", "tag": "4d24f486-f833-431e-9582-83ce4c3fbc44"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:12.650760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3b96a0a3-9b60-4b5f-8104-1c4a89c783a2 req-9745103a-7aec-4302-90c0-5eecb4121469 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:12.651491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3b96a0a3-9b60-4b5f-8104-1c4a89c783a2 req-9745103a-7aec-4302-90c0-5eecb4121469 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:12.684578 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3b96a0a3-9b60-4b5f-8104-1c4a89c783a2 req-9745103a-7aec-4302-90c0-5eecb4121469 service nova] Creating event network-vif-plugged:4d24f486-f833-431e-9582-83ce4c3fbc44 for instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db on nch1-master-1 Jul 02 21:13:12.695119 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3b96a0a3-9b60-4b5f-8104-1c4a89c783a2 req-9745103a-7aec-4302-90c0-5eecb4121469 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066620 Jul 02 21:13:12.696768 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1509/2996] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:12.702539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-709f7280-f976-4dbb-824d-d2e2dce4e523 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe46c49d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:12.895571 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-709f7280-f976-4dbb-824d-d2e2dce4e523 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02" status: 200 len: 222 microversion: 2.1 time: 0.197349 Jul 02 21:13:12.897293 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1510/2997] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:12 2022] GET /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02 => generated 222 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:12.907667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26a353c0-dbe7-4718-8412-bff4826530c3 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe462f670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:13.022796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:13.032566 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b67b650-9a22-4935-b65f-15d7e4f057d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.496385 Jul 02 21:13:13.047552 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1488/2998] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:12 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:13.055345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:13.056346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:13.063901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.064736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.065522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.066142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.431416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:13.444540 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1021587e-e3b7-4185-a036-c916c3ba0c29 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1318 microversion: 2.1 time: 0.393443 Jul 02 21:13:13.446673 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1489/2999] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:13 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:13.458437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:13.459836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:13.472754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.475476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.477107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.478682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.585564 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26a353c0-dbe7-4718-8412-bff4826530c3 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02" status: 202 len: 0 microversion: 2.1 time: 0.680899 Jul 02 21:13:13.586829 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1511/3000] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:12 2022] DELETE /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02 => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:13:13.595438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:13.596591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:13.607067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.608272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.609271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.610324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.832624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:13.841963 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-769f470e-3839-4a7a-83fe-f7cc812af513 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.392872 Jul 02 21:13:13.842888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1490/3001] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:13 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:13.847940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4959af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:13.918849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:13.919494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group 8b993373-560b-4988-8f40-930cb3fe0b02 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:13:13.923854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:13.924511 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.924511 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] Jul 02 21:13:13.932991 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c26a0e1e-cfdf-44f5-832f-eb60fc69c411 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1313 microversion: 2.1 time: 0.341374 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02 HTTP/1.1 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8b993373-560b-4988-8f40-930cb3fe0b02'} Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.933527 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-fa52aa87-8d17-4178-bb11-d1b9ba47d79b'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:13.939225 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-263f382e-d566-4422-99ed-c903f61d5a69 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02" status: 404 len: 194 microversion: 2.1 time: 0.091941 Jul 02 21:13:13.945238 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1512/3002] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:13 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:13.945390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1491/3003] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:13 2022] GET /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:13.950812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:13.951739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:13.953350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ea3ae71-885d-4b67-aacf-ef07631d159d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabe468a160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-110001728", "description": "tempest-description-1392686180"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:13.959320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.960116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:13.961133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:13.961791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:14.529875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:14.543952 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db1564c0-430a-48da-ad40-fd234a83f0ac tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.597187 Jul 02 21:13:14.545406 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1513/3004] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:13 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:14.553203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:14.554558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:14.573467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:14.574047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:14.575653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:14.576306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:14.638380 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ea3ae71-885d-4b67-aacf-ef07631d159d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.692755 Jul 02 21:13:14.645260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1492/3005] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:14.653393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:14.654478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:14.666666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:14.667432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:14.669213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:14.669846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:14.944607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:14.962766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:14.964357 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-639222c9-aab3-4306-b5e5-367f49a34417 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1318 microversion: 2.1 time: 0.416813 Jul 02 21:13:14.970727 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22f35944-1112-4a86-a57a-092a33372961 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.322864 Jul 02 21:13:14.971567 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1493/3006] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:14 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:14.976536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee8c0cb7-2fb5-476d-8864-13c6423423d7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabe42a4670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-522096803", "description": "tempest-description-1916872264"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:14.980694 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1514/3007] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:14 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:14.998551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:14.999383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:15.005630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.006278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:15.011886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.012623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:15.305793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:15.315124 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d987f6f3-a5d4-455a-95d4-2917d300d58d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1497 microversion: 2.1 time: 0.333476 Jul 02 21:13:15.320672 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1515/3008] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:14 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1497 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:15.328140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:15.331584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:15.339807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Searching by: {'deleted': False, 'project_id': '116d106003e54750a7e57d37e6a8798a'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:13:15.341016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee8c0cb7-2fb5-476d-8864-13c6423423d7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.368055 Jul 02 21:13:15.341921 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1494/3009] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:15.348122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1810760473", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "8f9f01f3-6960-405f-bcaa-01885e028463"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:15.349681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.350144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:15.350970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.351424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:15.387273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:13:15.441045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] validate_networks() for [('8f9f01f3-6960-405f-bcaa-01885e028463', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:13:15.447380 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7f6c5809-1909-4f84-8784-e76cd6a89fef tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.125378 Jul 02 21:13:15.448498 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1516/3010] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:13:15 2022] GET /compute/v2.1/servers => generated 339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:15.453931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b374b70-65da-49ae-b8e0-e1820faeef2d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:15.471658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.compute.server_groups [None req-2b374b70-65da-49ae-b8e0-e1820faeef2d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Querying cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) for 1 instances {{(pid=131045) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 02 21:13:15.472889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b374b70-65da-49ae-b8e0-e1820faeef2d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.473526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b374b70-65da-49ae-b8e0-e1820faeef2d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:15.495318 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b374b70-65da-49ae-b8e0-e1820faeef2d tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/daa43afa-9118-4434-a90b-391abbf6280d" status: 200 len: 221 microversion: 2.1 time: 0.045495 Jul 02 21:13:15.496967 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1517/3011] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:13:15 2022] GET /compute/v2.1/os-server-groups/daa43afa-9118-4434-a90b-391abbf6280d => generated 221 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:15.502226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9d43bd8-79fb-42a4-abc3-1f6ed02a9e96 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabd77a6700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-40947438", "description": "tempest-description-117056034"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:15.919223 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9d43bd8-79fb-42a4-abc3-1f6ed02a9e96 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.420767 Jul 02 21:13:15.920078 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1518/3012] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:15 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:15.929904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:15.933766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:15.939520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Searching by: {'deleted': False, 'project_id': '116d106003e54750a7e57d37e6a8798a'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:13:15.947634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.948801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:15.954002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:15.954785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.000078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:13:16.082606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:16.091848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.092582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.099824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:16.181239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:13:16.181835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:13:16.182137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:13:16.182853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:13:16.183440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:13:16.199651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.200714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.203167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.203777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.251757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:16.263942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for user 419f3872408c4d8c9a2980d6397d0aea and project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:16.287668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:13:16.291524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:13:16.332741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79eb752a-2dd5-4624-910d-7471ffab814a tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.411390 Jul 02 21:13:16.333769 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1519/3013] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:13:15 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:16.338508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:16.339234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:16.347666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.349233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.350401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.351179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.397918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:13:16.449137 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95ba1e5d-79f1-4243-87ee-d44697039280 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103601 Jul 02 21:13:16.450023 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1495/3014] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:13:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:13:16.463243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-358a7295-9965-4e4a-bb17-3d2c4b865d5a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4ad4820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:16.550334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f8dd712-aedc-4b55-bc69-a186902db001 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 204 len: 0 microversion: 2.1 time: 0.214021 Jul 02 21:13:16.552903 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1520/3015] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:13:16 2022] DELETE /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:16.567532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:16.570078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:16.578617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.579768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.580870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:16.581524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:16.897845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:16.911547 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-997f03c6-5f6f-4226-9198-e085541da86d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1318 microversion: 2.1 time: 0.352976 Jul 02 21:13:16.922371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1521/3016] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:16 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:16.928020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-faefdfe6-03d4-4e20-9b7e-7c323dbdee88 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:16.956980 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-faefdfe6-03d4-4e20-9b7e-7c323dbdee88 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039692 Jul 02 21:13:16.958076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1522/3017] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:13:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:16.970395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1282af3a-ebb0-4390-8cdb-70700728bfa1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:16.973008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1282af3a-ebb0-4390-8cdb-70700728bfa1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:17.021515 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-358a7295-9965-4e4a-bb17-3d2c4b865d5a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1827 microversion: 2.1 time: 0.569518 Jul 02 21:13:17.022462 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1496/3018] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:13:16 2022] GET /compute/v2.1/os-security-groups => generated 1827 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:17.033270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:17.034151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:17.065892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:17.066736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:17.067859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:17.069015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:17.122576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1282af3a-ebb0-4390-8cdb-70700728bfa1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:17.131343 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1282af3a-ebb0-4390-8cdb-70700728bfa1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1215 microversion: 2.1 time: 0.166826 Jul 02 21:13:17.132933 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1523/3019] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:16 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1215 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:17.145291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3635132-f252-49ba-8688-8f04c1d44c90 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4694040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:17.436057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:17.445388 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19655e73-43fd-472f-ac1d-410f822de90b tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1503 microversion: 2.1 time: 0.421590 Jul 02 21:13:17.451923 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1497/3020] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:17 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:17.464235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:17.465123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:17.483193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:17.483668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:17.484520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:17.484964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:17.527355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:13:17.591163 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3635132-f252-49ba-8688-8f04c1d44c90 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62" status: 202 len: 0 microversion: 2.1 time: 0.456941 Jul 02 21:13:17.594553 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1524/3021] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:17 2022] DELETE /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62 => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:17.602859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabea2bbc10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:17.645908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:17.647073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:13:17.647879 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.647879 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62 HTTP/1.1 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'eda7cb9c-2654-46b0-88fc-77b8490a3a62'} Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.654675 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] Jul 02 21:13:17.659899 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:17.665007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:13:17.665007 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-09c48303-0dde-4a4c-902a-7d145ed50490'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:17.666424 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dfb068ce-8826-4164-a9f5-c178be02e5ff tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62" status: 404 len: 194 microversion: 2.1 time: 0.067801 Jul 02 21:13:17.668295 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1525/3022] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:17 2022] GET /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62 => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:17.676991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e91f129-904b-4c33-bf5a-9f6165e7b2eb tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 204 len: 0 microversion: 2.1 time: 0.223344 Jul 02 21:13:17.681654 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1498/3023] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:13:17 2022] DELETE /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:17.683876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-beb9d371-8860-43dd-b1c9-bea2dce0f23d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabea1e68b0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:17.692184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:17.693038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:17.700681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:17.701221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:17.702933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:17.704405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.000850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:18.012306 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38be97bb-4a07-48e7-827e-6921f47ff3d3 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1714 microversion: 2.1 time: 0.327267 Jul 02 21:13:18.013675 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1499/3024] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:17 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1714 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:18.019241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:18.020294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:18.030614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.031600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.032661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.033481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.085110 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-beb9d371-8860-43dd-b1c9-bea2dce0f23d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79" status: 202 len: 0 microversion: 2.1 time: 0.411310 Jul 02 21:13:18.086623 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1526/3025] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:17 2022] DELETE /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79 => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:18.095553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd7ea6ee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:18.128708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:18.129403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group 85886d71-8188-462b-b0b2-1c35153aca79 not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:13:18.129844 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.129844 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79 HTTP/1.1 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '85886d71-8188-462b-b0b2-1c35153aca79'} Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.131834 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] Jul 02 21:13:18.136394 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:18.141409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:13:18.141409 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-32569f16-e88e-4a91-98c5-769691f06b9f'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:18.144180 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59ff5097-7de5-4914-aeb3-b601fac46cc7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79" status: 404 len: 194 microversion: 2.1 time: 0.053223 Jul 02 21:13:18.145351 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1527/3026] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:18 2022] GET /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:13:18.154354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:18.155048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:18.164799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.165720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.167056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.167517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.370997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:18.383861 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bab6b078-139c-4a41-ac65-041654ae78e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1211 microversion: 2.1 time: 0.236956 Jul 02 21:13:18.385016 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1528/3027] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:18 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1211 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:18.398791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-804ded5b-9ce0-4622-85fe-ff7d41c530ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabea2b1550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:18.453636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:18.470155 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53eaade5-2878-4498-9d91-decb0d8deabe tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1318 microversion: 2.1 time: 0.451545 Jul 02 21:13:18.472231 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1500/3028] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:18 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:18.681111 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-804ded5b-9ce0-4622-85fe-ff7d41c530ca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d" status: 202 len: 0 microversion: 2.1 time: 0.294088 Jul 02 21:13:18.681969 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1529/3029] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:18 2022] DELETE /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:18.688231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:18.689265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:18.709718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.710187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.710999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.711441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.873852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d07f2e48-f534-4a1b-b541-f13164304b1a tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe460c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-427195841", "description": "tempest-description-102160056"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:18.950541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:18.960726 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-676355b4-a41f-45b7-91c3-86117a84c77e tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1503 microversion: 2.1 time: 0.277229 Jul 02 21:13:18.961266 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1530/3030] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:18 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:18.966698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c70236f2-36f7-40a4-b444-9ee0176d164d req-98f64737-9d68-4fdf-bdd5-7b9f6d62b554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b84bf7-6cdb-4210-af84-cb6a31f12be1", "name": "network-vif-plugged", "status": "completed", "tag": "677d764f-fd62-47ee-b02c-8b2c5d07ed96"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:18.975552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c70236f2-36f7-40a4-b444-9ee0176d164d req-98f64737-9d68-4fdf-bdd5-7b9f6d62b554 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:18.976008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c70236f2-36f7-40a4-b444-9ee0176d164d req-98f64737-9d68-4fdf-bdd5-7b9f6d62b554 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:18.988692 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c70236f2-36f7-40a4-b444-9ee0176d164d req-98f64737-9d68-4fdf-bdd5-7b9f6d62b554 service nova] Creating event network-vif-plugged:677d764f-fd62-47ee-b02c-8b2c5d07ed96 for instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 on nch2-master-1 Jul 02 21:13:18.994426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c70236f2-36f7-40a4-b444-9ee0176d164d req-98f64737-9d68-4fdf-bdd5-7b9f6d62b554 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031759 Jul 02 21:13:18.995920 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1531/3031] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:19.001495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe462e0d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:19.039650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:19.040601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:13:19.041155 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.041155 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d HTTP/1.1 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7f815ff9-9cdf-4416-9683-7ac5b4af861d'} Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.043791 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-55d47545-705a-4fba-a0f4-87c3b6a3171d'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11c49d2b-2ef3-4403-be27-e8e71fd92c92 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d" status: 404 len: 194 microversion: 2.1 time: 0.047732 Jul 02 21:13:19.048022 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1532/3032] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:18 2022] GET /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:19.054953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:19.054953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:19.060111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:19.061865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:19.062891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:19.063526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:19.132426 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d07f2e48-f534-4a1b-b541-f13164304b1a tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.657198 Jul 02 21:13:19.133033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1501/3033] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:18 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:19.137673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46ef9a95-cf9d-4d5b-8580-04d682d1ad4f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe487d1f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:19.327961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:19.336645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2f7831d-21ae-414d-903a-bd17cc7935ae tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1714 microversion: 2.1 time: 0.289992 Jul 02 21:13:19.337353 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1533/3034] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:19 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1714 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:19.347854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1979aee3-97e1-433e-8a22-cae0441f9303 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe462ec10>, body: {"security_group_rule": {"parent_group_id": "2cea5de7-5a33-4b00-8d2b-2880fcd4346f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:19.433029 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46ef9a95-cf9d-4d5b-8580-04d682d1ad4f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.298884 Jul 02 21:13:19.434266 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1502/3035] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:13:19 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:19.445679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:19.446235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:19.454676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:19.455281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:19.455915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:19.456579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:19.542101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:19.550846 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6fd61663-a2a8-4997-bff2-2f83a315b3d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1267 microversion: 2.1 time: 0.115270 Jul 02 21:13:19.553666 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1503/3036] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:19 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1267 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:19.561465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ddeefd89-2c30-4f8c-bdb6-99b3add135e6 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabe474d820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2043401408", "description": "tempest-description-1760369309"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:19.792677 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1979aee3-97e1-433e-8a22-cae0441f9303 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.453808 Jul 02 21:13:19.793567 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1534/3037] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:13:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:19.804759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:19.828617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:19.853541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:19.856460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:19.858812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:19.859498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:20.468160 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ddeefd89-2c30-4f8c-bdb6-99b3add135e6 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.912696 Jul 02 21:13:20.477783 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1504/3038] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:19 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:20.482941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ff5274e-24d5-4287-bb7c-75ef6c072334 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe4569ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-426383469", "description": "tempest-description-612590620"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:20.526662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:20.536485 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a7b111d-ff60-4eff-b68f-444d25905d81 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1318 microversion: 2.1 time: 0.741108 Jul 02 21:13:20.537686 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1535/3039] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:19 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1318 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:20.542922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:20.543850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:20.551174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:20.551656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:20.552565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:20.553014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:20.595865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:20.596362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:20.596837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lazy-loading 'fault' on Instance uuid 7fce3bc6-ab40-4471-acb2-a78a1acdd9db {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:20.718683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f29fd685a149ea85207f47fcbb59d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4874e0d6bff34bfc9e2672caafad9556', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:20.728713 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4b0dc1b3-7fbe-48f3-97bb-8c58e49bf9ee tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 200 len: 1303 microversion: 2.1 time: 0.189871 Jul 02 21:13:20.729946 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1536/3040] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:20 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 1303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:20.735347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c26f84e9-d5e8-4dde-b805-ce49dfed4ae7 req-5c4aaf6c-a802-4e2d-946c-16a6fa9c8bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fce3bc6-ab40-4471-acb2-a78a1acdd9db", "name": "network-vif-deleted", "tag": "4d24f486-f833-431e-9582-83ce4c3fbc44"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:20.745816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c26f84e9-d5e8-4dde-b805-ce49dfed4ae7 req-5c4aaf6c-a802-4e2d-946c-16a6fa9c8bd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:20.746533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c26f84e9-d5e8-4dde-b805-ce49dfed4ae7 req-5c4aaf6c-a802-4e2d-946c-16a6fa9c8bd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:20.760346 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c26f84e9-d5e8-4dde-b805-ce49dfed4ae7 req-5c4aaf6c-a802-4e2d-946c-16a6fa9c8bd8 service nova] Creating event network-vif-deleted:4d24f486-f833-431e-9582-83ce4c3fbc44 for instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db on nch1-master-1 Jul 02 21:13:20.766006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c26f84e9-d5e8-4dde-b805-ce49dfed4ae7 req-5c4aaf6c-a802-4e2d-946c-16a6fa9c8bd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034705 Jul 02 21:13:20.774052 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1537/3041] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:20.795701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:20.796676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:20.808322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:20.809050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:20.813614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:20.816554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:21.665226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:21.677531 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-afb02935-5fb8-4cae-a44a-bd6513594b1c tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1714 microversion: 2.1 time: 0.900683 Jul 02 21:13:21.688930 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1538/3042] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:20 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1714 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:21.693085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ff5274e-24d5-4287-bb7c-75ef6c072334 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.212175 Jul 02 21:13:21.695108 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1505/3043] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:20 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:21.705169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:21.706050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:21.716553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-da80f238-8e43-43ce-88f5-e1bf83058461 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabea2bbf70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-159264517", "description": "tempest-description-144057119"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:21.729333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:21.729982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:21.730861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:21.732030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:21.764137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:21.961615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:21.977403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cab5a073-4be2-4223-b093-5564dd17940c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1273 microversion: 2.1 time: 0.278569 Jul 02 21:13:21.979052 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1506/3044] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:21 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:21.987711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:21.989282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:21.994295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:22.008442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:22.009358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:22.011435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:22.012239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:22.504356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:22.516031 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2553c9b-4510-4d4a-909b-69720dc5db26 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1467 microversion: 2.1 time: 0.535743 Jul 02 21:13:22.517386 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1507/3045] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:21 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1467 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:22.522269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-493abfae-ae12-48cc-84c5-ff432f2ac457 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe5270dc0>, body: {"security_group_rule": {"parent_group_id": "db1f921d-622a-481f-b1e9-0e3faf5956e4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:22.606630 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-da80f238-8e43-43ce-88f5-e1bf83058461 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.915902 Jul 02 21:13:22.616557 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1539/3046] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:22.624606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:22.625446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:22.640634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:22.644439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:22.644935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:22.657248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:22.658081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:22.688794 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db HTTP/1.1 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7fce3bc6-ab40-4471-acb2-a78a1acdd9db'} Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:22.694023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:22.699332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:22.703832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:22.705164 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-124aba4a-aaf3-4377-8fef-340d95284757 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 404 len: 111 microversion: 2.1 time: 0.087501 Jul 02 21:13:22.709862 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1540/3047] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:22 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:23.127335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1777861616", "block_migration": true, "disk_over_commit": false}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:23.128829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:23.143327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.145443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.151086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.151848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.449405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lazy-loading 'flavor' on Instance uuid 83b84bf7-6cdb-4210-af84-cb6a31f12be1 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:23.506190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Going to try to live migrate instance to tempest-host-1777861616 {{(pid=131045) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:13:23.543268 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] HTTP exception thrown: Compute host tempest-host-1777861616 could not be found. Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Request method failure captured: Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1/action HTTP/1.1 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 107 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTjggY57WrvaHAArMGsWMwBa3xdVnz7lmeEPVj74UrxorjxIUwwAIgidrkGoXdQQ_OQt9RYvnoo38YePurCtn50X9uw6r0Tdb3FwU_FH4NgbYZ_ow3uyvpBUOXTNVi6NDznLLuJv6zx5AfVCMlMEct_Bhjk9bqcnjIXOnvVvYVu-f0 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 40591bf3c1f84e09923f58cdfb142fb4 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-LiveMigrationNegativeTest-1624330722 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40591bf3c1f84e09923f58cdfb142fb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40591bf3c1f84e09923f58cdfb142fb4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40591bf3c1f84e09923f58cdfb142fb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40591bf3c1f84e09923f58cdfb142fb4"}]}] Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-LiveMigrationNegativeTest-1624330722 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 40591bf3c1f84e09923f58cdfb142fb4 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1624330722 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-LiveMigrationNegativeTest-1624330722-project-admin Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8d4ba4991979468bac74996b6b9d7f62 Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-LiveMigrationNegativeTest-1624330722-project-admin Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: {"os-migrateLive": {"host": "tempest-host-1777861616", "block_migration": true, "disk_over_commit": false}} Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: exception: Compute host tempest-host-1777861616 could not be found. Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '83b84bf7-6cdb-4210-af84-cb6a31f12be1', 'body': {'os-migrateLive': {'host': 'tempest-host-1777861616', 'block_migration': True, 'disk_over_commit': False}}} Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 02 21:13:23.580853 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1777861616 could not be found. Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1777861616 could not be found. Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1777861616 could not be found. Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:23.585871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Returning 400 to user: Compute host tempest-host-1777861616 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:23.589085 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b0c0e313-37a5-46d9-a64d-3e05dfd9d66b tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1/action" status: 400 len: 100 microversion: 2.1 time: 0.870575 Jul 02 21:13:23.594997 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1541/3048] 10.222.0.43 () {60 vars in 1278 bytes} [Sat Jul 2 21:13:22 2022] POST /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1/action => generated 100 bytes in 878 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:13:23.603151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:23.604165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:23.608332 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-493abfae-ae12-48cc-84c5-ff432f2ac457 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.089583 Jul 02 21:13:23.609501 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1508/3049] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:13:22 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:23.615119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.616634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.618379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.619062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.630062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-346afbf3-d419-4df4-b3b0-58d53400a622 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:23.670933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-346afbf3-d419-4df4-b3b0-58d53400a622 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Querying cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) for 1 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 02 21:13:23.671761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-346afbf3-d419-4df4-b3b0-58d53400a622 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.673130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-346afbf3-d419-4df4-b3b0-58d53400a622 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.699477 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-346afbf3-d419-4df4-b3b0-58d53400a622 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.088343 Jul 02 21:13:23.700741 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1509/3050] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:13:23 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:23.712732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1845043777", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ca4f0c76-2326-4860-85e6-44a9e2329bcf"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:23.744587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.745349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.746866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lazy-loading 'fault' on Instance uuid b7346a39-12a0-4dfd-bcd7-d071903b31fa {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:23.826670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] validate_networks() for [('ca4f0c76-2326-4860-85e6-44a9e2329bcf', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:13:23.873079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412af7535c24b5fa139fd87431375ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116d106003e54750a7e57d37e6a8798a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:23.883215 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4646fc4f-ebef-4270-8919-4a65874252bf tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 200 len: 1367 microversion: 2.1 time: 0.285502 Jul 02 21:13:23.887800 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1542/3051] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:23 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:23.893786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:23.894975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:23.907979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.909092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:23.910276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:23.910959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:24.354047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:24.372787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7c12495-1bdd-4e96-9586-4b9129df753c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.483377 Jul 02 21:13:24.376546 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1543/3052] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:23 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:24.390167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b258f5f5-e690-400a-b550-28aa012e078e req-6cde722f-5d6c-40a9-8c8a-e5c8ad3db43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7346a39-12a0-4dfd-bcd7-d071903b31fa", "name": "network-vif-deleted", "tag": "c65d66d3-c08d-4225-8f62-5bf5c3a1acf6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:24.419924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b258f5f5-e690-400a-b550-28aa012e078e req-6cde722f-5d6c-40a9-8c8a-e5c8ad3db43e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:24.422308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b258f5f5-e690-400a-b550-28aa012e078e req-6cde722f-5d6c-40a9-8c8a-e5c8ad3db43e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:24.464800 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b258f5f5-e690-400a-b550-28aa012e078e req-6cde722f-5d6c-40a9-8c8a-e5c8ad3db43e service nova] Creating event network-vif-deleted:c65d66d3-c08d-4225-8f62-5bf5c3a1acf6 for instance b7346a39-12a0-4dfd-bcd7-d071903b31fa on nch1-master-1 Jul 02 21:13:24.479469 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b258f5f5-e690-400a-b550-28aa012e078e req-6cde722f-5d6c-40a9-8c8a-e5c8ad3db43e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100044 Jul 02 21:13:24.481013 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1544/3053] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:24.492283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:24.493388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:24.505128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:24.507948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:24.509149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:24.511887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:24.915944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:24.932308 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5eab816-1430-4096-8bd1-5bf75490f02d tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1467 microversion: 2.1 time: 0.446790 Jul 02 21:13:24.944115 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1545/3054] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:24 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1467 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:24.944115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef7a1a48-c491-44e1-9dab-ffbefd6b4b11 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe4770820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1383371525", "description": "tempest-description-1621578707"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:25.056463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:13:25.057877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:13:25.058843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:13:25.059789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:13:25.061110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:13:25.090101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:25.091213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:25.091483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:25.091927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:25.168681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Getting quotas for project 27477995aa5c488bb3a2b414a540ceba. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:25.188724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Getting quotas for user 365ef707d87d4d5d818a7e9388c65fa0 and project 27477995aa5c488bb3a2b414a540ceba. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:25.232693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:13:25.238461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:13:25.323064 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bd9d78e-0bb1-4e80-b9b4-e3a9489bc402 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620381 Jul 02 21:13:25.330349 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1510/3055] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:13:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:13:25.336735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15fa0aab-ef44-4f0c-a946-d4db1aecc645 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:25.337208 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef7a1a48-c491-44e1-9dab-ffbefd6b4b11 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.402703 Jul 02 21:13:25.338207 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1546/3056] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:24 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:25.343136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:25.344285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] [instance: b7346a39-12a0-4dfd-bcd7-d071903b31fa] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:25.355005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_groups [None req-15fa0aab-ef44-4f0c-a946-d4db1aecc645 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Querying cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) for 1 instances {{(pid=131044) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 02 21:13:25.357817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15fa0aab-ef44-4f0c-a946-d4db1aecc645 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:25.358490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15fa0aab-ef44-4f0c-a946-d4db1aecc645 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:25.373298 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15fa0aab-ef44-4f0c-a946-d4db1aecc645 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/os-server-groups/daa43afa-9118-4434-a90b-391abbf6280d" status: 200 len: 183 microversion: 2.1 time: 0.041406 Jul 02 21:13:25.374220 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1511/3057] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:13:25 2022] GET /compute/v2.1/os-server-groups/daa43afa-9118-4434-a90b-391abbf6280d => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:25.390819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:25.391279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:25.391796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2083084396", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:25.396251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:25.396718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:25.421876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] HTTP exception thrown: Instance b7346a39-12a0-4dfd-bcd7-d071903b31fa could not be found. Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Request method failure captured: Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa HTTP/1.1 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRew9cI05mpbtpVN-U18yYFuNXjq5YnK6zTA8JhtrTOGb3TUxXT_6QP7-YT4IV6WfG_EBvqs0YnvxjQ-q0pcibaDYLz_7bFA129fdXWXX9zwA1tEKEPhsSBN5AwA1m0VTip6w0MyQo-F4iYbc65t4TXU7gYaB39gRi1ytLv18vRgEU Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 116d106003e54750a7e57d37e6a8798a Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestManualDisk-2105858386 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/116d106003e54750a7e57d37e6a8798a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_116d106003e54750a7e57d37e6a8798a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/116d106003e54750a7e57d37e6a8798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/116d106003e54750a7e57d37e6a8798a"}]}] Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestManualDisk-2105858386 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 116d106003e54750a7e57d37e6a8798a Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestManualDisk-2105858386 Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestManualDisk-2105858386-project Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 1412af7535c24b5fa139fd87431375ca Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestManualDisk-2105858386-project Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance b7346a39-12a0-4dfd-bcd7-d071903b31fa could not be found. Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b7346a39-12a0-4dfd-bcd7-d071903b31fa'} Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7346a39-12a0-4dfd-bcd7-d071903b31fa could not be found. Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7346a39-12a0-4dfd-bcd7-d071903b31fa could not be found. Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:25.424656 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7346a39-12a0-4dfd-bcd7-d071903b31fa could not be found. Jul 02 21:13:25.429999 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:25.438030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Returning 404 to user: Instance b7346a39-12a0-4dfd-bcd7-d071903b31fa could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:25.438986 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8fe0513b-b087-46df-94ae-0afafd23e0ca tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa" status: 404 len: 111 microversion: 2.1 time: 0.099551 Jul 02 21:13:25.441130 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1547/3058] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:25 2022] GET /compute/v2.1/servers/b7346a39-12a0-4dfd-bcd7-d071903b31fa => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:25.449440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f75eb29-e4b4-4d13-9dcf-c12692d1efdb tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:25.450183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f75eb29-e4b4-4d13-9dcf-c12692d1efdb tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:25.484934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:13:25.688753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f75eb29-e4b4-4d13-9dcf-c12692d1efdb tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:25.693225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=31 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:25.706611 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f75eb29-e4b4-4d13-9dcf-c12692d1efdb tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1216 microversion: 2.1 time: 0.263170 Jul 02 21:13:25.719358 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1548/3059] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:25 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1216 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:25.727577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-087f5349-c1ee-46e2-8df4-4d5f67149ff7 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe4770430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-196880576", "description": "tempest-description-1518638700"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:25.983331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:26.359747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:13:26.360395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:13:26.360679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:13:26.361093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:13:26.361512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:13:26.382836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:26.383295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:26.384121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:26.389505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:26.432756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Getting quotas for project 79a9f342331e41468cfbf45d04f8d623. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:13:26.445038 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-087f5349-c1ee-46e2-8df4-4d5f67149ff7 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.721263 Jul 02 21:13:26.448156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1549/3060] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:26.455004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:26.456479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:26.458709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Getting quotas for user 19fe81e09ba144b393a3809b89c6f8d5 and project 79a9f342331e41468cfbf45d04f8d623. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:13:26.475849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:26.476617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:26.483655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:13:26.485264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:26.485845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:26.507116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:13:26.536087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:26.539871 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db HTTP/1.1 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7fce3bc6-ab40-4471-acb2-a78a1acdd9db'} Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:13:26.541701 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:26.546298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:26.553671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:26.554932 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-587d46fc-a59c-48bd-b4e9-2670b345112f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 404 len: 111 microversion: 2.1 time: 0.105656 Jul 02 21:13:26.555531 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1550/3061] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:13:26 2022] DELETE /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:26.563792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:26.568792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:26.578942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:26.580818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:26.582081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:26.583366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:26.597844 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6085a8e8-6991-4a69-911f-f859b559181b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.221106 Jul 02 21:13:26.608165 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1512/3062] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:13:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:13:26.615858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c806e30-2e54-4f1a-8013-e6963ed158b1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] Calling method '.version_select at 0x7fabe46e40d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:26.649446 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c806e30-2e54-4f1a-8013-e6963ed158b1 tempest-ServersTestManualDisk-2105858386 tempest-ServersTestManualDisk-2105858386-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645693155" status: 202 len: 0 microversion: 2.1 time: 0.039711 Jul 02 21:13:26.652261 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1513/3063] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:13:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645693155 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:26.669487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f54e144d-f0c3-4e72-b026-2b6e3308a794 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe468a280>, body: {"security_group_rule": {"parent_group_id": "4af06619-7b7b-4a56-a735-981f6a5a9856", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ed003fe6-b4a3-49e1-a7b1-b252ee9e45d3"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:27.427695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:27.436526 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f78729e1-3049-44b0-afcb-8da137326234 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.876518 Jul 02 21:13:27.438157 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1551/3064] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:26 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:27.443746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b1d1b21f-ba07-412d-8778-4be2d8c5ddc8 req-3122403c-02a3-4de8-8a4b-d495aa2a77d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aabecf20-fdf3-4810-8009-53c57ae31700", "tag": "85eb89b4-63d1-4a1c-a06e-1e9e6834a3bd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:27.461472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b1d1b21f-ba07-412d-8778-4be2d8c5ddc8 req-3122403c-02a3-4de8-8a4b-d495aa2a77d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.462410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b1d1b21f-ba07-412d-8778-4be2d8c5ddc8 req-3122403c-02a3-4de8-8a4b-d495aa2a77d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.485443 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b1d1b21f-ba07-412d-8778-4be2d8c5ddc8 req-3122403c-02a3-4de8-8a4b-d495aa2a77d0 service nova] Creating event network-changed:85eb89b4-63d1-4a1c-a06e-1e9e6834a3bd for instance aabecf20-fdf3-4810-8009-53c57ae31700 on nch1-master-1 Jul 02 21:13:27.490931 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b1d1b21f-ba07-412d-8778-4be2d8c5ddc8 req-3122403c-02a3-4de8-8a4b-d495aa2a77d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051280 Jul 02 21:13:27.492510 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1552/3065] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:27.498438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:27.501349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] [instance: 7fce3bc6-ab40-4471-acb2-a78a1acdd9db] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:27.512126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.512599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.513622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.514094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.536955 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db HTTP/1.1 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7fce3bc6-ab40-4471-acb2-a78a1acdd9db'} Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.538861 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. Jul 02 21:13:27.544582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.549051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance 7fce3bc6-ab40-4471-acb2-a78a1acdd9db could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:27.551113 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4230668a-287f-4489-8a07-4718c86ad027 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db" status: 404 len: 111 microversion: 2.1 time: 0.056174 Jul 02 21:13:27.565007 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1553/3066] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:27 2022] GET /compute/v2.1/servers/7fce3bc6-ab40-4471-acb2-a78a1acdd9db => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:27.574492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:27.575541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:27.589305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.590027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.591436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.592076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.753843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:27.774316 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2dcbeda1-6eb4-4a48-993e-75740eb4eaea tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1271 microversion: 2.1 time: 0.207739 Jul 02 21:13:27.775318 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1554/3067] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:27 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:27.785644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:27.786621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:27.795644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.796387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.798278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:27.798959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:27.906559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:27.916964 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5e2767c-7260-4478-a34e-c50d3961d25b tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1274 microversion: 2.1 time: 0.140172 Jul 02 21:13:27.927526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1555/3068] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:27 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:27.937610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1931bbf9-9df0-4d5e-9ddd-73b4e2b9fb4f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:27.947213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1931bbf9-9df0-4d5e-9ddd-73b4e2b9fb4f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance group af6520a1-8c6c-4380-acf1-baabe9453779 could not be found. Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1931bbf9-9df0-4d5e-9ddd-73b4e2b9fb4f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-server-groups/af6520a1-8c6c-4380-acf1-baabe9453779 HTTP/1.1 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance group af6520a1-8c6c-4380-acf1-baabe9453779 could not be found. Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'af6520a1-8c6c-4380-acf1-baabe9453779'} Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group af6520a1-8c6c-4380-acf1-baabe9453779 could not be found. Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group af6520a1-8c6c-4380-acf1-baabe9453779 could not be found. Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.949423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group af6520a1-8c6c-4380-acf1-baabe9453779 could not be found. Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1931bbf9-9df0-4d5e-9ddd-73b4e2b9fb4f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance group af6520a1-8c6c-4380-acf1-baabe9453779 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1931bbf9-9df0-4d5e-9ddd-73b4e2b9fb4f tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/af6520a1-8c6c-4380-acf1-baabe9453779" status: 404 len: 117 microversion: 2.1 time: 0.021730 Jul 02 21:13:27.957156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1556/3069] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:13:27 2022] DELETE /compute/v2.1/os-server-groups/af6520a1-8c6c-4380-acf1-baabe9453779 => generated 117 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:27.960942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b094262-fcaf-4aad-a09c-7b492a6a1895 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:27.968445 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-2b094262-fcaf-4aad-a09c-7b492a6a1895 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance group 2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab could not be found. Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b094262-fcaf-4aad-a09c-7b492a6a1895 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-server-groups/2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab HTTP/1.1 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance group 2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab could not be found. Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab'} Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab could not be found. Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab could not be found. Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.970093 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab could not be found. Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b094262-fcaf-4aad-a09c-7b492a6a1895 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance group 2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b094262-fcaf-4aad-a09c-7b492a6a1895 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab" status: 404 len: 117 microversion: 2.1 time: 0.014588 Jul 02 21:13:27.977582 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1557/3070] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:13:27 2022] DELETE /compute/v2.1/os-server-groups/2c8f7e9e-97bb-4e7b-9921-e25e1370a7ab => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:27.982708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d4e27c9-3a3c-4535-94c0-4b8dab3382c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:27.997673 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-7d4e27c9-3a3c-4535-94c0-4b8dab3382c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance group 7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 could not be found. Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d4e27c9-3a3c-4535-94c0-4b8dab3382c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-server-groups/7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 HTTP/1.1 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance group 7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 could not be found. Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7b79a16b-ac5d-48b5-9b56-e3b08f4886b2'} Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 could not be found. Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 could not be found. Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:27.999902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:28.005001 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:28.005001 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:28.005001 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:28.005001 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:28.005001 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 could not be found. Jul 02 21:13:28.005001 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:28.006557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d4e27c9-3a3c-4535-94c0-4b8dab3382c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance group 7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:28.007669 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d4e27c9-3a3c-4535-94c0-4b8dab3382c8 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/7b79a16b-ac5d-48b5-9b56-e3b08f4886b2" status: 404 len: 117 microversion: 2.1 time: 0.029605 Jul 02 21:13:28.009420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1558/3071] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:13:27 2022] DELETE /compute/v2.1/os-server-groups/7b79a16b-ac5d-48b5-9b56-e3b08f4886b2 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:28.041934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb2ed0d3-e30d-477e-9899-3a8883085890 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:28.067536 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-cb2ed0d3-e30d-477e-9899-3a8883085890 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] HTTP exception thrown: Instance group 165cec7d-2bc8-40c7-a8b1-8a951d7e4774 could not be found. Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb2ed0d3-e30d-477e-9899-3a8883085890 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Request method failure captured: Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-server-groups/165cec7d-2bc8-40c7-a8b1-8a951d7e4774 HTTP/1.1 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTV50bvSEtzlnaNuFD-scYUfDKczsDrY7QAhX8SqGUVVy75y0kTjNagaxgLmy5EDbH5wEp4YHDjkXEr2BpnFj7gFmL7GM2bX3qW28GqC7ax0HCJFdGZU9SgtZGVX95Zvi067Y_XFgN-NvriJPUDpM3U6pAfIbD1xUfHsrQzDeys13w Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4874e0d6bff34bfc9e2672caafad9556", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4874e0d6bff34bfc9e2672caafad9556"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4874e0d6bff34bfc9e2672caafad9556"}]}] Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4874e0d6bff34bfc9e2672caafad9556 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerGroupTestJSON-1817033008 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 70f29fd685a149ea85207f47fcbb59d1 Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerGroupTestJSON-1817033008-project Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance group 165cec7d-2bc8-40c7-a8b1-8a951d7e4774 could not be found. Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '165cec7d-2bc8-40c7-a8b1-8a951d7e4774'} Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 165cec7d-2bc8-40c7-a8b1-8a951d7e4774 could not be found. Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 165cec7d-2bc8-40c7-a8b1-8a951d7e4774 could not be found. Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:28.070228 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:28.075268 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:28.075268 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:28.075268 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:28.075268 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:28.075268 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 165cec7d-2bc8-40c7-a8b1-8a951d7e4774 could not be found. Jul 02 21:13:28.075268 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:28.077936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb2ed0d3-e30d-477e-9899-3a8883085890 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Returning 404 to user: Instance group 165cec7d-2bc8-40c7-a8b1-8a951d7e4774 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:28.079122 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb2ed0d3-e30d-477e-9899-3a8883085890 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/165cec7d-2bc8-40c7-a8b1-8a951d7e4774" status: 404 len: 117 microversion: 2.1 time: 0.066111 Jul 02 21:13:28.080059 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1559/3072] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:13:28 2022] DELETE /compute/v2.1/os-server-groups/165cec7d-2bc8-40c7-a8b1-8a951d7e4774 => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:13:28.090151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-99326305-7f9a-434a-9e99-bb581ee46df2 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:28.179011 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-99326305-7f9a-434a-9e99-bb581ee46df2 tempest-ServerGroupTestJSON-1817033008 tempest-ServerGroupTestJSON-1817033008-project] 10.222.0.43 "DELETE /compute/v2.1/os-server-groups/daa43afa-9118-4434-a90b-391abbf6280d" status: 204 len: 0 microversion: 2.1 time: 0.091206 Jul 02 21:13:28.180004 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1560/3073] 10.222.0.43 () {58 vars in 1265 bytes} [Sat Jul 2 21:13:28 2022] DELETE /compute/v2.1/os-server-groups/daa43afa-9118-4434-a90b-391abbf6280d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:13:28.288539 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f54e144d-f0c3-4e72-b026-2b6e3308a794 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.634975 Jul 02 21:13:28.296630 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1514/3074] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:13:26 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:28.302064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63bd0c4e-ca54-468c-8334-2792f5c68ee5 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe47705e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1463930414", "description": "tempest-description-1395703505"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:28.456474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:28.457414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:28.469094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:28.469825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:28.470606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:28.471195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:28.969111 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63bd0c4e-ca54-468c-8334-2792f5c68ee5 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.671468 Jul 02 21:13:28.983861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:28.984076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1561/3075] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:28 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:28.997492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:28.999943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:29.004368 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e6fcaec-8d67-4ae4-b04f-ce70491752d3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.554067 Jul 02 21:13:29.007944 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1515/3076] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:28 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:29.025383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:29.026428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:29.026778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:29.027808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:29.028828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:29.030389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:29.047030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:29.047527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:29.048778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:29.049410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:29.242066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:29.259669 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e8da78a-e6da-452d-aa5c-407cf04d5330 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1277 microversion: 2.1 time: 0.273769 Jul 02 21:13:29.261207 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1562/3077] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:28 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1277 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:29.268414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-88ba8c57-80d3-4fe9-86ca-a548e3d766e8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabd7f09940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-553143837", "description": "tempest-description-577236051"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:30.008260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:30.029114 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0456b412-2852-4899-96e5-33e8461ce4d5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 1.017529 Jul 02 21:13:30.031852 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1516/3078] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:29 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:30.053822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:30.055082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:30.070972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:30.073155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:30.081303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:30.082285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:30.119536 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9169c53-f7dd-457e-8fd1-fecf6831d733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/ips" status: 200 len: 151 microversion: 2.20 time: 0.085672 Jul 02 21:13:30.120405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1517/3079] 10.222.0.43 () {60 vars in 1288 bytes} [Sat Jul 2 21:13:30 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/ips => generated 151 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:13:30.140724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:30.142811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:30.162869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:30.163672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:30.165204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:30.165893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:30.540120 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-88ba8c57-80d3-4fe9-86ca-a548e3d766e8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.277285 Jul 02 21:13:30.542154 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1563/3080] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:29 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:30.548256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:30.549122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:30.599868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:30.600579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:30.601583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:30.602252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:31.055978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:31.071096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-273bf5ce-5b62-4787-8a5a-b385313280f4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.948324 Jul 02 21:13:31.075054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1518/3081] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:30 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:31.087995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5a4787c-9165-43a3-8ea4-5bfaeb941e5a tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabe48198b0>, body: {"security_group_rule": {"parent_group_id": "c7c5f7ef-6420-41a0-9ddc-b95697e9c5e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "eb25d288-0d24-434e-8f7c-afadb4a340ae"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:31.542401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:31.552471 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-56faa647-a5a0-4aef-b455-97e12b5c86c4 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1319 microversion: 2.1 time: 1.008844 Jul 02 21:13:31.556867 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1564/3082] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:30 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1319 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:31.565924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:31.566623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:31.573282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:31.574604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:31.575594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:31.576225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:32.668469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:32.692881 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d613d808-c6fe-411d-9023-dea943460545 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 1.134256 Jul 02 21:13:32.693462 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1565/3083] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:31 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:32.698723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c35b5322-374f-4313-9c33-3a4bd9869e78 req-38fde387-7824-49f7-b899-7bd17150a8dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226fb301-cf6d-48b8-871e-2144e0f46890", "tag": "e6116473-161b-4347-892b-4633dd861ea1"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:32.709867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c35b5322-374f-4313-9c33-3a4bd9869e78 req-38fde387-7824-49f7-b899-7bd17150a8dc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:32.710319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c35b5322-374f-4313-9c33-3a4bd9869e78 req-38fde387-7824-49f7-b899-7bd17150a8dc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:32.723332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c35b5322-374f-4313-9c33-3a4bd9869e78 req-38fde387-7824-49f7-b899-7bd17150a8dc service nova] Creating event network-changed:e6116473-161b-4347-892b-4633dd861ea1 for instance 226fb301-cf6d-48b8-871e-2144e0f46890 on nch2-master-1 Jul 02 21:13:32.728417 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c35b5322-374f-4313-9c33-3a4bd9869e78 req-38fde387-7824-49f7-b899-7bd17150a8dc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033234 Jul 02 21:13:32.729015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1566/3084] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:32.737484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:32.738190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:32.745487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:32.745941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:32.746757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:32.747390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:33.383976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:33.392542 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f6533e6-f78e-4c49-a9a1-d016364befe0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.659198 Jul 02 21:13:33.393344 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1567/3085] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:32 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:33.399874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:33.400482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:33.407359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:33.408029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:33.408858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:33.409290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:33.415628 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5a4787c-9165-43a3-8ea4-5bfaeb941e5a tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 2.339227 Jul 02 21:13:33.424539 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1519/3086] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:13:31 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:33.434602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:33.435336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:33.436974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lazy-loading 'flavor' on Instance uuid 52054dc2-a0ff-49cd-88cc-e822331aabae {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:33.444720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:33.445444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:33.446443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:33.447319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:33.756210 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab7c493e-1434-451e-85db-3e700ff6de68 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/action" status: 202 len: 0 microversion: 2.20 time: 0.361364 Jul 02 21:13:33.756857 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1568/3087] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:13:33 2022] POST /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:33.762085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ceb8cd7-6055-48bb-b4ef-45c276b6ef05 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabe4c8faf0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:33.972452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:33.980510 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd63d04d-a958-4c61-9206-a472f7b33bf2 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1319 microversion: 2.1 time: 0.553177 Jul 02 21:13:33.981132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1520/3088] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:33 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:33.985812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:33.986425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:33.993189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:33.993559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:33.994340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:33.994780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:34.859212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:34.872649 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72bf29e8-aeca-491a-93cd-a2eb3652ca20 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.890208 Jul 02 21:13:34.874584 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1521/3089] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:33 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:34.879656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:34.880401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:34.893705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:34.894367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:34.895371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:34.901634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.431870 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1ceb8cd7-6055-48bb-b4ef-45c276b6ef05 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/eb25d288-0d24-434e-8f7c-afadb4a340ae" status: 202 len: 0 microversion: 2.1 time: 1.673334 Jul 02 21:13:35.434156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1569/3090] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:33 2022] DELETE /compute/v2.1/os-security-groups/eb25d288-0d24-434e-8f7c-afadb4a340ae => generated 0 bytes in 1675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:35.440613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:35.441711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:35.447687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:35.456683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:35.456894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:35.457626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.458379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:35.458893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:35.459404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.460153 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e06b8ee-93ae-4955-af82-c904e116eac6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.584310 Jul 02 21:13:35.461250 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1522/3091] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:34 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:35.467533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f65dbb1e-b242-4199-8d1f-9e346b15c4ed req-fee5ac84-4981-4c5b-a393-2dd9273ddff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47b7229-6aa2-4688-959b-407721ca10a1", "tag": "17aac8bd-951c-4ef5-8ca1-bb20fad556e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:35.479238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f65dbb1e-b242-4199-8d1f-9e346b15c4ed req-fee5ac84-4981-4c5b-a393-2dd9273ddff3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:35.479978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f65dbb1e-b242-4199-8d1f-9e346b15c4ed req-fee5ac84-4981-4c5b-a393-2dd9273ddff3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.508427 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f65dbb1e-b242-4199-8d1f-9e346b15c4ed req-fee5ac84-4981-4c5b-a393-2dd9273ddff3 service nova] Creating event network-changed:17aac8bd-951c-4ef5-8ca1-bb20fad556e5 for instance d47b7229-6aa2-4688-959b-407721ca10a1 on nch1-master-1 Jul 02 21:13:35.514525 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f65dbb1e-b242-4199-8d1f-9e346b15c4ed req-fee5ac84-4981-4c5b-a393-2dd9273ddff3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051722 Jul 02 21:13:35.516481 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1523/3092] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:35.522687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f50588b3-fccd-4de1-b2ba-ac31354cf208 req-67dbb548-5755-4c0d-b3b6-4b358ab48ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aabecf20-fdf3-4810-8009-53c57ae31700", "name": "network-vif-plugged", "status": "completed", "tag": "85eb89b4-63d1-4a1c-a06e-1e9e6834a3bd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:35.534403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f50588b3-fccd-4de1-b2ba-ac31354cf208 req-67dbb548-5755-4c0d-b3b6-4b358ab48ebb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:35.534962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f50588b3-fccd-4de1-b2ba-ac31354cf208 req-67dbb548-5755-4c0d-b3b6-4b358ab48ebb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.549051 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f50588b3-fccd-4de1-b2ba-ac31354cf208 req-67dbb548-5755-4c0d-b3b6-4b358ab48ebb service nova] Creating event network-vif-plugged:85eb89b4-63d1-4a1c-a06e-1e9e6834a3bd for instance aabecf20-fdf3-4810-8009-53c57ae31700 on nch1-master-1 Jul 02 21:13:35.555403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f50588b3-fccd-4de1-b2ba-ac31354cf208 req-67dbb548-5755-4c0d-b3b6-4b358ab48ebb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037215 Jul 02 21:13:35.556334 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1524/3093] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:35.564031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:35.564899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:35.571682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:35.572446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.573361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:35.573897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:35.736500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:36.018126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:36.031907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4373b639-a991-40fc-be7c-75f171b83704 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.596425 Jul 02 21:13:36.035514 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1570/3094] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:35 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:36.048181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9c4b825-6fcc-4fb6-af5e-a08986cf7239 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabea2bbc10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:36.186393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:36.197171 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee0aacf1-7cde-46eb-b142-21f0ef3d4d9a tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1319 microversion: 2.1 time: 0.639365 Jul 02 21:13:36.198026 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1525/3095] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:35 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:36.203058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:36.203912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:36.210801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:36.211590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:36.212625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:36.213268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:36.218777 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9c4b825-6fcc-4fb6-af5e-a08986cf7239 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/c7c5f7ef-6420-41a0-9ddc-b95697e9c5e9" status: 200 len: 248 microversion: 2.1 time: 0.180851 Jul 02 21:13:36.220093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1571/3096] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:36 2022] GET /compute/v2.1/os-security-groups/c7c5f7ef-6420-41a0-9ddc-b95697e9c5e9 => generated 248 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:36.233376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ce97c8d-a608-4dce-b21a-aaea84f63f46 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabd7dc1ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-116469786", "description": "tempest-description-2051119149"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:36.420800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:36.467175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:36.475160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:36.486272 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e244a0ab-8154-4298-8652-5d889d7439b2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.286637 Jul 02 21:13:36.487457 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1526/3097] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:36 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:36.498954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:36.508019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:36.528175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:36.528803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:36.530836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:36.531414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:36.633151 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ce97c8d-a608-4dce-b21a-aaea84f63f46 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.404763 Jul 02 21:13:36.634139 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1572/3098] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:13:36 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:36.645149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e69eac7b-e2b9-4cd3-9afc-a5373199a15a tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabd7f7ae50>, body: {"security_group_rule": {"parent_group_id": "6a06a793-aecd-4f89-84f4-2f909c4f7dcc", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:36.925355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:36.949026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:36.954655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:36.959404 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbf461c2-85ab-41aa-bd7d-6ab06c839460 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.469013 Jul 02 21:13:36.960388 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1527/3099] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:36 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:37.061880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:37.066771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:37.128243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:37.130883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:37.143739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:37.145420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:37.714628 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e69eac7b-e2b9-4cd3-9afc-a5373199a15a tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.073619 Jul 02 21:13:37.719387 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1573/3100] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:13:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:13:37.745684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:37.748876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:37.753207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:37.759471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:37.760297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:37.761182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:37.761695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:37.763283 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc720c59-c85b-4321-bb8c-21f9095707f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.716269 Jul 02 21:13:37.764229 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1528/3101] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:37 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:37.769152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:37.769764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:37.776260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:37.778407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:37.780805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:37.781467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:38.183446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:38.194749 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f438eaae-6043-4dba-ba97-1237949685d3 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1319 microversion: 2.1 time: 0.467523 Jul 02 21:13:38.196569 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1574/3102] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:37 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1319 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:38.201479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-aebdd124-f4d3-4d63-89e7-fb87aeb76c96 req-e83878ed-4d63-4313-8131-e3585567f408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226fb301-cf6d-48b8-871e-2144e0f46890", "name": "network-vif-plugged", "status": "completed", "tag": "e6116473-161b-4347-892b-4633dd861ea1"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:38.210750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-aebdd124-f4d3-4d63-89e7-fb87aeb76c96 req-e83878ed-4d63-4313-8131-e3585567f408 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:38.211424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-aebdd124-f4d3-4d63-89e7-fb87aeb76c96 req-e83878ed-4d63-4313-8131-e3585567f408 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:38.238114 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-aebdd124-f4d3-4d63-89e7-fb87aeb76c96 req-e83878ed-4d63-4313-8131-e3585567f408 service nova] Creating event network-vif-plugged:e6116473-161b-4347-892b-4633dd861ea1 for instance 226fb301-cf6d-48b8-871e-2144e0f46890 on nch2-master-1 Jul 02 21:13:38.245368 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-aebdd124-f4d3-4d63-89e7-fb87aeb76c96 req-e83878ed-4d63-4313-8131-e3585567f408 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047143 Jul 02 21:13:38.246956 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1575/3103] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:38.253511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86a644ae-1e61-4b9c-80db-20d3150bb96f tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Action: 'create', calling method: .version_select at 0x7fabd7f7aaf0>, body: {"security_group_rule": {"parent_group_id": "6a06a793-aecd-4f89-84f4-2f909c4f7dcc", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:38.288181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:38.302189 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c70383c-6500-45e7-b205-c60261c76e51 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.536253 Jul 02 21:13:38.314867 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1529/3104] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:37 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:38.321269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:38.322627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:38.332710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:38.333212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:38.334151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:38.334628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:38.755734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:38.790079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:38.792358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:38.793791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9b9dfdc-e559-4612-8d71-8c7e0c00ac08 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.477659 Jul 02 21:13:38.794853 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1530/3105] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:38 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:38.800996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:38.802076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:38.823101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:38.823721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:38.825441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:38.828505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:38.847684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:38.894287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86a644ae-1e61-4b9c-80db-20d3150bb96f tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.645736 Jul 02 21:13:38.895516 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1576/3106] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:13:38 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:38.919106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-461b360f-d8df-44ec-a340-940002d41b8e tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabd7ede430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:39.048972 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-461b360f-d8df-44ec-a340-940002d41b8e tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/6a06a793-aecd-4f89-84f4-2f909c4f7dcc" status: 200 len: 664 microversion: 2.1 time: 0.141018 Jul 02 21:13:39.049991 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1577/3107] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:13:38 2022] GET /compute/v2.1/os-security-groups/6a06a793-aecd-4f89-84f4-2f909c4f7dcc => generated 664 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:13:39.064905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ecf3778-a698-44f8-a820-7883f6b1e877 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabd7f09670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:39.078046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:39.099241 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7dd7a3a-c649-4381-ae2d-4dce778f5ca2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1315 microversion: 2.1 time: 0.298619 Jul 02 21:13:39.099748 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1531/3108] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:38 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:39.212390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:39.213415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:39.220175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:39.220615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:39.221594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:39.222227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:39.454019 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1ecf3778-a698-44f8-a820-7883f6b1e877 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/cf4f36c2-98ec-430b-8e9a-27a9caa64b6f" status: 202 len: 0 microversion: 2.1 time: 0.394203 Jul 02 21:13:39.455185 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1578/3109] 10.222.0.43 () {58 vars in 1286 bytes} [Sat Jul 2 21:13:39 2022] DELETE /compute/v2.1/os-security-group-rules/cf4f36c2-98ec-430b-8e9a-27a9caa64b6f => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:13:39.465494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:39.466242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:39.481577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:39.482045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:39.482830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:39.483269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:39.745911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:39.759994 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d5c3822-8f6c-474a-8c59-808b229e7c4b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1319 microversion: 2.1 time: 0.551135 Jul 02 21:13:39.762020 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1532/3110] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:39 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:39.771017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13e3494b-9f5b-41c5-9b89-23b45fb8bdb9 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabe4153670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:39.873507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:39.889551 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a1a23917-d424-4f03-ba05-1ce1789607d1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.432101 Jul 02 21:13:39.895028 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1579/3111] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:39 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:39.949591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:39.959567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:39.978162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:39.979066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:39.980781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:39.981569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:40.352033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:40.362641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:40.365085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:40.366764 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9915f1e9-41fa-453f-9559-851c48057120 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.468449 Jul 02 21:13:40.367856 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1580/3112] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:39 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:40.375151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:40.376231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:40.384531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:40.385809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:40.387731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:40.388402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:40.442057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13e3494b-9f5b-41c5-9b89-23b45fb8bdb9 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/6a06a793-aecd-4f89-84f4-2f909c4f7dcc" status: 202 len: 0 microversion: 2.1 time: 0.676659 Jul 02 21:13:40.443030 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1533/3113] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:39 2022] DELETE /compute/v2.1/os-security-groups/6a06a793-aecd-4f89-84f4-2f909c4f7dcc => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:40.451837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabe468aca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:40.568704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:40.569415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Neutron security group eb25d288-0d24-434e-8f7c-afadb4a340ae not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:13:40.570202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] HTTP exception thrown: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.570202 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Request method failure captured: Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/eb25d288-0d24-434e-8f7c-afadb4a340ae HTTP/1.1 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTuBIDxypmRak4tT-RpOwCfHW2IWaDAHU71wRg3P10BP9zzoUS1kHSd047SqIcxz2DPiz4uZg_7ZVeUUEfBCQ0UAVjx5pixJDQ98by_htkbqBgQ08sYIGSd-qN0NTL30Hy36IQfl-TFThgwjDfUBNHfYxR6pUM_BETpESYBHiue-2U Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a927eaf3d2da468480235dd4a065cdf6 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1501100418 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a927eaf3d2da468480235dd4a065cdf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a927eaf3d2da468480235dd4a065cdf6", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a927eaf3d2da468480235dd4a065cdf6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a927eaf3d2da468480235dd4a065cdf6"}]}] Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1501100418 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a927eaf3d2da468480235dd4a065cdf6 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1501100418 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesTestJSON-1501100418-project Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 40cbbd03a54c452a95fb84bc891bdfbb Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1501100418-project Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'eb25d288-0d24-434e-8f7c-afadb4a340ae'} Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:40.572767 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] Jul 02 21:13:40.577493 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:40.581505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Returning 404 to user: Security group eb25d288-0d24-434e-8f7c-afadb4a340ae does not exist Jul 02 21:13:40.581505 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-972233fe-f6c6-4be4-b2eb-285db898f4f2'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:40.582641 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48e7ab1c-a476-4ba2-b9fb-b18d652810d8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/eb25d288-0d24-434e-8f7c-afadb4a340ae" status: 404 len: 194 microversion: 2.1 time: 0.135280 Jul 02 21:13:40.583735 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1534/3114] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:40 2022] DELETE /compute/v2.1/os-security-groups/eb25d288-0d24-434e-8f7c-afadb4a340ae => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:13:40.602667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a3b192a-a62e-41f4-b1ad-eb1e5a995b1c tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabe4744c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:40.890159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:40.899349 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9bda1a08-f124-47a1-bb55-4c366689a4b2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1503 microversion: 2.1 time: 0.529399 Jul 02 21:13:40.904123 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1581/3115] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:40 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1503 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:40.915687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:40.920685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:40.938299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:40.938946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:40.940620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:40.941236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:40.994091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:41.246286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:41.251617 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a3b192a-a62e-41f4-b1ad-eb1e5a995b1c tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c7c5f7ef-6420-41a0-9ddc-b95697e9c5e9" status: 202 len: 0 microversion: 2.1 time: 0.662148 Jul 02 21:13:41.253166 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1535/3116] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:40 2022] DELETE /compute/v2.1/os-security-groups/c7c5f7ef-6420-41a0-9ddc-b95697e9c5e9 => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:13:41.264243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:41.267915 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0325c9ec-26a0-4e00-92f3-c5d03d6867c9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1468 microversion: 2.1 time: 0.362502 Jul 02 21:13:41.269623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:41.277708 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1582/3117] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:40 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1468 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:41.290224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.290922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:41.291736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fecc06b8-cf42-4bb6-bb8d-2fbc8acb5851 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:41.293790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.294278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:41.315814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fecc06b8-cf42-4bb6-bb8d-2fbc8acb5851 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.316592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fecc06b8-cf42-4bb6-bb8d-2fbc8acb5851 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:41.487556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fecc06b8-cf42-4bb6-bb8d-2fbc8acb5851 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Going to try to stop instance {{(pid=131045) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:13:41.555686 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fecc06b8-cf42-4bb6-bb8d-2fbc8acb5851 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700/action" status: 202 len: 0 microversion: 2.1 time: 0.270890 Jul 02 21:13:41.557232 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1583/3118] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:41 2022] POST /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:41.565544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a992e4d-b122-48ac-9ec7-b9a4e1f9678b tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabd7eb15e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:41.598342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:41.621481 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79c50137-5d81-41c7-903a-292da6bc22a7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.366311 Jul 02 21:13:41.624240 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1536/3119] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:41 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:41.632185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:41.632958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:41.642676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.643221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:41.644428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.644965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:41.672011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lazy-loading 'flavor' on Instance uuid 226fb301-cf6d-48b8-871e-2144e0f46890 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:41.826805 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-027a3eee-a516-4669-be4b-03927f6da536 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890/action" status: 202 len: 0 microversion: 2.1 time: 0.201094 Jul 02 21:13:41.827681 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1537/3120] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:41 2022] POST /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:41.837617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:41.838435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:41.846301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.846874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:41.848350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:41.848980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:42.181734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:42.192802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:42.195248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:42.197267 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10ca20c4-8442-4f87-9dd3-4b9068372979 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.368395 Jul 02 21:13:42.198422 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1538/3121] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:41 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:42.236429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:42.238881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:42.248254 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9a992e4d-b122-48ac-9ec7-b9a4e1f9678b tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ed003fe6-b4a3-49e1-a7b1-b252ee9e45d3" status: 202 len: 0 microversion: 2.1 time: 0.689301 Jul 02 21:13:42.250418 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1584/3122] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:41 2022] DELETE /compute/v2.1/os-security-groups/ed003fe6-b4a3-49e1-a7b1-b252ee9e45d3 => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:42.256640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:42.258048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:42.260107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:42.260247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:42.264320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:42.265648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:42.287829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:42.292239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:42.296590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:42.298235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:42.727522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:42.738839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c5fa993-35ff-43a5-ac8a-e89477ff5895 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.538378 Jul 02 21:13:42.739766 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1539/3123] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:42 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:42.749504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d212dd0e-6b7d-463a-9780-361e7b3bed9d tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabe4692550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:42.854104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:42.868990 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e6e96aa2-b11d-45c2-ba89-4007350c37e5 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1476 microversion: 2.1 time: 0.616472 Jul 02 21:13:42.878999 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1585/3124] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:42 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1476 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:42.884403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:42.885314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:42.891803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:42.892674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:42.893712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:42.894363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:43.243991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:43.261336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b71d4e3d-ffe5-4c8b-b07c-7bbada7b8092 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.379647 Jul 02 21:13:43.262260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1586/3125] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:42 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:43.268605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a5c91ed6-dfde-420d-b7d1-4abee4dbc6c8 req-7819e34e-55d0-4a54-af42-cf5ef0ef7369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47b7229-6aa2-4688-959b-407721ca10a1", "name": "network-vif-plugged", "status": "completed", "tag": "17aac8bd-951c-4ef5-8ca1-bb20fad556e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:43.280369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a5c91ed6-dfde-420d-b7d1-4abee4dbc6c8 req-7819e34e-55d0-4a54-af42-cf5ef0ef7369 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:43.281068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a5c91ed6-dfde-420d-b7d1-4abee4dbc6c8 req-7819e34e-55d0-4a54-af42-cf5ef0ef7369 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:43.317695 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a5c91ed6-dfde-420d-b7d1-4abee4dbc6c8 req-7819e34e-55d0-4a54-af42-cf5ef0ef7369 service nova] Creating event network-vif-plugged:17aac8bd-951c-4ef5-8ca1-bb20fad556e5 for instance d47b7229-6aa2-4688-959b-407721ca10a1 on nch1-master-1 Jul 02 21:13:43.325576 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a5c91ed6-dfde-420d-b7d1-4abee4dbc6c8 req-7819e34e-55d0-4a54-af42-cf5ef0ef7369 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061789 Jul 02 21:13:43.327829 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1587/3126] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:43.342655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:43.343270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:43.353751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:43.353751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:43.357139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:43.357652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:43.374766 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d212dd0e-6b7d-463a-9780-361e7b3bed9d tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/4af06619-7b7b-4a56-a735-981f6a5a9856" status: 202 len: 0 microversion: 2.1 time: 0.633503 Jul 02 21:13:43.376353 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1540/3127] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:42 2022] DELETE /compute/v2.1/os-security-groups/4af06619-7b7b-4a56-a735-981f6a5a9856 => generated 0 bytes in 636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:43.399399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a27b00bb-47eb-4c51-9ee1-bcb8f9a62aaa tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabe4692d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:43.970674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:43.991508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:43.995363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:43.997489 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ee9dfaa9-602a-4219-8204-45b1a9c99351 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.666931 Jul 02 21:13:43.999555 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1588/3128] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:43 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:44.005911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:44.006816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:44.016607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.017661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.019659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.020749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.253973 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a27b00bb-47eb-4c51-9ee1-bcb8f9a62aaa tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/db1f921d-622a-481f-b1e9-0e3faf5956e4" status: 202 len: 0 microversion: 2.1 time: 0.872217 Jul 02 21:13:44.256560 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1541/3129] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:43 2022] DELETE /compute/v2.1/os-security-groups/db1f921d-622a-481f-b1e9-0e3faf5956e4 => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:13:44.264956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:44.266250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:44.281073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.281704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.283297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.284366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.390182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:44.400746 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccb18b4d-bab1-4065-80ef-3960e7e770f9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.399627 Jul 02 21:13:44.401513 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1589/3130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:43 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:44.409088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b0829a3-190e-4daf-a521-13ac359caed8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] Calling method '.version_select at 0x7fabd7f09940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:44.511084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:44.526370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e997a64-d823-40d2-b0af-b1cc0dbd9749 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1459 microversion: 2.1 time: 0.268185 Jul 02 21:13:44.538457 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1542/3131] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:44 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1459 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:44.551064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:44.553710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:44.565052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.565831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.566709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.567176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.741933 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b0829a3-190e-4daf-a521-13ac359caed8 tempest-SecurityGroupRulesTestJSON-1501100418 tempest-SecurityGroupRulesTestJSON-1501100418-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/2cea5de7-5a33-4b00-8d2b-2880fcd4346f" status: 202 len: 0 microversion: 2.1 time: 0.336345 Jul 02 21:13:44.745790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1590/3132] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:44 2022] DELETE /compute/v2.1/os-security-groups/2cea5de7-5a33-4b00-8d2b-2880fcd4346f => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:44.775277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:44.776148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:44.808307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.809304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.813802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:44.815282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:44.828954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:44.858561 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9d174d3-bb9d-4e0c-8fdf-c109bfe2a42d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1316 microversion: 2.1 time: 0.319606 Jul 02 21:13:44.859171 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1543/3133] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:44 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:45.019862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:45.021578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:45.029578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.030120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.031032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.031621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.323042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:45.335639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:45.340060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:45.352605 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17d55eb6-80f0-4315-9421-90d17091fee9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.330019 Jul 02 21:13:45.355571 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1544/3134] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:45 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:13:45.419536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:45.420176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:45.430824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.431289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.432108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.432542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.493610 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07cd8a48-3616-42bf-b1b6-6b1babdb224e tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1610 microversion: 2.1 time: 0.744607 Jul 02 21:13:45.495480 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1591/3135] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:44 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1610 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:45.518212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5d299bbb-f251-4eef-bde3-441963e7ebe5 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:45.524104 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:13:45.524104 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:13:45.531233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d299bbb-f251-4eef-bde3-441963e7ebe5 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.532256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d299bbb-f251-4eef-bde3-441963e7ebe5 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.535115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d299bbb-f251-4eef-bde3-441963e7ebe5 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.536820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d299bbb-f251-4eef-bde3-441963e7ebe5 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.619592 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5d299bbb-f251-4eef-bde3-441963e7ebe5 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.111813 Jul 02 21:13:45.621395 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1592/3136] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:13:45 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:45.632902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:45.634309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:45.640836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.641534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.642609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.643272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.705911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Lazy-loading 'flavor' on Instance uuid 226fb301-cf6d-48b8-871e-2144e0f46890 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:45.726205 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 226fb301-cf6d-48b8-871e-2144e0f46890 while it is in vm_state suspended Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Request method failure captured: Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890/action HTTP/1.1 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 97 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTjggY57WrvaHAArMGsWMwBa3xdVnz7lmeEPVj74UrxorjxIUwwAIgidrkGoXdQQ_OQt9RYvnoo38YePurCtn50X9uw6r0Tdb3FwU_FH4NgbYZ_ow3uyvpBUOXTNVi6NDznLLuJv6zx5AfVCMlMEct_Bhjk9bqcnjIXOnvVvYVu-f0 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 40591bf3c1f84e09923f58cdfb142fb4 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-LiveMigrationNegativeTest-1624330722 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40591bf3c1f84e09923f58cdfb142fb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_40591bf3c1f84e09923f58cdfb142fb4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/40591bf3c1f84e09923f58cdfb142fb4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/40591bf3c1f84e09923f58cdfb142fb4"}]}] Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-LiveMigrationNegativeTest-1624330722 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 40591bf3c1f84e09923f58cdfb142fb4 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1624330722 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-LiveMigrationNegativeTest-1624330722-project-admin Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8d4ba4991979468bac74996b6b9d7f62 Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-LiveMigrationNegativeTest-1624330722-project-admin Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'os-migrateLive' instance 226fb301-cf6d-48b8-871e-2144e0f46890 while it is in vm_state suspended Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '226fb301-cf6d-48b8-871e-2144e0f46890', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:45.728422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 226fb301-cf6d-48b8-871e-2144e0f46890 while it is in vm_state suspended Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 226fb301-cf6d-48b8-871e-2144e0f46890 while it is in vm_state suspended Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 226fb301-cf6d-48b8-871e-2144e0f46890 while it is in vm_state suspended {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5a1c0c40-b469-4b7a-89fb-d6996bbf4fb1 tempest-LiveMigrationNegativeTest-1624330722 tempest-LiveMigrationNegativeTest-1624330722-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890/action" status: 409 len: 155 microversion: 2.1 time: 0.101548 Jul 02 21:13:45.733058 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1593/3137] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:45 2022] POST /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890/action => generated 155 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:13:45.744837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:45.745919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:45.759241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.759701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.760531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:45.760984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:45.795396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:13:45.961149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:45.967393 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e29cc0c4-e776-4440-9b16-67f115a5b403 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "DELETE /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 204 len: 0 microversion: 2.1 time: 0.229000 Jul 02 21:13:45.967941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:45.972108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1594/3138] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:13:45 2022] DELETE /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:45.977041 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-402bbe43-8f8d-42a5-a241-48a538bbe948 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.562094 Jul 02 21:13:45.980529 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1545/3139] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:45 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:45.987775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:45.995903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:45.998386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:46.000653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:46.005137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.005820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.007156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.007755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.018232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.018972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.020602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.022298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.361202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:46.365227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:46.373681 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ce43bdb-4ea2-487f-b3cf-1e77ea3f17ba tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1465 microversion: 2.1 time: 0.391557 Jul 02 21:13:46.376770 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1546/3140] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:45 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1465 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:46.377969 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d0d1603-ef9b-47cb-be92-8765b27df510 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1505 microversion: 2.1 time: 0.403733 Jul 02 21:13:46.378914 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1595/3141] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:45 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1505 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:46.390225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:46.391130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:46.401951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2043401408"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:46.402998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:46.404202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.404862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.405858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.406313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.423614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.424282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.425779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:46.426650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:46.708602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:46.717617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:46.730004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:46.731584 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5859246c-ca27-486b-81cc-f70dd2806daa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.353612 Jul 02 21:13:46.732428 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1547/3142] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:46 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:46.831456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.security_group_api [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Adding security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 to port 17aac8bd-951c-4ef5-8ca1-bb20fad556e5 Jul 02 21:13:46.998340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:46.999466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:47.002162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:47.016504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:47.016975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:47.017777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:47.018227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:47.519252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:47.532521 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a602459-9f75-4091-93a4-203bcb804542 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.538090 Jul 02 21:13:47.533083 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1548/3143] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:46 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:47.546602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:47.547226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:47.555649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:47.556248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:47.557732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:47.558178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.247874 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06c176e7-bec2-497c-88d0-ccfc65492d01 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1/action" status: 202 len: 0 microversion: 2.1 time: 1.852699 Jul 02 21:13:48.253158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1596/3144] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:46 2022] POST /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1/action => generated 0 bytes in 1859 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:48.261151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:48.263540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:48.276144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.279398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.282818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.283369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.288771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:48.301723 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-caf6c867-a6a0-4e6b-b232-dbcbaabdddee tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1465 microversion: 2.1 time: 0.766165 Jul 02 21:13:48.311983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1549/3145] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:47 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1465 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:48.311983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7f66775-5a93-4e84-8a92-b9b0d106422c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe46e4790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:48.676520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:48.689356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:48.690883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:48.696166 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86e5a6e0-feef-41f5-b3d3-4abf3ba40895 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.437141 Jul 02 21:13:48.696854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1597/3146] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:48 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:48.701632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0e9492fe-ebfd-44db-a454-10ef42076474 req-15bb8bbe-102d-42f8-83cc-08df3d48138c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47b7229-6aa2-4688-959b-407721ca10a1", "tag": "17aac8bd-951c-4ef5-8ca1-bb20fad556e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:48.728312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0e9492fe-ebfd-44db-a454-10ef42076474 req-15bb8bbe-102d-42f8-83cc-08df3d48138c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.728767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0e9492fe-ebfd-44db-a454-10ef42076474 req-15bb8bbe-102d-42f8-83cc-08df3d48138c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.747788 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0e9492fe-ebfd-44db-a454-10ef42076474 req-15bb8bbe-102d-42f8-83cc-08df3d48138c service nova] Creating event network-changed:17aac8bd-951c-4ef5-8ca1-bb20fad556e5 for instance d47b7229-6aa2-4688-959b-407721ca10a1 on nch1-master-1 Jul 02 21:13:48.756558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-f7f66775-5a93-4e84-8a92-b9b0d106422c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use.", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:48.757299 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0e9492fe-ebfd-44db-a454-10ef42076474 req-15bb8bbe-102d-42f8-83cc-08df3d48138c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059119 Jul 02 21:13:48.757626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f7f66775-5a93-4e84-8a92-b9b0d106422c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.757626 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] Jul 02 21:13:48.760093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1598/3147] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7f66775-5a93-4e84-8a92-b9b0d106422c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9 HTTP/1.1 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: exception: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'ac8610a3-4a2b-453a-a18c-e47ed59188b9'} Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.761921 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] Jul 02 21:13:48.767836 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:48.772230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:48.772230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:48.775195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7f66775-5a93-4e84-8a92-b9b0d106422c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 400 to user: Security Group ac8610a3-4a2b-453a-a18c-e47ed59188b9 in use. Jul 02 21:13:48.775195 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-4fcedac1-c6e7-4316-963c-b3273c08c7c0'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:48.775195 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7f66775-5a93-4e84-8a92-b9b0d106422c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9" status: 400 len: 185 microversion: 2.1 time: 0.470872 Jul 02 21:13:48.776365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1550/3148] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:48 2022] DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9 => generated 185 bytes in 473 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:13:48.785240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.785720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.786634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.787082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.798780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:48.817212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:48.835641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.838921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.839924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:48.845388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:48.965083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:49.036786 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-556194c5-49e5-412b-9656-2c9c82fdac91 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1/action" status: 202 len: 0 microversion: 2.1 time: 0.256867 Jul 02 21:13:49.037652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1551/3149] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:48 2022] POST /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:49.046752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:49.049251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:49.065946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.070887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.072014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.072660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.481278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:49.492792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffa19b0c-50a3-4cdf-89ec-62002e987845 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1576 microversion: 2.1 time: 0.450025 Jul 02 21:13:49.499080 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1552/3150] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:49 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1576 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:49.524679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-940a0d91-e5a2-4a60-b7c1-e4ce73d68450 req-77c2f12e-d11f-465c-8e24-0914ec357f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226fb301-cf6d-48b8-871e-2144e0f46890", "name": "network-vif-deleted", "tag": "e6116473-161b-4347-892b-4633dd861ea1"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:49.546108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-940a0d91-e5a2-4a60-b7c1-e4ce73d68450 req-77c2f12e-d11f-465c-8e24-0914ec357f77 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.547898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-940a0d91-e5a2-4a60-b7c1-e4ce73d68450 req-77c2f12e-d11f-465c-8e24-0914ec357f77 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.583286 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-940a0d91-e5a2-4a60-b7c1-e4ce73d68450 req-77c2f12e-d11f-465c-8e24-0914ec357f77 service nova] Creating event network-vif-deleted:e6116473-161b-4347-892b-4633dd861ea1 for instance 226fb301-cf6d-48b8-871e-2144e0f46890 on nch2-master-1 Jul 02 21:13:49.593909 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-940a0d91-e5a2-4a60-b7c1-e4ce73d68450 req-77c2f12e-d11f-465c-8e24-0914ec357f77 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079816 Jul 02 21:13:49.598211 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1553/3151] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:49.607592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:49.618208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:49.629359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.636321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.638822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.639523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.681015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:49.690112 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17b16897-bb19-4a6b-8dfd-806e9896d691 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.928394 Jul 02 21:13:49.692795 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1599/3152] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:48 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:49.714841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:49.715731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:49.723567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.724027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.724851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.725518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.726860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:49.727541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:49.728175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lazy-loading 'fault' on Instance uuid 226fb301-cf6d-48b8-871e-2144e0f46890 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:13:49.775581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:49.830857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:49.844634 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6d5d172-a2d1-45a6-b51d-e8e6029e31d9 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 200 len: 1309 microversion: 2.1 time: 0.242860 Jul 02 21:13:49.846320 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1554/3153] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:49 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 1309 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:50.177220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:50.196637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:50.198368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:50.199803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c2fe3344-58c9-434f-8e08-cf46fdc31e1c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.488995 Jul 02 21:13:50.200568 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1600/3154] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:49 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:13:50.516575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:50.517520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:50.532668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:50.533293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:50.534202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:50.534751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:50.709513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:50.710815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:50.722466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:50.732929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:50.734099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:50.734704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.508691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:51.520114 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a86f8cb-2b39-4a38-ab93-03cd6254a578 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1576 microversion: 2.1 time: 1.007071 Jul 02 21:13:51.534504 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1555/3155] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:50 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1576 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:51.540529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:51.541405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 226fb301-cf6d-48b8-871e-2144e0f46890] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:51.561671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:51.562517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.563513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:51.564130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.584749 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] HTTP exception thrown: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 could not be found. Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Request method failure captured: Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 HTTP/1.1 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTizif5w2-8d58VKKZ0xrvXuryAhSQsBIIr22p4BT7uhdPlTSHKByg2_Y1VTZbx9Hm7mY-9C0cH7Jm_c34-fntTCJIdczIfiAIdAKNxsDr-PNDLu3RTssjlKH2B1yxsyBmw_FGNIDpUDjXjeAmrtUo4FENQYGh_8vNGYtyoB4K-86Q Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 79a9f342331e41468cfbf45d04f8d623 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationNegativeTest-1965135543 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79a9f342331e41468cfbf45d04f8d623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_79a9f342331e41468cfbf45d04f8d623", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79a9f342331e41468cfbf45d04f8d623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/79a9f342331e41468cfbf45d04f8d623"}]}] Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationNegativeTest-1965135543 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 79a9f342331e41468cfbf45d04f8d623 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1965135543 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationNegativeTest-1965135543-project Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 19fe81e09ba144b393a3809b89c6f8d5 Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationNegativeTest-1965135543-project Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 could not be found. Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '226fb301-cf6d-48b8-871e-2144e0f46890'} Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 could not be found. Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 could not be found. Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:51.587392 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 could not be found. Jul 02 21:13:51.592468 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:51.594077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Returning 404 to user: Instance 226fb301-cf6d-48b8-871e-2144e0f46890 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:51.595199 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-238c3b49-d54b-480c-8fcd-f697629b39c0 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890" status: 404 len: 111 microversion: 2.1 time: 0.059333 Jul 02 21:13:51.599837 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1556/3156] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:51 2022] GET /compute/v2.1/servers/226fb301-cf6d-48b8-871e-2144e0f46890 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:51.606214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:51.607089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:51.617450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:51.618241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.619897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:51.622519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.729971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:51.740326 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba0324c8-85fb-419f-a048-865cc3058e24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 1.034641 Jul 02 21:13:51.758617 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1601/3157] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:50 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:51.772769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:51.775744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:51.800950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:51.801596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.802440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:51.802879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:51.847579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:13:52.049976 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80166577-eb6c-4593-a7e5-403cd6662bfc tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "DELETE /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 204 len: 0 microversion: 2.1 time: 0.280852 Jul 02 21:13:52.055238 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1602/3158] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:13:51 2022] DELETE /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:52.063107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:52.064190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:52.094759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:52.095788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:52.096859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:52.097629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:52.135930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:52.161718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:52.182808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:52.184342 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e495084-4504-4eea-9430-a6184919f7f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1743 microversion: 2.20 time: 0.583044 Jul 02 21:13:52.196432 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1557/3159] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:51 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1743 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:52.543294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:52.543994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:52.559194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:52.559776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:52.560664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:52.561105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:52.607295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:52.622801 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6681b87e-5750-4530-857c-cac9b7e57b40 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1473 microversion: 2.1 time: 0.565771 Jul 02 21:13:52.624948 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1603/3160] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:52 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1473 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:52.775194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:52.776870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:52.797370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:52.798726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:52.802317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:52.803133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:53.977789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:53.994067 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d8b1247-aac2-4a6a-a3b8-11d31262eb7c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1576 microversion: 2.1 time: 1.450208 Jul 02 21:13:53.994769 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1558/3161] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:52 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1576 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:54.008791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:54.021526 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd33e270-b3c6-4b11-bfb9-4e9e9f4b8fa7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 1.250053 Jul 02 21:13:54.024632 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1604/3162] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:52 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:13:54.028555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:54.029566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:54.041691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:54.043171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:54.045368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:54.046152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:54.047349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:54.048231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:54.065272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:54.065821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:54.071584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:54.074415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:54.564136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:54.569400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:54.578121 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-60f23a43-7558-417d-b853-54bd7e2b0d9b tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1473 microversion: 2.1 time: 0.550876 Jul 02 21:13:54.578740 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1605/3163] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:54 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1473 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:54.604020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:54.605892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:54.607143 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1aeb67f-dcfa-4ffc-baa9-e30a48374920 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1743 microversion: 2.20 time: 0.597622 Jul 02 21:13:54.607724 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1559/3164] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:53 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1743 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:55.013130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:55.013750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:55.030013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.031431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.044375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:55.045014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:55.047335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.049134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.069552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.070015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.070813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.071257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.533511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:55.551227 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5da337e6-c55c-4700-968d-0c17e5665a55 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1574 microversion: 2.1 time: 0.544110 Jul 02 21:13:55.552693 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1606/3165] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:55 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1574 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:55.567632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-53cb1393-a207-4b42-b275-b7ff6e87838d req-6c7b46e0-2814-4c95-b1d8-e44504341b38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "name": "network-vif-plugged", "status": "completed", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:55.583246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:13:55.587610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-53cb1393-a207-4b42-b275-b7ff6e87838d req-6c7b46e0-2814-4c95-b1d8-e44504341b38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.591854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-53cb1393-a207-4b42-b275-b7ff6e87838d req-6c7b46e0-2814-4c95-b1d8-e44504341b38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.633693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-53cb1393-a207-4b42-b275-b7ff6e87838d req-6c7b46e0-2814-4c95-b1d8-e44504341b38 service nova] Creating event network-vif-plugged:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:13:55.647506 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-53cb1393-a207-4b42-b275-b7ff6e87838d req-6c7b46e0-2814-4c95-b1d8-e44504341b38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093237 Jul 02 21:13:55.649437 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1607/3166] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:55.658968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-159264517"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:55.667626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:55.695779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.696293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.697456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.698123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.751739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:55.761420 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72839eed-a8db-4121-a7c7-012fe06afcd8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.722223 Jul 02 21:13:55.765511 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1560/3167] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:55 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:55.777180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:55.779466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:55.794611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.795243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:55.796181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:55.796687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:56.112008 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.security_group_api [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Adding security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d to port 17aac8bd-951c-4ef5-8ca1-bb20fad556e5 Jul 02 21:13:56.225015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19fe81e09ba144b393a3809b89c6f8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79a9f342331e41468cfbf45d04f8d623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:56.242065 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f903c1e-22e9-43c7-a4ca-c87e18c5e186 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 200 len: 1473 microversion: 2.1 time: 0.471376 Jul 02 21:13:56.246534 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1561/3168] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:55 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 1473 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:56.259133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:56.280545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:56.314723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:56.315759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:56.319506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:56.321460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:56.900078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:56.915456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:56.917062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:56.925098 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9032030b-148e-418b-9fc7-cb0d898aa05e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.673830 Jul 02 21:13:56.930601 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1562/3169] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:56 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:56.952616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f7b05c2a-58e8-4776-a916-833800c1770e req-a1e2f6df-26ad-4d84-86f4-11aaf7d76d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b84bf7-6cdb-4210-af84-cb6a31f12be1", "name": "network-vif-deleted", "tag": "677d764f-fd62-47ee-b02c-8b2c5d07ed96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:56.984852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f7b05c2a-58e8-4776-a916-833800c1770e req-a1e2f6df-26ad-4d84-86f4-11aaf7d76d98 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:56.987800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f7b05c2a-58e8-4776-a916-833800c1770e req-a1e2f6df-26ad-4d84-86f4-11aaf7d76d98 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.032016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f7b05c2a-58e8-4776-a916-833800c1770e req-a1e2f6df-26ad-4d84-86f4-11aaf7d76d98 service nova] Creating event network-vif-deleted:677d764f-fd62-47ee-b02c-8b2c5d07ed96 for instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 on nch2-master-1 Jul 02 21:13:57.045694 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f7b05c2a-58e8-4776-a916-833800c1770e req-a1e2f6df-26ad-4d84-86f4-11aaf7d76d98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113686 Jul 02 21:13:57.053261 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1563/3170] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:57.068909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:57.069634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:57.097683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.098583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.099255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.099694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.111650 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-209ef84d-35bb-42b5-a50b-00a34cc3209a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1/action" status: 202 len: 0 microversion: 2.1 time: 1.455753 Jul 02 21:13:57.111650 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1608/3171] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:13:55 2022] POST /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1/action => generated 0 bytes in 1461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:13:57.119406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f19c453b-43cf-44d0-8462-27ffe48d4617 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd78294c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:57.738120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:57.759965 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5928c71-819f-4001-931e-abafe25fa5d6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.704887 Jul 02 21:13:57.760611 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1564/3172] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:57 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:57.781618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2ca94a7e-caa5-4e2d-b3f6-7af5aca70307 req-61a8c1e1-22f1-49f0-b3fb-412abe5dfc20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d47b7229-6aa2-4688-959b-407721ca10a1", "tag": "17aac8bd-951c-4ef5-8ca1-bb20fad556e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:13:57.826901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2ca94a7e-caa5-4e2d-b3f6-7af5aca70307 req-61a8c1e1-22f1-49f0-b3fb-412abe5dfc20 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.829361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2ca94a7e-caa5-4e2d-b3f6-7af5aca70307 req-61a8c1e1-22f1-49f0-b3fb-412abe5dfc20 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.864101 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2ca94a7e-caa5-4e2d-b3f6-7af5aca70307 req-61a8c1e1-22f1-49f0-b3fb-412abe5dfc20 service nova] Creating event network-changed:17aac8bd-951c-4ef5-8ca1-bb20fad556e5 for instance d47b7229-6aa2-4688-959b-407721ca10a1 on nch1-master-1 Jul 02 21:13:57.881174 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2ca94a7e-caa5-4e2d-b3f6-7af5aca70307 req-61a8c1e1-22f1-49f0-b3fb-412abe5dfc20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116031 Jul 02 21:13:57.884762 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1565/3173] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:13:57.889447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-f19c453b-43cf-44d0-8462-27ffe48d4617 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use.", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:13:57.890153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-f19c453b-43cf-44d0-8462-27ffe48d4617 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.890153 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] Jul 02 21:13:57.895982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f19c453b-43cf-44d0-8462-27ffe48d4617 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d HTTP/1.1 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: exception: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b79b07ed-f16b-4f5d-b2d2-e46647c75e6d'} Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.897196 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] Jul 02 21:13:57.902122 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.905018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f19c453b-43cf-44d0-8462-27ffe48d4617 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 400 to user: Security Group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d in use. Jul 02 21:13:57.905018 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-71c3f26a-4ac4-4208-a5e1-908dafdb8e4f'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:57.906229 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f19c453b-43cf-44d0-8462-27ffe48d4617 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d" status: 400 len: 185 microversion: 2.1 time: 0.790078 Jul 02 21:13:57.907229 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1609/3174] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:13:57 2022] DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d => generated 185 bytes in 792 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:13:57.923182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:57.923764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] [instance: 83b84bf7-6cdb-4210-af84-cb6a31f12be1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:57.925287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:57.945527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.947941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.949070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.949844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.952748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.953226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.954035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:57.954481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:57.994661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] HTTP exception thrown: Instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 could not be found. Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Request method failure captured: Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 HTTP/1.1 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTizif5w2-8d58VKKZ0xrvXuryAhSQsBIIr22p4BT7uhdPlTSHKByg2_Y1VTZbx9Hm7mY-9C0cH7Jm_c34-fntTCJIdczIfiAIdAKNxsDr-PNDLu3RTssjlKH2B1yxsyBmw_FGNIDpUDjXjeAmrtUo4FENQYGh_8vNGYtyoB4K-86Q Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 79a9f342331e41468cfbf45d04f8d623 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-LiveMigrationNegativeTest-1965135543 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79a9f342331e41468cfbf45d04f8d623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_79a9f342331e41468cfbf45d04f8d623", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/79a9f342331e41468cfbf45d04f8d623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/79a9f342331e41468cfbf45d04f8d623"}]}] Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-LiveMigrationNegativeTest-1965135543 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 79a9f342331e41468cfbf45d04f8d623 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1965135543 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-LiveMigrationNegativeTest-1965135543-project Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 19fe81e09ba144b393a3809b89c6f8d5 Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-LiveMigrationNegativeTest-1965135543-project Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 could not be found. Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '83b84bf7-6cdb-4210-af84-cb6a31f12be1'} Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 could not be found. Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 could not be found. Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:13:57.997733 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 could not be found. Jul 02 21:13:58.003223 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:13:58.004216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] Returning 404 to user: Instance 83b84bf7-6cdb-4210-af84-cb6a31f12be1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:13:58.005303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5b93788-64eb-4fc6-8e3a-df109c492ff8 tempest-LiveMigrationNegativeTest-1965135543 tempest-LiveMigrationNegativeTest-1965135543-project] 10.222.0.43 "GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1" status: 404 len: 111 microversion: 2.1 time: 0.119158 Jul 02 21:13:58.008745 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1566/3175] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:57 2022] GET /compute/v2.1/servers/83b84bf7-6cdb-4210-af84-cb6a31f12be1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:13:58.019625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:58.023471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:58.026788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:13:58.039545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:58.045849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:58.053572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:58.055721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:58.220553 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-995ae65c-ed67-45ea-b9ad-9562390efcca tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 204 len: 0 microversion: 2.1 time: 0.308048 Jul 02 21:13:58.222367 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1610/3176] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:13:57 2022] DELETE /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:13:58.240595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:58.242217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:58.260204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:58.261749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:58.264981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:58.265676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:58.475304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:58.516871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:58.527781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:58.544468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de52a2b1-21fd-4732-9cc4-2d9f059f302b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.533323 Jul 02 21:13:58.550537 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1567/3177] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:58 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:13:58.777437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:58.779069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:58.794903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:58.795868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:58.796826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:58.798603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:58.812830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:58.824350 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63eca397-ee64-401b-a4e9-88408bb07436 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1648 microversion: 2.1 time: 0.596121 Jul 02 21:13:58.825856 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1611/3178] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:58 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1648 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:59.026357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:13:59.036075 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b81cc190-0221-481d-b091-5c1fa15c80b3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.262871 Jul 02 21:13:59.037760 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1568/3179] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:13:58 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:13:59.567327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:13:59.569532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:13:59.587398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:59.588462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:13:59.589668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:13:59.590446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:00.279310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-106228369", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:00.375423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] validate_networks() for [('393da7ac-8cf0-402c-8622-03c330c670fd', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:14:00.430187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:00.442199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:00.447727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:00.449683 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64df8eea-dc76-44b9-86bf-bda8e09e8afb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.886718 Jul 02 21:14:00.455084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1612/3180] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:13:59 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:00.463979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:00.464740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:00.485600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:00.486072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:00.486882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:00.487321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:01.818026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:01.838798 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-13f5433c-43a1-467e-aeb5-7c62468f8d7d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 200 len: 1648 microversion: 2.1 time: 1.375417 Jul 02 21:14:01.848773 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1613/3181] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:00 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 1648 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:01.868655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:01.873018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:01.903830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:01.911852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:01.912901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:01.913358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:03.728324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:03.744238 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-61c1d76f-9967-4716-a07d-38d45a4f8689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 1.903312 Jul 02 21:14:03.758284 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1614/3182] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:01 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 1918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:03.778691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:03.789033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:03.803554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:03.804632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:03.805500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:03.808694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.229899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:04.237248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:04.244706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:04.250478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:04.251723 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a73f5c2-8c31-4b62-8aa3-7bc50d11dcf8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.491980 Jul 02 21:14:04.258698 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1615/3183] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:03 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:04.276873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:04.277707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:04.312138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.313682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.314563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.315008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.399078 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 HTTP/1.1 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd47b7229-6aa2-4688-959b-407721ca10a1'} Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:04.410088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:04.414403 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-239103bb-9d08-4ad2-ade4-d90e7ca3d8cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 404 len: 111 microversion: 2.1 time: 0.151098 Jul 02 21:14:04.419851 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1616/3184] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:04 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:04.437411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-45549be0-0c7e-4bfc-80de-a1333320af68 req-f4614a40-c070-4e7e-907f-93d7661a9635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d47b7229-6aa2-4688-959b-407721ca10a1", "name": "network-vif-deleted", "tag": "17aac8bd-951c-4ef5-8ca1-bb20fad556e5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:04.455562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:14:04.456076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:14:04.456407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:14:04.456878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:14:04.457212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:14:04.480169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-45549be0-0c7e-4bfc-80de-a1333320af68 req-f4614a40-c070-4e7e-907f-93d7661a9635 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.480660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-45549be0-0c7e-4bfc-80de-a1333320af68 req-f4614a40-c070-4e7e-907f-93d7661a9635 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.484029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.487493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.488412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.488883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.530212 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-45549be0-0c7e-4bfc-80de-a1333320af68 req-f4614a40-c070-4e7e-907f-93d7661a9635 service nova] Creating event network-vif-deleted:17aac8bd-951c-4ef5-8ca1-bb20fad556e5 for instance d47b7229-6aa2-4688-959b-407721ca10a1 on nch1-master-1 Jul 02 21:14:04.549417 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-45549be0-0c7e-4bfc-80de-a1333320af68 req-f4614a40-c070-4e7e-907f-93d7661a9635 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115573 Jul 02 21:14:04.561628 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1617/3185] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:04.571899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b71dd2d5-4290-458e-a4e0-5e6db5d8256f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd7f09310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:04.574753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Getting quotas for project ae35822336ca48cd9f497419d0226268. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:14:04.596442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Getting quotas for user da701099fee44f03824febc2034358fa and project ae35822336ca48cd9f497419d0226268. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:14:04.652659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:14:04.655041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:14:04.799281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c4e1cbc-714b-43d0-be3b-7016bc8943d5 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.970720 Jul 02 21:14:04.802371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1569/3186] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:13:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 4974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:14:04.815004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:04.816077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:04.836976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.837436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:04.845407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:04.845870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:05.615752 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b71dd2d5-4290-458e-a4e0-5e6db5d8256f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9" status: 202 len: 0 microversion: 2.1 time: 1.049055 Jul 02 21:14:05.618393 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1618/3187] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9 => generated 0 bytes in 1054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:05.627890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75e487f5-4721-492e-bc96-808cd1d1ffe9 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:05.631879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75e487f5-4721-492e-bc96-808cd1d1ffe9 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:05.862288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75e487f5-4721-492e-bc96-808cd1d1ffe9 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:05.870828 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75e487f5-4721-492e-bc96-808cd1d1ffe9 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1222 microversion: 2.1 time: 0.250523 Jul 02 21:14:05.881954 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1619/3188] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:05 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1222 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:05.888336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:05.892856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:05.912018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:05.913450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:05.914561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:05.917231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:05.928365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:05.963545 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1838d7e-f7b6-4782-92da-83fb5b1239de tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 1.149869 Jul 02 21:14:05.977033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1570/3189] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:04 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:05.993134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-713a0486-b0cc-42d9-9c49-c4ad146726cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe410a430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:07.154506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:07.167438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:07.169997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:07.172019 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-05caa7c4-9da7-47ad-a9b2-cd9de444d154 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 1.288559 Jul 02 21:14:07.174393 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1620/3190] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:05 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:07.183743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:07.184862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:07.199003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:07.199845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:07.216883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:07.221001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:07.709431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:07.727940 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb4c0c52-1bd6-4ee3-ae0e-b7b069b0df14 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1292 microversion: 2.1 time: 0.552246 Jul 02 21:14:07.742249 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1621/3191] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:07 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1292 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:07.756082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:07.758709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:07.774850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:07.775589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:07.778088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:07.778792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:07.883157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-713a0486-b0cc-42d9-9c49-c4ad146726cc tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d" status: 202 len: 0 microversion: 2.1 time: 1.909152 Jul 02 21:14:07.885094 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1571/3192] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:05 2022] DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d => generated 0 bytes in 1915 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:07.895611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1126c1bc-1137-4bdb-a26a-a8bd9d967324 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'create', calling method: .version_select at 0x7fabe4656820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2109649825", "description": "tempest-description-1185291279"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:08.499312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:08.510974 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4018243-831e-43dd-bf00-2d84633a1957 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.767244 Jul 02 21:14:08.511778 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1622/3193] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:07 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:08.520518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:08.524070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:08.541076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:08.544524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:08.545729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:08.549089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:09.266555 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1126c1bc-1137-4bdb-a26a-a8bd9d967324 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.374913 Jul 02 21:14:09.273960 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1572/3194] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:14:07 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:09.273960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:09.273960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:09.302871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:09.303330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:09.307490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:09.308014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:09.398099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:09.672337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:09.687501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:09.690103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:09.692358 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ada12ded-ba21-4ecb-8df9-7d892b9ff44d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 1.179466 Jul 02 21:14:09.693494 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1623/3195] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:08 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:09.900504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b5be8fdc-0c44-4ffd-af4c-2c70795b8426 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '.version_select at 0x7fabe48f14c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:10.000333 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b5be8fdc-0c44-4ffd-af4c-2c70795b8426 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1" status: 200 len: 371 microversion: 2.1 time: 0.305194 Jul 02 21:14:10.002407 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1624/3196] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:14:09 2022] GET /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1 => generated 371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:10.008063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a89c1c95-3881-4cc8-8da5-be671a2e0da3 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Action: 'update', calling method: .version_select at 0x7fabd7693790>, body: {"security_group": {"name": "tempest-sg-hth-468720087", "description": "tempest-description-hth-1015232812"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:11.236480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:11.244283 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3547329-5730-4450-96f8-7100effebffb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 1.975711 Jul 02 21:14:11.244899 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1573/3197] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:09 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 1977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:11.262865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:11.262865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:11.282199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:11.282655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:11.283457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:11.283898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:11.636239 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a89c1c95-3881-4cc8-8da5-be671a2e0da3 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "PUT /compute/v2.1/os-security-groups/351e4c46-5722-45e2-bf5f-0cb7a970983f" status: 200 len: 217 microversion: 2.1 time: 1.631910 Jul 02 21:14:11.648715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1625/3198] 10.222.0.43 () {60 vars in 1289 bytes} [Sat Jul 2 21:14:10 2022] PUT /compute/v2.1/os-security-groups/351e4c46-5722-45e2-bf5f-0cb7a970983f => generated 217 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:11.662266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-177609e5-7887-40fa-9530-087234b6425d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Action: 'update', calling method: .version_select at 0x7fabd76931f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:11.793031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-177609e5-7887-40fa-9530-087234b6425d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:11.793932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-177609e5-7887-40fa-9530-087234b6425d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:11.799867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-177609e5-7887-40fa-9530-087234b6425d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:11.800709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-177609e5-7887-40fa-9530-087234b6425d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:11.916874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:11.936538 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-177609e5-7887-40fa-9530-087234b6425d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1" status: 200 len: 328 microversion: 2.1 time: 0.285155 Jul 02 21:14:11.937880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f54d3ffc-72a7-4d4c-8d87-f366473b6d2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1513 microversion: 2.1 time: 0.677219 Jul 02 21:14:11.940624 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1626/3199] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:14:11 2022] PUT /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1 => generated 328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:11.942323 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1574/3200] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:11 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1513 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:11.951445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:11.951445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:11.962321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f4c960f-3221-4b07-986e-aff7d698eb2d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4bf4dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:11.977415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:11.978079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:11.979060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:11.980245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:12.415990 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f4c960f-3221-4b07-986e-aff7d698eb2d tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/os-security-groups/351e4c46-5722-45e2-bf5f-0cb7a970983f" status: 200 len: 217 microversion: 2.1 time: 0.471888 Jul 02 21:14:12.428294 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1575/3201] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:14:11 2022] GET /compute/v2.1/os-security-groups/351e4c46-5722-45e2-bf5f-0cb7a970983f => generated 217 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:12.435751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5b7e2f9d-97dd-4e49-b269-d28be37948f5 req-99f6ffac-6a3f-4f98-a4cd-fa94b1686f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:12.456160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b7e2f9d-97dd-4e49-b269-d28be37948f5 req-99f6ffac-6a3f-4f98-a4cd-fa94b1686f54 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:12.456567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b7e2f9d-97dd-4e49-b269-d28be37948f5 req-99f6ffac-6a3f-4f98-a4cd-fa94b1686f54 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:12.483003 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5b7e2f9d-97dd-4e49-b269-d28be37948f5 req-99f6ffac-6a3f-4f98-a4cd-fa94b1686f54 service nova] Creating event network-changed:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:14:12.506871 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5b7e2f9d-97dd-4e49-b269-d28be37948f5 req-99f6ffac-6a3f-4f98-a4cd-fa94b1686f54 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059332 Jul 02 21:14:12.509422 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1576/3202] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:12.523924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b479545-5ceb-4500-883e-98b51285d827 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:12.541122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b479545-5ceb-4500-883e-98b51285d827 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1" status: 202 len: 0 microversion: 2.1 time: 0.028092 Jul 02 21:14:12.542086 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1577/3203] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:14:12 2022] DELETE /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:12.555017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:12.556136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:12.563429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:12.564162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:12.564978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:12.565576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:12.905505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:12.921785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:12.923650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:12.925137 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f46bde57-c5c6-4f30-a19e-b62590e58e32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.983376 Jul 02 21:14:12.931741 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1627/3204] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:11 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:12.941296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-87ce785c-4c9e-465a-9ccd-2a83a914b499 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd7693b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:13.193957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:13.207311 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e76e7f1d-56d1-4194-9337-4594a65d6e33 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 0.662297 Jul 02 21:14:13.209381 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1578/3205] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:12 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:13.222177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb905817-867b-4b88-a84a-4bb23eb96d79 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '.version_select at 0x7fabe411f700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:13.358746 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb905817-867b-4b88-a84a-4bb23eb96d79 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1" status: 200 len: 371 microversion: 2.1 time: 0.147268 Jul 02 21:14:13.373666 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1579/3206] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:14:13 2022] GET /compute/v2.1/os-quota-sets/24ed1303fdf44bdba765b0adf987a5d1 => generated 371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:13.385302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:13.388875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:13.400451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:13.407370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:13.408550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:13.409148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.155234 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-87ce785c-4c9e-465a-9ccd-2a83a914b499 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/351e4c46-5722-45e2-bf5f-0cb7a970983f" status: 202 len: 0 microversion: 2.1 time: 1.217672 Jul 02 21:14:14.156175 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1628/3207] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:12 2022] DELETE /compute/v2.1/os-security-groups/351e4c46-5722-45e2-bf5f-0cb7a970983f => generated 0 bytes in 1219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:14.160970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b5ff5fa8-99dc-464c-819e-c351fddbf64d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '.version_select at 0x7fabd76938b0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:14.187528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:14.200998 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f62e7436-8aed-467c-b21d-64cc545126bd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1490 microversion: 2.1 time: 0.818953 Jul 02 21:14:14.205164 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1580/3208] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:13 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1490 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:14.215094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:14.216347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:14.233483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.234289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.235279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.235905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.526996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:14.662317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:14.665814 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b5ff5fa8-99dc-464c-819e-c351fddbf64d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.508533 Jul 02 21:14:14.669950 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1629/3209] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:14:14 2022] GET /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7/defaults => generated 371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:14.680752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:14.681421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:14.682818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:14.685149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:14.688662 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33e38ff6-2f93-445a-a9c2-35082cb0f81c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.482371 Jul 02 21:14:14.692443 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1581/3210] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:14 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:14.699833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:14.701246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:14.702015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.702485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.703283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.704077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.720415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.724447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.726111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.727909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.736722 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 HTTP/1.1 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd47b7229-6aa2-4688-959b-407721ca10a1'} Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:14:14.741402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-19d9f94d-93e3-473e-b6f5-4e8f0c9f849c tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 404 len: 111 microversion: 2.1 time: 0.071885 Jul 02 21:14:14.745785 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1630/3211] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:14:14 2022] DELETE /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:14.763912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:14.765392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:14.788271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.789852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.790699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.791433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.892523 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09d6e18e-df37-4c88-98cb-5895509e9d1b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 200 len: 178 microversion: 2.1 time: 0.196259 Jul 02 21:14:14.893107 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1582/3212] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:14 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 178 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:14.898906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:14.899839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: d47b7229-6aa2-4688-959b-407721ca10a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:14.928844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.931023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.933161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:14.937336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:14.990215 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 HTTP/1.1 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'd47b7229-6aa2-4688-959b-407721ca10a1'} Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:14.998521 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. Jul 02 21:14:15.003531 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.006361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Instance d47b7229-6aa2-4688-959b-407721ca10a1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:15.007467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc4f153c-b9e6-481f-8a2b-f63bbc4c35de tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1" status: 404 len: 111 microversion: 2.1 time: 0.112897 Jul 02 21:14:15.009368 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1583/3213] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:14 2022] GET /compute/v2.1/servers/d47b7229-6aa2-4688-959b-407721ca10a1 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:15.025547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:15.029075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:15.046775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:15.048010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:15.049106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:15.057513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:15.382215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:15.404534 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5ca55f6-90e2-4eff-9278-041882de796f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 0.644882 Jul 02 21:14:15.405929 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1631/3214] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:14 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:15.418220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4b07670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:15.599060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:15.599989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:15.600780 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.600780 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d HTTP/1.1 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b79b07ed-f16b-4f5d-b2d2-e46647c75e6d'} Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.602959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] Jul 02 21:14:15.607530 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:15.616337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group b79b07ed-f16b-4f5d-b2d2-e46647c75e6d does not exist Jul 02 21:14:15.616337 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-ace8e76c-6c75-4c35-bd3b-bf888e7ca72f'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:15.616337 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b2c97b7-1c52-4a54-ae99-4ddbd9bd08c5 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d" status: 404 len: 194 microversion: 2.1 time: 0.208101 Jul 02 21:14:15.616337 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1632/3215] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:15 2022] DELETE /compute/v2.1/os-security-groups/b79b07ed-f16b-4f5d-b2d2-e46647c75e6d => generated 194 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:15.626225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a556dbc-9a7d-40e5-8d30-aff6d6fe841b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Action: 'update', calling method: .version_select at 0x7fabe4770b80>, body: {"quota_set": {"ram": "5120"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:15.732167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:15.740837 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c3bd862-cb1a-4ce8-b943-d6b34e60feab tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.729267 Jul 02 21:14:15.741431 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1584/3216] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:15 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:15.772801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4649ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:15.945763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a556dbc-9a7d-40e5-8d30-aff6d6fe841b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:15.947852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a556dbc-9a7d-40e5-8d30-aff6d6fe841b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:15.953931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a556dbc-9a7d-40e5-8d30-aff6d6fe841b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:15.954818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a556dbc-9a7d-40e5-8d30-aff6d6fe841b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:16.016806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:16.042020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:16.043185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:16.044418 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.044418 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9 HTTP/1.1 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'ac8610a3-4a2b-453a-a18c-e47ed59188b9'} Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.047064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] Jul 02 21:14:16.051986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.057831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group ac8610a3-4a2b-453a-a18c-e47ed59188b9 does not exist Jul 02 21:14:16.057831 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-73ffdb50-512c-48a8-b2f9-f54ab87c5144'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:16.059130 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70230269-7a1f-4c1a-8ec8-569e3679e22a tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9" status: 404 len: 194 microversion: 2.1 time: 0.294567 Jul 02 21:14:16.063031 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1585/3217] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:15 2022] DELETE /compute/v2.1/os-security-groups/ac8610a3-4a2b-453a-a18c-e47ed59188b9 => generated 194 bytes in 299 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:16.071874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:16.078101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:16.098047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:16.098606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:16.099520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:16.100101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:16.180071 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a556dbc-9a7d-40e5-8d30-aff6d6fe841b tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624" status: 200 len: 328 microversion: 2.1 time: 0.557632 Jul 02 21:14:16.186227 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1633/3218] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:14:15 2022] PUT /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624 => generated 328 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:16.192155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:16.192914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:16.226180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:16.226640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:16.227440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:16.227879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:16.779282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:16.792482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:16.794116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:16.801163 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-824f9ebe-935c-49aa-b89a-773b850e4cc6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.736280 Jul 02 21:14:16.802050 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1586/3219] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:16 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:16.812790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe43044c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:16.864720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:16.865653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:16.866401 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.866401 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d HTTP/1.1 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7f815ff9-9cdf-4416-9683-7ac5b4af861d'} Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.868802 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] Jul 02 21:14:16.872817 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:16.877482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group 7f815ff9-9cdf-4416-9683-7ac5b4af861d does not exist Jul 02 21:14:16.877482 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-961c6f64-7402-413a-bc30-eb7d8fbb2dcb'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:16.878886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46448663-1323-4300-8077-ee1a0ad2f0e1 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d" status: 404 len: 194 microversion: 2.1 time: 0.075544 Jul 02 21:14:16.882925 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1587/3220] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:16 2022] DELETE /compute/v2.1/os-security-groups/7f815ff9-9cdf-4416-9683-7ac5b4af861d => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:16.897660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-679bb666-08d2-45c9-822f-21b0fadca06f tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '.version_select at 0x7fabe4304700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:17.022777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:17.041677 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-69798f91-9296-4ab1-9350-42d9511bba95 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.854257 Jul 02 21:14:17.050257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679bb666-08d2-45c9-822f-21b0fadca06f tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.052349 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1634/3221] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:16 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:17.053638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679bb666-08d2-45c9-822f-21b0fadca06f tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.056657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679bb666-08d2-45c9-822f-21b0fadca06f tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.058339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-679bb666-08d2-45c9-822f-21b0fadca06f tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.065206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:17.065957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:17.104932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.109020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.110158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.110770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.113177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:17.137016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-679bb666-08d2-45c9-822f-21b0fadca06f tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624/detail" status: 200 len: 916 microversion: 2.1 time: 0.252660 Jul 02 21:14:17.141803 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1588/3222] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:14:16 2022] GET /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624/detail => generated 916 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:17.157558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe468f3a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:17.206235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:17.206849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group 85886d71-8188-462b-b0b2-1c35153aca79 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:17.207420 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.207420 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79 HTTP/1.1 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '85886d71-8188-462b-b0b2-1c35153aca79'} Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.209846 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group 85886d71-8188-462b-b0b2-1c35153aca79 does not exist Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-d30c6d4e-19fb-4044-ab10-a83f3d61c2b4'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eced9f69-1d04-459f-a3a2-920e3fa16ec7 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79" status: 404 len: 194 microversion: 2.1 time: 0.068351 Jul 02 21:14:17.214617 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1589/3223] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:17 2022] DELETE /compute/v2.1/os-security-groups/85886d71-8188-462b-b0b2-1c35153aca79 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:17.226617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:17.227399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:17.260693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.261149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.264882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.265436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.603291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:17.611609 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3aa41c9-ccbd-4670-a797-fbc817572eef tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 0.558052 Jul 02 21:14:17.629445 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1635/3224] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:17 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:17.639592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd76615e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:17.900857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:17.901472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:17.902003 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.902003 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62 HTTP/1.1 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'eda7cb9c-2654-46b0-88fc-77b8490a3a62'} Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.904130 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group eda7cb9c-2654-46b0-88fc-77b8490a3a62 does not exist Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-5a15332b-e838-4718-bf7b-e463c22e9a3d'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d98265a2-d9f7-4390-979e-46742ad90c7f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62" status: 404 len: 194 microversion: 2.1 time: 0.274773 Jul 02 21:14:17.911808 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1636/3225] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:17 2022] DELETE /compute/v2.1/os-security-groups/eda7cb9c-2654-46b0-88fc-77b8490a3a62 => generated 194 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:17.926217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:17.926853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:17.968166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.968629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:17.969422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:17.977338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.013774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:18.026161 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06cdd16e-7818-4c46-a67c-9c62ae806d90 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.810153 Jul 02 21:14:18.026754 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1590/3226] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:17 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:18.053287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabe4a2b550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:18.151299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:18.151922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.security_group_api [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Neutron security group 8b993373-560b-4988-8f40-930cb3fe0b02 not found {{(pid=131044) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:18.153006 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.153006 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02 HTTP/1.1 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: exception: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8b993373-560b-4988-8f40-930cb3fe0b02'} Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.155580 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Security group 8b993373-560b-4988-8f40-930cb3fe0b02 does not exist Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: Neutron server returns request_ids: ['req-07adc47f-197a-4a06-a4c6-73de05038044'] {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51fdf3c7-dec7-428a-9ece-8e2e6c54ed1f tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02" status: 404 len: 194 microversion: 2.1 time: 0.126565 Jul 02 21:14:18.159705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1591/3227] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:18 2022] DELETE /compute/v2.1/os-security-groups/8b993373-560b-4988-8f40-930cb3fe0b02 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:18.164812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Action: 'update', calling method: .version_select at 0x7fabe491a670>, body: {"quota_set": {"ram": "2048"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:18.294036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.297009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.300351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.301165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.407719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.409208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.411422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.421484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.575964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:18.593770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:18.595539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:18.597289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55858a82-18e8-47e7-8e76-66dbeabc8dd0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.690508 Jul 02 21:14:18.612358 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f9d2226-071a-40aa-81c7-3ca8a5b3b227 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624?user_id=3b5cc347db6f4fdaa771521657ee15c3" status: 200 len: 328 microversion: 2.1 time: 0.452199 Jul 02 21:14:18.615499 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1592/3228] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:14:18 2022] PUT /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624?user_id=3b5cc347db6f4fdaa771521657ee15c3 => generated 328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:18.621730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:18.622374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:18.649448 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1637/3229] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:17 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:18.661492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:18.663197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.663663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.664504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.664951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.669119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:18.701092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.701564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.702374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:18.702832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:18.821453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:14:19.076428 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b4a0839-d600-46ff-8a91-9ca068566012 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 204 len: 0 microversion: 2.1 time: 0.416685 Jul 02 21:14:19.085689 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1638/3230] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:14:18 2022] DELETE /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:14:19.106754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f2dd81de-26d1-4019-8d00-e6c7c6905732 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '.version_select at 0x7fabe4a929d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:19.362426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f2dd81de-26d1-4019-8d00-e6c7c6905732 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624?user_id=3b5cc347db6f4fdaa771521657ee15c3" status: 200 len: 370 microversion: 2.1 time: 0.270623 Jul 02 21:14:19.364373 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1639/3231] 10.222.0.43 () {58 vars in 1322 bytes} [Sat Jul 2 21:14:19 2022] GET /compute/v2.1/os-quota-sets/b22e8286030640d3ad067ac82d5d5624?user_id=3b5cc347db6f4fdaa771521657ee15c3 => generated 370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:19.394307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:19.404355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:19.426565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:19.429847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:19.437746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:19.440818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:19.490219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:19.505329 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d98ff5be-0733-4aa3-bace-d960a3168be2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.888536 Jul 02 21:14:19.505846 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1593/3232] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:18 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:19.531008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:19.537555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:19.562314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:19.566109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:19.571856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:19.573347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:19.935249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:19.948150 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6febacdb-2fbe-46f2-b106-5e09fc078703 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 0.582353 Jul 02 21:14:19.948760 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1640/3233] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:19 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:19.965517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:19.966108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:19.987747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:20.001497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:20.002852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:20.007797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:20.062233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365ef707d87d4d5d818a7e9388c65fa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27477995aa5c488bb3a2b414a540ceba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:20.071375 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad751b63-1dd6-40ac-8e2d-6c06ebd63623 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 200 len: 1644 microversion: 2.1 time: 0.564136 Jul 02 21:14:20.084338 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1594/3234] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:19 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 1644 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:20.342483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:20.351581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:20.364926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:20.370289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-403c50d1-efec-4f2a-aadf-a04e7418db3e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.412754 Jul 02 21:14:20.373017 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1641/3235] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:19 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:20.389104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2067754435", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "8f9f01f3-6960-405f-bcaa-01885e028463"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:20.544496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] validate_networks() for [('8f9f01f3-6960-405f-bcaa-01885e028463', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:14:20.773626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d63ac2c5-52ce-4feb-a8dd-2ea4d89172a6 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe4077d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-961293697", "description": "tempest-description-1355878701"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:22.594374 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d63ac2c5-52ce-4feb-a8dd-2ea4d89172a6 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.503178 Jul 02 21:14:22.596239 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1595/3236] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:14:20 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:22.604783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ce435c9-6328-475b-856e-91c04177ec0d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Calling method '.version_select at 0x7fabe411fdc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:22.925272 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ce435c9-6328-475b-856e-91c04177ec0d tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.327471 Jul 02 21:14:22.929933 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1596/3237] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:14:22 2022] GET /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7/defaults => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:22.944908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:22.955210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:22.989594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:22.991790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.014959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.015706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.630094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:23.638820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:14:23.639436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:14:23.639864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:14:23.640405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:14:23.640921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:14:23.643598 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ccd8c50-14a3-43bf-bf4d-040eaa539f57 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 0.712068 Jul 02 21:14:23.651025 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1597/3238] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:22 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:23.653963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.654555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.655504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.656191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.660669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:23.663023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] [instance: 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:23.680512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.681651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.682644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:14:23.682964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.683421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.688916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for user 419f3872408c4d8c9a2980d6397d0aea and project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:14:23.712239 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] HTTP exception thrown: Instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 could not be found. Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Request method failure captured: Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 HTTP/1.1 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLTKARmjJpNPBF80r0E1uf0sm4ib1t7NM-Tbu6VAI1xR7r0A42UrsjtfXTmCA7sYne9HGxippS7Or04ZpMsRiSZIYO2q7UVQZSBMB1g4yyBB78D1gVy7VF9e1rsVicCQCtVlHPcAcKipNfv6EPq4ZhppEF71533qB4fxw6sNuHfIPLc Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_27477995aa5c488bb3a2b414a540ceba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/27477995aa5c488bb3a2b414a540ceba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/27477995aa5c488bb3a2b414a540ceba"}]}] Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 27477995aa5c488bb3a2b414a540ceba Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1027764 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 365ef707d87d4d5d818a7e9388c65fa0 Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupsTestJSON-1027764-project Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 could not be found. Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3'} Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 could not be found. Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 could not be found. Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:23.714373 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 could not be found. Jul 02 21:14:23.719638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:23.721184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Returning 404 to user: Instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:23.722661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0dd6f6b-4d79-4418-8a07-238872e45067 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3" status: 404 len: 111 microversion: 2.1 time: 0.070388 Jul 02 21:14:23.725068 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1598/3239] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:23 2022] GET /compute/v2.1/servers/8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:23.727205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:14:23.734688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:14:23.738496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-aeaff345-c84e-4923-a11a-3c23a834bf78 req-fa8f6957-d50d-4908-984c-1238c771c0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "name": "network-vif-plugged", "status": "completed", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:23.781937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aeaff345-c84e-4923-a11a-3c23a834bf78 req-fa8f6957-d50d-4908-984c-1238c771c0b8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.782387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aeaff345-c84e-4923-a11a-3c23a834bf78 req-fa8f6957-d50d-4908-984c-1238c771c0b8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.801540 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-aeaff345-c84e-4923-a11a-3c23a834bf78 req-fa8f6957-d50d-4908-984c-1238c771c0b8 service nova] Creating event network-vif-plugged:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:14:23.817816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-aeaff345-c84e-4923-a11a-3c23a834bf78 req-fa8f6957-d50d-4908-984c-1238c771c0b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088599 Jul 02 21:14:23.822037 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1599/3240] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:23.844187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:23.846348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:23.876579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.877453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.878474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.879777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.926428 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3bca2cff-9591-410e-831c-dba74221282a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.530626 Jul 02 21:14:23.927625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1642/3241] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:14:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:14:23.938644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4a4667cc-55a0-4aff-a527-768c9a0c192d req-7d158b0c-4e48-4aee-941f-99f36049a530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3", "name": "network-vif-deleted", "tag": "bf76ff61-209b-4571-a4f4-62e2dbd2ccf8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:23.956195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4a4667cc-55a0-4aff-a527-768c9a0c192d req-7d158b0c-4e48-4aee-941f-99f36049a530 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:23.957143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4a4667cc-55a0-4aff-a527-768c9a0c192d req-7d158b0c-4e48-4aee-941f-99f36049a530 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:23.975591 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4a4667cc-55a0-4aff-a527-768c9a0c192d req-7d158b0c-4e48-4aee-941f-99f36049a530 service nova] Creating event network-vif-deleted:bf76ff61-209b-4571-a4f4-62e2dbd2ccf8 for instance 8d53e6a7-31b3-45b2-99fa-2c0b252a5ef3 on nch2-master-1 Jul 02 21:14:23.991737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4a4667cc-55a0-4aff-a527-768c9a0c192d req-7d158b0c-4e48-4aee-941f-99f36049a530 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059198 Jul 02 21:14:23.994275 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1643/3242] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:24.021792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-699667d3-bf85-473e-bdc1-b1bb09676b55 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe47eb4c0>, body: {"security_group_rule": {"parent_group_id": "9b56bb0d-204f-4ed0-b6a5-dfa7a9037394", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:24.410203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:24.431906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:24.436922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:24.461074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81dab31e-4d0d-4167-a515-bcdba7c2abca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.629497 Jul 02 21:14:24.465585 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1600/3243] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:23 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:24.486905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebcbd45f-bec3-4143-b94b-bf717e35d346 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Action: 'update', calling method: .version_select at 0x7fabe4141ca0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:24.694608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebcbd45f-bec3-4143-b94b-bf717e35d346 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:24.695929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebcbd45f-bec3-4143-b94b-bf717e35d346 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:24.695929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebcbd45f-bec3-4143-b94b-bf717e35d346 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:24.696293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebcbd45f-bec3-4143-b94b-bf717e35d346 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:24.815389 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-699667d3-bf85-473e-bdc1-b1bb09676b55 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.819503 Jul 02 21:14:24.817498 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1644/3244] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:24.832316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc574966-a514-48e9-b5c4-18f001e5a318 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd78499d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:25.444601 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebcbd45f-bec3-4143-b94b-bf717e35d346 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7" status: 200 len: 329 microversion: 2.1 time: 0.977581 Jul 02 21:14:25.455101 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1601/3245] 10.222.0.43 () {60 vars in 1262 bytes} [Sat Jul 2 21:14:24 2022] PUT /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7 => generated 329 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:25.486247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:25.488252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:25.502635 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc574966-a514-48e9-b5c4-18f001e5a318 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/07772168-ec52-4286-828f-e43ade9fea88" status: 202 len: 0 microversion: 2.1 time: 0.682885 Jul 02 21:14:25.503309 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1645/3246] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:24 2022] DELETE /compute/v2.1/os-security-groups/07772168-ec52-4286-828f-e43ade9fea88 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:25.507599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:25.508479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:25.510932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:25.511578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:25.511709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:25.512449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:25.580267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:25.580545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:25.581346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:25.581836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:25.670880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:25.700482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:25.713854 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a270d64-c3e6-4dd5-8d45-75937a6e2d62 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1211 microversion: 2.1 time: 0.238485 Jul 02 21:14:25.723897 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1602/3247] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:25 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1211 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:25.729064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e77424e1-cdd1-4e11-b56d-590a459b5233 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe40f5e50>, body: {"security_group_rule": {"parent_group_id": "9b56bb0d-204f-4ed0-b6a5-dfa7a9037394", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:25.967592 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e77424e1-cdd1-4e11-b56d-590a459b5233 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: This rule already exists in group 9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e77424e1-cdd1-4e11-b56d-590a459b5233 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 138 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: {"security_group_rule": {"parent_group_id": "9b56bb0d-204f-4ed0-b6a5-dfa7a9037394", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: exception: This rule already exists in group 9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9b56bb0d-204f-4ed0-b6a5-dfa7a9037394', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:25.970191 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:25.975261 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:25.975261 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:25.975261 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 Jul 02 21:14:25.975261 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:25.976439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e77424e1-cdd1-4e11-b56d-590a459b5233 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 400 to user: This rule already exists in group 9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:25.977472 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e77424e1-cdd1-4e11-b56d-590a459b5233 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.252499 Jul 02 21:14:25.979198 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1603/3248] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:14:26.000170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bcd130eb-5860-4a91-9cea-e62885f4df66 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Action: 'update', calling method: .version_select at 0x7fabe4141ee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:26.356014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:26.367891 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ae1c047-2b55-43b8-affd-9ccca0fa2080 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1322 microversion: 2.1 time: 0.862895 Jul 02 21:14:26.377559 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1646/3249] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:25 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1322 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:26.383879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:26.384526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:26.440443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:26.440905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:26.455307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:26.455773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:26.465218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcd130eb-5860-4a91-9cea-e62885f4df66 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:26.469994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcd130eb-5860-4a91-9cea-e62885f4df66 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:26.473505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcd130eb-5860-4a91-9cea-e62885f4df66 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:26.476206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bcd130eb-5860-4a91-9cea-e62885f4df66 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:26.584485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=59 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:26.703353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=17,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:26.797471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:26.811278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:26.814324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:26.815699 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e81e4313-6cc2-4c82-9ee4-060fcffa84f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1738 microversion: 2.20 time: 0.436751 Jul 02 21:14:26.817408 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1647/3250] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:26 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1738 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:26.823390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8628572-3911-4def-a1c9-68d9a52b7fc2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] Calling method '.version_select at 0x7fabd7eb1040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:27.202183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8628572-3911-4def-a1c9-68d9a52b7fc2 tempest-SecurityGroupsTestJSON-1027764 tempest-SecurityGroupsTestJSON-1027764-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/caf622f1-f551-4de4-b666-57f8df970b89" status: 202 len: 0 microversion: 2.1 time: 0.383507 Jul 02 21:14:27.205019 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1648/3251] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:26 2022] DELETE /compute/v2.1/os-security-groups/caf622f1-f551-4de4-b666-57f8df970b89 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:27.218743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a468c27f-d808-4a4a-9f9b-a94154574568 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabd7829b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:27.252216 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bcd130eb-5860-4a91-9cea-e62885f4df66 tempest-QuotasAdminTestJSON-257249712 tempest-QuotasAdminTestJSON-257249712-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7" status: 200 len: 329 microversion: 2.1 time: 1.269902 Jul 02 21:14:27.252876 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1604/3252] 10.222.0.43 () {60 vars in 1262 bytes} [Sat Jul 2 21:14:25 2022] PUT /compute/v2.1/os-quota-sets/4a3573b91d3f463e92ef7aa2335812f7 => generated 329 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:27.273256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:27.274069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:27.293497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:27.294362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:27.295623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:27.296421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:27.311717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:27.451978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:27.467252 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-610329c9-cf32-4ddd-aca2-7cf9797e86e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1273 microversion: 2.1 time: 0.206145 Jul 02 21:14:27.468498 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1605/3253] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:27 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:27.473411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:27.478086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:27.491614 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a468c27f-d808-4a4a-9f9b-a94154574568 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/dc6690b5-bbc1-4ed0-83d6-c9728e29fe0c" status: 202 len: 0 microversion: 2.1 time: 0.279930 Jul 02 21:14:27.492371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:27.492922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:27.497714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:27.497714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:27.499639 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1649/3254] 10.222.0.43 () {58 vars in 1286 bytes} [Sat Jul 2 21:14:27 2022] DELETE /compute/v2.1/os-security-group-rules/dc6690b5-bbc1-4ed0-83d6-c9728e29fe0c => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:27.506308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4b343e95-3e65-4340-9209-0b2909145b1a tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabd78491f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1617768877", "description": "tempest-description-487259205"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:28.484427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:28.503185 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-741a3f4e-722f-4c89-a445-ffca04760c3c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1517 microversion: 2.1 time: 1.030801 Jul 02 21:14:28.505285 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1606/3255] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:27 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1517 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:28.514183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:28.515233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:28.537487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:28.537984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:28.538802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:28.539921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:28.579931 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4b343e95-3e65-4340-9209-0b2909145b1a tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.078905 Jul 02 21:14:28.580916 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1650/3256] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:14:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:28.592526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:28.593153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:28.615512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:28.615982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:28.616839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:28.617312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:28.797765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:28.818474 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f7bbefd3-e485-4632-bfba-bf97477cafba tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1273 microversion: 2.1 time: 0.230048 Jul 02 21:14:28.819479 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1651/3257] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:28 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1273 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:28.829942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:28.831229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:28.845703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:28.846177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:28.847032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:28.847506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:28.884475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lazy-loading 'flavor' on Instance uuid 3229dcfb-12f7-4420-af06-7f3375b9e5a4 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:14:28.995088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:28.997693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9dcdf9c3-8254-4673-81a8-e7b450b9cf7a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action" status: 200 len: 32 microversion: 2.1 time: 0.169349 Jul 02 21:14:28.998878 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1652/3258] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:28 2022] POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:14:29.012400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-457f7a48-f134-478c-b087-1345ad62b267 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabd7eb1280>, body: {"security_group_rule": {"parent_group_id": "02e4259a-fea6-400d-9059-5c9397992e5a", "ip_protocol": "tcp", "from_port": 202829449, "to_port": 22}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:29.014337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:29.020915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:29.023186 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-647228a3-1594-4e82-9df2-0b1d1951687e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1720 microversion: 2.20 time: 0.515467 Jul 02 21:14:29.024401 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1607/3259] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:28 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1720 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:29.031382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:29.032459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:29.041169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:29.042726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:29.043948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:29.044830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:29.249349 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-457f7a48-f134-478c-b087-1345ad62b267 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Invalid port range 202829449:22. Former value cannot be greater than the later Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-457f7a48-f134-478c-b087-1345ad62b267 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 145 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: {"security_group_rule": {"parent_group_id": "02e4259a-fea6-400d-9059-5c9397992e5a", "ip_protocol": "tcp", "from_port": 202829449, "to_port": 22}} Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid port range 202829449:22. Former value cannot be greater than the later Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'security_group_rule': {'parent_group_id': '02e4259a-fea6-400d-9059-5c9397992e5a', 'ip_protocol': 'tcp', 'from_port': 202829449, 'to_port': 22}}} Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 202829449:22. Former value cannot be greater than the later Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 202829449:22. Former value cannot be greater than the later Jul 02 21:14:29.257522 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 202829449:22. Former value cannot be greater than the later Jul 02 21:14:29.261934 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.264688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-457f7a48-f134-478c-b087-1345ad62b267 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 400 to user: Invalid port range 202829449:22. Former value cannot be greater than the later {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:29.265807 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-457f7a48-f134-478c-b087-1345ad62b267 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.266038 Jul 02 21:14:29.266493 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1653/3260] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:28 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 267 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:14:29.276812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62da0136-b6bc-4a42-a09d-9b4809caf30e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabd76615e0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1494168572", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:29.279840 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-62da0136-b6bc-4a42-a09d-9b4809caf30e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Security group id should be uuid Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62da0136-b6bc-4a42-a09d-9b4809caf30e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 131 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1494168572", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group id should be uuid Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1494168572', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:29.284098 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:29.288517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 02 21:14:29.288517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:29.292105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62da0136-b6bc-4a42-a09d-9b4809caf30e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 400 to user: Security group id should be uuid {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:29.293944 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-62da0136-b6bc-4a42-a09d-9b4809caf30e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021150 Jul 02 21:14:29.299380 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1654/3261] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:29 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:29.306690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c0fad5c9-0896-48d9-8481-eefb5512f89f tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe47709d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1176963948", "description": "tempest-description-797370878"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:29.371099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:29.383983 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ac0cfce-c83d-4c8d-9cc4-8f08a502176c tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.358177 Jul 02 21:14:29.384609 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1608/3262] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:29 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:29.693028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c0fad5c9-0896-48d9-8481-eefb5512f89f tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.391752 Jul 02 21:14:29.695156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1655/3263] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:14:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:29.708206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-760fea16-90ff-4696-b054-442cf77922e5 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe411f040>, body: {"security_group_rule": {"parent_group_id": "54f4b38d-e2ac-4585-b61f-bd0122ed4a31", "ip_protocol": "tempest-999-1637250481", "from_port": 22, "to_port": 22}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:29.844001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:29.844777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:29.852545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:29.853008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:29.853801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:29.854254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:30.095888 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-760fea16-90ff-4696-b054-442cf77922e5 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Invalid IP protocol tempest-999-1637250481. Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-760fea16-90ff-4696-b054-442cf77922e5 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 157 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: {"security_group_rule": {"parent_group_id": "54f4b38d-e2ac-4585-b61f-bd0122ed4a31", "ip_protocol": "tempest-999-1637250481", "from_port": 22, "to_port": 22}} Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid IP protocol tempest-999-1637250481. Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'security_group_rule': {'parent_group_id': '54f4b38d-e2ac-4585-b61f-bd0122ed4a31', 'ip_protocol': 'tempest-999-1637250481', 'from_port': 22, 'to_port': 22}}} Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1637250481. Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1637250481. Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:30.097674 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1637250481. Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-760fea16-90ff-4696-b054-442cf77922e5 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 400 to user: Invalid IP protocol tempest-999-1637250481. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-760fea16-90ff-4696-b054-442cf77922e5 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.397502 Jul 02 21:14:30.102774 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1609/3264] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:29 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 399 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:14:30.115423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:30.116153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:30.138361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:30.140494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:30.143648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:30.145881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:30.500602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:30.530458 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e743c481-e74d-4281-bd78-2fb7543dcd80 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.696461 Jul 02 21:14:30.537373 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1656/3265] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:29 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:30.546240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eea97042-f169-4763-b63e-009b4d98d28b tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabd7dc1d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-741385956", "description": "tempest-description-594540477"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:30.629162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:30.640412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:30.651697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:30.653158 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d778c51-60f6-48da-9552-c570bd59d7ba tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1720 microversion: 2.20 time: 0.550434 Jul 02 21:14:30.655662 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1610/3266] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:30 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1720 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:30.671061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:30.671822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:30.688740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:30.689760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:30.693933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:30.694527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:31.209122 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eea97042-f169-4763-b63e-009b4d98d28b tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.670458 Jul 02 21:14:31.210784 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1657/3267] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:14:30 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:31.218022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-9cb082da-4521-4ab7-b626-5dbb9b96a78e req-2c9402f2-5638-4d0e-98d3-8c834beaf634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "name": "network-vif-unplugged", "status": "completed", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:31.228479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-9cb082da-4521-4ab7-b626-5dbb9b96a78e req-2c9402f2-5638-4d0e-98d3-8c834beaf634 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:31.229261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-9cb082da-4521-4ab7-b626-5dbb9b96a78e req-2c9402f2-5638-4d0e-98d3-8c834beaf634 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:31.242667 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-9cb082da-4521-4ab7-b626-5dbb9b96a78e req-2c9402f2-5638-4d0e-98d3-8c834beaf634 service nova] Creating event network-vif-unplugged:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:14:31.247004 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-9cb082da-4521-4ab7-b626-5dbb9b96a78e req-2c9402f2-5638-4d0e-98d3-8c834beaf634 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034553 Jul 02 21:14:31.248690 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1658/3268] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:31.255325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1327f981-1955-409a-a751-c54463d2ab29 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe45f29d0>, body: {"security_group_rule": {"parent_group_id": "78c1119c-60bb-4639-952a-0b2e9917f86f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:31.380823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:31.389600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ba874e9-f86b-4d07-9c3d-fb1c4989e61a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.726766 Jul 02 21:14:31.398737 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1611/3269] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:30 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:31.475966 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1327f981-1955-409a-a751-c54463d2ab29 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1327f981-1955-409a-a751-c54463d2ab29 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 138 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: {"security_group_rule": {"parent_group_id": "78c1119c-60bb-4639-952a-0b2e9917f86f", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'security_group_rule': {'parent_group_id': '78c1119c-60bb-4639-952a-0b2e9917f86f', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 02 21:14:31.477925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 02 21:14:31.485823 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:31.488030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1327f981-1955-409a-a751-c54463d2ab29 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:31.489547 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1327f981-1955-409a-a751-c54463d2ab29 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.239405 Jul 02 21:14:31.490250 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1659/3270] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:31 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:14:31.501347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7b8e4d7-5c3f-4ab9-9902-f1cc23e75e3b tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabea153040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-589346069", "description": "tempest-description-1892358484"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:31.550912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:31.552219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:31.573213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:31.574000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:31.577584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:31.578235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:32.216383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:32.229177 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f7d1f3a-dca5-4251-96a2-b3ce384f3dd3 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.682005 Jul 02 21:14:32.230332 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1660/3271] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:31 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:32.249057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:32.249962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:32.267789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:32.269374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:32.270721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:32.271526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:32.899470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7b8e4d7-5c3f-4ab9-9902-f1cc23e75e3b tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.403066 Jul 02 21:14:32.901615 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1612/3272] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:14:31 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:32.920650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-acd027d6-64b2-4f99-bcb9-e9214eef5c58 req-eec1193f-8719-428d-953f-14d3def8db9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0dc4641-20a8-4679-82a3-c8f9ddcc801d", "tag": "87c6cf33-62a5-4113-aeb4-491f187a244d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:32.940848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-acd027d6-64b2-4f99-bcb9-e9214eef5c58 req-eec1193f-8719-428d-953f-14d3def8db9c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:32.942090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-acd027d6-64b2-4f99-bcb9-e9214eef5c58 req-eec1193f-8719-428d-953f-14d3def8db9c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:32.969234 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-acd027d6-64b2-4f99-bcb9-e9214eef5c58 req-eec1193f-8719-428d-953f-14d3def8db9c service nova] Creating event network-changed:87c6cf33-62a5-4113-aeb4-491f187a244d for instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d on nch1-master-1 Jul 02 21:14:32.980710 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-acd027d6-64b2-4f99-bcb9-e9214eef5c58 req-eec1193f-8719-428d-953f-14d3def8db9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076522 Jul 02 21:14:32.982051 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1613/3273] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:32.994496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:32.995655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:33.007145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:33.007942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:33.009581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:33.010587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:33.227763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:33.246937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:33.248740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:33.250071 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b3a2ad68-9e26-4efb-8700-2af715689f90 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1663 microversion: 2.20 time: 1.007638 Jul 02 21:14:33.250940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1661/3274] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:32 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1663 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:33.259253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-400ca16a-9596-4596-a38a-a7665940a17e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe462f4c0>, body: {"security_group_rule": {"parent_group_id": "c90e53fb-2687-4e0f-a258-bd010ab8d8bd", "ip_protocol": "tcp", "from_port": 22, "to_port": 975685756}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:33.381724 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-400ca16a-9596-4596-a38a-a7665940a17e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Invalid port range 22:975685756. Valid TCP ports should be between 1-65535 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-400ca16a-9596-4596-a38a-a7665940a17e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 145 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: {"security_group_rule": {"parent_group_id": "c90e53fb-2687-4e0f-a258-bd010ab8d8bd", "ip_protocol": "tcp", "from_port": 22, "to_port": 975685756}} Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid port range 22:975685756. Valid TCP ports should be between 1-65535 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c90e53fb-2687-4e0f-a258-bd010ab8d8bd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 975685756}}} Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:975685756. Valid TCP ports should be between 1-65535 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:975685756. Valid TCP ports should be between 1-65535 Jul 02 21:14:33.383567 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:975685756. Valid TCP ports should be between 1-65535 Jul 02 21:14:33.388329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.389722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-400ca16a-9596-4596-a38a-a7665940a17e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 400 to user: Invalid port range 22:975685756. Valid TCP ports should be between 1-65535 {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:33.391589 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-400ca16a-9596-4596-a38a-a7665940a17e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.138314 Jul 02 21:14:33.392886 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1662/3275] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:33 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:14:33.397752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:33.401048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:33.424066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:33.425870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:33.427818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:33.429624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:33.535238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:33.548268 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b010deb5-e3e5-4a4a-821f-cb5d549a01ab tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.564088 Jul 02 21:14:33.549933 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1614/3276] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:32 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:33.559153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa1b5e5c-92f9-4ce4-b42d-2aeafada2342"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:33.560704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:33.571811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:33.572547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:33.573514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:33.574120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:33.673770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:33.698476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=30 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:33.850225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:33.861768 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64b091e3-e17d-4ee2-8e29-dabbdf24df14 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.467657 Jul 02 21:14:33.877664 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1663/3277] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:33 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:33.883290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Action: 'create', calling method: .version_select at 0x7fabe48f15e0>, body: {"security_group_rule": {"parent_group_id": "294651d0-b7b9-4f63-b608-f4bb3088591e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:33.956678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:33.957347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Neutron security group 294651d0-b7b9-4f63-b608-f4bb3088591e not found {{(pid=131045) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 02 21:14:33.957880 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.957880 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 138 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: {"security_group_rule": {"parent_group_id": "294651d0-b7b9-4f63-b608-f4bb3088591e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'security_group_rule': {'parent_group_id': '294651d0-b7b9-4f63-b608-f4bb3088591e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:33.959819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 404 to user: Security group 294651d0-b7b9-4f63-b608-f4bb3088591e does not exist Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-ec6b58dc-c068-427b-bffe-f1826c4f8bd9'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c4791d3f-4750-4b9b-be5d-5590c95c1617 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.082656 Jul 02 21:14:33.963890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1664/3278] 10.222.0.43 () {60 vars in 1194 bytes} [Sat Jul 2 21:14:33 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:33.980903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabd7849670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:34.065090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG neutronclient.v2_0.client [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist", "detail": ""}} {{(pid=131045) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:14:34.065697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Neutron security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e not found {{(pid=131045) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 02 21:14:34.066304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] HTTP exception thrown: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.066304 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Request method failure captured: Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/os-security-group-rules/345aa6e0-ce93-41a4-8bec-ab20df4ba22e HTTP/1.1 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUrP0zcaooRUg8NjteVIXybFb2WwmuiaFuggtnpGigMcCqeCuJVn3hlOs8dMa_adSlvCT-cZiWgfFhODsYhEGQaiodZS3ubSHHLI50cpSelvgBXCIKoJY5Mu74mlG62eQ7CXSFvGT6Iwmjp0VVz2uhqiYk4kYHhIplTM6cbYyTstPI Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f6facae2ace740f68128a626ba49e42a", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f6facae2ace740f68128a626ba49e42a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f6facae2ace740f68128a626ba49e42a"}]}] Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f6facae2ace740f68128a626ba49e42a Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54460739a1234cad987fe9593d443afe Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: exception: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '345aa6e0-ce93-41a4-8bec-ab20df4ba22e'} Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:14:34.070959 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] Jul 02 21:14:34.075397 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:34.083767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Returning 404 to user: Security group rule 345aa6e0-ce93-41a4-8bec-ab20df4ba22e does not exist Jul 02 21:14:34.083767 ncdv-master-1 devstack@n-api.service[131045]: Neutron server returns request_ids: ['req-6b94c7c5-fc38-4e1f-b986-504b08f487e8'] {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:34.086092 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ee646b7d-0f38-430d-bd10-aab2b4ee86da tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-group-rules/345aa6e0-ce93-41a4-8bec-ab20df4ba22e" status: 404 len: 199 microversion: 2.1 time: 0.109168 Jul 02 21:14:34.087208 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1665/3279] 10.222.0.43 () {58 vars in 1286 bytes} [Sat Jul 2 21:14:33 2022] DELETE /compute/v2.1/os-security-group-rules/345aa6e0-ce93-41a4-8bec-ab20df4ba22e => generated 199 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:14:34.138908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6883387c-ba56-498a-bef5-287b4c1b0dd7 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabe48f1c10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:34.303245 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17eb9cb9-70c4-4580-9315-db0e9d73cfc2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.749607 Jul 02 21:14:34.305725 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1615/3280] 10.222.0.43 () {62 vars in 1363 bytes} [Sat Jul 2 21:14:33 2022] POST /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments => generated 188 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:14:34.491815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:34.492419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:34.530276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:34.530948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:34.532421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:34.533208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:34.717403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca9bd5b8-643f-4430-9128-dd97ed90f5fc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/action" status: 202 len: 0 microversion: 2.20 time: 0.229082 Jul 02 21:14:34.723367 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1616/3281] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:14:34 2022] POST /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:14:34.816812 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6883387c-ba56-498a-bef5-287b4c1b0dd7 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/c90e53fb-2687-4e0f-a258-bd010ab8d8bd" status: 202 len: 0 microversion: 2.1 time: 0.713401 Jul 02 21:14:34.818341 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1666/3282] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:34 2022] DELETE /compute/v2.1/os-security-groups/c90e53fb-2687-4e0f-a258-bd010ab8d8bd => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:34.827115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:34.829751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:34.859137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:34.859993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:34.860860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:34.861369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:34.936165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1415338221", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:35.046564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:14:35.362212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:35.371028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7f6dc121-0e7b-42f5-a73b-321d6e1c7ce3 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.551467 Jul 02 21:14:35.375185 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1667/3283] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:34 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:35.388590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:35.389279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:35.398364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:35.399071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:35.400134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:35.400804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:35.557420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:14:35.559262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:14:35.560097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:14:35.561165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:14:35.562291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:14:35.579612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:35.581548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:35.585490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:35.586248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:35.653098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Getting quotas for project 4b21ffb35f1c4be7b4f58889b8be7fae. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:14:35.662670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Getting quotas for user 6f727ff1b49246268c55900aa1cc3a1b and project 4b21ffb35f1c4be7b4f58889b8be7fae. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:14:35.702446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:14:35.708238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:14:35.820675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c41f8d8-7e6d-40c3-8ec9-d0078007ff53 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.094086 Jul 02 21:14:35.827459 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1617/3284] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:14:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:14:35.837625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-374ba116-17ae-47ca-876f-5ef42f22362a tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabe405c9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:36.071018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:36.099352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:36.101095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:36.106276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1c16f1f-5a70-4bd9-9a6d-42e5b634e6fb tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1749 microversion: 2.20 time: 0.726187 Jul 02 21:14:36.107409 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1668/3285] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:35 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1749 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:36.118536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:36.121107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:36.135598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:36.136091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:36.139157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:36.140718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:36.947748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:36.963412 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b3279f2-e0c9-47c9-baef-e9a8d714b073 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.852689 Jul 02 21:14:36.964710 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1669/3286] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:36 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:36.972329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:36.973321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:36.982037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:36.982818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:36.983821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:36.984485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:37.225687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:37.248878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a259a701-35de-417b-b0ed-87e75a630650 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1219 microversion: 2.1 time: 0.282860 Jul 02 21:14:37.249521 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1670/3287] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:36 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1219 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:37.254764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:37.255482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:37.270754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:37.271845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:37.273747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:37.274274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:38.128299 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-374ba116-17ae-47ca-876f-5ef42f22362a tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/78c1119c-60bb-4639-952a-0b2e9917f86f" status: 202 len: 0 microversion: 2.1 time: 2.299598 Jul 02 21:14:38.129426 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1618/3288] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:35 2022] DELETE /compute/v2.1/os-security-groups/78c1119c-60bb-4639-952a-0b2e9917f86f => generated 0 bytes in 2301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:38.138525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:38.139389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:38.155171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:38.158228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:38.160853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:38.165790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:38.428315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:38.442206 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eee46668-a6a3-4940-9b1c-3d0a267a6abe tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 1.190116 Jul 02 21:14:38.443979 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1671/3289] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:37 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:38.453669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:38.454378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:38.477972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:38.478457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:38.480697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:38.483175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:39.210832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:39.253806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:39.264631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:39.274733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-621b4681-dd92-44a3-b37e-76374e00d176 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1751 microversion: 2.20 time: 1.136214 Jul 02 21:14:39.282027 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1619/3290] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:38 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1751 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:39.291290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b44ba0df-cfe6-40e8-a5b3-aa00a377a4ea tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabe405c550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:39.366689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:39.379448 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dcd9373b-0bd8-4c24-91ed-fd9ac76049df tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.933320 Jul 02 21:14:39.380375 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1672/3291] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:38 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:39.394699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:39.399672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:39.429588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:39.430093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:39.436999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:39.437610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:40.336638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:40.340684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:40.348397 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4154366f-b63f-41ae-bea6-a02083034e9e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 0.966423 Jul 02 21:14:40.349345 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1673/3292] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:39 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:40.355684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:40.357357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:40.371124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:40.371983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:40.373072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:40.373751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:41.220167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:41.231276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-777adc2d-68c3-43c4-a5d7-0390c706ebe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.880450 Jul 02 21:14:41.232700 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1674/3293] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:40 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:41.238526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:41.239377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:41.252848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:41.264652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:41.265904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:41.266598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:41.301493 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b44ba0df-cfe6-40e8-a5b3-aa00a377a4ea tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/54f4b38d-e2ac-4585-b61f-bd0122ed4a31" status: 202 len: 0 microversion: 2.1 time: 2.018205 Jul 02 21:14:41.306952 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1620/3294] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:39 2022] DELETE /compute/v2.1/os-security-groups/54f4b38d-e2ac-4585-b61f-bd0122ed4a31 => generated 0 bytes in 2021 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:41.312855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:41.313505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:41.338869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:41.339357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:41.340215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:41.352858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:42.178225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:42.189335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:42.191034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:42.192332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f5168d8-653c-4696-bd18-a4edff49ff64 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.958416 Jul 02 21:14:42.193299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1675/3295] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:41 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:42.201511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:42.207738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-70385a3e-364b-4414-95d3-62304f80cd21 req-faaa0585-624c-486c-9cd4-58176e412da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6563245e-b279-496a-a4dc-87e946ad9d8a", "tag": "e6c07fd2-8c38-4e41-896b-82588873fbe9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:42.210773 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0f69fdd-ab1b-4923-867e-01d5acdeca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.905611 Jul 02 21:14:42.216992 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1621/3296] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:41 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:42.224384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc2760b0-b974-46e5-9251-91f998593d7e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabe468a790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:42.225671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-70385a3e-364b-4414-95d3-62304f80cd21 req-faaa0585-624c-486c-9cd4-58176e412da6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:42.226162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-70385a3e-364b-4414-95d3-62304f80cd21 req-faaa0585-624c-486c-9cd4-58176e412da6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:42.240688 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-70385a3e-364b-4414-95d3-62304f80cd21 req-faaa0585-624c-486c-9cd4-58176e412da6 service nova] Creating event network-changed:e6c07fd2-8c38-4e41-896b-82588873fbe9 for instance 6563245e-b279-496a-a4dc-87e946ad9d8a on nch1-master-1 Jul 02 21:14:42.247109 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-70385a3e-364b-4414-95d3-62304f80cd21 req-faaa0585-624c-486c-9cd4-58176e412da6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052190 Jul 02 21:14:42.248537 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1676/3297] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:42.253960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:42.254685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:42.261573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:42.262036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:42.262829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:42.263275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:42.732545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:42.741500 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7e35d94a-9c93-44e5-b487-baee42e93d3d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 0.491730 Jul 02 21:14:42.751846 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1677/3298] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:42 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:42.758128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d9ba024e-52ec-43cd-8e23-a749051fcea0 req-9e8eae25-fe00-4b6c-88f7-150dafdd419f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dc4641-20a8-4679-82a3-c8f9ddcc801d", "name": "network-vif-plugged", "status": "completed", "tag": "87c6cf33-62a5-4113-aeb4-491f187a244d"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:42.776083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9ba024e-52ec-43cd-8e23-a749051fcea0 req-9e8eae25-fe00-4b6c-88f7-150dafdd419f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:42.785484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9ba024e-52ec-43cd-8e23-a749051fcea0 req-9e8eae25-fe00-4b6c-88f7-150dafdd419f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:42.807635 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d9ba024e-52ec-43cd-8e23-a749051fcea0 req-9e8eae25-fe00-4b6c-88f7-150dafdd419f service nova] Creating event network-vif-plugged:87c6cf33-62a5-4113-aeb4-491f187a244d for instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d on nch1-master-1 Jul 02 21:14:42.818291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d9ba024e-52ec-43cd-8e23-a749051fcea0 req-9e8eae25-fe00-4b6c-88f7-150dafdd419f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063097 Jul 02 21:14:42.823998 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1678/3299] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:14:42.829534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:42.830243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:42.838265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:42.839069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:42.840122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:42.840764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:43.003628 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc2760b0-b974-46e5-9251-91f998593d7e tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/02e4259a-fea6-400d-9059-5c9397992e5a" status: 202 len: 0 microversion: 2.1 time: 0.782629 Jul 02 21:14:43.004309 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1622/3300] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:42 2022] DELETE /compute/v2.1/os-security-groups/02e4259a-fea6-400d-9059-5c9397992e5a => generated 0 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:14:43.018039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dc72a04-039b-4be1-959b-f45482499208 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] Calling method '.version_select at 0x7fabe405c0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:43.185838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:43.194740 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c74d11ee-6754-4ddc-aa00-50fa73a488bf tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.369321 Jul 02 21:14:43.198211 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1679/3301] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:42 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:43.212752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:43.213688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:43.228760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:43.231374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:43.232940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:43.234691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:43.536860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:43.548530 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dc72a04-039b-4be1-959b-f45482499208 tempest-SecurityGroupRulesNegativeTestJSON-1316794885 tempest-SecurityGroupRulesNegativeTestJSON-1316794885-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/9b56bb0d-204f-4ed0-b6a5-dfa7a9037394" status: 202 len: 0 microversion: 2.1 time: 0.538456 Jul 02 21:14:43.550918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:43.551067 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1623/3302] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:43 2022] DELETE /compute/v2.1/os-security-groups/9b56bb0d-204f-4ed0-b6a5-dfa7a9037394 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:14:43.552988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:43.554993 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-702c8cf5-a48e-4cff-b15c-7c2fc6c4407a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.346925 Jul 02 21:14:43.556209 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1680/3303] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:43 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:43.558691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:43.560389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:43.561710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-35188ecd-d21e-4c8b-8c5d-25e0d0b1857c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Action: 'create', calling method: .version_select at 0x7fabe48f1c10>, body: {"keypair": {"name": "tempest-keypair-1318357403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmX3MjGKqiFyNHJm85Z7JaCxQEPzC/bXOabMLQ7MjhUCeYMVNxr0etV0yU2X0g/kGf1qjI2rpAN2SRHJwi+i6e4+BguxUDdznKSnTepDaX3tcWzPyFNL8jHnX9BIr2PDQ=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:43.573579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:43.574399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:43.575144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:43.575301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:43.576410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:43.581415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-35188ecd-d21e-4c8b-8c5d-25e0d0b1857c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Getting quotas for project b7da173babe7403fa85f5aab929e3068. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:14:43.590197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-35188ecd-d21e-4c8b-8c5d-25e0d0b1857c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Getting quotas for user 0f5b2e7e4efe478abdc85fc51fa064de and project b7da173babe7403fa85f5aab929e3068. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:14:43.673028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-35188ecd-d21e-4c8b-8c5d-25e0d0b1857c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.115403 Jul 02 21:14:43.674248 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1681/3304] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:14:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:14:43.758074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:43.759126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:43.766011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:43.766846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:43.767861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:43.768555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:44.190455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:44.202665 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c258e2eb-bd65-4d88-bd53-8431381dc89b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.650476 Jul 02 21:14:44.213568 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1624/3305] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:43 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:44.222005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:44.222964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:44.232637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:44.233317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:44.234402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:44.235441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:44.247231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:44.263218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:44.263970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1fbcaaae-424a-4243-923c-eb888de5ff02 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 0.509740 Jul 02 21:14:44.264820 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1682/3306] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:43 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:14:44.573994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:44.574893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:44.581998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:44.582745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:44.583732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:44.584372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:44.591657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:44.608001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a77a411-0da5-4316-a808-5fb6af129720 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.391048 Jul 02 21:14:44.609854 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1625/3307] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:44 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:44.953901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:45.005133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:45.008638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:45.052834 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4701c7b3-32ff-4e4a-b1eb-8970c254c771 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.480378 Jul 02 21:14:45.057846 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1683/3308] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:44 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:45.225742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:45.227600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:45.234047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=15,nova_api:UPDATE=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:45.241561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:45.245315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:45.256441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:45.257380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:45.283981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:45.285290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:45.296627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:45.309776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:45.310631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:45.311070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:45.619685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:45.625712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:45.635420 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a60d429b-bee7-4a31-b538-f5f92a606224 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1315 microversion: 2.1 time: 0.417281 Jul 02 21:14:45.636076 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1626/3309] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:45 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:45.650773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:45.656688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:45.674109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:45.674437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:45.675613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:45.681696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:45.683882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:45.694684 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb87dfcd-dd02-4735-88dd-e51febecdb72 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 0.415801 Jul 02 21:14:45.696197 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1684/3310] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:45 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:14:45.761953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=37 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:46.075032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:46.076122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:46.086868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:46.087411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:46.088243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:46.088737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:46.722753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:46.731112 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03d7338e-408f-47cd-b718-8990c6c1db34 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 1.089682 Jul 02 21:14:46.746556 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1627/3311] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:45 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:46.758510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:46.759392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:46.777921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:46.783097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:46.784324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:46.784864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:46.967607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:46.985967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:46.990338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:46.998318 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb42cbe1-9b83-4710-ba59-122098ebac40 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.926975 Jul 02 21:14:47.019309 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1685/3312] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:46 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:14:47.035146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:47.036425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:47.056600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:47.059428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:47.062420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:47.063936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:47.375064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:47.408396 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d80a659-c8f1-4619-8f41-f7a758415906 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1502 microversion: 2.1 time: 0.650559 Jul 02 21:14:47.412193 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1628/3313] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:46 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1502 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:47.428662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:47.431311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:47.450569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:47.452663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:47.453828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:47.454854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:47.530860 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70bde0ac-6154-4707-bffd-5b95c60950cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action" status: 200 len: 14 microversion: 2.1 time: 0.105003 Jul 02 21:14:47.533564 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1629/3314] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:47 2022] POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:14:47.629554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:47.649399 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c170bc9-83f7-4df9-ad73-3b885b88d506 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 0.626144 Jul 02 21:14:47.662330 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1686/3315] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:47 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:47.761925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:47.763984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:47.782463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:47.786374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:47.787446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:47.789238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.019051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:48.019589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:48.058805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.059794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.067940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.071560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.164996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:48.178693 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eee077fe-211f-4e0d-b520-f549863192c4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.423484 Jul 02 21:14:48.182163 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1630/3316] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:47 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:48.240099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c5b0f218-c0ae-44ee-8dff-a50ea4966704 req-375ee884-6430-4ee9-8454-ede4fccbcd6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6563245e-b279-496a-a4dc-87e946ad9d8a", "name": "network-vif-plugged", "status": "completed", "tag": "e6c07fd2-8c38-4e41-896b-82588873fbe9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:48.262004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c5b0f218-c0ae-44ee-8dff-a50ea4966704 req-375ee884-6430-4ee9-8454-ede4fccbcd6f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.264502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c5b0f218-c0ae-44ee-8dff-a50ea4966704 req-375ee884-6430-4ee9-8454-ede4fccbcd6f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.314162 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c5b0f218-c0ae-44ee-8dff-a50ea4966704 req-375ee884-6430-4ee9-8454-ede4fccbcd6f service nova] Creating event network-vif-plugged:e6c07fd2-8c38-4e41-896b-82588873fbe9 for instance 6563245e-b279-496a-a4dc-87e946ad9d8a on nch1-master-1 Jul 02 21:14:48.330659 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c5b0f218-c0ae-44ee-8dff-a50ea4966704 req-375ee884-6430-4ee9-8454-ede4fccbcd6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098000 Jul 02 21:14:48.343374 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1631/3317] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 02 21:14:48.544552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:48.545930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:48.574933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.575570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.576715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.577988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.679327 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a59aa5e1-93d9-4616-b12a-982eb6f7ce85 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action" status: 200 len: 14 microversion: 2.1 time: 0.139070 Jul 02 21:14:48.688390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1632/3318] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:48 2022] POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:14:48.697518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:48.698247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:48.721407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.721943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.726496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:48.734563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:48.871880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:48.885827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:48.897408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:48.898593 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e643bd8a-145d-44b6-8158-ea3880b49273 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.884139 Jul 02 21:14:48.902837 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1687/3319] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:48 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:14:49.197603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:49.203351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:49.226571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:49.227045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:49.227850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:49.228321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:49.700378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:49.717070 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c8e9c0b-c152-4237-82af-0ecab8ac993e tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 1.026326 Jul 02 21:14:49.733038 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1633/3320] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:48 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:49.741508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:49.747496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:49.757827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:49.767630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:49.768463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:49.771267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:49.774742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:49.790112 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e64c9d9-cea3-4329-b5f0-f8ad708dbfe2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.596215 Jul 02 21:14:49.806082 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1688/3321] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:49 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:14:49.921939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:49.922662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:49.948861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:49.951411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:49.956351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:49.956822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:50.073785 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c60a7f35-86e6-456e-857a-fe106876c7ff tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action" status: 200 len: 14 microversion: 2.1 time: 0.338351 Jul 02 21:14:50.079907 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1634/3322] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:49 2022] POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action => generated 14 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:14:50.262679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:50.272011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:50.273544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:50.295888 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-402d0a3f-2c42-4a30-9498-acefd097f059 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.382593 Jul 02 21:14:50.302334 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1689/3323] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:49 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:14:50.354340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-452133265", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e957b9b1-8ab8-4e5e-aad7-e042769e7a9e"}, {"port": "e502bf66-d0a7-4697-9c26-7f5ff4399906", "tag": "port-1"}, {"port": "9865bb29-9fe1-41c8-9b51-3fcd651dccfd", "tag": "port-2"}, {"uuid": "e28adf54-4cb9-4b67-aca5-91de229b65ca", "tag": "net-1"}, {"uuid": "e28adf54-4cb9-4b67-aca5-91de229b65ca"}, {"uuid": "98a800a2-6866-463d-9077-fb35c2356f2b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "98a800a2-6866-463d-9077-fb35c2356f2b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4f464256-167f-499c-a620-977a48ba0220", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a22e0b4d-265f-434c-bfd9-e859326dc395", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6593f24e-5231-490f-8bfd-665de85ebc5b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1526316570"}], "key_name": "tempest-keypair-1318357403", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:50.527979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] validate_networks() for [('e957b9b1-8ab8-4e5e-aad7-e042769e7a9e', None, None, None, None, None), (None, None, 'e502bf66-d0a7-4697-9c26-7f5ff4399906', None, None, None), (None, None, '9865bb29-9fe1-41c8-9b51-3fcd651dccfd', None, None, None), ('e28adf54-4cb9-4b67-aca5-91de229b65ca', None, None, None, None, None), ('e28adf54-4cb9-4b67-aca5-91de229b65ca', None, None, None, None, None), ('98a800a2-6866-463d-9077-fb35c2356f2b', '10.2.2.100', None, None, None, None), ('98a800a2-6866-463d-9077-fb35c2356f2b', '10.2.2.200', None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:14:50.736892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:50.737718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:50.761364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:50.764311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:50.768494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:50.768985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:51.744685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:51.777772 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f79f3e36-4ac5-4aed-88ca-7c12b5136e82 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1323 microversion: 2.1 time: 1.045507 Jul 02 21:14:51.789403 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1690/3324] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:50 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1323 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:14:51.830670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:51.831711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:51.838864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:51.840360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:51.841491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:51.842163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:52.275252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:52.288556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d78706ff-ff7f-458a-b6e7-c6300ccb0456 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.497207 Jul 02 21:14:52.294375 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1691/3325] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:51 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:52.301017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:52.307826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:52.327648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:52.328445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:52.331875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:52.334927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:52.449191 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76db80da-4245-4e21-bc2c-f558492f7a88 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action" status: 200 len: 14 microversion: 2.1 time: 0.152439 Jul 02 21:14:52.450048 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1692/3326] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:52 2022] POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:14:52.456802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:52.464447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:52.483040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:52.486913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:52.488029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:52.503793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:52.523234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:52.841750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:52.863368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:52.865362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:52.869394 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b6936de-cd00-4001-babe-4faaada4a764 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.417931 Jul 02 21:14:52.873221 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1693/3327] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:52 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:52.879964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:52.886757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:52.903867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:52.905536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:52.907647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:52.910762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.240311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:53.252484 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e98f3775-3254-4e4f-b835-1019e9529682 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1472 microversion: 2.1 time: 0.375706 Jul 02 21:14:53.253901 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1694/3328] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:52 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:53.289058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:53.291321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:53.324663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:53.331136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.333002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:53.333707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.388465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Request method failure captured: Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a/diagnostics HTTP/1.1 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLU45df5YSMSVMII7Gx_vka3l_ntVthJvYdRvO9FBQQyn-A1UaGL_FkkYO14r9shg-sIMwi0GECidUR-T7h_DaWVobJnWP_l7J8S6Ee8LXnzorRYtkov6V_vryJYyO5JPJB_wA-qPt-Oa0IBljry5WX1AsE0K-YJEZcN9CEAIj6HyLY Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4b21ffb35f1c4be7b4f58889b8be7fae Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1904267385 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b21ffb35f1c4be7b4f58889b8be7fae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b21ffb35f1c4be7b4f58889b8be7fae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b21ffb35f1c4be7b4f58889b8be7fae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b21ffb35f1c4be7b4f58889b8be7fae"}]}] Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1904267385 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4b21ffb35f1c4be7b4f58889b8be7fae Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1904267385 Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiagnosticsNegativeTest-1904267385-project Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 6f727ff1b49246268c55900aa1cc3a1b Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1904267385-project Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'server_id': '6563245e-b279-496a-a4dc-87e946ad9d8a'} Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise self.value Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:53.407769 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:14:53.413862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:14:53.414583 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20433b08-2772-4a9d-a120-43d2af91730d tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.140148 Jul 02 21:14:53.419411 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1695/3329] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:14:53 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a/diagnostics => generated 117 bytes in 144 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:14:53.423698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:53.424483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:53.438102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:53.441752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.442974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:53.443648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.621447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:14:53.768907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:53.781070 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2903ff85-aaed-4408-9ac3-27acfac1db32 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 0.362215 Jul 02 21:14:53.782186 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1696/3330] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:53 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:53.794035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:53.794913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:53.808066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:53.809784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.813635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:53.814360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:53.867603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:14:54.060764 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f90e0b8a-48ab-4186-aeae-42b110ec8ba5 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 204 len: 0 microversion: 2.1 time: 0.275988 Jul 02 21:14:54.064816 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1697/3331] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:14:53 2022] DELETE /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:14:54.067136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:54.072904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:54.086000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:54.086450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:54.087257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:54.087747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:55.225526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:14:55.226880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:14:55.227577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:14:55.228330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:14:55.228988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:14:55.261916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:55.263241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:55.265824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:55.267589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:55.328002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Getting quotas for project b7da173babe7403fa85f5aab929e3068. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:14:55.351536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Getting quotas for user 0f5b2e7e4efe478abdc85fc51fa064de and project b7da173babe7403fa85f5aab929e3068. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:14:55.760773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:14:55.764594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4f464256-167f-499c-a620-977a48ba0220',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a22e0b4d-265f-434c-bfd9-e859326dc395',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6593f24e-5231-490f-8bfd-665de85ebc5b',volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:14:56.395452 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-870e88ac-0514-4753-932d-cfa8b5e50d0c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.045701 Jul 02 21:14:56.397058 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1635/3332] 10.222.0.43 () {62 vars in 1188 bytes} [Sat Jul 2 21:14:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 6048 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:14:56.402699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:56.403930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:56.423663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:56.424452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:56.426059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:56.440526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:56.680179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:56.696750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:56.698683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:56.702205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f913634a-6aca-4b43-879f-00c14cf0ee8a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.303684 Jul 02 21:14:56.706705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1636/3333] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:56 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:56.716839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:56.717742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:56.728293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:56.732772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:56.742700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:56.743834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:56.839554 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-66a14b84-601d-4910-88c0-b2ec4e6f5aa5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action" status: 200 len: 14 microversion: 2.1 time: 2.776290 Jul 02 21:14:56.843319 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1698/3334] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:54 2022] POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action => generated 14 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:14:56.849059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:56.849750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:56.886738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:56.887348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:56.888264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:56.898025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:57.057253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:57.073341 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5980859-c909-4611-a15a-a9a9f673bd95 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1478 microversion: 2.1 time: 0.365254 Jul 02 21:14:57.088547 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1637/3335] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:56 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1478 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:57.103178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4cbdbc7-c1f3-4af5-b8ae-07b777742cf1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:57.105138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4cbdbc7-c1f3-4af5-b8ae-07b777742cf1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:58.193193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4cbdbc7-c1f3-4af5-b8ae-07b777742cf1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.205967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4cbdbc7-c1f3-4af5-b8ae-07b777742cf1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.214476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4cbdbc7-c1f3-4af5-b8ae-07b777742cf1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.226611 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4cbdbc7-c1f3-4af5-b8ae-07b777742cf1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1285 microversion: 2.32 time: 1.124983 Jul 02 21:14:58.244835 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1638/3336] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:57 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1285 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:58.256520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:58.257219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:58.277950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.290180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:58.292076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:58.292555 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3048c806-a55e-46fb-beda-4517f31aa04a tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1523 microversion: 2.1 time: 1.447224 Jul 02 21:14:58.295606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:58.296102 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1699/3337] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:56 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1523 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:58.296747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:58.309837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:14:58.311096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:58.322213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:58.322918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:58.324109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:58.324872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:58.491628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.500925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.502739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.504157 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9298c7c-9cdd-4f7d-b788-fed0e6ec0c0a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.258234 Jul 02 21:14:58.504895 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1639/3338] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:58 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:14:58.512732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:58.513691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:58.520681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:58.521354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:58.522134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:58.522560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:58.705198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:58.713716 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c08a9bf7-d63b-4354-af90-ac781ab94f92 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1478 microversion: 2.1 time: 0.207640 Jul 02 21:14:58.714655 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1640/3339] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:58 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1478 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:59.245703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:59.246432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:59.262457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:59.262993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:59.269586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:59.270239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:59.571085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:59.603220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:59.604917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:59.607181 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a37da69-1c62-449d-a1a8-6389e3da6ff5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1583 microversion: 2.32 time: 0.365061 Jul 02 21:14:59.608332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1641/3340] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:59 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1583 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:14:59.613949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:59.614983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:59.623925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:59.624628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:59.626178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:59.626780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:59.835969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:14:59.847535 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56c193cf-ed60-4704-ace8-c6a503514f50 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1503 microversion: 2.1 time: 0.236312 Jul 02 21:14:59.850531 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1642/3341] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:14:59 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:14:59.871423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:14:59.872210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:14:59.888561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:59.888915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:14:59.901021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:14:59.901731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:00.254221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:00.270946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:00.275147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:00.276949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f68e682c-15cd-461a-9c3c-4d5184714c98 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.424776 Jul 02 21:15:00.293739 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1643/3342] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:14:59 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:00.299384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e6fe3592-d126-432a-98ab-9b21699309c3 req-3147e691-5dce-4993-91aa-35e0444db5c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6563245e-b279-496a-a4dc-87e946ad9d8a", "name": "network-vif-deleted", "tag": "e6c07fd2-8c38-4e41-896b-82588873fbe9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:00.326416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e6fe3592-d126-432a-98ab-9b21699309c3 req-3147e691-5dce-4993-91aa-35e0444db5c7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:00.327009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e6fe3592-d126-432a-98ab-9b21699309c3 req-3147e691-5dce-4993-91aa-35e0444db5c7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:00.352326 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e6fe3592-d126-432a-98ab-9b21699309c3 req-3147e691-5dce-4993-91aa-35e0444db5c7 service nova] Creating event network-vif-deleted:e6c07fd2-8c38-4e41-896b-82588873fbe9 for instance 6563245e-b279-496a-a4dc-87e946ad9d8a on nch1-master-1 Jul 02 21:15:00.361624 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e6fe3592-d126-432a-98ab-9b21699309c3 req-3147e691-5dce-4993-91aa-35e0444db5c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066187 Jul 02 21:15:00.362966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1644/3343] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:00.596081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-873638f5-0dc7-4274-8fdb-25acb5656cc6 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-878141874", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:00.598335 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-873638f5-0dc7-4274-8fdb-25acb5656cc6 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] HTTP exception thrown: min_count must be <= max_count Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-873638f5-0dc7-4274-8fdb-25acb5656cc6 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Request method failure captured: Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 183 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLVTJlfpiGFalk74_NiwL4bBvCBKWa2JR3XwU_psV2lk124HX3ppHSjRdsrGVfcrKqTOkCa0Ne1jeUURkZxCATi-55DVdKWVcZu1oUDsQwTDnvvkerTre4Oy84KcMQ0q7WJQr7uUsJ4MzmHXDGZIUieCdMOcEDDN6Xs-_ne0qdMB77w Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bcba662c7b648d39ac1d11cbc9762ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bcba662c7b648d39ac1d11cbc9762ed"}]}] Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 63b4fe8dc61f479ba74ed1c03f918132 Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-878141874", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: exception: min_count must be <= max_count Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-878141874', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 02 21:15:00.600780 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:00.611084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-873638f5-0dc7-4274-8fdb-25acb5656cc6 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Returning 400 to user: min_count must be <= max_count {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:00.613460 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-873638f5-0dc7-4274-8fdb-25acb5656cc6 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.247758 Jul 02 21:15:00.620234 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1645/3344] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:00 2022] POST /compute/v2.1/servers => generated 74 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:15:00.646084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:00.650322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:00.675335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:00.676189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:00.682676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:00.683502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:00.835992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:00.848803 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4542fbde-0671-4b20-8e1b-416bfc96c8f7 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1436 microversion: 2.1 time: 0.225366 Jul 02 21:15:00.849405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1646/3345] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:00 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1436 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:00.867061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f3d0a71-bd8d-4024-91a8-3fcc348140ac tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'create', calling method: .version_select at 0x7fabd797d280>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1771722608", "description": "tempest-description-1566314940"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:00.909280 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-904655ec-794a-4e24-b61a-385bd361d254 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action" status: 200 len: 16399 microversion: 2.1 time: 2.609763 Jul 02 21:15:00.912782 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1700/3346] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:14:58 2022] POST /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d/action => generated 16399 bytes in 2615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:15:00.918967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:00.921221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:00.957477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:00.957809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:00.958620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:00.967067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:01.364121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:01.383516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:01.386673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:01.388295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5c16a1b-fc76-488c-b641-3e1a02aa9dcc tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1593 microversion: 2.32 time: 0.473927 Jul 02 21:15:01.389063 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1701/3347] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:00 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1593 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:01.404916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02aaff92-316d-4413-a077-36ca99417eec tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-493570221", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "max_count": 0}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02aaff92-316d-4413-a077-36ca99417eec tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Request method failure captured: Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 167 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVTJlfpiGFalk74_NiwL4bBvCBKWa2JR3XwU_psV2lk124HX3ppHSjRdsrGVfcrKqTOkCa0Ne1jeUURkZxCATi-55DVdKWVcZu1oUDsQwTDnvvkerTre4Oy84KcMQ0q7WJQr7uUsJ4MzmHXDGZIUieCdMOcEDDN6Xs-_ne0qdMB77w Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bcba662c7b648d39ac1d11cbc9762ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bcba662c7b648d39ac1d11cbc9762ed"}]}] Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 63b4fe8dc61f479ba74ed1c03f918132 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-493570221", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "max_count": 0}} Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-493570221', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'max_count': 0}}} Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 0 Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:15:01.412303 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 02 21:15:01.417454 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:01.423009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02aaff92-316d-4413-a077-36ca99417eec tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:01.424260 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-02aaff92-316d-4413-a077-36ca99417eec tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030324 Jul 02 21:15:01.429886 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1702/3348] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:01 2022] POST /compute/v2.1/servers => generated 130 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:15:01.443830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:01.444699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:01.453467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:01.455070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:01.456290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:01.457025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:01.878244 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f3d0a71-bd8d-4024-91a8-3fcc348140ac tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 1.023950 Jul 02 21:15:01.879555 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1647/3349] 10.222.0.43 () {60 vars in 1179 bytes} [Sat Jul 2 21:15:00 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:01.885585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:01.886273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:01.904794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:01.905608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:01.907320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:01.907946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:01.924174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:01.991781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:02.009712 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ea87abc-bd30-4af6-9d87-51826b3fc094 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.578516 Jul 02 21:15:02.011642 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1703/3350] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:01 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:02.027649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5d4da69-cc12-4a55-82ff-62aeda273830 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-776405286", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "max_count": 2.5}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5d4da69-cc12-4a55-82ff-62aeda273830 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Request method failure captured: Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 169 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVTJlfpiGFalk74_NiwL4bBvCBKWa2JR3XwU_psV2lk124HX3ppHSjRdsrGVfcrKqTOkCa0Ne1jeUURkZxCATi-55DVdKWVcZu1oUDsQwTDnvvkerTre4Oy84KcMQ0q7WJQr7uUsJ4MzmHXDGZIUieCdMOcEDDN6Xs-_ne0qdMB77w Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bcba662c7b648d39ac1d11cbc9762ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bcba662c7b648d39ac1d11cbc9762ed"}]}] Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 63b4fe8dc61f479ba74ed1c03f918132 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-776405286", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "max_count": 2.5}} Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-776405286', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'max_count': 2.5}}} Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 2.5 Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:15:02.031232 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:02.035756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5d4da69-cc12-4a55-82ff-62aeda273830 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:02.040426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5d4da69-cc12-4a55-82ff-62aeda273830 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022958 Jul 02 21:15:02.040426 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1704/3351] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:15:02.051902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:02.054488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:02.086928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.099169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.100490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.102632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.189622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.190461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.192305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lazy-loading 'fault' on Instance uuid 6563245e-b279-496a-a4dc-87e946ad9d8a {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:15:02.390076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f727ff1b49246268c55900aa1cc3a1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b21ffb35f1c4be7b4f58889b8be7fae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:02.412736 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f44bcb0-2bad-4c35-9548-c16f75e2cea3 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 200 len: 1313 microversion: 2.1 time: 0.370022 Jul 02 21:15:02.423573 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1705/3352] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:02 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:02.432471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1771722608"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:02.433742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:02.452257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.452839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.453892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.454408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.533278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:02.551727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:02.554973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:02.567141 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ce572e6-d487-4ba3-8200-30dc146e5fca tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.684507 Jul 02 21:15:02.582321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1648/3353] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:01 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:02.585112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:02.585818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:02.604255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.604687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.605506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:02.605948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:02.829589 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.security_group_api [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Adding security group 5d11c719-23ab-4a72-8808-2cb59e78b9e8 to port b4aa6b0f-0159-4ca2-9324-42c8626890fc Jul 02 21:15:03.250400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:03.281513 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3975104-c035-4705-93b8-8d282326515d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.707773 Jul 02 21:15:03.282436 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1649/3354] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:02 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:03.325849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f9a7ce-89e7-4989-87a9-c15741f65ac2 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-648041158", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 0}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f9a7ce-89e7-4989-87a9-c15741f65ac2 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Request method failure captured: Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 167 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLVTJlfpiGFalk74_NiwL4bBvCBKWa2JR3XwU_psV2lk124HX3ppHSjRdsrGVfcrKqTOkCa0Ne1jeUURkZxCATi-55DVdKWVcZu1oUDsQwTDnvvkerTre4Oy84KcMQ0q7WJQr7uUsJ4MzmHXDGZIUieCdMOcEDDN6Xs-_ne0qdMB77w Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bcba662c7b648d39ac1d11cbc9762ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bcba662c7b648d39ac1d11cbc9762ed"}]}] Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 63b4fe8dc61f479ba74ed1c03f918132 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-648041158", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 0}} Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-648041158', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'min_count': 0}}} Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 0 Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:15:03.349279 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 02 21:15:03.355021 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:03.358598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f9a7ce-89e7-4989-87a9-c15741f65ac2 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:03.362580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84f9a7ce-89e7-4989-87a9-c15741f65ac2 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.064019 Jul 02 21:15:03.368154 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1650/3355] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:15:03.380821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:03.381385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:03.401253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:03.401730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:03.402533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:03.402999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:03.955019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:03.996562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:04.000733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:04.010308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3a4ab63-8c85-40dd-8041-81ef81a9b61c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1661 microversion: 2.32 time: 0.634598 Jul 02 21:15:04.024505 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1651/3356] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:03 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1661 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:04.032798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:04.034697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:04.046445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:04.047327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:04.048461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:04.049770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:04.098900 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f23c55f4-62ec-43ef-b258-fa550dddbfa4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action" status: 202 len: 0 microversion: 2.1 time: 1.683248 Jul 02 21:15:04.099569 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1706/3357] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:02 2022] POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action => generated 0 bytes in 1685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:04.109952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:04.110570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] [instance: 6563245e-b279-496a-a4dc-87e946ad9d8a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:04.124482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:04.127568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:04.128642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:04.131719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:04.156437 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] HTTP exception thrown: Instance 6563245e-b279-496a-a4dc-87e946ad9d8a could not be found. Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Request method failure captured: Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a HTTP/1.1 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLU45df5YSMSVMII7Gx_vka3l_ntVthJvYdRvO9FBQQyn-A1UaGL_FkkYO14r9shg-sIMwi0GECidUR-T7h_DaWVobJnWP_l7J8S6Ee8LXnzorRYtkov6V_vryJYyO5JPJB_wA-qPt-Oa0IBljry5WX1AsE0K-YJEZcN9CEAIj6HyLY Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4b21ffb35f1c4be7b4f58889b8be7fae Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1904267385 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b21ffb35f1c4be7b4f58889b8be7fae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4b21ffb35f1c4be7b4f58889b8be7fae", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4b21ffb35f1c4be7b4f58889b8be7fae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4b21ffb35f1c4be7b4f58889b8be7fae"}]}] Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1904267385 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4b21ffb35f1c4be7b4f58889b8be7fae Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1904267385 Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiagnosticsNegativeTest-1904267385-project Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 6f727ff1b49246268c55900aa1cc3a1b Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1904267385-project Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 6563245e-b279-496a-a4dc-87e946ad9d8a could not be found. Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '6563245e-b279-496a-a4dc-87e946ad9d8a'} Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6563245e-b279-496a-a4dc-87e946ad9d8a could not be found. Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6563245e-b279-496a-a4dc-87e946ad9d8a could not be found. Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.158503 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6563245e-b279-496a-a4dc-87e946ad9d8a could not be found. Jul 02 21:15:04.164735 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.165925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] Returning 404 to user: Instance 6563245e-b279-496a-a4dc-87e946ad9d8a could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:04.166745 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d73b4000-fd22-46c6-8fdd-1e3abe1a3fd1 tempest-ServerDiagnosticsNegativeTest-1904267385 tempest-ServerDiagnosticsNegativeTest-1904267385-project] 10.222.0.43 "GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a" status: 404 len: 111 microversion: 2.1 time: 0.062576 Jul 02 21:15:04.167323 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1707/3358] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:04 2022] GET /compute/v2.1/servers/6563245e-b279-496a-a4dc-87e946ad9d8a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:15:04.180561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb5b4e34-b690-4829-bf93-d0b8aee482f5 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1877311806", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 2.5}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb5b4e34-b690-4829-bf93-d0b8aee482f5 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Request method failure captured: Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 170 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVTJlfpiGFalk74_NiwL4bBvCBKWa2JR3XwU_psV2lk124HX3ppHSjRdsrGVfcrKqTOkCa0Ne1jeUURkZxCATi-55DVdKWVcZu1oUDsQwTDnvvkerTre4Oy84KcMQ0q7WJQr7uUsJ4MzmHXDGZIUieCdMOcEDDN6Xs-_ne0qdMB77w Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4bcba662c7b648d39ac1d11cbc9762ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4bcba662c7b648d39ac1d11cbc9762ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4bcba662c7b648d39ac1d11cbc9762ed"}]}] Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 4bcba662c7b648d39ac1d11cbc9762ed Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-993687237 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 63b4fe8dc61f479ba74ed1c03f918132 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-993687237-project Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1877311806", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "min_count": 2.5}} Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1877311806', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'min_count': 2.5}}} Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 2.5 Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:15:04.185819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb5b4e34-b690-4829-bf93-d0b8aee482f5 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb5b4e34-b690-4829-bf93-d0b8aee482f5 tempest-MultipleCreateNegativeTestJSON-993687237 tempest-MultipleCreateNegativeTestJSON-993687237-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018979 Jul 02 21:15:04.190979 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1708/3359] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:04 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:15:04.201023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:04.201653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:04.228255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:04.229188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:04.230160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:04.230784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:04.682408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:04.705640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b268f836-5d00-4ab2-9df8-fddf48231ea4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.679334 Jul 02 21:15:04.719190 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1652/3360] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:04 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:04.728062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-986724569", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "1798b2b9-b23b-4deb-a05f-11af29982e8e"}, {"uuid": "5b6e7ad2-9f0a-418f-a084-8da77c9f889c"}, {"uuid": "1798b2b9-b23b-4deb-a05f-11af29982e8e"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:04.847970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] validate_networks() for [('1798b2b9-b23b-4deb-a05f-11af29982e8e', None, None, None, None, None), ('5b6e7ad2-9f0a-418f-a084-8da77c9f889c', None, None, None, None, None), ('1798b2b9-b23b-4deb-a05f-11af29982e8e', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:15:05.052091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:05.069822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:05.080886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:05.095148 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e496a545-632f-4695-8253-36454dda0518 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.900963 Jul 02 21:15:05.095841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1709/3361] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:04 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:05.110346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1771722608"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:05.114562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:05.159109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:05.159584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:05.165595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:05.166841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:05.298809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:05.670208 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.security_group_api [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Removing security group 5d11c719-23ab-4a72-8808-2cb59e78b9e8 from port b4aa6b0f-0159-4ca2-9324-42c8626890fc Jul 02 21:15:07.497694 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db718ebb-0de4-4722-8624-d92215370629 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action" status: 202 len: 0 microversion: 2.1 time: 2.399815 Jul 02 21:15:07.499186 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1710/3362] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:05 2022] POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action => generated 0 bytes in 2402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:07.507089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4e7dcf34-2dc3-46ca-9dab-bf71bfbf8a0c req-a4ad8cfb-460e-4315-894a-199707baa80a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:07.539749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4e7dcf34-2dc3-46ca-9dab-bf71bfbf8a0c req-a4ad8cfb-460e-4315-894a-199707baa80a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:07.540663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4e7dcf34-2dc3-46ca-9dab-bf71bfbf8a0c req-a4ad8cfb-460e-4315-894a-199707baa80a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:07.591263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4e7dcf34-2dc3-46ca-9dab-bf71bfbf8a0c req-a4ad8cfb-460e-4315-894a-199707baa80a service nova] Creating event network-changed:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:15:07.609550 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4e7dcf34-2dc3-46ca-9dab-bf71bfbf8a0c req-a4ad8cfb-460e-4315-894a-199707baa80a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108940 Jul 02 21:15:07.626380 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1711/3363] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:07.642576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:07.651068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:07.671525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:07.671997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:07.672835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:07.673286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:08.198411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:08.358930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:08.375733 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48ca84dd-3ae2-4a4d-9fa3-d0b9f8ae2802 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.743887 Jul 02 21:15:08.384634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1712/3364] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:07 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:08.414981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:08.416850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:08.482312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:08.485643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:08.502448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:08.505341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:08.570486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:15:08.570912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:15:08.571402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:15:08.571805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:15:08.572437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:15:08.604666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:08.605832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:08.613134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:08.613865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:08.678295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Getting quotas for project ebcb0a2922d64d6e8d0c4114e10b954d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:15:08.684464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Getting quotas for user 649c6088b26049ba9a765be082f38259 and project ebcb0a2922d64d6e8d0c4114e10b954d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:15:08.702494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:15:08.705081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:15:08.811403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de50e346-dba8-472d-871f-2e9e22408264 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.098253 Jul 02 21:15:08.815689 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1653/3365] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 4105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:15:08.826685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:08.829385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:08.840567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:08.841014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:08.845649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:08.848334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:09.226982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.231348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:09.239077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.242268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.246104 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-147d1d54-f19b-48c3-af8b-3ecee43dc235 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1790 microversion: 2.32 time: 0.859984 Jul 02 21:15:09.246959 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1713/3366] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:08 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1790 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:09.255442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a85ac833-8007-4b5e-bec7-aa82bbb6428b tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'create', calling method: .version_select at 0x7fabd7561160>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:09.357140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.374409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.375962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.377281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7291b36-c350-4a8a-b001-647ad50b5e88 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.560258 Jul 02 21:15:09.399303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1654/3367] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:08 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:09.412461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:09.413816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:09.432252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:09.434394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:09.437354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:09.438130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:09.535923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Locking {{(pid=131044) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 02 21:15:09.652833 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa4385d8-a432-4094-ac8b-910110a5a5a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.251066 Jul 02 21:15:09.659754 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1655/3368] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:09 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:09.667038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:09.684053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:09.698867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:09.700886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:09.702088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:09.702990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:09.898011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:09.910929 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fed6d01-36f5-4d2b-9ae1-6f5c0edf3954 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1216 microversion: 2.1 time: 0.249552 Jul 02 21:15:09.913087 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1656/3369] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:09 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1216 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:09.929596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:09.930237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:09.950994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:09.952379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:09.955166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:09.956533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:10.618039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:10.648972 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d124f5d-ed68-4fb7-afea-57dfae565500 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.732655 Jul 02 21:15:10.650148 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1657/3370] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:09 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:10.660142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cd8efa7a-3c8e-4f7b-8380-f1109cb01c17 req-74f7231d-a1cc-4580-8150-b26ead57fddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:10.683721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cd8efa7a-3c8e-4f7b-8380-f1109cb01c17 req-74f7231d-a1cc-4580-8150-b26ead57fddc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:10.685618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cd8efa7a-3c8e-4f7b-8380-f1109cb01c17 req-74f7231d-a1cc-4580-8150-b26ead57fddc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:10.714569 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cd8efa7a-3c8e-4f7b-8380-f1109cb01c17 req-74f7231d-a1cc-4580-8150-b26ead57fddc service nova] Creating event network-changed:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:15:10.724637 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cd8efa7a-3c8e-4f7b-8380-f1109cb01c17 req-74f7231d-a1cc-4580-8150-b26ead57fddc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071916 Jul 02 21:15:10.728158 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1658/3371] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:10.735413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:10.736719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:10.745955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:10.747060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:10.748458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:10.749372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:11.984963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:11.998300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:11.999816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:12.008705 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b42a7bf-09cf-47fb-aba8-507fc3b0c4b7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1837 microversion: 2.32 time: 1.278352 Jul 02 21:15:12.009392 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1659/3372] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:10 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1837 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:12.018579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:12.019430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:12.035738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:12.036359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:12.037463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:12.040644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:12.859942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:12.875784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:12.877853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:12.879277 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4056a333-4f0d-4934-a63d-d8e1bb508325 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.868651 Jul 02 21:15:12.890647 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1660/3373] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:12 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:12.896181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:12.903173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:12.903900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:12.946685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] HTTP exception thrown: Instance 42f5e581-653c-47dd-beca-62493c2367ba is locked Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Request method failure captured: Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action HTTP/1.1 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 15 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQ9gAFNCpDNoVjVjLKqvdOZRR6wL_Fze-ofTWXa4xg-poFl1LUrUiPGK8EZI5QEbnV3-HO2VR02AmHsvDPofHvuv75CF9_KWm6wWOAgv6sn821PxM5ENxp57ZN_-xvUjJ6Q-58w21j6k9Vc3T8k0EIoGy_2oW_cnysErpJCniIM7CQ Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_756410b2ad7345779f62a9db9835456f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/756410b2ad7345779f62a9db9835456f"}]}] Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-629868272 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 419f3872408c4d8c9a2980d6397d0aea Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: {"os-stop": {}} Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 42f5e581-653c-47dd-beca-62493c2367ba is locked Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '42f5e581-653c-47dd-beca-62493c2367ba', 'body': {'os-stop': {}}} Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 42f5e581-653c-47dd-beca-62493c2367ba is locked Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 42f5e581-653c-47dd-beca-62493c2367ba is locked Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f5e581-653c-47dd-beca-62493c2367ba is locked Jul 02 21:15:12.948813 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:12.956245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Returning 409 to user: Instance 42f5e581-653c-47dd-beca-62493c2367ba is locked {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:12.957470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c86dca6-61b4-4098-b14c-4f9ebcdcad58 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 409 len: 107 microversion: 2.1 time: 0.065412 Jul 02 21:15:12.958248 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1661/3374] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:12 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 107 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:15:13.177517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1401764165", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": "none"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:13.339330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:15:13.339758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:15:13.340271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:15:13.340686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:15:13.341091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:15:13.346303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:13.352873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:13.353624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:13.354602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:13.355195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:13.381633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Getting quotas for project 19872a49ec264233a46bd7efb908f2ba. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:15:13.390845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Getting quotas for user ad75c47e5e1f4d3ea6f7643eff6c9e0d and project 19872a49ec264233a46bd7efb908f2ba. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:15:13.409009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:15:13.411237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:15:13.495458 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed74dda3-a88d-45ea-957b-4e76a7c8f188 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.535939 Jul 02 21:15:13.498367 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1662/3375] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:15:13.508813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:13.509433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:13.533613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:13.534959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:13.535630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:13.536304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:14.174768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:14.191243 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5025177b-d40a-4aea-8b77-4f99ea1104c4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1312 microversion: 2.1 time: 0.688844 Jul 02 21:15:14.193121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1663/3376] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:13 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1312 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:14.228928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e606ddc5-ddca-45bf-9195-b052acce8cc2 req-d0d54ce2-f374-4e90-a96c-b15bb425d894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "name": "network-vif-plugged", "status": "completed", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:14.261910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e606ddc5-ddca-45bf-9195-b052acce8cc2 req-d0d54ce2-f374-4e90-a96c-b15bb425d894 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:14.264674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e606ddc5-ddca-45bf-9195-b052acce8cc2 req-d0d54ce2-f374-4e90-a96c-b15bb425d894 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:14.300332 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e606ddc5-ddca-45bf-9195-b052acce8cc2 req-d0d54ce2-f374-4e90-a96c-b15bb425d894 service nova] Creating event network-vif-plugged:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:15:14.310997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e606ddc5-ddca-45bf-9195-b052acce8cc2 req-d0d54ce2-f374-4e90-a96c-b15bb425d894 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111263 Jul 02 21:15:14.312349 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1664/3377] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:14.322902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-19cbd6ae-303b-428e-9f7c-7735d2624091 req-7285bf75-8448-43e8-a3d4-0a9ea1e19a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "fa77338d-8218-440b-9196-cfd58e7c0468"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:14.350172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-19cbd6ae-303b-428e-9f7c-7735d2624091 req-7285bf75-8448-43e8-a3d4-0a9ea1e19a14 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:14.350691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-19cbd6ae-303b-428e-9f7c-7735d2624091 req-7285bf75-8448-43e8-a3d4-0a9ea1e19a14 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:14.374454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-19cbd6ae-303b-428e-9f7c-7735d2624091 req-7285bf75-8448-43e8-a3d4-0a9ea1e19a14 service nova] Creating event network-changed:fa77338d-8218-440b-9196-cfd58e7c0468 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:14.380053 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-19cbd6ae-303b-428e-9f7c-7735d2624091 req-7285bf75-8448-43e8-a3d4-0a9ea1e19a14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062749 Jul 02 21:15:14.381705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1665/3378] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:14.389112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:14.389972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:14.404690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:14.410171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:14.413384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:14.416755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:14.510869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:14.533592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Unlocking {{(pid=131044) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 02 21:15:14.659507 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2f0aa4d-1f0f-421a-855b-1a557892ee55 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.275813 Jul 02 21:15:14.660576 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1666/3379] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:14 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:14.665745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:14.666312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:14.687654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:14.688140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:14.689005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:14.689383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:15.807013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:15.825256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:15.831571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:15.835364 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ab226bd-03f9-4ba1-b0a7-c045e21bd595 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1858 microversion: 2.32 time: 1.173627 Jul 02 21:15:15.838423 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1667/3380] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:14 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1858 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:15.855216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:15.856751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:15.868372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:15.868886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:15.869686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:15.870384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.112342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.135196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.141896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.166474 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f1ece65-424f-4c4b-a445-9cee60f560a6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "PUT /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1417 microversion: 2.75 time: 0.326380 Jul 02 21:15:16.168032 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1668/3381] 10.222.0.43 () {62 vars in 1296 bytes} [Sat Jul 2 21:15:15 2022] PUT /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1417 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:16.172671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:16.173488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:16.196115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.196576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.197365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.197829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.373363 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a85ac833-8007-4b5e-bec7-aa82bbb6428b tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 7.124735 Jul 02 21:15:16.375041 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1714/3382] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:15:09 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 7127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:16.379445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-917b5ec1-98db-4ec4-ac9a-6debaa658b67 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:16.393187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:16.395122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-917b5ec1-98db-4ec4-ac9a-6debaa658b67 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.395599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-917b5ec1-98db-4ec4-ac9a-6debaa658b67 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.450464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-917b5ec1-98db-4ec4-ac9a-6debaa658b67 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Going to try to stop instance {{(pid=131045) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:15:16.538519 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-917b5ec1-98db-4ec4-ac9a-6debaa658b67 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.162735 Jul 02 21:15:16.542187 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1715/3383] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:16 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:16.550413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:16.551151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:16.573140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.573609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.573952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.574421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.575054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.591667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.594332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.597092 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c1ea9e2-c875-4862-b43d-9230182e45c5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.427970 Jul 02 21:15:16.598587 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1669/3384] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:16 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:16.621072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:16.624245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:16.641840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.643626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.644703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.647955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.805903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.823073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.828084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:16.835494 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e39125dd-7a55-4411-abfe-f14351efd35e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1417 microversion: 2.75 time: 0.235517 Jul 02 21:15:16.840128 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1670/3385] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:16 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1417 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:16.853140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.2"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:16.854383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:16.862075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.862678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.863536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:16.864060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:16.891864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Acquired lock "refresh_cache-3229dcfb-12f7-4420-af06-7f3375b9e5a4" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:15:16.995835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:17.017719 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d77fb2fc-dffd-4942-b927-c5018ff0d1c0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.475980 Jul 02 21:15:17.018950 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1716/3386] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:16 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:17.025967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5d9ef251-0f60-42b2-9a7d-e841a7874219 req-b245bd3a-4673-4c9a-985d-034af29193f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "e502bf66-d0a7-4697-9c26-7f5ff4399906"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:17.044416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5d9ef251-0f60-42b2-9a7d-e841a7874219 req-b245bd3a-4673-4c9a-985d-034af29193f5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:17.045872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5d9ef251-0f60-42b2-9a7d-e841a7874219 req-b245bd3a-4673-4c9a-985d-034af29193f5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:17.098248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5d9ef251-0f60-42b2-9a7d-e841a7874219 req-b245bd3a-4673-4c9a-985d-034af29193f5 service nova] Creating event network-changed:e502bf66-d0a7-4697-9c26-7f5ff4399906 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:17.117136 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5d9ef251-0f60-42b2-9a7d-e841a7874219 req-b245bd3a-4673-4c9a-985d-034af29193f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096359 Jul 02 21:15:17.132239 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1717/3387] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:17.142626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:17.143605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:17.155548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:17.156695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:17.157683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:17.158188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:18.305111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:18.315135 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9b2b80d5-c092-4d6b-b8a2-f159428169c6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 1.181277 Jul 02 21:15:18.328430 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1718/3388] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:17 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:18.333773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:18.334662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:18.350223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:18.350682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:18.351476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:18.351914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:19.117074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:19.169477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:19.174701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:19.184566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ec042a5-09d6-443e-8c3e-2cb37e70abf7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.854626 Jul 02 21:15:19.190427 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1719/3389] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:18 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:19.199542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:19.200595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:19.221890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:19.222684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:19.223862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:19.224850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:20.011304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:20.025905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:20.032817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:20.034650 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8edd4202-8a0f-498e-95a6-a395e0838c5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1807 microversion: 2.20 time: 0.842852 Jul 02 21:15:20.038934 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1720/3390] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:19 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1807 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:20.044196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:20.048256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:20.061748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:20.066287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:20.068637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:20.069354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:20.262037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:20.288545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:20.291581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:20.300140 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d68b86ec-ad16-4729-8a38-366c93107759 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1417 microversion: 2.75 time: 0.259599 Jul 02 21:15:20.313750 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1721/3391] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:20 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1417 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:20.320862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:20.321825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:20.336830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:20.337697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:20.338729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:20.339432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:21.170233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:21.181919 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bac4dde2-6d09-4930-8e9e-76c01c3deacc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.865608 Jul 02 21:15:21.193026 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1722/3392] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:20 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:21.212720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "9865bb29-9fe1-41c8-9b51-3fcd651dccfd"}, {"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "a1ebac5d-ae30-4272-8209-39af7edd756f"}, {"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "912378a0-41d0-4582-b82a-6871699c6ef3"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:21.230188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:21.231015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:21.253916 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] Creating event network-changed:9865bb29-9fe1-41c8-9b51-3fcd651dccfd for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:21.255136 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] Creating event network-changed:a1ebac5d-ae30-4272-8209-39af7edd756f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:21.255904 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] Creating event network-changed:912378a0-41d0-4582-b82a-6871699c6ef3 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:21.268697 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-03a8c087-6340-458c-a2e5-d1b57c780c57 req-acb668bd-63b0-4be8-ab6c-7af2e236b3d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.061951 Jul 02 21:15:21.270284 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1723/3393] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:21.275847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:21.278467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:21.287317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:21.288335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:21.289476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:21.290196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:21.910806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:21.938080 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-72eb7de7-9677-413a-8e99-d3328e224638 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.665528 Jul 02 21:15:21.939227 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1724/3394] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:21 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:21.951649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:21.955750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:21.966088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:21.967503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:21.968522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:21.969069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:22.131853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:15:22.664262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:22.679193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:22.680769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:22.681984 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b543efc0-1e8a-4415-8f16-364c97ef3a5f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.740464 Jul 02 21:15:22.690652 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1725/3395] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:21 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:22.699107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:22.699721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:22.723986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:22.724597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:22.725390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:22.726013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:23.314822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:23.323972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:23.356818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:23.358195 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4887cd00-58b2-4b7f-af1b-03012fda9002 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1794 microversion: 2.20 time: 0.665799 Jul 02 21:15:23.359555 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1726/3396] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:22 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1794 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:23.364386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:23.365258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:23.365982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:23.384888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:23.385639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:23.388022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:23.388742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:23.403167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:23.603363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:23.625518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:23.631356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:23.648847 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a17e2c55-ca12-4bb0-8c7f-ba7329c65568 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1438 microversion: 2.75 time: 0.286019 Jul 02 21:15:23.651609 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1727/3397] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:23 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1438 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:23.657965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a9c44e6c-665c-4eb4-b8f1-fb49090b9b72 req-71745d1f-d0da-49ed-be73-5c9e81831cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:23.679634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a9c44e6c-665c-4eb4-b8f1-fb49090b9b72 req-71745d1f-d0da-49ed-be73-5c9e81831cf0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:23.681516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a9c44e6c-665c-4eb4-b8f1-fb49090b9b72 req-71745d1f-d0da-49ed-be73-5c9e81831cf0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:23.697026 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a9c44e6c-665c-4eb4-b8f1-fb49090b9b72 req-71745d1f-d0da-49ed-be73-5c9e81831cf0 service nova] Creating event network-changed:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:15:23.702928 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a9c44e6c-665c-4eb4-b8f1-fb49090b9b72 req-71745d1f-d0da-49ed-be73-5c9e81831cf0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049621 Jul 02 21:15:23.704360 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1728/3398] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:23.710270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:23.711331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:23.718801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:23.719709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:23.720738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:23.721498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:24.609551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:24.621605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c514bf9-3db1-485d-8d4c-018eff9fad11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.914964 Jul 02 21:15:24.622323 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1729/3399] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:23 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:24.685952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Updating instance_info_cache with network_info: [{"id": "b4aa6b0f-0159-4ca2-9324-42c8626890fc", "address": "fa:16:3e:35:5e:aa", "network": {"id": "393da7ac-8cf0-402c-8622-03c330c670fd", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1056671779-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae35822336ca48cd9f497419d0226268", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb4aa6b0f-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:15:24.708914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Releasing lock "refresh_cache-3229dcfb-12f7-4420-af06-7f3375b9e5a4" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:15:24.710581 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0ec0f84-86c2-43e5-bcdf-3a409d267ec4 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action" status: 202 len: 0 microversion: 2.1 time: 7.868874 Jul 02 21:15:24.711364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1671/3400] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:16 2022] POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action => generated 0 bytes in 7871 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:15:24.721466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "tag": "9caff0a5-9604-49f2-a5b4-aa1894bc18aa"}, {"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "7392035b-5277-47d7-afbf-73666c9b1f2f"}, {"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "bd1eb072-75bb-4a9c-98b2-5be5c1f7e968"}, {"name": "network-changed", "server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "tag": "f29402bd-69c0-4143-adac-d3eeaaf5f782"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:24.738857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:24.739316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:24.774727 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Creating event network-changed:9caff0a5-9604-49f2-a5b4-aa1894bc18aa for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:24.776568 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Creating event network-changed:7392035b-5277-47d7-afbf-73666c9b1f2f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:24.778880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Creating event network-changed:bd1eb072-75bb-4a9c-98b2-5be5c1f7e968 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:24.780457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] Creating event network-changed:f29402bd-69c0-4143-adac-d3eeaaf5f782 for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:24.797839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dc7defeb-cc42-45c6-98ad-d9c7f415260a req-6bb275eb-d9d8-4fbb-a389-5f098a36acd7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.083380 Jul 02 21:15:24.799921 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1672/3401] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:24.813360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:24.833849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:24.852121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:24.852839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:24.853877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:24.854542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:24.856908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:24.857607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:24.879114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:24.879579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:24.880430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:24.880877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:24.988272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:15:24.989230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:15:24.993538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:15:24.994517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:15:24.995205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:15:25.135301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:25.142565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:25.143279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:25.144995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:25.145546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:25.341936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:25.352265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:25.355181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:25.361193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f4ca81f-6d6b-45f4-b02e-6603b06312ac tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "POST /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e/action" status: 202 len: 1495 microversion: 2.75 time: 0.559566 Jul 02 21:15:25.362098 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1673/3402] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:15:24 2022] POST /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e/action => generated 1495 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 02 21:15:25.377566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:25.379039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:25.387381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:25.387960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:25.388896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:25.389609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:25.405389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:25.418286 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1f397fb-eb86-4dfb-8bb1-20f38500a474 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.783765 Jul 02 21:15:25.420410 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1730/3403] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:24 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:25.428267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.2"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:25.945852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:25.958683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:25.960358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:25.961181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:25.961624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:26.004862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:26.028532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:26.030863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:26.032540 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d342abe1-bff1-4c79-ba88-644e40a474c1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.669423 Jul 02 21:15:26.033319 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1674/3404] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:25 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:26.045929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:26.046872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:26.057087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:26.057612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:26.058425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:26.058865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:26.287012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:26.308625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:26.310648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:26.319655 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-483694b8-a472-48df-9458-b9ed10310e9a tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.284993 Jul 02 21:15:26.321527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1675/3405] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:26 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:26.327344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:26.328405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:26.337897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:26.343991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:26.346668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:26.347585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:26.914863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Acquired lock "refresh_cache-3229dcfb-12f7-4420-af06-7f3375b9e5a4" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:15:27.463219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:27.473628 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dbd9290-91f3-4f02-b25b-a086d1baa857 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 1.150696 Jul 02 21:15:27.484557 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1676/3406] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:26 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:27.559179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-581098868", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "40fd9bde-b481-47cc-b5b9-8c3fb6c0e0d1"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:27.623458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] validate_networks() for [('40fd9bde-b481-47cc-b5b9-8c3fb6c0e0d1', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:15:29.238733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:15:29.240546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:15:29.241199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:15:29.241819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:15:29.242434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:15:29.258865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:29.259838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:29.260882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:29.261510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:29.281445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Getting quotas for project d505023bb41e4c7cb4f65f6ff69c121e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:15:29.287016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Getting quotas for user af79a7ef254d4df1806f6b5c2f91a4c3 and project d505023bb41e4c7cb4f65f6ff69c121e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:15:29.299868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:15:29.302434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:15:29.349657 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08c03283-c4a1-496c-8af1-e29fa1941db1 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868502 Jul 02 21:15:29.350295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1677/3407] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:15:29.355096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:29.355946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:29.362367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:29.362811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:29.363578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:29.364008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:30.143920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:30.180360 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68c515f9-8761-482f-9e00-5412b5cb6c08 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1658 microversion: 2.1 time: 0.826611 Jul 02 21:15:30.181762 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1678/3408] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:29 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1658 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:30.187935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:30.188840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:30.199253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:30.199799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:30.200787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:30.201292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:30.221053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:30.250311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:15:30.741411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:30.768434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:30.785167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:30.787825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f572e547-1017-4d41-9e79-c1c91f1a1287 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.604759 Jul 02 21:15:30.795313 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1679/3409] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:30 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:30.807785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e035243c-fea0-454e-8516-7fe6475f71a6 req-764595cc-c832-42e7-a677-f369aaae0419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "tag": "4fb8598a-bdb7-46ea-8d5d-a5e0978f1bba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:30.845563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e035243c-fea0-454e-8516-7fe6475f71a6 req-764595cc-c832-42e7-a677-f369aaae0419 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:30.846279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e035243c-fea0-454e-8516-7fe6475f71a6 req-764595cc-c832-42e7-a677-f369aaae0419 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:30.883336 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e035243c-fea0-454e-8516-7fe6475f71a6 req-764595cc-c832-42e7-a677-f369aaae0419 service nova] Creating event network-changed:4fb8598a-bdb7-46ea-8d5d-a5e0978f1bba for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:30.892471 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e035243c-fea0-454e-8516-7fe6475f71a6 req-764595cc-c832-42e7-a677-f369aaae0419 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095162 Jul 02 21:15:30.895468 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1680/3410] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:30.910276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:30.911471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:30.922352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:30.923976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:30.925836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:30.926455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.092724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:31.109115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:31.111314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:31.118019 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8f3db5d-397b-44bd-9971-167cdc00fdea tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.221021 Jul 02 21:15:31.119359 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1681/3411] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:30 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:31.124669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:31.125552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:31.132513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.133441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.134473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.135191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.622304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:31.636991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05e3255a-d9ad-44d4-8047-caaf87864bb6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.515976 Jul 02 21:15:31.637587 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1682/3412] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:31 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:31.646810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:31.647578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:31.659843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.660398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.664221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.664861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.767434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:31.775528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Updating instance_info_cache with network_info: [{"id": "b4aa6b0f-0159-4ca2-9324-42c8626890fc", "address": "fa:16:3e:35:5e:aa", "network": {"id": "393da7ac-8cf0-402c-8622-03c330c670fd", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1056671779-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ae35822336ca48cd9f497419d0226268", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb4aa6b0f-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:15:31.783916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:31.797268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Releasing lock "refresh_cache-3229dcfb-12f7-4420-af06-7f3375b9e5a4" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:15:31.798164 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc743f0e-2a0d-4cc5-9e5b-3bfd724b84a6 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action" status: 202 len: 0 microversion: 2.1 time: 6.375405 Jul 02 21:15:31.798935 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1731/3413] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:25 2022] POST /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4/action => generated 0 bytes in 6377 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:15:31.804618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4104a9de-2d4d-4104-bf40-890720287a81 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:31.806307 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99aa9015-0395-4de4-8d4b-575e7e840eaa tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1273 microversion: 2.1 time: 0.167469 Jul 02 21:15:31.808606 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1683/3414] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:31 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:31.813661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0a0c7274-37ff-40a3-8232-86fbf43fe70f req-86b44568-9de6-4029-9d48-564c9502d544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:31.828304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a0c7274-37ff-40a3-8232-86fbf43fe70f req-86b44568-9de6-4029-9d48-564c9502d544 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.828750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a0c7274-37ff-40a3-8232-86fbf43fe70f req-86b44568-9de6-4029-9d48-564c9502d544 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.831430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4104a9de-2d4d-4104-bf40-890720287a81 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.831916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4104a9de-2d4d-4104-bf40-890720287a81 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.846743 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0a0c7274-37ff-40a3-8232-86fbf43fe70f req-86b44568-9de6-4029-9d48-564c9502d544 service nova] Creating event network-changed:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:15:31.854044 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0a0c7274-37ff-40a3-8232-86fbf43fe70f req-86b44568-9de6-4029-9d48-564c9502d544 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043077 Jul 02 21:15:31.855445 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1684/3415] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:31.874174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18625bfc-55cd-4d10-82e7-e92653109cbb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '.version_select at 0x7fabd78d3e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:31.891074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4104a9de-2d4d-4104-bf40-890720287a81 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Going to try to start instance {{(pid=131045) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 21:15:31.958328 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4104a9de-2d4d-4104-bf40-890720287a81 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.157853 Jul 02 21:15:31.960620 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1732/3416] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:31 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:31.969224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:31.971089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:31.981604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.982280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:31.983511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:31.984345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:32.419553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:32.434125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:32.435643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:32.436878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27f90b6e-13cc-4cc8-95c8-071203fdff64 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.474559 Jul 02 21:15:32.437450 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1733/3417] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:31 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:32.443154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:32.443965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:32.451341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:32.452216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:32.453006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:32.453450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:33.339891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:33.349036 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-01300557-4524-4ffe-bd09-1668248a92b1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1667 microversion: 2.1 time: 0.910125 Jul 02 21:15:33.349862 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1734/3418] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:32 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1667 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:33.355143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:33.355750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:33.362221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:33.362682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:33.363422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:33.364647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:33.483662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:33.492863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:33.494437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:33.499790 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93bd6c6c-b217-4ac2-8092-a7c91f05054c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.148563 Jul 02 21:15:33.500430 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1735/3419] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:33 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:33.505255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:33.506240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:33.513083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:33.513789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:33.514892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:33.515313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:33.941819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:33.950404 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-36f977fc-1a79-46f3-a241-4bc6dea0ec2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.448651 Jul 02 21:15:33.960875 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1736/3420] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:33 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:33.966002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:33.966810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:33.977509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:33.980616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:33.981616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:33.982256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:34.389491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:34.397508 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3bc2e863-4829-4d4d-ad87-06bcbfff6df4 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.435220 Jul 02 21:15:34.398114 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1737/3421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:33 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:34.407735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:34.415586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:34.432020 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18625bfc-55cd-4d10-82e7-e92653109cbb tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/47898c27-db1b-4270-a0ef-18795858ac4e" status: 202 len: 0 microversion: 2.1 time: 2.574850 Jul 02 21:15:34.432722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:34.432929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:34.433707 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1685/3422] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:15:31 2022] DELETE /compute/v2.1/os-floating-ips/47898c27-db1b-4270-a0ef-18795858ac4e => generated 0 bytes in 2578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:34.439747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:34.439747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:34.446592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:34.447677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:34.456453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:34.457173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:34.458155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:34.458789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.146181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.148551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.161083 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a335d63a-95eb-466e-9b1a-f6a01807772b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1667 microversion: 2.1 time: 0.719434 Jul 02 21:15:35.161935 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1686/3423] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:34 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1667 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:35.172128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b96ca925-c699-4cb3-bc34-87256ef42ada tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '.version_select at 0x7fabe4040550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:35.176692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.179835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.181519 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6d8f36a2-ab5c-49c6-8e01-337e1d9ab42e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.782457 Jul 02 21:15:35.183530 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1738/3424] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:34 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:35.190613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:35.192361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:35.204545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.205164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.206230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.207674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.356661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.372938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.374999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.387566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5f73f01-5681-462d-b50e-1aeeca3afc23 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.202561 Jul 02 21:15:35.388211 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1739/3425] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:35 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:35.393173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1ee29740-722b-4f35-b769-bbc1e156f637 req-53ee442e-872f-470c-8ead-f74e5e3107ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb82cc53-151c-482b-8731-8fa0bc4a8cb6", "tag": "f709d744-c838-47b5-a9ec-f3f7b2eede00"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:35.404080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1ee29740-722b-4f35-b769-bbc1e156f637 req-53ee442e-872f-470c-8ead-f74e5e3107ee service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.404634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1ee29740-722b-4f35-b769-bbc1e156f637 req-53ee442e-872f-470c-8ead-f74e5e3107ee service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.423673 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1ee29740-722b-4f35-b769-bbc1e156f637 req-53ee442e-872f-470c-8ead-f74e5e3107ee service nova] Creating event network-changed:f709d744-c838-47b5-a9ec-f3f7b2eede00 for instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 on nch2-master-1 Jul 02 21:15:35.438708 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1ee29740-722b-4f35-b769-bbc1e156f637 req-53ee442e-872f-470c-8ead-f74e5e3107ee service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049108 Jul 02 21:15:35.440079 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1740/3426] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:35.445630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:35.446642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:35.454284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.454967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.455928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.456559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.714627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.726414 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9ea6b41c-fbad-443e-8221-2ebfbd2d8d41 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.284365 Jul 02 21:15:35.727872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1741/3427] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:35 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:35.759000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:35.761490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:35.773407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.774184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.775968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.776738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.818275 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b96ca925-c699-4cb3-bc34-87256ef42ada tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "DELETE /compute/v2.1/os-security-groups/5d11c719-23ab-4a72-8808-2cb59e78b9e8" status: 202 len: 0 microversion: 2.1 time: 0.652550 Jul 02 21:15:35.819818 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1687/3428] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:15:35 2022] DELETE /compute/v2.1/os-security-groups/5d11c719-23ab-4a72-8808-2cb59e78b9e8 => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:35.827653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:35.828558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:35.835958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.839128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.842882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:35.843380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:35.918561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:15:35.979316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:35.987757 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ad19a45-265e-410e-b87e-93fd56b08620 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.257077 Jul 02 21:15:35.988378 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1742/3429] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:35 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:36.019187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2f1f85f-e93f-4e01-b198-3355c3033dc2 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 204 len: 0 microversion: 2.1 time: 0.195059 Jul 02 21:15:36.020853 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1688/3430] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:15:35 2022] DELETE /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:15:36.028812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.029754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.036846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.037409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.038366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.038807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.180784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.181501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.198126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.198628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.199461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.199895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.251418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.261638 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-decb912c-8da9-489d-b381-9747c4613289 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1509 microversion: 2.1 time: 0.235754 Jul 02 21:15:36.261638 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1743/3431] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:36.266618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.267405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.275909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.276403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.277288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.277802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.436452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.445441 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c9cc6504-c206-402b-918f-62d18ca0a5a8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.270141 Jul 02 21:15:36.446315 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1689/3432] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:36.452549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.453354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.459764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.460525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.461779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.462226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.501551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.515322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.516876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.518337 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0fe67fc3-2481-4958-9408-defbacc78ad8 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.255731 Jul 02 21:15:36.519076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1744/3433] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:36.523635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.524266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.530796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.531249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.532029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.532490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.541201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.550875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.552626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.556936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:36.559759 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f518022-cd90-4c6b-8fa9-cce58586acbf tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.112306 Jul 02 21:15:36.560683 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1690/3434] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:36.679276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.687580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3a597f6d-b99d-4cd6-8151-8c55e46b135d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.167433 Jul 02 21:15:36.688245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1745/3435] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:36.704184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:36.704821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.711857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.712444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.713402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.713908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.744272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.744964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.752460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.752706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.753497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.753938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.761196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Unlocking {{(pid=131044) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 02 21:15:36.821826 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbff753c-3aed-461c-9501-f500c83de3a7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.121031 Jul 02 21:15:36.822900 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1691/3436] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:36 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:36.833044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:36.833765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:36.840031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.840616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.841444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:36.842116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:36.975555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:36.983496 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-53570363-9410-4a0f-9b59-5a65db6e191a tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.243295 Jul 02 21:15:36.993866 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1746/3437] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:37.006230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.007234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.013853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.014418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.015295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.016157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.033918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.044459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca2aa93c-3524-43e6-b310-25488f3b9aad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.214995 Jul 02 21:15:37.045601 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1692/3438] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:36 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:37.062139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.062844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.070577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.071812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.072673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.073123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.221156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.229714 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78359478-683a-4d30-84ef-40936a7d1e7a tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.227497 Jul 02 21:15:37.230625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1747/3439] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:37.258298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.266015 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e795ee12-7728-4b88-a465-3286bae0dfbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.207955 Jul 02 21:15:37.266578 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1693/3440] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:37.277574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.278193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.284772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.285223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.286003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.286440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.288969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.289798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.291662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:37.298478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.298927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.299706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.300343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.544822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.556624 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6aae87bc-1028-4785-a843-69627b34fc51 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1509 microversion: 2.1 time: 0.282852 Jul 02 21:15:37.557683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1748/3441] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:37.562390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.563143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.564083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.574164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.574992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.576095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.576735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.577980 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9950ad5-c879-4690-9fe6-236a76bc4f3b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.292748 Jul 02 21:15:37.581065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1694/3442] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:37.585975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.586631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.611349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.611841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.613176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.614392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.621425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:37.731155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.743194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.745435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.751439 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e5984a7-087b-4b6f-9c0e-398030f6d102 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.169273 Jul 02 21:15:37.752756 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1695/3443] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:37.758010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:37.758706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.774708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.775576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.776584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.778436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.860986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.870984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.872597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:37.874170 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-662ae784-18d9-46a4-9059-978c137bb3d2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.315260 Jul 02 21:15:37.885414 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b5ae7b1b-80c5-41f7-99e3-67f5a330ea9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.127931 Jul 02 21:15:37.885414 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1696/3444] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:37 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:37.886900 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1749/3445] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:37.891532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-af936a67-12d3-40c9-a30b-9bde75cd07c5 req-e66b6e06-93a0-49bf-a57f-33e39a29e51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "name": "network-vif-plugged", "status": "completed", "tag": "9caff0a5-9604-49f2-a5b4-aa1894bc18aa"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:37.892215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:37.893025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:37.900157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.900866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.901827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.902428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.904914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-af936a67-12d3-40c9-a30b-9bde75cd07c5 req-e66b6e06-93a0-49bf-a57f-33e39a29e51e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:37.906095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-af936a67-12d3-40c9-a30b-9bde75cd07c5 req-e66b6e06-93a0-49bf-a57f-33e39a29e51e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:37.929389 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-af936a67-12d3-40c9-a30b-9bde75cd07c5 req-e66b6e06-93a0-49bf-a57f-33e39a29e51e service nova] Creating event network-vif-plugged:9caff0a5-9604-49f2-a5b4-aa1894bc18aa for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:37.935850 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-af936a67-12d3-40c9-a30b-9bde75cd07c5 req-e66b6e06-93a0-49bf-a57f-33e39a29e51e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051035 Jul 02 21:15:37.938114 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1697/3446] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:38.002098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:38.002910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:38.010479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.011113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.012186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.012718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.121854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.130056 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-588d705e-4ae1-467b-a6cb-f53552778462 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1676 microversion: 2.1 time: 0.241849 Jul 02 21:15:38.148071 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1750/3447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1676 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:38.206324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.214773 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7db6bca9-a33d-47b8-9973-4204aca28326 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.217623 Jul 02 21:15:38.215636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1698/3448] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:37 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:38.247294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:38.248137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:38.266398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.268495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.269543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.270453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.417325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.425542 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4de97947-3c09-44eb-a21c-d92bf75ea13f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.182667 Jul 02 21:15:38.435872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1751/3449] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:38 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:38.574213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:38.574923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:38.582375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.582842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.583629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.584226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.774843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:38.777191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:38.787917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.788984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.790186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.790802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.903448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.905838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.922289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c53c398-ba3b-4fa8-ad10-bb5a99cb6484 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1509 microversion: 2.1 time: 0.352105 Jul 02 21:15:38.923342 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1699/3450] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:38 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:38.929487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:38.931257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.933540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:38.944315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:38.948158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.948611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.949391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:38.950013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:38.962890 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76565d6c-2dc5-4646-891e-5e5d6fedba37 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.195013 Jul 02 21:15:38.973278 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1752/3451] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:38 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:15:39.148029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:39.149139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:39.155555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:39.156461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:39.157730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:39.158407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:39.272612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:39.295402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:39.721691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:39.732573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:39.734843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:39.737109 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b38b031-9876-460a-8ccb-b26707650cf6 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.812418 Jul 02 21:15:39.749914 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1700/3452] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:38 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:39.757972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:39.759054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:39.775118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:39.785839 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6b88678c-5913-45ad-a7f4-21c8f6a56564 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1656 microversion: 2.1 time: 0.641746 Jul 02 21:15:39.786455 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1753/3453] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:39 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1656 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:39.788117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:39.788580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:39.789582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:39.791756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:39.793488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:39.794119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:39.805174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:39.805631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:39.806413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:39.806853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.061918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.074292 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-204f64a6-8363-444e-ab55-73b095e54afd tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.285952 Jul 02 21:15:40.075551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.076205 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1754/3454] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:39 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:40.082027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:40.083378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:40.087874 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40a3e7ce-a8ca-423c-92ad-525ce3ae24bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.334268 Jul 02 21:15:40.089453 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1701/3455] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:39 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:40.091670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.092441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.093971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.094622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:40.095064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.095478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:40.119105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.119722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.126233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.127019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.207538 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d8919aea-f615-49d2-af0b-cfb5366a64db tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.129059 Jul 02 21:15:40.214220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1755/3456] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:15:40 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:15:40.222460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:40.223440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:40.245729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.246503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.247574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.248237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.250031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da701099fee44f03824febc2034358fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae35822336ca48cd9f497419d0226268', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.279308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0984d4e-d618-4677-a995-8b1fe7356863 tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 200 len: 1467 microversion: 2.1 time: 0.188479 Jul 02 21:15:40.284357 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1702/3457] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:40 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 1467 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:40.297144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-35562883-6cb8-40f8-a50b-d5932c61c500 req-f9dbed9d-e5c5-42aa-9d2f-e948cc633503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "name": "network-vif-plugged", "status": "completed", "tag": "f29402bd-69c0-4143-adac-d3eeaaf5f782"}, {"server_uuid": "fb82cc53-151c-482b-8731-8fa0bc4a8cb6", "name": "network-vif-plugged", "status": "completed", "tag": "f709d744-c838-47b5-a9ec-f3f7b2eede00"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:40.313397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-35562883-6cb8-40f8-a50b-d5932c61c500 req-f9dbed9d-e5c5-42aa-9d2f-e948cc633503 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.314379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-35562883-6cb8-40f8-a50b-d5932c61c500 req-f9dbed9d-e5c5-42aa-9d2f-e948cc633503 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.340551 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-35562883-6cb8-40f8-a50b-d5932c61c500 req-f9dbed9d-e5c5-42aa-9d2f-e948cc633503 service nova] Creating event network-vif-plugged:f29402bd-69c0-4143-adac-d3eeaaf5f782 for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:40.341072 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-35562883-6cb8-40f8-a50b-d5932c61c500 req-f9dbed9d-e5c5-42aa-9d2f-e948cc633503 service nova] Creating event network-vif-plugged:f709d744-c838-47b5-a9ec-f3f7b2eede00 for instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 on nch2-master-1 Jul 02 21:15:40.352767 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-35562883-6cb8-40f8-a50b-d5932c61c500 req-f9dbed9d-e5c5-42aa-9d2f-e948cc633503 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.066616 Jul 02 21:15:40.354591 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1703/3458] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:40.363023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:40.364021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:40.378848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.379680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.380365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.381654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.382075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.388917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.390486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.396310 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c10fd695-1c3c-486d-9d98-0b277ea7f97e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.180453 Jul 02 21:15:40.397371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1756/3459] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:40 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:40.445339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-35399af2-0061-4d87-a93e-73b18c8fa08c req-a2a975a7-9b6e-42e9-a26b-09618caf8e46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3229dcfb-12f7-4420-af06-7f3375b9e5a4", "name": "network-vif-deleted", "tag": "b4aa6b0f-0159-4ca2-9324-42c8626890fc"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:40.460331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-35399af2-0061-4d87-a93e-73b18c8fa08c req-a2a975a7-9b6e-42e9-a26b-09618caf8e46 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.460926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-35399af2-0061-4d87-a93e-73b18c8fa08c req-a2a975a7-9b6e-42e9-a26b-09618caf8e46 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.472930 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-35399af2-0061-4d87-a93e-73b18c8fa08c req-a2a975a7-9b6e-42e9-a26b-09618caf8e46 service nova] Creating event network-vif-deleted:b4aa6b0f-0159-4ca2-9324-42c8626890fc for instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 on nch2-master-1 Jul 02 21:15:40.481807 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-35399af2-0061-4d87-a93e-73b18c8fa08c req-a2a975a7-9b6e-42e9-a26b-09618caf8e46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040254 Jul 02 21:15:40.482560 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1757/3460] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:15:40.612149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.625402 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9fea2d2-0e47-48a2-b9fe-65fe726fdcb9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1663 microversion: 2.1 time: 0.268697 Jul 02 21:15:40.626277 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1704/3461] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:40 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1663 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:40.758551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:40.759298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:40.765863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.766319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.767151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:40.767585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:40.950763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.960335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.961878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:40.963050 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9c78624b-1433-44a3-bc17-91f09eb87e17 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.208891 Jul 02 21:15:40.963604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1758/3462] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:40 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:41.097567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.098158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.105352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.106488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.107277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.107720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.112515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.114343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.119989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:41.125553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.126439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.127308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.127811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.333173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:41.337280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:41.342762 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6307dfcf-ad59-4e67-aaff-8fdc8a4257a2 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.255728 Jul 02 21:15:41.345873 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9b3ff91-539a-4489-8ca7-67ccf170c3a6 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.244059 Jul 02 21:15:41.346449 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1759/3463] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:41.351316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.351911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] [instance: 3229dcfb-12f7-4420-af06-7f3375b9e5a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.353055 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1705/3464] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:41.357922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.358366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.359135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.359570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.373157 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] HTTP exception thrown: Instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 could not be found. Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Request method failure captured: Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 HTTP/1.1 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLUX-21EVn5VdK2auUt2_j9BXJswNMEhICpI3L0ujL93-8HamLzXnrDy2BHChTE08ndpotqdMm3LpScFd-MosnY0apYAJiMEPLLVLR3GtnFRnqWNgq7omzer9XTb08Ui2s8_ap8DeGMCDL5KZkt2Uqu0CVBVI23l1OjvY4nJotudtQg Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ae35822336ca48cd9f497419d0226268 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-425496895 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ae35822336ca48cd9f497419d0226268"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ae35822336ca48cd9f497419d0226268", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ae35822336ca48cd9f497419d0226268"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ae35822336ca48cd9f497419d0226268"}]}] Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-425496895 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ae35822336ca48cd9f497419d0226268 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-425496895 Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerRescueTestJSONUnderV235-425496895-project Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: da701099fee44f03824febc2034358fa Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-425496895-project Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 could not be found. Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '3229dcfb-12f7-4420-af06-7f3375b9e5a4'} Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 could not be found. Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 could not be found. Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:41.374837 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 could not be found. Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] Returning 404 to user: Instance 3229dcfb-12f7-4420-af06-7f3375b9e5a4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-02c270d2-1d12-49fc-a79d-780e9a492e1f tempest-ServerRescueTestJSONUnderV235-425496895 tempest-ServerRescueTestJSONUnderV235-425496895-project] 10.222.0.43 "GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4" status: 404 len: 111 microversion: 2.1 time: 0.028690 Jul 02 21:15:41.379768 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1760/3465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/3229dcfb-12f7-4420-af06-7f3375b9e5a4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:15:41.416979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.417675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.424126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.424581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.425387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.425859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.492111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:41.500926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:41.502518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:41.507730 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9946848-41c3-48b7-bcbd-dfd5e68cf741 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.094717 Jul 02 21:15:41.508347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1706/3466] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:41.644267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.645166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.652005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.652808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.653670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.654263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.893680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:41.901549 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab2b26ea-75a0-4809-90c0-71fd6e5d3ae0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.262547 Jul 02 21:15:41.902299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1761/3467] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:41.918102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.918718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.925427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.925877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.926648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.927093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.982508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:41.983444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:41.991466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.993417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:41.995899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:41.996575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.104798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.115520 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d24c1b3-8df1-43ee-bec2-99bc8169be24 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.201106 Jul 02 21:15:42.116597 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1707/3468] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:42.135157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:42.135794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:42.142482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.142941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.143724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.144288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.267248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.278652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.280516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.282158 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2db962e-8e5a-4198-9c50-6e71fd44dbaf tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.305053 Jul 02 21:15:42.283239 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1762/3469] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:41 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:42.311665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.319770 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ae19af3-1244-479f-a941-6d02a3800049 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.188600 Jul 02 21:15:42.320396 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1708/3470] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:42 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:42.337083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:42.338031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:42.351555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.352709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.353756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.354192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.364285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:42.365282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:42.385457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.385885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.386693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.387392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.557786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.567371 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-88eddf35-294e-44e2-8745-796cdab70a65 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.235196 Jul 02 21:15:42.568238 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1763/3471] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:42 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:42.572875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:42.573488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:42.580265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.580733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.581538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.581963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.593369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.602560 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb2e3146-0a88-4564-992b-811311697373 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1315 microversion: 2.1 time: 0.245797 Jul 02 21:15:42.604163 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1709/3472] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:42 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:42.608436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7a0b1caa-8a2e-4172-afda-cb4640aed32d req-85e88cc3-c155-414f-9f69-dad6f3f242bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "name": "network-vif-plugged", "status": "completed", "tag": "4fb8598a-bdb7-46ea-8d5d-a5e0978f1bba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:42.617389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7a0b1caa-8a2e-4172-afda-cb4640aed32d req-85e88cc3-c155-414f-9f69-dad6f3f242bf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.617987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7a0b1caa-8a2e-4172-afda-cb4640aed32d req-85e88cc3-c155-414f-9f69-dad6f3f242bf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.633897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7a0b1caa-8a2e-4172-afda-cb4640aed32d req-85e88cc3-c155-414f-9f69-dad6f3f242bf service nova] Creating event network-vif-plugged:4fb8598a-bdb7-46ea-8d5d-a5e0978f1bba for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:42.639509 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7a0b1caa-8a2e-4172-afda-cb4640aed32d req-85e88cc3-c155-414f-9f69-dad6f3f242bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034977 Jul 02 21:15:42.640554 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1710/3473] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:42.646369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:42.647683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:42.655009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.655856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.656800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.657357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.741881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.751080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.754332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.762809 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05775b6d-0eac-4d48-85aa-cd80b492a19c tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.121154 Jul 02 21:15:42.776427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:42.777964 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1711/3474] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:42 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:42.785933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:42.786747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:42.789784 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5007e9f6-73b4-495d-abb0-71ae8ce292ba tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.220631 Jul 02 21:15:42.790625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1764/3475] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:42 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:42.800423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.801443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:42.802420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:42.802956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.044352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.048411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:43.053582 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9176ebfc-c192-4ebf-a699-bf996dcb7c48 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.271528 Jul 02 21:15:43.054325 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1712/3476] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:42 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:43.069762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:43.070341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:43.076904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.077574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.078538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.079148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.083750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:43.275805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.283576 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ab5b97a-8ebc-4790-848e-358707cbb7cd tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.217703 Jul 02 21:15:43.284191 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1765/3477] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:43 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:43.302278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:43.302822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:43.310131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.310660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.311504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.311885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.545565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.555396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.556902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.558072 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-383aff5c-0345-4eb3-b5cf-700ea6080689 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.260550 Jul 02 21:15:43.558852 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1713/3478] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:43 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:43.619998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:43.620659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:43.628480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.628944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.629729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.630170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.783240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:43.783845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:43.790304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.791031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.791649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.792082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.892420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.899023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.900241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b34085bf-03e3-41d3-b80f-d87285c3a070 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1502 microversion: 2.1 time: 0.284090 Jul 02 21:15:43.911918 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1766/3479] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:43 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:43.912157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.912157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:43.912434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:43.912434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:43.917502 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ce1e9f1-97b0-47fb-94ee-b8766f7388ab tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.138332 Jul 02 21:15:43.918199 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1714/3480] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:43 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:15:43.923200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:43.923388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.923685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.923799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:43.924491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.924927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.931472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.931718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:43.932799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:43.933306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.032328 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f84120fd-cd80-47d1-a085-bc6a53c551b9 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.111858 Jul 02 21:15:44.033013 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1715/3481] 10.222.0.43 () {58 vars in 1295 bytes} [Sat Jul 2 21:15:43 2022] DELETE /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6/os-server-password => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:15:44.044767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:44.045547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:44.054380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.055219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.057311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.057940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.099646 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ffe111d-52ec-491a-ae65-3bdcc9474ba3 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.060376 Jul 02 21:15:44.100765 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1716/3482] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:15:44 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6/os-server-password => generated 16 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:15:44.111610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:44.112967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:44.125918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.128068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.129837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.130739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.170771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:15:44.205136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:44.213467 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-272d6903-94bb-49cb-b9fe-82d05c4dde24 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1354 microversion: 2.1 time: 0.311593 Jul 02 21:15:44.214060 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1767/3483] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:43 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1354 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:44.306733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da332d17-5223-4d34-8cd0-b3fbf220430f tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 204 len: 0 microversion: 2.1 time: 0.199303 Jul 02 21:15:44.310857 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1717/3484] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:15:44 2022] DELETE /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:15:44.318412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:44.319124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:44.333770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.334217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.335275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.335713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.578638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:44.579713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:44.584840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:44.587903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.589177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.590175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.591572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.596779 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-adb334e8-e9e6-4e9c-ad76-7d9c8dc685a8 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1508 microversion: 2.1 time: 0.284302 Jul 02 21:15:44.597708 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1768/3485] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:44 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:44.940786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:44.947211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:44.948983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:44.969695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.972192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.973894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:44.974589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:44.975263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:44.979128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:44.981575 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5da5bacf-9f42-4c81-abc3-9ec01e5992e1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.407849 Jul 02 21:15:44.984967 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1718/3486] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:44 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:45.166913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:45.169549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:45.180070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:45.189911 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f10ffc5e-3ab6-4a92-84aa-2d4e293c1c91 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.252539 Jul 02 21:15:45.191637 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1769/3487] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:44 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:45.231728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:45.232380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:45.239988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.240703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.241684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.242290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.458571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:45.468193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70c69370-97de-4386-8dad-2098e56c7666 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1805 microversion: 2.1 time: 0.241404 Jul 02 21:15:45.472821 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1719/3488] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:45 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1805 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:45.488313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:45.489466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:45.496761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.497493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.498506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.499101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.547573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a50fc0d9-8362-4bf1-a6fc-f7aa535c4b11 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2/ips" status: 200 len: 219 microversion: 2.1 time: 0.064394 Jul 02 21:15:45.551260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1770/3489] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:15:45 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2/ips => generated 219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:45.562334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:45.563172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:45.570874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.571696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.572638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.573251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.614148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:45.614758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:45.622016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:15:45.624536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.627232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.629560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.631746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.790661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d492c5bf-1215-4bff-b92f-517b33460204 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 204 len: 0 microversion: 2.1 time: 0.231740 Jul 02 21:15:45.794761 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1720/3490] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:15:45 2022] DELETE /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:15:45.801706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:45.802681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:45.813657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.814413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.815699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:45.816240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:45.843440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:45.853836 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-90c8f1b5-285a-419d-931e-ba008b570653 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1508 microversion: 2.1 time: 0.243153 Jul 02 21:15:45.864624 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1771/3491] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:45 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:46.004654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:46.006987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:46.017652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:46.018466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:46.020224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:46.020930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:46.196314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.214938 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b71793cf-06cd-4da8-a6fc-3edf64ae981f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1811 microversion: 2.1 time: 0.410748 Jul 02 21:15:46.215979 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1721/3492] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:45 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1811 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:46.225542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:46.225542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:46.241968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:46.243190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:46.244110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:46.244586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:46.508647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.535349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.546559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.567101 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73f11725-e636-4676-9865-c18fc5fb634b tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.346713 Jul 02 21:15:46.571230 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1722/3493] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:46 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:46.607960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.627045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.629492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:46.631681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7b20b1fb-5876-48a7-a49b-0335dec4d257 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.631431 Jul 02 21:15:46.648622 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1772/3494] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:45 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:15:46.871753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:46.872907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:46.885362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:46.886320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:46.887329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:46.888995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.116055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:47.144695 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4436342-7c42-42a7-b649-832f8d152155 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1508 microversion: 2.1 time: 0.277267 Jul 02 21:15:47.146213 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1723/3495] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:46 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:47.234793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:47.235855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:47.254491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.256468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.257672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.258487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.272671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b25803e-cd27-4ad9-bc4b-7c9d5ede77bf req-49e458cc-312b-491e-9f03-a093115d4d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb82cc53-151c-482b-8731-8fa0bc4a8cb6", "name": "network-vif-deleted", "tag": "f709d744-c838-47b5-a9ec-f3f7b2eede00"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:47.310693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b25803e-cd27-4ad9-bc4b-7c9d5ede77bf req-49e458cc-312b-491e-9f03-a093115d4d0a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.311981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b25803e-cd27-4ad9-bc4b-7c9d5ede77bf req-49e458cc-312b-491e-9f03-a093115d4d0a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.368393 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b25803e-cd27-4ad9-bc4b-7c9d5ede77bf req-49e458cc-312b-491e-9f03-a093115d4d0a service nova] Creating event network-vif-deleted:f709d744-c838-47b5-a9ec-f3f7b2eede00 for instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 on nch2-master-1 Jul 02 21:15:47.387335 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b25803e-cd27-4ad9-bc4b-7c9d5ede77bf req-49e458cc-312b-491e-9f03-a093115d4d0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120362 Jul 02 21:15:47.394484 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1724/3496] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:47.547794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:47.556292 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e71dcc2e-8680-49d7-9328-146611e7bab0 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1811 microversion: 2.1 time: 0.326278 Jul 02 21:15:47.557100 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1773/3497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:47 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1811 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:47.591028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:47.591799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:47.598680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.599218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.600005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.600617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.663253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:47.663873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:47.671707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.672388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.688652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:47.698128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:47.701105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:47.703142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:47.707900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:47.709190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:47.713523 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1bd0b91d-8ab7-4d84-8638-c14d4bb5cbfa tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.126288 Jul 02 21:15:47.714469 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1725/3498] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:47 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:48.080627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:48.092368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:48.096756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:48.098461 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d5f3187-d904-4b37-a4ae-4007b39c058a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.439159 Jul 02 21:15:48.099794 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1774/3499] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:47 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:15:48.166871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:48.167616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:48.181967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.182486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.188327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.188969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.235799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.236442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.237108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lazy-loading 'fault' on Instance uuid fb82cc53-151c-482b-8731-8fa0bc4a8cb6 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:15:48.340092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af79a7ef254d4df1806f6b5c2f91a4c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd505023bb41e4c7cb4f65f6ff69c121e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:48.349210 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08417c5b-3920-439d-a5a1-9ddf64abad6b tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 200 len: 1305 microversion: 2.1 time: 0.190246 Jul 02 21:15:48.351525 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1726/3500] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:48 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 1305 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:48.554039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c64ed9f9-f091-415c-9b24-569e6dc4dbf4 tempest-ExtensionsTest-1483424554 tempest-ExtensionsTest-1483424554-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:48.555669 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c64ed9f9-f091-415c-9b24-569e6dc4dbf4 tempest-ExtensionsTest-1483424554 tempest-ExtensionsTest-1483424554-project] 10.222.0.43 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.218865 Jul 02 21:15:48.556265 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1775/3501] 10.222.0.43 () {58 vars in 1169 bytes} [Sat Jul 2 21:15:48 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:48.565429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcc1449c-dbbd-436c-977d-5a2b881dcb25 tempest-ExtensionsTest-1483424554 tempest-ExtensionsTest-1483424554-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:48.569142 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fcc1449c-dbbd-436c-977d-5a2b881dcb25 tempest-ExtensionsTest-1483424554 tempest-ExtensionsTest-1483424554-project] 10.222.0.43 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006174 Jul 02 21:15:48.569142 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1727/3502] 10.222.0.43 () {58 vars in 1133 bytes} [Sat Jul 2 21:15:48 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:15:48.585267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:48.586051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:48.594586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.595065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.596120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.597081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.705452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-374a4948-e119-4860-923e-981d49502e1f req-e2d722ec-586b-484c-96de-0bed0667b8c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "name": "network-vif-deleted", "tag": "9caff0a5-9604-49f2-a5b4-aa1894bc18aa"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:48.718686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:48.724854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-374a4948-e119-4860-923e-981d49502e1f req-e2d722ec-586b-484c-96de-0bed0667b8c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.725594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-374a4948-e119-4860-923e-981d49502e1f req-e2d722ec-586b-484c-96de-0bed0667b8c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.757615 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-374a4948-e119-4860-923e-981d49502e1f req-e2d722ec-586b-484c-96de-0bed0667b8c3 service nova] Creating event network-vif-deleted:9caff0a5-9604-49f2-a5b4-aa1894bc18aa for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:48.774117 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-374a4948-e119-4860-923e-981d49502e1f req-e2d722ec-586b-484c-96de-0bed0667b8c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078736 Jul 02 21:15:48.776291 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1728/3503] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:15:48.803885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:48.805681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:48.822505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.826836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:48.829373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:48.829832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:49.017328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.028759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.030843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.038480 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-500c615d-0dbb-454c-9313-19409adfb449 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.255311 Jul 02 21:15:49.052815 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1729/3504] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:48 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:49.085317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.109681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6f2fbdc-2236-4c2a-8d40-9c1f6c8afc25 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1790 microversion: 2.1 time: 0.532001 Jul 02 21:15:49.111315 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1776/3505] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:48 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1790 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:49.128008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:49.130983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:49.139285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:49.140015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:49.141063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:49.141768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:49.368991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:49.370087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] [instance: fb82cc53-151c-482b-8731-8fa0bc4a8cb6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:49.385707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:49.386456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:49.390025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:49.391013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:49.415373 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] HTTP exception thrown: Instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 could not be found. Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Request method failure captured: Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 HTTP/1.1 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVtkzQIOmsg9VnIu8EcAIJNzUxMOILez1Pl7CCfiUk4XZ-3ljJ3xaf0PYLfS2rlvkN4oLXDN7l46ukdAJNlrUbCTNytGYtm2VgHWVFG7BD4b0LagN6wr4OFVkMB3laQLQfV0q80QzCQcXBr24VprpQvBJuixI5CKpzdZx2VsOg_MCA Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: d505023bb41e4c7cb4f65f6ff69c121e Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerPasswordTestJSON-1025262442 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d505023bb41e4c7cb4f65f6ff69c121e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d505023bb41e4c7cb4f65f6ff69c121e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d505023bb41e4c7cb4f65f6ff69c121e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d505023bb41e4c7cb4f65f6ff69c121e"}]}] Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerPasswordTestJSON-1025262442 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: d505023bb41e4c7cb4f65f6ff69c121e Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1025262442 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerPasswordTestJSON-1025262442-project Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: af79a7ef254d4df1806f6b5c2f91a4c3 Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerPasswordTestJSON-1025262442-project Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 could not be found. Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'fb82cc53-151c-482b-8731-8fa0bc4a8cb6'} Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 could not be found. Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 could not be found. Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:49.418258 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 could not be found. Jul 02 21:15:49.423676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:15:49.424465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] Returning 404 to user: Instance fb82cc53-151c-482b-8731-8fa0bc4a8cb6 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:49.425605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03241dd2-35ce-46b0-a114-158e9b8d1289 tempest-ServerPasswordTestJSON-1025262442 tempest-ServerPasswordTestJSON-1025262442-project] 10.222.0.43 "GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6" status: 404 len: 111 microversion: 2.1 time: 0.062577 Jul 02 21:15:49.426892 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1777/3506] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:49 2022] GET /compute/v2.1/servers/fb82cc53-151c-482b-8731-8fa0bc4a8cb6 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:15:49.451169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.470788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.473963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:49.475378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96323dc5-e2b3-4b40-9982-2473fc9baceb tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.351335 Jul 02 21:15:49.486669 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1730/3507] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:49 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:50.060353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:50.061278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:50.068814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.069543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.070528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.071136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.144922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:50.146342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:50.154545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.155240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.156260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.156865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.242538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.258521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.261629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.280434 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dc42e6f7-9d29-460a-8c94-a98fb2abbb72 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.221892 Jul 02 21:15:50.292111 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1778/3508] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:50 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:50.495387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:50.496302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:50.516572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.516572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.516572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.519797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.539453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.566218 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7edf6ab-3a53-4d2b-b736-d00714751585 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1654 microversion: 2.1 time: 0.438855 Jul 02 21:15:50.569396 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1731/3509] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:50 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1654 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:15:50.715306 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:15:50.715847 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:15:50.841485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-417cc79a-f7c1-4eef-9fe1-65598b320486 req-012fe139-41d3-4766-b585-4ef10ce3c1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "name": "network-vif-deleted", "tag": "f29402bd-69c0-4143-adac-d3eeaaf5f782"}, {"server_uuid": "05384a41-b1d4-4a0a-bc9c-39e43a56fda2", "name": "network-vif-deleted", "tag": "4fb8598a-bdb7-46ea-8d5d-a5e0978f1bba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:50.869636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-417cc79a-f7c1-4eef-9fe1-65598b320486 req-012fe139-41d3-4766-b585-4ef10ce3c1f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:50.871079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-417cc79a-f7c1-4eef-9fe1-65598b320486 req-012fe139-41d3-4766-b585-4ef10ce3c1f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:50.898401 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-417cc79a-f7c1-4eef-9fe1-65598b320486 req-012fe139-41d3-4766-b585-4ef10ce3c1f0 service nova] Creating event network-vif-deleted:f29402bd-69c0-4143-adac-d3eeaaf5f782 for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:50.900886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-417cc79a-f7c1-4eef-9fe1-65598b320486 req-012fe139-41d3-4766-b585-4ef10ce3c1f0 service nova] Creating event network-vif-deleted:4fb8598a-bdb7-46ea-8d5d-a5e0978f1bba for instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 on nch1-master-1 Jul 02 21:15:50.912451 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-417cc79a-f7c1-4eef-9fe1-65598b320486 req-012fe139-41d3-4766-b585-4ef10ce3c1f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076139 Jul 02 21:15:50.913052 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1732/3510] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:50.919817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.931536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.933471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:50.935000 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.444353 Jul 02 21:15:50.946561 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1779/3511] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:50 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:51.306232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.307034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:51.317312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.317815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:51.319208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.320020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:51.441171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:51.451821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:51.453850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:51.460944 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1447 microversion: 2.75 time: 0.162501 Jul 02 21:15:51.461972 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1733/3512] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1447 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:51.490019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.491017 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001380 Jul 02 21:15:51.491361 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1780/3513] 10.222.0.43 () {56 vars in 885 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 02 21:15:51.497782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.498930 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001699 Jul 02 21:15:51.499322 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1734/3514] 10.222.0.43 () {54 vars in 1034 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 02 21:15:51.505098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.507112 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a019e895-1c63-46f7-b073-da2e6585a736 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002422 Jul 02 21:15:51.507511 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1781/3515] 10.222.0.43 () {54 vars in 1040 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:51.514186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.515162 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee79eb18-23c1-4d51-a993-a5f333dc1c32 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001257 Jul 02 21:15:51.515627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1735/3516] 10.222.0.43 () {56 vars in 885 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 02 21:15:51.584121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.584749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:51.599123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.599936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:51.601161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.602047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:51.652408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.653140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:51.653932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lazy-loading 'fault' on Instance uuid 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:15:51.704915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:51.716495 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc44dc66-9525-4246-b7fe-e135f3c74e80 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 200 len: 1302 microversion: 2.1 time: 0.136065 Jul 02 21:15:51.727520 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1782/3517] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 1302 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:15:51.957832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:51.958498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:51.972498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.972764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:51.973690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:51.974156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:52.481585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:52.483184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:52.493331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:52.498206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:52.499248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:52.501417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:52.650665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:52.664306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:52.666661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:52.668919 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57fb8b7e-e414-4dfd-a1ab-066070cee78b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.719391 Jul 02 21:15:52.670473 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1736/3518] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:51 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:52.677690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:52.687896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:52.689992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:52.696770 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9649c7b0-ccfc-4641-92d1-8a8d1b8f4c6e tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1453 microversion: 2.75 time: 0.219036 Jul 02 21:15:52.698439 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1783/3519] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:52 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1453 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:52.734365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:52.735280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:52.742783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:52.743539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:52.744561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:52.745002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:52.760297 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] HTTP exception thrown: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Request method failure captured: Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 HTTP/1.1 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLVS5Xtj1ZUJK6ITuiEpf_Rgk8jMZugfVtxdnARTSWCeAS5AoSlTTqyyUBw7tny2HmXgxYnCQ5viV739OFmecmNuW9rjrwA1jaj24-6PRGWbAqIqp4yXAGLYkL2vGjLiu_gkcRkUQirhh3R7lqIxj6qZ1yMV8oU18nMBs9TFn-jtycA Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebcb0a2922d64d6e8d0c4114e10b954d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebcb0a2922d64d6e8d0c4114e10b954d"}]}] Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestMultiNic-1345240431 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 649c6088b26049ba9a765be082f38259 Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '05384a41-b1d4-4a0a-bc9c-39e43a56fda2'} Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:15:52.762171 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Returning 404 to user: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d644d70b-9265-4106-8f06-4bef3cd4851c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 404 len: 111 microversion: 2.1 time: 0.033593 Jul 02 21:15:52.768936 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1737/3520] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:15:52 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:15:53.689031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:53.690432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:53.707299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:53.707732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:53.718226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:53.719444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:53.724903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:53.726937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:53.736600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:53.737080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:53.737868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:53.750019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:53.964730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:53.979628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:53.982450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:53.997088 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b1dfd79-cad9-49f6-a77b-8401715bfaa7 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1453 microversion: 2.75 time: 0.283034 Jul 02 21:15:53.997706 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1738/3521] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:53 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:15:54.302871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:54.321674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:54.329463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:54.334432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a4e0c7a4-1a0b-4f82-ba74-243a053d2f90 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.648857 Jul 02 21:15:54.337245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1784/3522] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:53 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:54.698344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2d15a11a-a245-4abe-a7f8-ba77aa4fee66 req-a21cccca-76e1-4860-a6b1-4166dc4191ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "a1ebac5d-ae30-4272-8209-39af7edd756f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:54.709985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2d15a11a-a245-4abe-a7f8-ba77aa4fee66 req-a21cccca-76e1-4860-a6b1-4166dc4191ac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:54.711010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2d15a11a-a245-4abe-a7f8-ba77aa4fee66 req-a21cccca-76e1-4860-a6b1-4166dc4191ac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:54.725834 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2d15a11a-a245-4abe-a7f8-ba77aa4fee66 req-a21cccca-76e1-4860-a6b1-4166dc4191ac service nova] Creating event network-vif-plugged:a1ebac5d-ae30-4272-8209-39af7edd756f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:54.733305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2d15a11a-a245-4abe-a7f8-ba77aa4fee66 req-a21cccca-76e1-4860-a6b1-4166dc4191ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039321 Jul 02 21:15:54.734532 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1739/3523] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:55.018802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:55.020215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:55.029764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:55.030370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:55.032240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:55.032833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:55.079483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:15:55.207092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:55.229639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:55.232651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:55.258192 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-effffc24-31e0-45a1-a356-d4ee190194cc tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1453 microversion: 2.75 time: 0.243881 Jul 02 21:15:55.264279 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1785/3524] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:55 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:55.357704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:55.358414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:55.372369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:55.372799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:55.373596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:55.374039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:55.894805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:55.909731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:55.911503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:55.913276 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21dcd4e3-b80f-4296-a048-4ddea4627bc9 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.562281 Jul 02 21:15:55.914682 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1740/3525] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:55 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:56.287068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:56.289513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:56.306618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:56.307087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:56.308020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:56.308524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:56.456881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:56.467265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:56.469146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:56.475456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0820810e-44c5-4468-aae4-dbb4b08bc833 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1453 microversion: 2.75 time: 0.198614 Jul 02 21:15:56.476620 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1786/3526] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:56 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:56.860683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "fa77338d-8218-440b-9196-cfd58e7c0468"}, {"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "bd1eb072-75bb-4a9c-98b2-5be5c1f7e968"}, {"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "9865bb29-9fe1-41c8-9b51-3fcd651dccfd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:56.872418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:56.873169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:56.886886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] Creating event network-vif-plugged:fa77338d-8218-440b-9196-cfd58e7c0468 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:56.887799 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] Creating event network-vif-plugged:bd1eb072-75bb-4a9c-98b2-5be5c1f7e968 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:56.888579 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] Creating event network-vif-plugged:9865bb29-9fe1-41c8-9b51-3fcd651dccfd for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:56.895857 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a1457854-20c2-4dd9-bf90-1428a12ea56e req-76ff1217-d321-49f3-a22a-7eb70d0ae989 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039426 Jul 02 21:15:56.897943 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1741/3527] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:56.936010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:56.937575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:56.952512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:56.954929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:56.956327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:56.956801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:57.498842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:57.499911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:57.521842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:57.522815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:57.524364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:57.526527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:57.750358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:57.761057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:57.763070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:57.764670 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51690900-4617-401e-a7a2-f5c52571292b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.834645 Jul 02 21:15:57.765548 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1787/3528] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:56 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:58.039450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:58.052327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:58.059516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:58.073126 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-291d02bc-36bd-4cc4-aa72-69d9cf885af9 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1438 microversion: 2.75 time: 0.580409 Jul 02 21:15:58.076634 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1742/3529] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:57 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1438 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:58.446701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:58.449701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:58.473769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:58.475394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:58.477019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:58.479012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:58.638016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:15:58.640377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:15:58.641385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:15:58.643457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:15:58.644009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:15:58.786479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:58.787855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:58.819351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:58.820522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:58.824720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:58.838860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:58.842496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:58.861816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:58.862396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:58.863285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:58.863756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:59.215114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:15:59.253737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9ea3dc4b-b41a-446b-bdf2-5e4b467468be tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e/action" status: 202 len: 1942 microversion: 2.75 time: 1.163907 Jul 02 21:15:59.254512 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1788/3530] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:15:58 2022] POST /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e/action => generated 1942 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 02 21:15:59.287356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "e502bf66-d0a7-4697-9c26-7f5ff4399906"}, {"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "912378a0-41d0-4582-b82a-6871699c6ef3"}, {"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-plugged", "status": "completed", "tag": "7392035b-5277-47d7-afbf-73666c9b1f2f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:59.304346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:59.305191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:59.320301 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] Creating event network-vif-plugged:e502bf66-d0a7-4697-9c26-7f5ff4399906 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:59.321267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] Creating event network-vif-plugged:912378a0-41d0-4582-b82a-6871699c6ef3 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:59.322008 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] Creating event network-vif-plugged:7392035b-5277-47d7-afbf-73666c9b1f2f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:15:59.328658 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d9bc59ee-5140-4146-9947-2224ec32c969 req-cefaff0b-c1fe-4e37-9c73-7db1de5c3ae8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053455 Jul 02 21:15:59.330069 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1789/3531] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:15:59.341672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1711504912", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "fdbf9bd0-2451-47d9-a8be-354953cb3759"}, {"uuid": "fb0bcd32-2d4b-4f8a-be38-9b4b6c36b830"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:15:59.457386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] validate_networks() for [('fdbf9bd0-2451-47d9-a8be-354953cb3759', None, None, None, None, None), ('fb0bcd32-2d4b-4f8a-be38-9b4b6c36b830', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:15:59.474209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:59.505468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:59.510355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:15:59.514227 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0b7e35c-8361-4854-b173-9c0d8ff31036 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.731396 Jul 02 21:15:59.516247 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1743/3532] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:58 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:15:59.529042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:15:59.540129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:15:59.554456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:59.557898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:59.561838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:15:59.562579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:15:59.883155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:15:59.913202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-533d653e-cc55-41e1-873a-aa660715894f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.394483 Jul 02 21:15:59.914246 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1744/3533] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:15:59 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:00.515719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:16:00.516345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:16:00.516736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:16:00.517158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:16:00.517577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:16:00.538399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:00.539018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:00.543375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:00.544025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:00.547239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:00.548007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:00.562283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:00.562934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:00.564268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:00.564884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:00.615426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Getting quotas for project ebcb0a2922d64d6e8d0c4114e10b954d. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:16:00.627740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Getting quotas for user 649c6088b26049ba9a765be082f38259 and project ebcb0a2922d64d6e8d0c4114e10b954d. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:16:00.663801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:16:00.672609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:16:00.796556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f0beeadc-0976-47e3-96b8-4b68ebe22f7c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.464899 Jul 02 21:16:00.798243 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1790/3534] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:15:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:16:00.811739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6f663d83-aabb-4683-b4b3-8a5d3e1e2cf4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:00.812931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6f663d83-aabb-4683-b4b3-8a5d3e1e2cf4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:00.972127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6f663d83-aabb-4683-b4b3-8a5d3e1e2cf4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:00.984823 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6f663d83-aabb-4683-b4b3-8a5d3e1e2cf4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1213 microversion: 2.1 time: 0.177189 Jul 02 21:16:00.987847 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1791/3535] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:00 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1213 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:01.001416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:01.003243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:01.021737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:01.024414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:01.026640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:01.027781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:01.070487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:01.083947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:01.091113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:01.092715 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-039d5ca7-2ab8-44ae-9f46-17396ed0164f tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1879 microversion: 2.32 time: 0.558336 Jul 02 21:16:01.094856 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1745/3536] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:00 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:01.617448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:01.639340 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-29e6004f-969c-43c7-b14d-26a497839763 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.650039 Jul 02 21:16:01.641173 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1792/3537] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:00 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:02.003182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:02.004163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:02.018135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.023783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.025275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.025901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.112425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:02.113054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:02.132331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.132791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.133593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.134039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.239193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:02.260806 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13812044-d051-48d1-b2a7-2a38760ca43f tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1265 microversion: 2.1 time: 0.261655 Jul 02 21:16:02.261317 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1746/3538] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:01 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:02.582876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:02.597683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:02.600013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:02.602420 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a8f7400-ea8e-4eb0-8e7b-18a7a205a74a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2831 microversion: 2.32 time: 0.494102 Jul 02 21:16:02.609821 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1793/3539] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:02 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2831 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:02.629342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:02.629845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:02.637592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.638098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.638845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.639267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.660532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:02.661457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:02.663608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:02.686044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.686892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.687904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:02.688532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:02.978622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b58b10fd-027c-4172-8786-b242f436c555 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.351932 Jul 02 21:16:02.979025 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1747/3540] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:16:02 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478/os-interface => generated 1831 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:03.071703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:03.122351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e55769dd-cb10-4850-a036-7b1318ff7944 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.465520 Jul 02 21:16:03.123103 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1794/3541] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:02 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:03.279169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:03.281270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:03.293728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:03.294181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:03.294971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:03.295404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:03.376928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:03.676395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:03.699175 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab44d97b-034f-461b-bb7b-590faa34cbd4 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1271 microversion: 2.1 time: 0.421021 Jul 02 21:16:03.702197 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1748/3542] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:03 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1271 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:04.143670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:04.145006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:04.158333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:04.160499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:04.162886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:04.163567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:04.317321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:04.360090 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-be45598f-ad63-494f-a9a3-24950e9b0149 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.220626 Jul 02 21:16:04.361191 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1795/3543] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:04 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:04.721861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:04.723280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:04.739100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:04.742061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:04.743730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:04.745683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:04.855499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:04.870308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7225e435-c20d-4b0f-a36f-9cb191e493b7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1271 microversion: 2.1 time: 0.153060 Jul 02 21:16:04.871518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1749/3544] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:04 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:05.384650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:05.386834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:05.396983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:05.398243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:05.399323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:05.404101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:05.545970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:05.588672 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-233c4d57-9c91-48c2-9560-824fd8c63dd3 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.211693 Jul 02 21:16:05.602163 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1796/3545] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:05 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:05.888234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:05.888868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:05.903349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:05.903807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:05.904625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:05.905064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:06.272174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:06.288923 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-61a04f6a-c922-47b7-b965-16a454447edc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1313 microversion: 2.1 time: 0.404507 Jul 02 21:16:06.289536 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1750/3546] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:05 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:06.611391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:06.612028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:06.620161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:06.628975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:06.629907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:06.630675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:06.699412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c799f116-8011-40d1-8ebb-db33520c1400 req-e4ab39d1-8ab6-42d8-b280-95dc805053fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "tag": "fa77338d-8218-440b-9196-cfd58e7c0468"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:06.720626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c799f116-8011-40d1-8ebb-db33520c1400 req-e4ab39d1-8ab6-42d8-b280-95dc805053fa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:06.721680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c799f116-8011-40d1-8ebb-db33520c1400 req-e4ab39d1-8ab6-42d8-b280-95dc805053fa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:06.743607 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c799f116-8011-40d1-8ebb-db33520c1400 req-e4ab39d1-8ab6-42d8-b280-95dc805053fa service nova] Creating event network-changed:fa77338d-8218-440b-9196-cfd58e7c0468 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:16:06.754051 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c799f116-8011-40d1-8ebb-db33520c1400 req-e4ab39d1-8ab6-42d8-b280-95dc805053fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060573 Jul 02 21:16:06.755053 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1751/3547] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:16:06.872367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:06.953334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf4e7ae3-3a84-4420-be39-b5d3bbfb7837 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.347646 Jul 02 21:16:06.955568 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1797/3548] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:06 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:07.309246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:07.311851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:07.329876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:07.330496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:07.348530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:07.349069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:07.670082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:07.683631 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23a8db8c-e9c5-4ee7-8654-7d6d9634590c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1313 microversion: 2.1 time: 0.380621 Jul 02 21:16:07.684490 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1752/3549] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:07 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:07.973441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:07.974162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:07.989032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:07.989832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:07.990868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:07.991577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:08.158223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:08.188771 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-87b320f2-c1be-4bdf-b0b5-8accf35f9904 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.219588 Jul 02 21:16:08.206260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1798/3550] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:07 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:08.702105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:08.702651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:08.717924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:08.723612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:08.725978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:08.727219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:09.004785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:09.017534 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25078c80-ac27-4a27-9857-e49889f81020 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1313 microversion: 2.1 time: 0.319357 Jul 02 21:16:09.018637 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1753/3551] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:08 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:09.213151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:09.213834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:09.227510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:09.227946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:09.228814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:09.229258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:09.379387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:09.392381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:09.423327 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5e4e013c-c707-46af-8c3d-de928a5a9f3d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.214850 Jul 02 21:16:09.424260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1799/3552] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:09 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:10.043153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:10.044359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:10.068144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:10.070488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:10.073973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:10.075174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:10.286462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:10.301771 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-310b64f4-bb33-40d7-a239-083d0afe2f9c tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.265910 Jul 02 21:16:10.303376 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1754/3553] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:10 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:10.445935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:10.446552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:10.461962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:10.462421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:10.463211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:10.463652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:10.582890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:10.607764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:10.618891 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ec46e15d-9a50-48ef-87e9-fbd8b59d655a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.178004 Jul 02 21:16:10.620185 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1800/3554] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:10 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:11.263150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bcc0f6ca-38a8-4414-9fe6-7c4c712cff94 req-3fd0fe32-0e32-4448-a862-0202bb5c47ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5", "tag": "340bbd8c-1313-40d0-bbff-16735603e5c4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:11.274273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:11.280408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bcc0f6ca-38a8-4414-9fe6-7c4c712cff94 req-3fd0fe32-0e32-4448-a862-0202bb5c47ac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:11.283285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bcc0f6ca-38a8-4414-9fe6-7c4c712cff94 req-3fd0fe32-0e32-4448-a862-0202bb5c47ac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:11.322176 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bcc0f6ca-38a8-4414-9fe6-7c4c712cff94 req-3fd0fe32-0e32-4448-a862-0202bb5c47ac service nova] Creating event network-changed:340bbd8c-1313-40d0-bbff-16735603e5c4 for instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 on nch2-master-1 Jul 02 21:16:11.354804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-893893429", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "b1e0e7e8-4a4d-4cd7-881e-3289243d0e83"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:11.363839 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bcc0f6ca-38a8-4414-9fe6-7c4c712cff94 req-3fd0fe32-0e32-4448-a862-0202bb5c47ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078653 Jul 02 21:16:11.366007 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1801/3555] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:11.376167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:11.382367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:11.402134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:11.403247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:11.404683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:11.405410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:11.472679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] validate_networks() for [('b1e0e7e8-4a4d-4cd7-881e-3289243d0e83', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:16:11.730711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:11.745481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ab1f749-6003-4424-a5a5-ce11b579e93d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.375184 Jul 02 21:16:11.746078 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1802/3556] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:11 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:11.750743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:11.753703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:11.768287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:11.769013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:11.770003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:11.772926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:11.984270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:12.034604 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3201ee3-f933-44de-824f-fc2e79060a08 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.284340 Jul 02 21:16:12.034604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1803/3557] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:11 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:12.373322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:16:12.373846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:16:12.374275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:16:12.375305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:16:12.376288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:16:12.392342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:12.392809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:12.393826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:12.394915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:12.438097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Getting quotas for project b59eba31be824dc79a797e0f756d1e2c. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:16:12.451620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Getting quotas for user f194933a022742588069b78df9f1c177 and project b59eba31be824dc79a797e0f756d1e2c. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:16:12.493701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:16:12.496343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:16:12.580247 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75c66574-274c-4bdc-bca8-5b392eafe47e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.760273 Jul 02 21:16:12.587278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1755/3558] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:16:12.608991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-203cb924-a76d-4201-aad2-00ca5d201a89 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:12.611158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-203cb924-a76d-4201-aad2-00ca5d201a89 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:12.717005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-203cb924-a76d-4201-aad2-00ca5d201a89 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:12.727727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-203cb924-a76d-4201-aad2-00ca5d201a89 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:12.730864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-203cb924-a76d-4201-aad2-00ca5d201a89 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:12.733617 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-203cb924-a76d-4201-aad2-00ca5d201a89 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1261 microversion: 2.26 time: 0.141295 Jul 02 21:16:12.735384 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1804/3559] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:12 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1261 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:12.762870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:12.763503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:12.782940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:12.783391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:12.784266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:12.787197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:13.056682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:13.057695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:13.086809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:13.088023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:13.098320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:13.098783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:13.104372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:13.131362 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b36d7b70-4df2-4190-a54a-f41a15635a16 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.372013 Jul 02 21:16:13.132761 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1756/3560] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:12 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:16:13.245954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:13.280557 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-921eb909-fb60-42a8-a8b7-7aa840b70cf6 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.228814 Jul 02 21:16:13.285495 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1805/3561] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:13 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:13.756114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acd6585c-38a2-4823-9553-7b45d0d3e53c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:13.757424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acd6585c-38a2-4823-9553-7b45d0d3e53c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:13.818304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-18e897ae-d00d-4b77-ab2d-7f27c1a457f0 req-64e4bfce-6dc2-48ca-b5f7-d2462db705cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5", "tag": "2466978f-dc15-4b9f-8970-b081daf7fd6e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:13.866342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-18e897ae-d00d-4b77-ab2d-7f27c1a457f0 req-64e4bfce-6dc2-48ca-b5f7-d2462db705cf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:13.866812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-18e897ae-d00d-4b77-ab2d-7f27c1a457f0 req-64e4bfce-6dc2-48ca-b5f7-d2462db705cf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:13.913967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acd6585c-38a2-4823-9553-7b45d0d3e53c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:13.919213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-18e897ae-d00d-4b77-ab2d-7f27c1a457f0 req-64e4bfce-6dc2-48ca-b5f7-d2462db705cf service nova] Creating event network-changed:2466978f-dc15-4b9f-8970-b081daf7fd6e for instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 on nch2-master-1 Jul 02 21:16:13.935346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acd6585c-38a2-4823-9553-7b45d0d3e53c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:13.941631 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-18e897ae-d00d-4b77-ab2d-7f27c1a457f0 req-64e4bfce-6dc2-48ca-b5f7-d2462db705cf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127510 Jul 02 21:16:13.941820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acd6585c-38a2-4823-9553-7b45d0d3e53c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:13.942906 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acd6585c-38a2-4823-9553-7b45d0d3e53c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1261 microversion: 2.26 time: 0.192510 Jul 02 21:16:13.943486 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1757/3563] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:13 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:13.956248 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1806/3563] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:16:14.158283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:14.159502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:14.205221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.206669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.208551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.209421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.307045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:14.307045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:14.336712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.337684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.340827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.342409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.524591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:14.558251 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-914d26ef-1bdd-4b40-b403-2550301d4025 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.260636 Jul 02 21:16:14.559914 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1807/3564] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:14 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:14.570833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:14.572254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:14.580501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.581200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.582210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.583171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.626397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:14.642021 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1acb0a50-82d1-47a2-ba80-a1700ca4435d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.491623 Jul 02 21:16:14.644190 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1758/3565] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:14 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:14.690809 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8adfe0b6-3a1c-4c69-b013-9041313f2818 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.129260 Jul 02 21:16:14.691909 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1808/3566] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:16:14 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:16:14.701522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:14.702136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:14.713494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.715946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.720247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.720781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.953330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:14.963055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:14.963777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:14.970121 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0dc0c34-dc6f-42d8-8ecf-ca4bafb8da29 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1673 microversion: 2.1 time: 0.272036 Jul 02 21:16:14.973132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1759/3567] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:14 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1673 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:14.993668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.994173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:14.994950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:14.995401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:15.222931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:15.246040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:15.263788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:15.270328 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-326bf7c1-2e5f-4737-bea9-f60085c7b5ca tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1321 microversion: 2.26 time: 0.311934 Jul 02 21:16:15.271233 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1809/3568] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:14 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:15.580599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:15.581614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:15.591369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:15.591907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:15.592960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:15.593496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:15.660257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:15.661041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:15.668374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:15.669218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:15.670219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:15.670855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:15.693348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:15.720056 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85930a2f-987d-43a1-af63-e97b19324e7c tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.144051 Jul 02 21:16:15.721055 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1760/3569] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:15 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:15.915771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:15.924333 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51cceca1-0486-4ec0-a5bf-a64325624e0e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.269172 Jul 02 21:16:15.924917 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1810/3570] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:15 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:16:15.988958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:15.989723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:15.997391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:15.997840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:15.999168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.000869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:16.243808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:16.254355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f48742c2-a737-4da1-a45d-946bcbacc8ea tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1673 microversion: 2.1 time: 0.270161 Jul 02 21:16:16.268258 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1761/3571] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:15 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1673 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:16.291048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:16.292351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:16.302475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.304089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:16.305211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.305755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:16.543439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:16.557006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:16.559296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:16.561123 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83811a40-5f12-42d1-9c36-4c6f9ec71b15 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.275145 Jul 02 21:16:16.562615 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1811/3572] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:16 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:16.757650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:16.758444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:16.767761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.776518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:16.777512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.777956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:16.941939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:16.943100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:16.953769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.956594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:16.957599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:16.960352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:17.012370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:17.050537 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5073ee5-5f3e-46ac-ae41-d58c2ff903d2 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.314037 Jul 02 21:16:17.078400 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1762/3573] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:16 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:17.197738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:17.209924 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-21d8f43b-e01c-4396-8a54-0120c656c533 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.271799 Jul 02 21:16:17.210877 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1812/3574] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:16 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:17.268990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5b9e9d88-730b-4584-be0d-f159f8c720be req-0e271f63-0fa9-4a71-8fe6-5316c816aeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d37d6c9-89a7-42c6-b865-93bed9eebb51", "tag": "db80e86f-ec20-4e14-b9b4-1a4406e4a8d5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:17.273687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:17.274444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:17.293373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:17.297762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b9e9d88-730b-4584-be0d-f159f8c720be req-0e271f63-0fa9-4a71-8fe6-5316c816aeea service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:17.298279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5b9e9d88-730b-4584-be0d-f159f8c720be req-0e271f63-0fa9-4a71-8fe6-5316c816aeea service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:17.299803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:17.301817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:17.303538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:17.324691 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5b9e9d88-730b-4584-be0d-f159f8c720be req-0e271f63-0fa9-4a71-8fe6-5316c816aeea service nova] Creating event network-changed:db80e86f-ec20-4e14-b9b4-1a4406e4a8d5 for instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 on nch1-master-1 Jul 02 21:16:17.337747 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5b9e9d88-730b-4584-be0d-f159f8c720be req-0e271f63-0fa9-4a71-8fe6-5316c816aeea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074829 Jul 02 21:16:17.338682 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1763/3575] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:17.581045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:17.582389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:17.583102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:17.590522 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-da847015-21c0-4493-b642-00b10ee319b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1678 microversion: 2.1 time: 0.321704 Jul 02 21:16:17.591113 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1813/3576] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:17 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1678 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:17.601413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:17.601413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:17.601413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:17.601413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:17.892009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:17.900575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:17.902085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:17.903231 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-196d2174-cb67-4e54-93a5-36423562ee74 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.326391 Jul 02 21:16:17.903793 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1764/3577] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:17 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:18.077227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:18.077835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:18.087575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.100180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.101154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.101615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.226944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:18.228251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:18.232192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:18.242426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.243338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.246144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.246592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.258162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:18.288764 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9d69313-3cb5-411d-a34d-2f27de6857d5 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.215336 Jul 02 21:16:18.289553 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1814/3578] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:18 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:18.418681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:18.426989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-484156c2-ac8f-4afa-a7db-f4394e3215bc tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.203949 Jul 02 21:16:18.428259 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1765/3579] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:18 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:16:18.608879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:18.610345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:18.620854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.621315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.622136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.622573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.769724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:18.772193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:18.778735 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75b37329-9ea8-4c3a-b5c2-d8fac351b846 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.173779 Jul 02 21:16:18.779311 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1815/3580] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:18 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:18.922441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:18.923059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:18.930325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.930990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:18.931967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:18.932434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:19.076706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:19.088689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:19.091235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:19.093115 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ae39bfe-0112-47f7-9a6c-d29db5ea1df6 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.174222 Jul 02 21:16:19.093933 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1766/3581] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:18 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:19.310117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:19.312845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:19.320950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:19.322039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:19.323045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:19.323591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:19.406514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:19.425426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2cb18771-5fcd-4038-8e55-dea5ad0da10b tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.119531 Jul 02 21:16:19.426003 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1816/3582] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:19 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:19.444502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:19.445018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:19.451542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:19.451985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:19.452868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:19.453473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:19.471311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:19.598537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:19.606408 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4865e83-ae31-456f-866e-c35e51572178 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.165823 Jul 02 21:16:19.606983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1767/3583] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:19 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:20.111804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:20.113161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:20.121029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.121699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.122479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.122937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.261538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:20.270349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:20.272151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:20.273803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a84d8862-22b2-4ed6-8b10-c7ab8dc01039 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.166054 Jul 02 21:16:20.274458 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1817/3584] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:20 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:20.445685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:20.446369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:20.454196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.454754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.455749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.456227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.537065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:20.559057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffaff2d9-2ef1-46af-a5f4-68fc9a4aa012 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.116979 Jul 02 21:16:20.559659 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1768/3585] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:20 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:20.624689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:20.625177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:20.631783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.631931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.632658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.633083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.856390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:20.866040 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7704ece8-23da-4803-a9bf-fef0714fb87b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.245520 Jul 02 21:16:20.867453 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1818/3586] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:20 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:20.917758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4ebf0ab2-9d32-4859-9802-de41dfb0fdaa req-983e8d77-0f58-4739-8d94-6d4cc35eacfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5", "name": "network-vif-plugged", "status": "completed", "tag": "2466978f-dc15-4b9f-8970-b081daf7fd6e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:20.927362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ebf0ab2-9d32-4859-9802-de41dfb0fdaa req-983e8d77-0f58-4739-8d94-6d4cc35eacfe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:20.929177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ebf0ab2-9d32-4859-9802-de41dfb0fdaa req-983e8d77-0f58-4739-8d94-6d4cc35eacfe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:20.945063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4ebf0ab2-9d32-4859-9802-de41dfb0fdaa req-983e8d77-0f58-4739-8d94-6d4cc35eacfe service nova] Creating event network-vif-plugged:2466978f-dc15-4b9f-8970-b081daf7fd6e for instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 on nch2-master-1 Jul 02 21:16:20.952827 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4ebf0ab2-9d32-4859-9802-de41dfb0fdaa req-983e8d77-0f58-4739-8d94-6d4cc35eacfe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038176 Jul 02 21:16:20.954842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1769/3587] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:16:21.293490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:21.294213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:21.303136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:21.303584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:21.304402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:21.304835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:21.455149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:21.472358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:21.475028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:21.476664 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-389011ec-3a7e-43ba-a603-9fc4d3e6ed0b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.187586 Jul 02 21:16:21.477245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1819/3588] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:21 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:21.581148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:21.581853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:21.590128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:21.590615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:21.591404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:21.591826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:21.673159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:21.708435 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c9be87f-ddba-49ad-bf22-f4949c625330 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.121143 Jul 02 21:16:21.708435 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1770/3589] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:21 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:21.883825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:21.884496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:21.892477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:21.893234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:21.894256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:21.894986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:22.068793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:22.077145 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-868d39cd-ee2d-4ecb-ab0e-2df037236e28 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.197875 Jul 02 21:16:22.077739 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1820/3590] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:21 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:16:22.495292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:22.495920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:22.498278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:22.516583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:22.517301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:22.518091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:22.518534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:22.664015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:22.672784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:22.674277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:22.675402 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d5d91f3-23aa-4e79-afa6-9478d16e0797 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.184119 Jul 02 21:16:22.675968 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1771/3591] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:22 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:22.723132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:22.723855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:22.726736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:22.732651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:22.733107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:22.733887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:22.734417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:22.815702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:22.836410 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9098506b-1906-461d-bdb8-cdba915c49f1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.117041 Jul 02 21:16:22.837200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1821/3592] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:22 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:22.983471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1fb057e0-93e2-4f30-a1c1-5b992350ab4b req-4056969c-8a66-45d1-aa86-dcff040e4184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5", "name": "network-vif-plugged", "status": "completed", "tag": "340bbd8c-1313-40d0-bbff-16735603e5c4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:22.995813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1fb057e0-93e2-4f30-a1c1-5b992350ab4b req-4056969c-8a66-45d1-aa86-dcff040e4184 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:22.996285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1fb057e0-93e2-4f30-a1c1-5b992350ab4b req-4056969c-8a66-45d1-aa86-dcff040e4184 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.011065 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1fb057e0-93e2-4f30-a1c1-5b992350ab4b req-4056969c-8a66-45d1-aa86-dcff040e4184 service nova] Creating event network-vif-plugged:340bbd8c-1313-40d0-bbff-16735603e5c4 for instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 on nch2-master-1 Jul 02 21:16:23.018731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1fb057e0-93e2-4f30-a1c1-5b992350ab4b req-4056969c-8a66-45d1-aa86-dcff040e4184 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040588 Jul 02 21:16:23.020319 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1772/3593] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:23.094599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:23.095646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:23.102970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:23.103408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.104264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:23.104948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.253525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:23.261289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-13949de6-a472-4708-bb75-8eec101928e7 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.171049 Jul 02 21:16:23.261870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1822/3594] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:23 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:23.695701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:23.696998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:23.703467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:23.703890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.704702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:23.705136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.858794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:23.860372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:23.865663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:23.879396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:23.880348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:23.881853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:23.883000 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6133e29-6f3a-46ae-ba18-17d53c1ffeb9 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.192450 Jul 02 21:16:23.883640 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1773/3595] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:23 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:23.883924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.885087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:23.885709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:23.969102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:23.990183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a7153b7d-d2a2-421e-9f89-341b5cf371e4 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.137805 Jul 02 21:16:24.000710 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1823/3596] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:23 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:24.282006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:24.282667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:24.284840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:24.292776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:24.293230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:24.294015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:24.294453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:24.457978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:24.472323 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97855267-ae44-48d9-8a8f-d052e6bb4039 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1334 microversion: 2.1 time: 0.194563 Jul 02 21:16:24.473303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1774/3597] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:24 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1334 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:24.901967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:24.903166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:24.910188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:24.910644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:24.911414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:24.911852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.013039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:25.014064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:25.022748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.023590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.024488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.025168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.051958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:25.061484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:25.064312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:25.065542 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9c1de63a-90a7-47f6-a64f-cb934d703129 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.167518 Jul 02 21:16:25.066307 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1824/3598] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:24 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:25.071462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1e005620-88b4-41ab-a080-0512dca5229d req-19c43c29-d9af-438d-836c-02cd2514329a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d37d6c9-89a7-42c6-b865-93bed9eebb51", "name": "network-vif-plugged", "status": "completed", "tag": "db80e86f-ec20-4e14-b9b4-1a4406e4a8d5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:25.081059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1e005620-88b4-41ab-a080-0512dca5229d req-19c43c29-d9af-438d-836c-02cd2514329a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.081499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1e005620-88b4-41ab-a080-0512dca5229d req-19c43c29-d9af-438d-836c-02cd2514329a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.094103 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1e005620-88b4-41ab-a080-0512dca5229d req-19c43c29-d9af-438d-836c-02cd2514329a service nova] Creating event network-vif-plugged:db80e86f-ec20-4e14-b9b4-1a4406e4a8d5 for instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 on nch1-master-1 Jul 02 21:16:25.100401 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1e005620-88b4-41ab-a080-0512dca5229d req-19c43c29-d9af-438d-836c-02cd2514329a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Jul 02 21:16:25.101507 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1825/3599] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:25.140288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:25.161123 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6de4d19b-7bef-4a38-aa79-6e202f512691 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.152679 Jul 02 21:16:25.162328 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1775/3600] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:25 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:25.491162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:25.492263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:25.499721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.500346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.501174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.501625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.758027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:25.768241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d72d04b5-ba9d-42a0-80b9-efcca184dfe2 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1669 microversion: 2.1 time: 0.281323 Jul 02 21:16:25.768872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1826/3601] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:25 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1669 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:25.785582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:25.786073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:25.792378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.792902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.793751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.794221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.820660 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78bdc566-e8c9-4b71-96e9-3a973d88f207 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5/ips" status: 200 len: 179 microversion: 2.1 time: 0.038835 Jul 02 21:16:25.821360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1776/3602] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:16:25 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5/ips => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:16:25.832780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:25.833273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:25.839597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.840280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.841044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.841495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.869623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:16:25.951549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:25.960392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-74ff5aba-0d1f-48f8-804a-d6e39dfe0a3b tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 204 len: 0 microversion: 2.1 time: 0.131817 Jul 02 21:16:25.961088 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1827/3603] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:16:25 2022] DELETE /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:16:25.971592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:25.972383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:25.985603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.986527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:25.987895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:25.989029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:26.096824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:26.098806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:26.108774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:26.109630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:26.111038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:26.112124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:26.153216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:26.162266 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a6910b8-5a98-42e9-aad2-06d24c707c2d tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1675 microversion: 2.1 time: 0.196400 Jul 02 21:16:26.163499 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1777/3604] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:25 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:26.182999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:26.183997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:26.191477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:26.192306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:26.193170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:26.194241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:26.320005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:26.320309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:26.333782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:26.335661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:26.337320 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b00f7cf0-1107-4b21-8a7d-cf2f86055041 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.255539 Jul 02 21:16:26.342921 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5a4c886-26ff-417e-8444-8f2dd997369a tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1929 microversion: 2.75 time: 0.164268 Jul 02 21:16:26.344206 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1778/3605] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:26 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1929 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:26.350713 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1828/3606] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:26 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:27.181544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:27.182254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:27.189911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:27.190364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:27.191171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:27.191608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:27.344073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:27.353320 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c65fee77-cab5-47f1-ab76-db5d07b130fa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1675 microversion: 2.1 time: 0.176082 Jul 02 21:16:27.353792 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1779/3607] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:27 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:27.368717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:27.369404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:27.369965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:27.370509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:27.378107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:27.378324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:27.378556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:27.378764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:27.379631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:27.380205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:27.380340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:27.380689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:27.502292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:27.525577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3647f384-8c0e-4eb5-b1d9-75a0a2a2286f tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1947 microversion: 2.75 time: 0.165970 Jul 02 21:16:27.526714 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1780/3608] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:27 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1947 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:27.590848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:27.603017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:27.608075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:27.609336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6b32890-efa0-471d-971e-4b2bdfca2bc0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1361 microversion: 2.26 time: 0.255820 Jul 02 21:16:27.612902 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1829/3609] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:27 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:28.372466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:28.373312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:28.383394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.384180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.385247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.385851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.404463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:28.446344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-de07f283-e3ea-4111-aa83-7cce91dc2e94 req-39f8569d-fdc5-4028-bf74-e39fcae481bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5", "name": "network-vif-deleted", "tag": "2466978f-dc15-4b9f-8970-b081daf7fd6e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:28.457950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-de07f283-e3ea-4111-aa83-7cce91dc2e94 req-39f8569d-fdc5-4028-bf74-e39fcae481bb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.458687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-de07f283-e3ea-4111-aa83-7cce91dc2e94 req-39f8569d-fdc5-4028-bf74-e39fcae481bb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.471504 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-de07f283-e3ea-4111-aa83-7cce91dc2e94 req-39f8569d-fdc5-4028-bf74-e39fcae481bb service nova] Creating event network-vif-deleted:2466978f-dc15-4b9f-8970-b081daf7fd6e for instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 on nch2-master-1 Jul 02 21:16:28.479363 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-de07f283-e3ea-4111-aa83-7cce91dc2e94 req-39f8569d-fdc5-4028-bf74-e39fcae481bb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324417 Jul 02 21:16:28.480024 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1781/3610] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:28.554354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:28.555251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:28.562755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.563162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '649c6088b26049ba9a765be082f38259', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb0a2922d64d6e8d0c4114e10b954d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:28.563403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.564078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.564794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.574970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-614fc2e6-84a5-4407-b7f6-911b7b2552de tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 200 len: 1654 microversion: 2.1 time: 0.207485 Jul 02 21:16:28.576013 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1830/3611] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:28 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 1654 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:28.632415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:28.633382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:28.643642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.644000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.646518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.647644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.656143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:28.696995 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a749b2c-56df-4474-91ce-d757044c0924 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1935 microversion: 2.75 time: 0.148972 Jul 02 21:16:28.697910 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1782/3612] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:28 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1935 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:28.865907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:28.879765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:28.881769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:28.883431 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8d007db6-69a6-4f47-adfe-02e3e4f2080e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1545 microversion: 2.26 time: 0.256105 Jul 02 21:16:28.884711 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1831/3613] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:28 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1545 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:28.904884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd785e430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:28.918173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.918627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.919107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:28.933213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.933936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.934714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.935329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.961424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.961872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.977251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:28.977974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:28.985654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:SAVEPOINT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:29.009874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.049593 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98ef5f53-8555-49cf-b84a-73657ea378f7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1122336357" status: 201 len: 0 microversion: 2.26 time: 0.148738 Jul 02 21:16:29.050599 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1783/3614] 10.222.0.43 () {62 vars in 1379 bytes} [Sat Jul 2 21:16:28 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1122336357 => generated 0 bytes in 151 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 02 21:16:29.063100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de3a01e8-4295-4308-8082-75333a4067a0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd73ac0d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.079926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de3a01e8-4295-4308-8082-75333a4067a0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.080426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de3a01e8-4295-4308-8082-75333a4067a0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.104018 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de3a01e8-4295-4308-8082-75333a4067a0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1122336357" status: 204 len: 0 microversion: 2.26 time: 0.046424 Jul 02 21:16:29.104715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1832/3615] 10.222.0.43 () {60 vars in 1360 bytes} [Sat Jul 2 21:16:29 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1122336357 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:29.113330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd785e5e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.135829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.136212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.136644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.143761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.144583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.145705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.146112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.171424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.171909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.188268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.204573 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b201577f-99b9-4b06-a876-2163cf6827a3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 204 len: 0 microversion: 2.26 time: 0.095183 Jul 02 21:16:29.205264 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1784/3616] 10.222.0.43 () {60 vars in 1294 bytes} [Sat Jul 2 21:16:29 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:29.215993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b482b2ee-71de-41c9-ab25-8ee3f8897c02 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd743aca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.224723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b482b2ee-71de-41c9-ab25-8ee3f8897c02 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.225188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b482b2ee-71de-41c9-ab25-8ee3f8897c02 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.236308 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b482b2ee-71de-41c9-ab25-8ee3f8897c02 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 200 len: 12 microversion: 2.26 time: 0.024966 Jul 02 21:16:29.236928 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1833/3617] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 21:16:29 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 12 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:16:29.247640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd785ea60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.256027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.256528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.256985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.262544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.262995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.263757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.264255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.289788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.290244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.298963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.299476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.328337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.343563 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a065924-2673-416c-b114-3fdc67e14fda tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1740036358" status: 201 len: 0 microversion: 2.26 time: 0.099013 Jul 02 21:16:29.345050 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1785/3618] 10.222.0.43 () {62 vars in 1379 bytes} [Sat Jul 2 21:16:29 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1740036358 => generated 0 bytes in 103 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 02 21:16:29.355494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2cbecf40-bcf4-4e30-b025-b1ee4cf7dcc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd73ace50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.364825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cbecf40-bcf4-4e30-b025-b1ee4cf7dcc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.365282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cbecf40-bcf4-4e30-b025-b1ee4cf7dcc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.379344 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2cbecf40-bcf4-4e30-b025-b1ee4cf7dcc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 200 len: 36 microversion: 2.26 time: 0.028263 Jul 02 21:16:29.384905 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1834/3619] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 21:16:29 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 36 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:29.391586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd78de5e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.403975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.404900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.405661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.415159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.415619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.416546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.417596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.451361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.452571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.489368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.509232 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98875ff8-c586-4719-99e6-172ffd941370 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1740036358" status: 204 len: 0 microversion: 2.26 time: 0.122905 Jul 02 21:16:29.510393 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1786/3620] 10.222.0.43 () {60 vars in 1363 bytes} [Sat Jul 2 21:16:29 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1740036358 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:29.522312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c475def1-2671-4817-84f1-7d9b81ae22f4 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd73db670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.533398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c475def1-2671-4817-84f1-7d9b81ae22f4 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.534510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c475def1-2671-4817-84f1-7d9b81ae22f4 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.547133 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c475def1-2671-4817-84f1-7d9b81ae22f4 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 200 len: 12 microversion: 2.26 time: 0.031437 Jul 02 21:16:29.553366 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1835/3621] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 21:16:29 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 12 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:29.560274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd785ee50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.570415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.571255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.571732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.578949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.580513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.584379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.585159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.593700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.594440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.601309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.601772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.602553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.603220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.613198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.614239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.620562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] HTTP exception thrown: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Request method failure captured: Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 HTTP/1.1 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVS5Xtj1ZUJK6ITuiEpf_Rgk8jMZugfVtxdnARTSWCeAS5AoSlTTqyyUBw7tny2HmXgxYnCQ5viV739OFmecmNuW9rjrwA1jaj24-6PRGWbAqIqp4yXAGLYkL2vGjLiu_gkcRkUQirhh3R7lqIxj6qZ1yMV8oU18nMBs9TFn-jtycA Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebcb0a2922d64d6e8d0c4114e10b954d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebcb0a2922d64d6e8d0c4114e10b954d"}]}] Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 649c6088b26049ba9a765be082f38259 Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5'} Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:29.622246 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Returning 404 to user: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:29.628494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac389b13-8356-4793-8ab3-fbb37b17f908 tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 404 len: 111 microversion: 2.1 time: 0.034335 Jul 02 21:16:29.629830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.632196 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1836/3622] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:29 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:16:29.644497 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4fa3c048-ea50-40d6-8191-0ff87d0b4a6f tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 204 len: 0 microversion: 2.26 time: 0.089432 Jul 02 21:16:29.645039 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1787/3623] 10.222.0.43 () {60 vars in 1294 bytes} [Sat Jul 2 21:16:29 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:29.655458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd73a45e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.666406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.667225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.667938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.674520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.675245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.677082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.677896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.706447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.706887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.717786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.718694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.725041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.725744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.726694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.727288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.728588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.729131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.767472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.798855 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fd1db45-816f-4284-a5f7-43a1dcee1d10 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1991596656" status: 201 len: 0 microversion: 2.26 time: 0.147816 Jul 02 21:16:29.801817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1837/3624] 10.222.0.43 () {62 vars in 1379 bytes} [Sat Jul 2 21:16:29 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1991596656 => generated 0 bytes in 151 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 02 21:16:29.811057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.812921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd7e469d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.831529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.831529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.832171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.838039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.838508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.838792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73170dff-aad3-4c7d-91f1-ecb63658e059 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1935 microversion: 2.75 time: 0.123933 Jul 02 21:16:29.839250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.839677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.852885 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1788/3625] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:29 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1935 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:29.876835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.877368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.887384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.887927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.917945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:29.935970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78dcc200-8a89-47bb-9fa2-df7efb5141b7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-412064964" status: 201 len: 0 microversion: 2.26 time: 0.127994 Jul 02 21:16:29.937055 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1838/3626] 10.222.0.43 () {62 vars in 1376 bytes} [Sat Jul 2 21:16:29 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-412064964 => generated 0 bytes in 130 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 02 21:16:29.948754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd781c670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:29.958918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.959141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.959863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:29.967699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.968527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.969473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.970710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:29.995696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:29.996273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.015873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:30.035796 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c70cc86f-b7f6-4012-b1b3-bc191e9ea19e tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 204 len: 0 microversion: 2.26 time: 0.092579 Jul 02 21:16:30.040570 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1789/3627] 10.222.0.43 () {60 vars in 1294 bytes} [Sat Jul 2 21:16:29 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:30.046757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ddb147ac-eea6-4c12-b65c-0e1655d0e923 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd739e550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.056891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddb147ac-eea6-4c12-b65c-0e1655d0e923 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.057448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ddb147ac-eea6-4c12-b65c-0e1655d0e923 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.069039 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ddb147ac-eea6-4c12-b65c-0e1655d0e923 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 200 len: 12 microversion: 2.26 time: 0.026867 Jul 02 21:16:30.070457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1839/3628] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 21:16:30 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:30.082120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd78de0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.092170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.092724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.093331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.104468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.104951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.105739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.106210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.131676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.132534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.157219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:30.197764 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5773d085-03d9-4f82-b006-9027b7e192cf tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 204 len: 0 microversion: 2.26 time: 0.120964 Jul 02 21:16:30.204130 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1790/3629] 10.222.0.43 () {60 vars in 1294 bytes} [Sat Jul 2 21:16:30 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:30.210392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd73acaf0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.220843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.221930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.222610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.230482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.231119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.232293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.233314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.262146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.262782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.276002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.276492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.325261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:30.365217 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-abb65b2a-7c15-4a4e-8e22-0a991f8addc3 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1128347883" status: 201 len: 0 microversion: 2.26 time: 0.158820 Jul 02 21:16:30.374130 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1840/3630] 10.222.0.43 () {62 vars in 1379 bytes} [Sat Jul 2 21:16:30 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1128347883 => generated 0 bytes in 168 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 02 21:16:30.381843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd73cee50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.407365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.409274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.410126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.423191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.428072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.431656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.432944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.479742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.480457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.496152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.497145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.552860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:30.588365 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03e0e403-fcf1-4dd0-8271-192d88bb70a7 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1342521301" status: 201 len: 0 microversion: 2.26 time: 0.212535 Jul 02 21:16:30.591349 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1841/3631] 10.222.0.43 () {62 vars in 1379 bytes} [Sat Jul 2 21:16:30 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags/tempest-tag-1342521301 => generated 0 bytes in 216 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 02 21:16:30.600276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3e3cbb37-7f41-490d-a36a-1f4fab268c9b req-3fd13845-5e31-4991-b6e6-ee0f5c409a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5", "name": "network-vif-deleted", "tag": "340bbd8c-1313-40d0-bbff-16735603e5c4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:30.614401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3e3cbb37-7f41-490d-a36a-1f4fab268c9b req-3fd13845-5e31-4991-b6e6-ee0f5c409a95 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.615622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3e3cbb37-7f41-490d-a36a-1f4fab268c9b req-3fd13845-5e31-4991-b6e6-ee0f5c409a95 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.631618 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3e3cbb37-7f41-490d-a36a-1f4fab268c9b req-3fd13845-5e31-4991-b6e6-ee0f5c409a95 service nova] Creating event network-vif-deleted:340bbd8c-1313-40d0-bbff-16735603e5c4 for instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 on nch2-master-1 Jul 02 21:16:30.638797 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3e3cbb37-7f41-490d-a36a-1f4fab268c9b req-3fd13845-5e31-4991-b6e6-ee0f5c409a95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044828 Jul 02 21:16:30.640110 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1842/3632] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:30.649308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Action: 'update_all', calling method: .version_select at 0x7fabd73ceee0>, body: {"tags": ["tempest-tag-1720249189", "tempest-tag-2055335697"]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:30.683961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.684451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.685092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.703702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.705172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.706006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.706449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.751202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:30.770125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.771038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.800733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:30.827359 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48d6d043-eff9-475f-b81f-3157b4003bea tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 200 len: 62 microversion: 2.26 time: 0.185628 Jul 02 21:16:30.833211 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1843/3633] 10.222.0.43 () {62 vars in 1311 bytes} [Sat Jul 2 21:16:30 2022] PUT /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 62 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:30.842287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0c2ab3c4-51f1-4a8a-8c37-02ee733353a1 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd738a310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.854900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c2ab3c4-51f1-4a8a-8c37-02ee733353a1 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.855285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c2ab3c4-51f1-4a8a-8c37-02ee733353a1 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.876831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.877525 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0c2ab3c4-51f1-4a8a-8c37-02ee733353a1 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 200 len: 62 microversion: 2.26 time: 0.041427 Jul 02 21:16:30.877901 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1844/3634] 10.222.0.43 () {60 vars in 1291 bytes} [Sat Jul 2 21:16:30 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 62 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:30.880191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.890836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.891729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.892734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.896057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.903728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.905812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.923119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.924293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.926315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.928397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.937174 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8475415-cc55-4895-bba4-1223ddd88bc8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments/aa1b5e5c-92f9-4ce4-b42d-2aeafada2342" status: 200 len: 194 microversion: 2.20 time: 0.602333 Jul 02 21:16:30.939040 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1791/3635] 10.222.0.43 () {60 vars in 1453 bytes} [Sat Jul 2 21:16:30 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments/aa1b5e5c-92f9-4ce4-b42d-2aeafada2342 => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:16:30.950059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '.version_select at 0x7fabd785e4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:30.959367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.960096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.960570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:30.970443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.971758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.972926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.974135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:30.998265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:30.998984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.015911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'flavor' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:31.033970 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b92f6262-59be-41a3-80a8-4df1fa84b310 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags" status: 204 len: 0 microversion: 2.26 time: 0.093582 Jul 02 21:16:31.038823 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1792/3636] 10.222.0.43 () {60 vars in 1294 bytes} [Sat Jul 2 21:16:30 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:31.044447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:31.045244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:31.055489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.056157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.057109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.057711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.104690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:16:31.111614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:SELECT=89,nova_cell1:DELETE=6,nova_cell1:SAVEPOINT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:31.132667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:31.177109 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e3ca9bc-0728-49b9-a6ec-09bfeb7e83e1 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1935 microversion: 2.75 time: 0.295173 Jul 02 21:16:31.181922 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1845/3637] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:30 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1935 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:31.190553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:31.195731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:31.207343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.207958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.209567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.212316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.237107 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ba77fe5-1a94-47d6-b8c7-a63a87ebfc21 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 204 len: 0 microversion: 2.26 time: 0.195281 Jul 02 21:16:31.242261 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1793/3638] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:16:31 2022] DELETE /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:31.265496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:31.267749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:31.278524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.279543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.280576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.281212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.398452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lazy-loading 'services' on Instance uuid 52054dc2-a0ff-49cd-88cc-e822331aabae {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:31.534739 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6d1f0880-8b55-4777-8cde-7419f44f43f5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments/aa1b5e5c-92f9-4ce4-b42d-2aeafada2342" status: 202 len: 0 microversion: 2.20 time: 0.350917 Jul 02 21:16:31.535365 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1846/3639] 10.222.0.43 () {60 vars in 1456 bytes} [Sat Jul 2 21:16:31 2022] DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments/aa1b5e5c-92f9-4ce4-b42d-2aeafada2342 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:16:31.547150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:31.548981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:31.559117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.559579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.560510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:31.561319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:31.607219 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-215449e5-b614-475c-ac8b-537e8afb852b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066919 Jul 02 21:16:31.607854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1847/3640] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:16:31 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:16:31.792693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:31.805125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:31.807374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:31.809240 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d68535f-1981-4c90-8e34-600d99cc5327 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1551 microversion: 2.26 time: 0.560153 Jul 02 21:16:31.810469 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1794/3641] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:31 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1551 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:32.202793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.203630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.210434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.211118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.212128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.212731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.359600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:32.383110 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-698b7907-c942-4a35-b89e-7b1c13575893 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1935 microversion: 2.75 time: 0.184705 Jul 02 21:16:32.385678 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1848/3642] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:32 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1935 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:32.622445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.624175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.634498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.635404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.635887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.636780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.672219 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3230da4-af14-4755-ad6f-3ced545f4b0e tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056517 Jul 02 21:16:32.673548 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1795/3643] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:16:32 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:16:32.788590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.789965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.800022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.800793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.802101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.803673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.829193 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] HTTP exception thrown: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.830658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.831284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Request method failure captured: Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 HTTP/1.1 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVS5Xtj1ZUJK6ITuiEpf_Rgk8jMZugfVtxdnARTSWCeAS5AoSlTTqyyUBw7tny2HmXgxYnCQ5viV739OFmecmNuW9rjrwA1jaj24-6PRGWbAqIqp4yXAGLYkL2vGjLiu_gkcRkUQirhh3R7lqIxj6qZ1yMV8oU18nMBs9TFn-jtycA Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebcb0a2922d64d6e8d0c4114e10b954d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebcb0a2922d64d6e8d0c4114e10b954d"}]}] Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 649c6088b26049ba9a765be082f38259 Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5'} Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:32.831795 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.839238 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.841888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Returning 404 to user: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:32.845739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.846125 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a09c2ed-ef98-460f-bf98-ae4bc4abbdaa tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 404 len: 111 microversion: 2.1 time: 0.060005 Jul 02 21:16:32.846351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.847134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.847786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.847919 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1849/3644] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:16:32 2022] DELETE /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:16:32.863245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.863895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.874804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.875572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.877224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.878754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.901257 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] HTTP exception thrown: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Request method failure captured: Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 HTTP/1.1 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVS5Xtj1ZUJK6ITuiEpf_Rgk8jMZugfVtxdnARTSWCeAS5AoSlTTqyyUBw7tny2HmXgxYnCQ5viV739OFmecmNuW9rjrwA1jaj24-6PRGWbAqIqp4yXAGLYkL2vGjLiu_gkcRkUQirhh3R7lqIxj6qZ1yMV8oU18nMBs9TFn-jtycA Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebcb0a2922d64d6e8d0c4114e10b954d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebcb0a2922d64d6e8d0c4114e10b954d"}]}] Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 649c6088b26049ba9a765be082f38259 Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5'} Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:32.903510 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Returning 404 to user: Instance 9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:32.909402 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-37c32500-ce30-432e-8004-8fdc16b590ad tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5" status: 404 len: 111 microversion: 2.1 time: 0.051527 Jul 02 21:16:32.910394 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1850/3645] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:32 2022] GET /compute/v2.1/servers/9f6b4e8e-b6fc-4e64-bd82-d6da175dd9c5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:16:32.916805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.917429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.924104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.924767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.925326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.925942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.945693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] HTTP exception thrown: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Request method failure captured: Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 HTTP/1.1 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVS5Xtj1ZUJK6ITuiEpf_Rgk8jMZugfVtxdnARTSWCeAS5AoSlTTqyyUBw7tny2HmXgxYnCQ5viV739OFmecmNuW9rjrwA1jaj24-6PRGWbAqIqp4yXAGLYkL2vGjLiu_gkcRkUQirhh3R7lqIxj6qZ1yMV8oU18nMBs9TFn-jtycA Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebcb0a2922d64d6e8d0c4114e10b954d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebcb0a2922d64d6e8d0c4114e10b954d"}]}] Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 649c6088b26049ba9a765be082f38259 Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '05384a41-b1d4-4a0a-bc9c-39e43a56fda2'} Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:32.947950 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:32.953550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:32.955483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Returning 404 to user: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:32.957290 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1cf7f762-4f93-4874-93ec-d53ed48db88e tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 404 len: 111 microversion: 2.1 time: 0.045638 Jul 02 21:16:32.963351 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1851/3646] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:16:32 2022] DELETE /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:16:32.970816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:32.972496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] [instance: 05384a41-b1d4-4a0a-bc9c-39e43a56fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:32.982368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.983039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:32.984030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:32.985046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:33.006457 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] HTTP exception thrown: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Request method failure captured: Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 HTTP/1.1 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVS5Xtj1ZUJK6ITuiEpf_Rgk8jMZugfVtxdnARTSWCeAS5AoSlTTqyyUBw7tny2HmXgxYnCQ5viV739OFmecmNuW9rjrwA1jaj24-6PRGWbAqIqp4yXAGLYkL2vGjLiu_gkcRkUQirhh3R7lqIxj6qZ1yMV8oU18nMBs9TFn-jtycA Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ebcb0a2922d64d6e8d0c4114e10b954d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ebcb0a2922d64d6e8d0c4114e10b954d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ebcb0a2922d64d6e8d0c4114e10b954d"}]}] Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ebcb0a2922d64d6e8d0c4114e10b954d Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestMultiNic-1345240431 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 649c6088b26049ba9a765be082f38259 Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestMultiNic-1345240431-project Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '05384a41-b1d4-4a0a-bc9c-39e43a56fda2'} Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:33.008278 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] Returning 404 to user: Instance 05384a41-b1d4-4a0a-bc9c-39e43a56fda2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:33.013562 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8228069b-250a-4aab-8690-7f3d438b41bf tempest-ServersTestMultiNic-1345240431 tempest-ServersTestMultiNic-1345240431-project] 10.222.0.43 "GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2" status: 404 len: 111 microversion: 2.1 time: 0.046853 Jul 02 21:16:33.018125 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1852/3647] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:32 2022] GET /compute/v2.1/servers/05384a41-b1d4-4a0a-bc9c-39e43a56fda2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:16:33.083984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:33.094818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:33.106476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:33.107961 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a762583-f1d4-4bc5-a82d-c8e9ad4ed4c0 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1551 microversion: 2.26 time: 0.282787 Jul 02 21:16:33.112220 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1796/3648] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:32 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1551 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:33.411640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:33.413117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:33.422280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:33.423201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:33.424268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:33.424902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:33.558883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:33.584517 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7f3a0a3-42a9-4541-9a54-287196e2e756 tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1935 microversion: 2.75 time: 0.180659 Jul 02 21:16:33.585650 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1853/3649] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:33 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1935 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:33.685503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:33.687666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:33.692481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:33.697622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:33.708797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:33.708797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:33.708797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:33.737524 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-39232144-1e6b-44e6-9757-128c40261955 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055977 Jul 02 21:16:33.738112 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1797/3650] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:16:33 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:16:34.138265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:34.141538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:34.203716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.205447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.207812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.212663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.608871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:34.610630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:34.624755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.625298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.626286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.626964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.780175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:34.794157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:34.799459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:34.805208 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-31310acf-5eec-46b8-8cab-e20d0f8c951c tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1551 microversion: 2.26 time: 0.677112 Jul 02 21:16:34.806881 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1854/3651] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:34 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1551 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:34.825209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:34.826902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:34.848299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.848978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.852943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.853878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.909912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] Lazy-loading 'services' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:34.918940 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-46871774-5ccf-4dc6-9f25-daae38f1bdf5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.107643 Jul 02 21:16:34.920540 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1855/3652] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:16:34 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:34.934683 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f88ef5a-3c1f-43d0-8f7d-bc111785523d tempest-ServersAdmin275Test-2061525205 tempest-ServersAdmin275Test-2061525205-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1920 microversion: 2.75 time: 0.331415 Jul 02 21:16:34.936127 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1798/3653] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:34 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1920 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:34.970429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:34.971796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:34.980422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.981884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:34.983153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:34.983808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.025591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:16:35.061797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:35.062378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:35.074286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.075129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.077728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.078793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.129323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:16:35.282524 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55c4b873-558e-4b75-a763-352b426b0730 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 204 len: 0 microversion: 2.75 time: 0.308785 Jul 02 21:16:35.283225 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1856/3654] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:16:34 2022] DELETE /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 02 21:16:35.299219 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6774c4ef-2619-4273-b4d3-f4743f4b020c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 204 len: 0 microversion: 2.20 time: 0.241105 Jul 02 21:16:35.301140 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1799/3655] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:16:35 2022] DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:35.301901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:35.303017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:35.317633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2d81852a-5753-49c9-ac9c-85c20e6ba192 req-f6b719ee-40d3-49cb-8137-523460adbfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d37d6c9-89a7-42c6-b865-93bed9eebb51", "name": "network-vif-deleted", "tag": "db80e86f-ec20-4e14-b9b4-1a4406e4a8d5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:35.324598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.331731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.333790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.334242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.342982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2d81852a-5753-49c9-ac9c-85c20e6ba192 req-f6b719ee-40d3-49cb-8137-523460adbfd0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.343468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2d81852a-5753-49c9-ac9c-85c20e6ba192 req-f6b719ee-40d3-49cb-8137-523460adbfd0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.366344 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2d81852a-5753-49c9-ac9c-85c20e6ba192 req-f6b719ee-40d3-49cb-8137-523460adbfd0 service nova] Creating event network-vif-deleted:db80e86f-ec20-4e14-b9b4-1a4406e4a8d5 for instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 on nch1-master-1 Jul 02 21:16:35.372752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2d81852a-5753-49c9-ac9c-85c20e6ba192 req-f6b719ee-40d3-49cb-8137-523460adbfd0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066784 Jul 02 21:16:35.374260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1800/3656] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:35.383186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:35.384353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:35.395784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.396833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.398796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.400051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.619505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.655063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.657506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.666030 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccdcd681-bb8c-48d3-88b2-7c9d7767b569 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1444 microversion: 2.75 time: 0.377422 Jul 02 21:16:35.667044 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1857/3657] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:35 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1444 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:35.829818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:35.830605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:35.838631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.839425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.840637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:35.841317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:35.857857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.871559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.877104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.882081 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc9de951-5a64-4bc3-8a6a-ad86e21c8b6d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.505502 Jul 02 21:16:35.882749 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1801/3658] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:35 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:35.966900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.977871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.979924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:35.981954 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4bb690c4-e05c-4035-a37f-86a849fe3184 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1509 microversion: 2.26 time: 0.157826 Jul 02 21:16:35.983085 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1858/3659] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:35 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:36.689736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:36.692301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:36.701611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:36.702653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:36.704825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:36.705881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:36.848158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:36.873381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:36.884366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:36.901671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:36.903155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:36.904186 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acd68720-6981-432a-9eb9-831bb5a06a44 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1444 microversion: 2.75 time: 0.220941 Jul 02 21:16:36.906960 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1802/3660] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:36 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1444 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:36.928255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:36.928856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:36.931334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:36.931796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:36.941714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=1,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:37.002180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:37.002852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:37.013793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:37.014229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:37.015036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:37.015579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:37.138466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:37.138787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:37.143083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'fault' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:37.179806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:37.194520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:37.199234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:37.202247 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-10c69494-b34b-44aa-8c4c-6342daa55070 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.304976 Jul 02 21:16:37.209267 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1859/3661] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:36 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:37.270939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:37.284753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:37.287459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:37.290224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e252d91-80ed-4fe7-9ce0-c862ac5a217d tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1351 microversion: 2.26 time: 0.292016 Jul 02 21:16:37.304098 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1803/3662] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:36 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1351 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:37.931395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:37.932302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:37.949873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:37.950333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:37.953810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:37.954301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:38.098570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.108682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.111041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.117420 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b0f34f7d-c234-4a49-8a4b-d88eaa716ee5 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1444 microversion: 2.75 time: 0.192399 Jul 02 21:16:38.118295 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1860/3663] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:37 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1444 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:38.229414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:38.234634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:38.255226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:38.255665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:38.256487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:38.258578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:38.312639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:38.313938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:38.325445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:38.329414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:38.332419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:38.334804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:38.413120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:38.415279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:38.416707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lazy-loading 'fault' on Instance uuid 8d37d6c9-89a7-42c6-b865-93bed9eebb51 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:38.524528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.540004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.548741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f194933a022742588069b78df9f1c177', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b59eba31be824dc79a797e0f756d1e2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.550386 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-989572ef-e632-459c-abe6-8b7199c379a5 tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 200 len: 1351 microversion: 2.26 time: 0.242928 Jul 02 21:16:38.551634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1861/3664] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:38 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 1351 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:38.799829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.810958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.817798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:38.821500 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fe1d11fe-0f1f-46b9-9777-eb44d361f373 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1722 microversion: 2.20 time: 0.598428 Jul 02 21:16:38.822549 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1804/3665] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:38 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1722 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:39.140540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:39.142237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:39.145430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:39.152970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.154053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.154809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.155247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.199874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.200226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.201131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lazy-loading 'fault' on Instance uuid 7d6e2683-accf-402c-8690-3c1c919bc98e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:39.397449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:39.412518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:39.418221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ad75c47e5e1f4d3ea6f7643eff6c9e0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19872a49ec264233a46bd7efb908f2ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:39.436925 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e9c71010-2cee-4d30-b827-c355856246fd tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 200 len: 1449 microversion: 2.75 time: 0.301739 Jul 02 21:16:39.442314 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1862/3666] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:39 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 1449 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:39.571861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:39.573668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] [instance: 8d37d6c9-89a7-42c6-b865-93bed9eebb51] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:39.583639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.584555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.586073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.587078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.606966 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] HTTP exception thrown: Instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 could not be found. Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Request method failure captured: Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 HTTP/1.1 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLWavfe2gyxWhCymhMY5v2TdG41__wYdICMDXxHGABsbmDRaoHnJykm1JasqdvsERio48NVGWplpD8YkMeVlZMjlZrzgaPsyCfDR423ItzA3MEfI6PrP6WjkPHuatixOQ0miLkOkx1XM2fulP0UeC8F8GbdwRHrY5FVXMPzAj1MC_BQ Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.26 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: b59eba31be824dc79a797e0f756d1e2c Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerTagsTestJSON-1578316815 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b59eba31be824dc79a797e0f756d1e2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b59eba31be824dc79a797e0f756d1e2c", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b59eba31be824dc79a797e0f756d1e2c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b59eba31be824dc79a797e0f756d1e2c"}]}] Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerTagsTestJSON-1578316815 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: b59eba31be824dc79a797e0f756d1e2c Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerTagsTestJSON-1578316815 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerTagsTestJSON-1578316815-project Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: f194933a022742588069b78df9f1c177 Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerTagsTestJSON-1578316815-project Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 could not be found. Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8d37d6c9-89a7-42c6-b865-93bed9eebb51'} Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 could not be found. Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 could not be found. Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:39.609181 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 could not be found. Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] Returning 404 to user: Instance 8d37d6c9-89a7-42c6-b865-93bed9eebb51 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-525de6f4-fef3-4df0-9b1e-c10c8be53b2b tempest-ServerTagsTestJSON-1578316815 tempest-ServerTagsTestJSON-1578316815-project] 10.222.0.43 "GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51" status: 404 len: 111 microversion: 2.26 time: 0.044290 Jul 02 21:16:39.621573 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1805/3667] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:39 2022] GET /compute/v2.1/servers/8d37d6c9-89a7-42c6-b865-93bed9eebb51 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:16:39.840777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:39.841389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:39.848033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.848859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.849857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:39.851209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:39.940322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:39.954656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:39.957108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:39.959896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-820c94a2-94f8-460f-aaf2-5eca29b53732 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1655 microversion: 2.20 time: 0.123026 Jul 02 21:16:39.976256 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1863/3668] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:39 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1655 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:40.313486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7ac6b0ee-9e77-49d4-8fff-c9735b6bf7ee req-7b116f19-f0af-4e80-8c15-1fd0ee887342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52054dc2-a0ff-49cd-88cc-e822331aabae", "name": "network-vif-deleted", "tag": "af38f887-0383-44f3-9d74-f3fa0e27aba4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:40.333240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7ac6b0ee-9e77-49d4-8fff-c9735b6bf7ee req-7b116f19-f0af-4e80-8c15-1fd0ee887342 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:40.336110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7ac6b0ee-9e77-49d4-8fff-c9735b6bf7ee req-7b116f19-f0af-4e80-8c15-1fd0ee887342 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:40.378934 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7ac6b0ee-9e77-49d4-8fff-c9735b6bf7ee req-7b116f19-f0af-4e80-8c15-1fd0ee887342 service nova] Creating event network-vif-deleted:af38f887-0383-44f3-9d74-f3fa0e27aba4 for instance 52054dc2-a0ff-49cd-88cc-e822331aabae on nch1-master-1 Jul 02 21:16:40.391102 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7ac6b0ee-9e77-49d4-8fff-c9735b6bf7ee req-7b116f19-f0af-4e80-8c15-1fd0ee887342 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079862 Jul 02 21:16:40.392192 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1806/3669] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:16:40.457021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:40.457711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] [instance: 7d6e2683-accf-402c-8690-3c1c919bc98e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:40.472533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:40.473486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:40.474086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:40.474634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:40.515389 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] HTTP exception thrown: Instance 7d6e2683-accf-402c-8690-3c1c919bc98e could not be found. Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Request method failure captured: Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e HTTP/1.1 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLVdxJzDGuRlzEJCRmEgZDXxwqO_x0oNyDM349vuMDaSvfL_K_DsslMbdyWiupigt-a7dpOg9SplmKxdBIAs9E5FPJE3-F_K6L2ctj3zol9IBt31rDYpVJ2wiORSqiQQan-FUpZrlhIHxKYQzmpvLK3EMmBRQkkj2Ma5QAIvMDn1H3g Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.75 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 19872a49ec264233a46bd7efb908f2ba Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdmin275Test-377251571 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19872a49ec264233a46bd7efb908f2ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_19872a49ec264233a46bd7efb908f2ba", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/19872a49ec264233a46bd7efb908f2ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/19872a49ec264233a46bd7efb908f2ba"}]}] Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdmin275Test-377251571 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 19872a49ec264233a46bd7efb908f2ba Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdmin275Test-377251571 Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdmin275Test-377251571-project Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ad75c47e5e1f4d3ea6f7643eff6c9e0d Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdmin275Test-377251571-project Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7d6e2683-accf-402c-8690-3c1c919bc98e could not be found. Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7d6e2683-accf-402c-8690-3c1c919bc98e'} Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6e2683-accf-402c-8690-3c1c919bc98e could not be found. Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6e2683-accf-402c-8690-3c1c919bc98e could not be found. Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:40.517566 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6e2683-accf-402c-8690-3c1c919bc98e could not be found. Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:40.523280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] Returning 404 to user: Instance 7d6e2683-accf-402c-8690-3c1c919bc98e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:40.525402 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c77f1e34-86ed-4825-9710-6f546e7284e6 tempest-ServersAdmin275Test-377251571 tempest-ServersAdmin275Test-377251571-project] 10.222.0.43 "GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e" status: 404 len: 111 microversion: 2.75 time: 0.072424 Jul 02 21:16:40.529311 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1864/3670] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:40 2022] GET /compute/v2.1/servers/7d6e2683-accf-402c-8690-3c1c919bc98e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:16:40.984384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:40.985727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:40.999473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:41.000394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:41.001454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:41.002108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:41.112400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:41.118557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:41.120384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lazy-loading 'fault' on Instance uuid 52054dc2-a0ff-49cd-88cc-e822331aabae {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:16:41.212216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:41.223872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:41.226991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:41.228830 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8cefa6e-af7a-4881-b29e-817cc2515872 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 200 len: 1371 microversion: 2.20 time: 0.249300 Jul 02 21:16:41.240672 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1807/3671] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:40 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:42.253079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:42.253643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:42.273970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:42.275628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:42.276397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:42.276833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:42.315088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] HTTP exception thrown: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Request method failure captured: Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae HTTP/1.1 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRxSC2T0Ci8MuwTucQDxvgTuvFI95SbYVYK4v6NjWN5o03ksen1itRFai2UNEd64aTa9y5vipLxW28NAyXeQ2Wi8MF76lsHPIpDqlJRoMVTt83OdtgJXlUHvMKN3FUBbL9KCxsjhoRAJ_q51NrZjKGzxYup0ICakqiyQZoi7gW7gKI Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f644f2d1c56c43cf851deb020af7161e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f644f2d1c56c43cf851deb020af7161e"}]}] Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 984631f5a77a48c5a9619e33e608dd59 Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '52054dc2-a0ff-49cd-88cc-e822331aabae'} Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:42.321204 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:16:42.326294 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:16:42.338951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Returning 404 to user: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:16:42.342324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44039b05-ac27-4ef9-8fb0-7b4443f08399 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 404 len: 111 microversion: 2.20 time: 0.096027 Jul 02 21:16:42.345114 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1865/3672] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:42 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:16:42.362267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f511c04b-859c-4247-8bc9-3426c3c501e7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '.version_select at 0x7fabd77d6d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:42.405103 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f511c04b-859c-4247-8bc9-3426c3c501e7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244259102" status: 204 len: 0 microversion: 2.20 time: 0.050024 Jul 02 21:16:42.411147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1808/3673] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:16:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244259102 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:16:44.021362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b8edf83-4bb0-44d6-a149-c36ffe27cbf4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'create', calling method: .version_select at 0x7fabd7376160>, body: {"keypair": {"name": "tempest-keypair-594701096", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3pOuVJltVHGMyyVUn08BNCU5B0Js3UVfAlvQtMAUeg+VetFejEWxB6JCD+fMrW6cm1lsqfZxRpNcJPcKsiZn2EVqDIqcE+akWh4COE2Xs24m9ZicuQ8tDREPFHc1f5gA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:44.054724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3b8edf83-4bb0-44d6-a149-c36ffe27cbf4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for project f644f2d1c56c43cf851deb020af7161e. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:16:44.084655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3b8edf83-4bb0-44d6-a149-c36ffe27cbf4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for user 984631f5a77a48c5a9619e33e608dd59 and project f644f2d1c56c43cf851deb020af7161e. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:16:44.149803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b8edf83-4bb0-44d6-a149-c36ffe27cbf4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.132367 Jul 02 21:16:44.150884 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1866/3674] 10.222.0.43 () {62 vars in 1199 bytes} [Sat Jul 2 21:16:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:16:49.316344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2114058487", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e2ccb6d-6e1d-4a18-8db3-7d2e53564721"}], "security_groups": [{"name": "tempest-securitygroup--472383764"}], "key_name": "tempest-keypair-594701096", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:49.595751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] validate_networks() for [('4e2ccb6d-6e1d-4a18-8db3-7d2e53564721', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:16:51.093271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:16:51.094698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:16:51.095397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:16:51.095901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:16:51.096459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:16:51.112129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:51.112584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:51.113382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:51.114008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:51.126051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:51.160437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for project f644f2d1c56c43cf851deb020af7161e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:16:51.178208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Getting quotas for user 984631f5a77a48c5a9619e33e608dd59 and project f644f2d1c56c43cf851deb020af7161e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:16:51.215223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:16:51.219909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:16:51.308164 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d72f4567-f329-4677-8f03-cafa7f6fab82 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.996548 Jul 02 21:16:51.309618 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1809/3675] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:16:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 1999 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:16:51.322502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b34e675e-7733-4903-91df-043e1a81b05f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:51.324019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b34e675e-7733-4903-91df-043e1a81b05f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:51.479410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b34e675e-7733-4903-91df-043e1a81b05f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:51.490975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b34e675e-7733-4903-91df-043e1a81b05f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:51.493010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b34e675e-7733-4903-91df-043e1a81b05f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:51.495813 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b34e675e-7733-4903-91df-043e1a81b05f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1281 microversion: 2.20 time: 0.180146 Jul 02 21:16:51.501355 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1867/3676] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:51 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1281 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:16:52.517530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:52.518136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:52.535967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:52.536722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:52.537719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:52.538166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:52.870977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:52.885678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:52.892906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:52.894474 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b452efb3-3199-4097-9f3c-67e4faecc733 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1333 microversion: 2.20 time: 0.383815 Jul 02 21:16:52.898538 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1810/3677] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:52 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1333 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:53.031815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=37 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:16:53.388162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-894083146", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "6322da22-ec4a-4279-8dcc-ad4888372caf"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:53.856942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:53.857569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:53.880838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:53.881330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:53.884334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:53.888211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:54.139574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] validate_networks() for [('6322da22-ec4a-4279-8dcc-ad4888372caf', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:16:54.449332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:54.465862 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4825719a-d0eb-4f99-bc09-5ff118822f06 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.608899 Jul 02 21:16:54.466921 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1811/3678] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:53 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:16:54.490840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:54.492991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:54.506164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:54.510681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:54.518174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:54.519276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:54.738555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:54.758160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:54.759912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:54.777321 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9de7aa31-8649-4f63-8585-525cd297429a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1339 microversion: 2.20 time: 0.298714 Jul 02 21:16:54.778453 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1812/3679] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:54 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:54.795339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:54.796159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:54.811306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:54.813582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:54.816352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:54.817105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:56.224263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:56.235854 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-258620bc-5786-45d3-a2f2-5a981b5d1a9f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 1.455352 Jul 02 21:16:56.236509 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1813/3680] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:54 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:56.255052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:56.262667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:56.291262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:56.296805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:56.297960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:56.298928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:56.827179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:56.853141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:56.866244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:56.867442 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70a93621-0529-4689-883a-e14748aee76a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1339 microversion: 2.20 time: 0.629987 Jul 02 21:16:56.882629 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1814/3681] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:56 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1339 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:56.909037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:56.909793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:56.941740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:56.946390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:56.947700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:56.952851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:57.219785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:16:57.220970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:16:57.222415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:16:57.223010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:16:57.223622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:16:57.243849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:57.248513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:57.249988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:57.250593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:57.319671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Getting quotas for project 6cc0bf706fb941f59a94a88a811468c7. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:16:57.341222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Getting quotas for user 4157aea6b829422398f3f1fcf3abe116 and project 6cc0bf706fb941f59a94a88a811468c7. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:16:57.375174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:16:57.381945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:16:57.565763 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.539184 Jul 02 21:16:57.566434 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1868/3682] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:16:57.592889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b91a0cca-2e9d-41f0-aff2-c2ae8c00bc80 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:57.592889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b91a0cca-2e9d-41f0-aff2-c2ae8c00bc80 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:57.917634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:57.932291 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f51ff274-7737-4dd2-9149-7fb22b53bfe6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 1.044778 Jul 02 21:16:57.937893 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1815/3683] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:56 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:57.943287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:57.943882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:57.951974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b91a0cca-2e9d-41f0-aff2-c2ae8c00bc80 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:57.971384 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b91a0cca-2e9d-41f0-aff2-c2ae8c00bc80 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1216 microversion: 2.1 time: 0.393018 Jul 02 21:16:57.972980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:57.975200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1869/3684] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:57 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1216 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:57.985247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:57.985247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:57.985247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:58.013299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:58.018048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:58.050170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:58.050675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:58.051519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:58.054248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:58.328958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:58.363977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:58.370937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:58.377702 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de87c094-751d-4a38-be8e-addecdaec87d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1339 microversion: 2.20 time: 0.438528 Jul 02 21:16:58.379214 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1816/3685] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:57 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:16:58.994847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:58.996022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:59.017023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:59.017632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:59.018742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:59.019828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:59.355561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:59.377126 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94370e48-5c35-485f-a240-dc0b78a161f6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 1.387758 Jul 02 21:16:59.398313 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1870/3686] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:57 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:59.424395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:16:59.428289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:16:59.446338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:59.447411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:59.449240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:16:59.450137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:16:59.462478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:16:59.476676 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c51a8907-0333-4db2-9158-4bbca10481e2 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1212 microversion: 2.1 time: 0.487650 Jul 02 21:16:59.484414 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1817/3687] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:16:58 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1212 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:16:59.635929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-825880161", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "8f9f01f3-6960-405f-bcaa-01885e028463"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:16:59.764995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] validate_networks() for [('8f9f01f3-6960-405f-bcaa-01885e028463', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:00.327210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:00.346539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:00.352527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:00.353934 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71793cfc-3c18-4e11-a396-6aa363c2c284 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 0.952207 Jul 02 21:17:00.355576 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1871/3688] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:16:59 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:00.494604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:00.496412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:00.503741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:00.514638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:00.515929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:00.519377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:00.854009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:00.864604 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a11531ee-4d4f-4b04-afe9-08ec8770c862 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1274 microversion: 2.1 time: 0.374290 Jul 02 21:17:00.865198 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1872/3689] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:00 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1274 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:01.126974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:01.201880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:01.373371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:01.374284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:01.392614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:01.393319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:01.394193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:01.396004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:02.214142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:02.214728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:02.215093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:02.215654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:02.216103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:02.234835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:02.239562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:02.242370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:02.243333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:02.301732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:02.321390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for user 419f3872408c4d8c9a2980d6397d0aea and project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:02.349966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:02.355120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:02.471560 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-590f866e-c32e-49bb-a58f-527e9a1c3f70 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.839592 Jul 02 21:17:02.472771 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1818/3690] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:17:02.488553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:02.489587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:02.502785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:02.503707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:02.506066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:02.507389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:02.781108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:02.796866 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-448b917f-cb08-480b-8cf9-cc384b9eec46 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1274 microversion: 2.1 time: 0.322222 Jul 02 21:17:02.800786 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1819/3691] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:02 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:02.874792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba57ae9d-6132-4d09-be3e-f7af3e9aad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:02.876614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba57ae9d-6132-4d09-be3e-f7af3e9aad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:03.021535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:03.041067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:03.049559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:03.051418 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-123c24f1-8508-40f0-bdaa-1b61e7715061 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 1.681991 Jul 02 21:17:03.056683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1873/3692] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:01 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:17:03.067523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-147af50f-1df5-4802-b0c0-ef374e6a7667 req-def1e051-6317-40fc-b7bd-1db21d105fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:03.095040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-147af50f-1df5-4802-b0c0-ef374e6a7667 req-def1e051-6317-40fc-b7bd-1db21d105fbe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:03.099548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-147af50f-1df5-4802-b0c0-ef374e6a7667 req-def1e051-6317-40fc-b7bd-1db21d105fbe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:03.147178 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-147af50f-1df5-4802-b0c0-ef374e6a7667 req-def1e051-6317-40fc-b7bd-1db21d105fbe service nova] Creating event network-changed:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:17:03.158804 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-147af50f-1df5-4802-b0c0-ef374e6a7667 req-def1e051-6317-40fc-b7bd-1db21d105fbe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098307 Jul 02 21:17:03.164588 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1874/3693] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:03.193501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba57ae9d-6132-4d09-be3e-f7af3e9aad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:03.202989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba57ae9d-6132-4d09-be3e-f7af3e9aad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1214 microversion: 2.1 time: 0.396135 Jul 02 21:17:03.210420 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1820/3694] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:02 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:03.670153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1945081312", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "bb524285-cec5-4598-9c67-5611fb01bfa2"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:03.793007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] validate_networks() for [('bb524285-cec5-4598-9c67-5611fb01bfa2', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:03.818083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:03.818970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:03.822184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:03.832500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:03.836251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:03.839431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:03.842759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:04.386215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:04.402425 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a2525e6-9639-4df1-a1af-aa125662d634 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.588930 Jul 02 21:17:04.403958 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1821/3695] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:03 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:04.418912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:04.421045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:04.453190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:04.454858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:04.456983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:04.460647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:05.600822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:05.617106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:05.619055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:05.623303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e58a2727-faba-4821-95cf-4aa81542edc5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 1.217407 Jul 02 21:17:05.624267 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1822/3696] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:04 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:05.634181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:05.636788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:05.637900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:05.638385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:05.638866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:05.639397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:05.640062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:05.657206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:05.657962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:05.659220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:05.660113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:05.668587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:05.669572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:05.671921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:05.673260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:05.713779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Getting quotas for project 6ec66c4ca37f47dcb3d18f89f3fe2a75. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:05.723656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Getting quotas for user 7e89c1afe4de42e68f65d0a700c63b4e and project 6ec66c4ca37f47dcb3d18f89f3fe2a75. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:05.758963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:05.762371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:05.864754 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac182114-37e0-49b9-be1f-5a1bbbe3dbe0 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.538481 Jul 02 21:17:05.866007 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1875/3697] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:17:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:17:05.893121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:05.893615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:05.895889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:05.905356 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f03aad18-30dc-4f77-be4b-f380a6eea725 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1272 microversion: 2.1 time: 0.276149 Jul 02 21:17:05.915318 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1823/3698] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:05 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:05.923709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acfc6717-bce4-4424-bd14-a6612d945f03 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:05.928909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acfc6717-bce4-4424-bd14-a6612d945f03 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:05.961048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:05.962379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:05.967364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:05.973814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:06.015707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-acfc6717-bce4-4424-bd14-a6612d945f03 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:06.025267 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acfc6717-bce4-4424-bd14-a6612d945f03 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1224 microversion: 2.1 time: 0.108678 Jul 02 21:17:06.026167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1824/3699] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:05 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:06.502696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:06.527804 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2dff23b2-298b-4213-b9e8-20d731cd5daf tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.660549 Jul 02 21:17:06.530965 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1876/3700] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:05 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:06.643350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:06.643975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:06.658138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:06.666663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:06.667882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:06.670598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:06.924945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:06.926361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:06.942179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:06.943908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:06.946586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:06.949055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:07.349545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:07.358025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:07.362771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:07.365765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:07.369422 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a45becb-af38-48a0-85ab-ee9ede4ab439 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 0.730019 Jul 02 21:17:07.383203 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1825/3701] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:06 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:07.388990 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9998641-e9d0-484d-a3b0-08be6b1bf652 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1272 microversion: 2.1 time: 0.469392 Jul 02 21:17:07.389666 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1877/3702] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:06 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1272 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:07.404604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:07.405457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:07.433185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:07.434712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:07.435715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:07.438042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:07.551570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:07.552784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:07.572944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:07.576985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:07.579614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:07.580562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:07.673925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:07.690738 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8b126f58-9013-4570-a0a7-0ccfb10fc2a3 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1276 microversion: 2.1 time: 0.290812 Jul 02 21:17:07.702978 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1826/3703] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:07 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1276 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:08.013314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:08.029883 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f98d0f8-a4a5-4048-a175-907e87e22645 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.486194 Jul 02 21:17:08.030690 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1878/3704] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:07 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:08.393152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:08.394060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:08.406414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:08.407890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:08.410304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:08.410766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:08.479889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a8ac0d72-fbd3-432d-8577-784fcc028594 req-db12dd0f-1354-4efb-9913-e02001118e0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f015c339-e9ca-40e0-a386-e506cff5d120", "tag": "cf33b2f7-f156-4448-b1d7-fd9f774c40c2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:08.508478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a8ac0d72-fbd3-432d-8577-784fcc028594 req-db12dd0f-1354-4efb-9913-e02001118e0b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:08.513434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a8ac0d72-fbd3-432d-8577-784fcc028594 req-db12dd0f-1354-4efb-9913-e02001118e0b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:08.562311 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a8ac0d72-fbd3-432d-8577-784fcc028594 req-db12dd0f-1354-4efb-9913-e02001118e0b service nova] Creating event network-changed:cf33b2f7-f156-4448-b1d7-fd9f774c40c2 for instance f015c339-e9ca-40e0-a386-e506cff5d120 on nch1-master-1 Jul 02 21:17:08.574666 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a8ac0d72-fbd3-432d-8577-784fcc028594 req-db12dd0f-1354-4efb-9913-e02001118e0b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.257643 Jul 02 21:17:08.577921 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1827/3705] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:08.587658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:08.589512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:08.604937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:08.605978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:08.607149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:08.610307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:08.937697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:08.957305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa4ad272-0267-48da-957c-704e55760920 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 0.378073 Jul 02 21:17:08.979504 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1828/3706] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:08 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:09.011061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:09.015519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:09.062256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:09.064177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:09.071182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:09.074189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:09.396280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:09.407077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:09.423414 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38b57be4-ce33-4381-943e-2b5b86c9a1dd tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1282 microversion: 2.1 time: 0.442485 Jul 02 21:17:09.437158 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1829/3707] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:08 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1282 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:09.445020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:09.447008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:09.458591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:09.459700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:09.462606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:09.463556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:09.691011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:09.706144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:09.708195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:09.709703 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-095b29a8-418c-473c-a37c-ceb40cb5e3f3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 1.320603 Jul 02 21:17:09.715846 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1879/3708] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:08 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:17:09.946528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:09.960602 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d54ea898-228b-4eab-b1b4-ccddf7d22ee5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.520156 Jul 02 21:17:09.962418 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1830/3709] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:09 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:10.000820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:10.001867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:10.020394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:10.021233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:10.023744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:10.027485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:10.240176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1726491438", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:10.254695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=7 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:10.337604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:11.070659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:11.082957 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3100af44-1583-4866-9465-1f97bcf3ca64 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 1.089079 Jul 02 21:17:11.086556 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1831/3710] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:09 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:11.108949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:11.109689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:11.117250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:11.117806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:11.119011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:11.119499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:11.569736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:11.586729 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-471b6141-fe68-47ee-ac24-0be9eb3a2858 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.498300 Jul 02 21:17:11.589272 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1832/3711] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:11 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:11.613389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:11.621928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:11.662781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:11.663700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:11.665366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:11.667056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:11.990412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:12.005018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:12.007601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:12.012173 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a72972b9-5dac-4dc7-ac64-9b59c6157be3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 0.421474 Jul 02 21:17:12.015180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:12.015715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:12.016541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:12.017300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:12.017978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:12.018327 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1833/3712] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:11 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:12.032421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:12.034215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:12.043377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.044345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.046054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.049324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.062721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.063276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.067174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.068995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.106543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:12.123880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:12.190461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:12.198639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:12.277511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:12.307269 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a4d780c-5196-4d89-b287-6b8b410c05f2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.344354 Jul 02 21:17:12.308758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1880/3713] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:17:12.320452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3df983aa-8c7c-465a-850f-afecc3c95353 req-e192d908-db22-4f93-a9a6-9072ab31735f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8693d34f-7523-432a-9444-a92c0db2379b", "tag": "466b4eac-080d-45ee-8ca9-1f03a25acf5f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:12.340496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3df983aa-8c7c-465a-850f-afecc3c95353 req-e192d908-db22-4f93-a9a6-9072ab31735f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.346636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3df983aa-8c7c-465a-850f-afecc3c95353 req-e192d908-db22-4f93-a9a6-9072ab31735f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.369688 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3df983aa-8c7c-465a-850f-afecc3c95353 req-e192d908-db22-4f93-a9a6-9072ab31735f service nova] Creating event network-changed:466b4eac-080d-45ee-8ca9-1f03a25acf5f for instance 8693d34f-7523-432a-9444-a92c0db2379b on nch2-master-1 Jul 02 21:17:12.393298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:12.404513 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3df983aa-8c7c-465a-850f-afecc3c95353 req-e192d908-db22-4f93-a9a6-9072ab31735f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088220 Jul 02 21:17:12.405768 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a6a0c05-bb32-4c2b-bcf9-06c402df232c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.384784 Jul 02 21:17:12.406903 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1881/3714] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:12.412498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:12.413024 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1834/3715] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:12 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:12.419489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15f74ea4-16a6-455a-b7e4-ffc9f8cf92ab tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:12.421610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15f74ea4-16a6-455a-b7e4-ffc9f8cf92ab tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:12.422519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:12.441940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.449993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.451010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:12.451632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:12.715483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15f74ea4-16a6-455a-b7e4-ffc9f8cf92ab tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:12.737752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15f74ea4-16a6-455a-b7e4-ffc9f8cf92ab tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1193 microversion: 2.1 time: 0.320791 Jul 02 21:17:12.748278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1835/3716] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:12 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1193 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:13.014381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:13.032472 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d3176cb2-b7df-418e-b4ec-08a6c962874a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 0.624089 Jul 02 21:17:13.041862 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1882/3717] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:12 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:13.049705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:13.050375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:13.076054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.078345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.085728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.086408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.277289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3b261e26-2f89-4566-b0ca-78d6bb421c8a req-44ac2850-e82f-4839-89df-7f79cdfbb659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "name": "network-vif-plugged", "status": "completed", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:13.320163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3b261e26-2f89-4566-b0ca-78d6bb421c8a req-44ac2850-e82f-4839-89df-7f79cdfbb659 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.321864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3b261e26-2f89-4566-b0ca-78d6bb421c8a req-44ac2850-e82f-4839-89df-7f79cdfbb659 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.387095 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3b261e26-2f89-4566-b0ca-78d6bb421c8a req-44ac2850-e82f-4839-89df-7f79cdfbb659 service nova] Creating event network-vif-plugged:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:17:13.400559 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3b261e26-2f89-4566-b0ca-78d6bb421c8a req-44ac2850-e82f-4839-89df-7f79cdfbb659 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.649951 Jul 02 21:17:13.413078 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1836/3718] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:13.439368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:13.442048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:13.461254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.467183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.469929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.475001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.555619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:13.564749 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-636464a6-b82a-457f-ac16-bed7d9e1823c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.521335 Jul 02 21:17:13.565360 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1883/3719] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:13 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:13.609122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:13.618971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:13.634003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.634558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.635379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:13.635824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:13.997166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:14.008886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:14.015258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:14.018851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b0e50bb-74c2-4375-9f1d-ed18aa2dcc43 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 0.604222 Jul 02 21:17:14.032856 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1837/3720] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:13 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:14.046787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:14.047793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:14.064083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:14.067353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:14.069960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:14.070608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:14.160105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:14.171120 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aa4bdc53-8f72-4abf-9112-11e3617b3a33 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.584802 Jul 02 21:17:14.178090 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1884/3721] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:13 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:14.192781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:14.193676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:14.210121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:14.211109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:14.214385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:14.217827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:14.273096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:14.291426 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d329fb7c-0ace-4e2e-95cc-cdd3c79b9747 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1189 microversion: 2.1 time: 0.256433 Jul 02 21:17:14.310398 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1838/3722] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:14 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1189 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:14.585323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:14.586379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:14.587138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:14.593451 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3cbc757a-6f30-4a63-8008-eac0f9f249f2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 0.413980 Jul 02 21:17:14.603291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:14.603291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:14.603291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:14.603291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:14.604081 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1885/3723] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:14 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:15.039124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:15.040253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:15.059324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:15.069396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:15.070453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:15.070915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:15.807766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:15.829930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:15.831506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:15.848216 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-87d44e91-0075-419f-abf0-9a55e27942ac tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 0.813627 Jul 02 21:17:15.856619 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1886/3724] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:15 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:17:15.859191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:15.859830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:15.897904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:15.898535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:15.899250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:15.899706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:15.917288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:15.933370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b3838f5-ab32-483c-89ab-ec47b1092e61 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 1.351377 Jul 02 21:17:15.950673 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1839/3725] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:14 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:15.965871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:15.971101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:15.986767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:15.987227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:15.992437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:15.992929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.217557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:16.232715 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0cac636-dc62-47ec-9f03-a0c12ce16fb6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1251 microversion: 2.1 time: 0.286522 Jul 02 21:17:16.233641 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1840/3726] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:15 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1251 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:16.238359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:16.246331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:16.258276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.259151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.260400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.261128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.679743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:16.706600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b0ff0eb-6281-4aa9-bb35-6091bf32960c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 0.467747 Jul 02 21:17:16.708419 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1841/3727] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:16 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:16.710669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:16.726587 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce751acd-ae15-44dc-a925-9dafbedd9bf6 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.876101 Jul 02 21:17:16.733243 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1887/3728] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:15 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:16.742118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8b07e342-bfa3-45bb-970d-a459e567944a req-884438b5-e0c4-454d-867c-9b630c18b848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:16.766537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b07e342-bfa3-45bb-970d-a459e567944a req-884438b5-e0c4-454d-867c-9b630c18b848 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.767558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8b07e342-bfa3-45bb-970d-a459e567944a req-884438b5-e0c4-454d-867c-9b630c18b848 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.801025 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8b07e342-bfa3-45bb-970d-a459e567944a req-884438b5-e0c4-454d-867c-9b630c18b848 service nova] Creating event network-changed:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:17:16.819577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8b07e342-bfa3-45bb-970d-a459e567944a req-884438b5-e0c4-454d-867c-9b630c18b848 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093616 Jul 02 21:17:16.822334 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1842/3729] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:16.868605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:16.869247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:16.894137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.900550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.900550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.901070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.955210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:16.955920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:16.977655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.978036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:16.978837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:16.979276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:17.957876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:17.964422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:17.970425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:17.976163 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37e063c0-ce4a-4e13-bcd8-d74651d1e56d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 1.029262 Jul 02 21:17:17.981884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:17.991626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:17.994767 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1843/3730] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:16 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:18.005956 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f48cb05-cb2a-489b-8e4a-563f52eb5dcd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1406 microversion: 2.20 time: 1.134349 Jul 02 21:17:18.006272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:18.006668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:18.009395 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1888/3731] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:16 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1406 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:18.024900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:18.027955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:18.041936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:18.042643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:18.043634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:18.044276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:18.058568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:18.059072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:18.059907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:18.072942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:18.529834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:18.544937 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d3635bbf-a180-4b46-9c8f-2fb0c3a9034f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 0.533961 Jul 02 21:17:18.545562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1889/3732] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:18 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:18.562492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:18.563124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:18.593950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:18.596592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:18.597491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:18.598051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:18.643999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:18.662838 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d792c528-be05-4735-8ba3-4f03144d0298 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.661536 Jul 02 21:17:18.665632 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1844/3733] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:17 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:18.905839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:18.917179 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8c80475-1874-440f-8178-85a9cf03a2ad tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.365330 Jul 02 21:17:18.919108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1890/3734] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:18 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:18.997530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:18.998942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:19.005640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.006443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.007649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.008353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.026711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:19.027491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:19.036189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.038691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.046397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.047071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.374822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:19.392448 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c21fe95c-9560-4b02-92dc-1ed35cebd724 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.397755 Jul 02 21:17:19.403210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:19.405898 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1845/3735] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:18 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:19.417628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:19.420562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:19.422741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c7e4413-5526-485f-82d6-c87a0fb7f172 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1599 microversion: 2.20 time: 0.399834 Jul 02 21:17:19.424156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1891/3736] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:19 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1599 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:17:19.443187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:19.443781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:19.451974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.452621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.453752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.454508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.537460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-59272e4a-1fbb-46ce-9d4c-a13ce77f44bc req-91f49764-4356-416d-975c-af3a16e25049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015c339-e9ca-40e0-a386-e506cff5d120", "name": "network-vif-plugged", "status": "completed", "tag": "cf33b2f7-f156-4448-b1d7-fd9f774c40c2"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:19.558338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-59272e4a-1fbb-46ce-9d4c-a13ce77f44bc req-91f49764-4356-416d-975c-af3a16e25049 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.559825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-59272e4a-1fbb-46ce-9d4c-a13ce77f44bc req-91f49764-4356-416d-975c-af3a16e25049 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.590863 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-59272e4a-1fbb-46ce-9d4c-a13ce77f44bc req-91f49764-4356-416d-975c-af3a16e25049 service nova] Creating event network-vif-plugged:cf33b2f7-f156-4448-b1d7-fd9f774c40c2 for instance f015c339-e9ca-40e0-a386-e506cff5d120 on nch1-master-1 Jul 02 21:17:19.612511 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-59272e4a-1fbb-46ce-9d4c-a13ce77f44bc req-91f49764-4356-416d-975c-af3a16e25049 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080444 Jul 02 21:17:19.615335 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1892/3737] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:17:19.629491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:19.635981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:19.660191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.661291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.662501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.663289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.675017 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7f97e12-8b18-4ef6-a9f3-0de9c3d83f32 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.235779 Jul 02 21:17:19.675815 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1846/3738] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:17:19 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-interface => generated 285 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:17:19.691853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:19.692552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:19.705293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.705758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:19.708963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:19.711267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:20.843871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:20.854120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:20.859210 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17834c44-6a49-4562-8edf-9940c39f4a2a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 1.240729 Jul 02 21:17:20.862240 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1893/3739] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:19 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:20.871940 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64203213-7e85-46c4-94c0-1c5be51b03f0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 1.185420 Jul 02 21:17:20.882697 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1847/3740] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:19 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:20.882942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:20.882942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:20.884971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:20.885467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:20.886450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:20.887066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:20.887616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:20.888236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:20.894933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:20.895340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:20.896212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:20.896709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:21.376435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:21.390754 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08e2e35d-49ea-4b49-93c6-7c5548e7a5fa tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.516926 Jul 02 21:17:21.393076 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1848/3741] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:20 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:21.409585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:21.423336 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8dbcba40-f825-4ddb-a0da-16954bdd600c tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1316 microversion: 2.1 time: 0.553614 Jul 02 21:17:21.426094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1894/3742] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:20 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1316 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:21.671187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6e12d1b9-fff5-48db-a2bb-a60a23916e4b req-4f1928d3-7c01-4728-a9a7-5bac66cf641b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8693d34f-7523-432a-9444-a92c0db2379b", "name": "network-vif-plugged", "status": "completed", "tag": "466b4eac-080d-45ee-8ca9-1f03a25acf5f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:21.685676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6e12d1b9-fff5-48db-a2bb-a60a23916e4b req-4f1928d3-7c01-4728-a9a7-5bac66cf641b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:21.686131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6e12d1b9-fff5-48db-a2bb-a60a23916e4b req-4f1928d3-7c01-4728-a9a7-5bac66cf641b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:21.703313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:21.718299 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6e12d1b9-fff5-48db-a2bb-a60a23916e4b req-4f1928d3-7c01-4728-a9a7-5bac66cf641b service nova] Creating event network-vif-plugged:466b4eac-080d-45ee-8ca9-1f03a25acf5f for instance 8693d34f-7523-432a-9444-a92c0db2379b on nch2-master-1 Jul 02 21:17:21.734028 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6e12d1b9-fff5-48db-a2bb-a60a23916e4b req-4f1928d3-7c01-4728-a9a7-5bac66cf641b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068264 Jul 02 21:17:21.734849 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1849/3743] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:21.887918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:21.890728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:21.890905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:21.891475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:21.900459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:21.900918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:21.901707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:21.902145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:21.905555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:21.907371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:21.909769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:21.913367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:22.083712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:22.148015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=26 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:22.683530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:22.692508 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3ab2407-19f3-4823-b762-d96c4e3fd7be tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1314 microversion: 2.1 time: 0.812918 Jul 02 21:17:22.693103 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1895/3744] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:21 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:22.707351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:22.708326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:22.716268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:22.717099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:22.718104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:22.718740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:22.735720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:22.743693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:22.756479 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9a802c7-e840-4895-a500-e72734b28602 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.864119 Jul 02 21:17:22.758626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1850/3745] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:21 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:22.772911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:22.773994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:22.793545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:22.795815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:22.797447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:22.799229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.352467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:23.370872 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-863aa6c1-a080-4f72-b802-8caee7768848 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.667444 Jul 02 21:17:23.373467 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1896/3746] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:22 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:23.386251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c568055e-8e10-44d8-8927-6ae4808487b1 req-1f14cfa7-172a-46ae-9815-cc7a3f78cd84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85341d1d-7094-41ea-b6f6-f637d68a8169", "tag": "cb165b8f-70c3-4ab9-a06e-d7eb8b0bf496"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:23.407819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c568055e-8e10-44d8-8927-6ae4808487b1 req-1f14cfa7-172a-46ae-9815-cc7a3f78cd84 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.414289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c568055e-8e10-44d8-8927-6ae4808487b1 req-1f14cfa7-172a-46ae-9815-cc7a3f78cd84 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.442901 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c568055e-8e10-44d8-8927-6ae4808487b1 req-1f14cfa7-172a-46ae-9815-cc7a3f78cd84 service nova] Creating event network-changed:cb165b8f-70c3-4ab9-a06e-d7eb8b0bf496 for instance 85341d1d-7094-41ea-b6f6-f637d68a8169 on nch1-master-1 Jul 02 21:17:23.460973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c568055e-8e10-44d8-8927-6ae4808487b1 req-1f14cfa7-172a-46ae-9815-cc7a3f78cd84 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077841 Jul 02 21:17:23.462353 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1897/3747] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:23.504569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:23.520675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1ea0a0d-c6ea-4b66-99c3-58e3ce1695b0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1505 microversion: 2.1 time: 0.757200 Jul 02 21:17:23.536973 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1851/3748] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:22 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:23.545816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:23.547127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:23.563123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.563630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.564501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.565001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.650004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:23.651149 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f4d834d6-0d78-4a50-93de-d3fdbaf9496a tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120/os-instance-actions/req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c" status: 200 len: 313 microversion: 2.1 time: 0.113237 Jul 02 21:17:23.659239 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1898/3749] 10.222.0.43 () {58 vars in 1418 bytes} [Sat Jul 2 21:17:23 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120/os-instance-actions/req-39500d83-ea6c-4ae1-a817-fe171d0c8f3c => generated 313 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:23.664455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:23.665499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:23.683035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.683513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.696001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.697703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.709919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:23.710822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:23.727472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.733458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.736560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.737062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.864729 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6cd079d-2cc6-4f10-9f94-b43666251253 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "POST /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120/action" status: 202 len: 0 microversion: 2.1 time: 0.203976 Jul 02 21:17:23.865903 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1852/3750] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:17:23 2022] POST /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:17:23.890436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:23.895088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:23.906707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.907412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:23.908539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:23.909455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:24.827930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:24.841507 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4fb79466-71d5-4518-b810-3cf37ff52160 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1501 microversion: 2.1 time: 1.135689 Jul 02 21:17:24.842824 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1899/3751] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:23 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1501 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:24.854808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:24.856196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:24.871356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:24.874006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:24.876683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:24.877812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.063536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:25.075469 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-634efeda-129d-4e89-a34b-b1632bed3cbf tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 1.207748 Jul 02 21:17:25.087327 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1853/3752] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:23 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:25.093624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:25.095205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:25.102907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:25.103696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.104751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:25.106577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.388865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:25.403140 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-746a4bec-b34e-4188-8fed-9b703a157b05 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1507 microversion: 2.1 time: 0.555424 Jul 02 21:17:25.404303 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1900/3753] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:24 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1507 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:25.432798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:25.434842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:25.449427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:25.451490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.453358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:25.454702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.489204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:25.498367 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4dbde630-3b9b-428d-a563-6d37c1ac17e1 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.409367 Jul 02 21:17:25.502336 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1854/3754] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:25 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:25.512625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0936515c-e087-461c-bfa4-0e90b098765b req-444f1df4-d1b6-412a-95d6-c98453f61115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:25.528975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0936515c-e087-461c-bfa4-0e90b098765b req-444f1df4-d1b6-412a-95d6-c98453f61115 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:25.529827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0936515c-e087-461c-bfa4-0e90b098765b req-444f1df4-d1b6-412a-95d6-c98453f61115 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.558035 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0936515c-e087-461c-bfa4-0e90b098765b req-444f1df4-d1b6-412a-95d6-c98453f61115 service nova] Creating event network-changed:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:17:25.573747 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0936515c-e087-461c-bfa4-0e90b098765b req-444f1df4-d1b6-412a-95d6-c98453f61115 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069983 Jul 02 21:17:25.577466 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1855/3755] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:25.677452 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.security_group_api [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Removing security group d0b84b97-c746-418e-8c76-f2d23f7e7a67 from port 466b4eac-080d-45ee-8ca9-1f03a25acf5f Jul 02 21:17:25.748120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0a7d8bdd-8d8f-4a70-b202-aa38be3bb956 req-c40a22a5-bed2-4a97-86f8-a9c9ba5e5dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "name": "network-vif-plugged", "status": "completed", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:25.759413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a7d8bdd-8d8f-4a70-b202-aa38be3bb956 req-c40a22a5-bed2-4a97-86f8-a9c9ba5e5dec service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:25.760224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a7d8bdd-8d8f-4a70-b202-aa38be3bb956 req-c40a22a5-bed2-4a97-86f8-a9c9ba5e5dec service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:25.773990 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0a7d8bdd-8d8f-4a70-b202-aa38be3bb956 req-c40a22a5-bed2-4a97-86f8-a9c9ba5e5dec service nova] Creating event network-vif-plugged:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:17:25.781014 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0a7d8bdd-8d8f-4a70-b202-aa38be3bb956 req-c40a22a5-bed2-4a97-86f8-a9c9ba5e5dec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037266 Jul 02 21:17:25.782626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1856/3756] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:17:26.097147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:26.099293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:26.119198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.119916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.121189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.121962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.256545 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-070b2109-0476-4523-88b4-4066c37dc50e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b/action" status: 202 len: 0 microversion: 2.1 time: 0.835342 Jul 02 21:17:26.257644 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1901/3757] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:17:25 2022] POST /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b/action => generated 0 bytes in 839 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:17:26.266016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:26.267239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:26.285819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.286484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.288804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.289974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.474935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:26.484831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71c78b9a-81df-4531-b854-dbed6139683b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.392955 Jul 02 21:17:26.493840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1857/3758] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:26 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:26.518612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:26.523543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:26.531455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.532333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.533370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.534042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.560787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:26.571020 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2a39d0b-9b97-4207-a423-300b1c9de888 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1459 microversion: 2.1 time: 0.308079 Jul 02 21:17:26.573774 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1902/3759] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:26 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1459 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:26.583082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:26.586244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:26.602373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.605260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.606398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.608080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.761950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:26.774107 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09f1a8a5-4849-42a3-a370-37f3bbf27c8d tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1507 microversion: 2.1 time: 0.275795 Jul 02 21:17:26.775187 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1858/3760] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:26 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:26.782678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:26.786679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:26.805025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.806556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:26.812414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:26.812414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:27.030844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:27.039403 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c64fa5b-94d5-461c-bd88-da9d15179b87 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.464372 Jul 02 21:17:27.040064 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1903/3761] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:26 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:27.134865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:27.152857 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58745983-f289-4500-a6af-b889633d5110 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.376307 Jul 02 21:17:27.156825 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1859/3762] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:26 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:27.175546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:27.176918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:27.189823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:27.190612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:27.192084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:27.192712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:27.409369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:27.423015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2468fa4-bd72-4395-918d-74209500c47c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.251491 Jul 02 21:17:27.424362 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1904/3763] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:27 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:27.446265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:27.447217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:27.458585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:27.461792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:27.464113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:27.464777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:27.512802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:27.512802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:27.518851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:27.527273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:27.533193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:27.536335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.031408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:28.046624 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79a3df1c-e4e5-48d0-940d-8c8d1bee8e1b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.539476 Jul 02 21:17:28.048606 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1905/3764] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:27 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:28.055899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d9ed93e5-6495-48c6-996a-d20f235db895 req-6c7232f0-b914-42b8-b2ca-5054f073858f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8693d34f-7523-432a-9444-a92c0db2379b", "tag": "466b4eac-080d-45ee-8ca9-1f03a25acf5f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:28.071505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9ed93e5-6495-48c6-996a-d20f235db895 req-6c7232f0-b914-42b8-b2ca-5054f073858f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.072359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d9ed93e5-6495-48c6-996a-d20f235db895 req-6c7232f0-b914-42b8-b2ca-5054f073858f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.076801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:28.090219 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa846905-952a-4ae7-b96e-f00d72e955f1 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.648049 Jul 02 21:17:28.106776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1860/3765] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:27 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:28.107147 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d9ed93e5-6495-48c6-996a-d20f235db895 req-6c7232f0-b914-42b8-b2ca-5054f073858f service nova] Creating event network-changed:466b4eac-080d-45ee-8ca9-1f03a25acf5f for instance 8693d34f-7523-432a-9444-a92c0db2379b on nch2-master-1 Jul 02 21:17:28.118370 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d9ed93e5-6495-48c6-996a-d20f235db895 req-6c7232f0-b914-42b8-b2ca-5054f073858f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068124 Jul 02 21:17:28.119200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1906/3766] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:28.120257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:28.121097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:28.136081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.140861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.141988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.142649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.143209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:28.144779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:28.152108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.152713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.153651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.154460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.591960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:28.607115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:28.614155 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49d4f184-4ba6-4188-88b5-0adee46a5108 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1507 microversion: 2.1 time: 0.501611 Jul 02 21:17:28.616367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:28.619565 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ed0eb0b-5472-4d48-9158-86f324bf5b56 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1324 microversion: 2.1 time: 0.499092 Jul 02 21:17:28.620453 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1907/3767] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:28 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1324 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:28.626170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:28.627047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:28.627322 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1861/3768] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:28 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:28.634835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.635597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.636670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:28.637400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:28.954418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:28.976402 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-df7d7166-7bdb-40f5-b0df-9c22b3ec5b04 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.354554 Jul 02 21:17:28.977478 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1908/3769] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:28 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:29.067366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:29.068780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:29.077705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:29.078655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:29.079705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:29.080407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:29.139046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-243176465", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "8f9f01f3-6960-405f-bcaa-01885e028463"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:29.248176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] validate_networks() for [('8f9f01f3-6960-405f-bcaa-01885e028463', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:29.907737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:29.928727 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-62c98951-215d-4901-9876-a4ce33935330 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.865876 Jul 02 21:17:29.933774 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1862/3770] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:29 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:29.941552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:29.942497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:29.954264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:29.955040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:29.956008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:29.956627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.519109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:30.537468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-873adf3d-947f-4f11-b59c-da1c932abe45 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1505 microversion: 2.1 time: 0.601378 Jul 02 21:17:30.538237 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1863/3771] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:29 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:30.543330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:30.544207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:30.552423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.552862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.553847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.554282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.740530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:30.741580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:30.742068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:30.742657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:30.743080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:30.753747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.754201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.755009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.755455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.767517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:30.775890 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51006154-9b91-44ac-b23a-062329785589 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1519 microversion: 2.1 time: 0.236346 Jul 02 21:17:30.777214 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1864/3772] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:30 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:30.782693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '.version_select at 0x7fabd7896a60>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:30.783253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:30.783985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:30.790070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Getting quotas for user 419f3872408c4d8c9a2980d6397d0aea and project 756410b2ad7345779f62a9db9835456f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:30.797432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.798177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.799198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.799845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.820543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:30.823374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:30.843655 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71e3f60f-5d64-4050-b88c-a2d552817bd0 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.065022 Jul 02 21:17:30.844761 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1865/3773] 10.222.0.43 () {58 vars in 1295 bytes} [Sat Jul 2 21:17:30 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120/os-instance-actions => generated 611 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:30.851887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8f0694c-e127-4be3-a523-9ac0d4794594 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'create', calling method: .version_select at 0x7fabd78ad160>, body: {"pool": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:30.892867 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3313400d-2f1b-45aa-977c-3ad892b99054 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758328 Jul 02 21:17:30.901081 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1909/3774] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:17:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:17:30.907645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:30.908491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:30.916548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.917311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.918409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:30.919013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:30.956287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:17:31.146843 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9bda3ad5-8b3c-484f-ade2-352901271d50 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 204 len: 0 microversion: 2.1 time: 0.243735 Jul 02 21:17:31.149361 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1910/3775] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:17:30 2022] DELETE /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:17:31.173230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bd58d062-8ab4-4324-b97c-1684c2170dd6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:31.173982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bd58d062-8ab4-4324-b97c-1684c2170dd6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:31.443589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bd58d062-8ab4-4324-b97c-1684c2170dd6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:31.457464 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bd58d062-8ab4-4324-b97c-1684c2170dd6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1214 microversion: 2.1 time: 0.302653 Jul 02 21:17:31.459926 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1911/3776] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:31 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:31.480862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:31.483032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:31.491350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:31.503027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:31.503497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:31.506645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:31.507350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:31.767172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:31.775105 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-deb224b1-152b-4fa5-8b4c-d58300d88671 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.303813 Jul 02 21:17:31.775695 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1912/3777] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:31 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:31.784280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:31.784888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:31.791477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:31.791930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:31.792964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:31.793864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:32.157501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:32.175639 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4197817d-347e-4f32-b6da-eb22f29f40e5 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1511 microversion: 2.1 time: 0.398644 Jul 02 21:17:32.177335 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1913/3778] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:31 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:32.478007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:32.479091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:32.493958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:32.498749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:32.499852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:32.500503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:32.611638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:32.622632 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cea83f78-f935-4170-b556-cf64c6e7467b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1274 microversion: 2.1 time: 0.149160 Jul 02 21:17:32.636155 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1914/3779] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:32 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:32.792437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:32.793045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:32.799494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:32.799837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:32.800842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:32.802030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:33.266745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:33.296334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f332d37-d841-48f5-927c-dd5fc3639af3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.507355 Jul 02 21:17:33.297888 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1915/3780] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:32 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:33.305371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:33.306769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:33.318562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:33.319158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:33.325001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8f0694c-e127-4be3-a523-9ac0d4794594 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.475379 Jul 02 21:17:33.326844 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1866/3781] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:17:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:33.327215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:33.327767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:33.543745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1987394736", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "bb524285-cec5-4598-9c67-5611fb01bfa2"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:33.664653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] validate_networks() for [('bb524285-cec5-4598-9c67-5611fb01bfa2', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:34.085969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4157aea6b829422398f3f1fcf3abe116', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc0bf706fb941f59a94a88a811468c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:34.100801 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-475a0657-6da4-42b9-a737-700413db94a8 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 200 len: 1511 microversion: 2.1 time: 0.801431 Jul 02 21:17:34.101706 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1916/3782] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:33 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:34.113364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:34.115594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:34.131514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:34.133583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:34.134781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:34.135543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:34.793837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:34.809183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2523d6d8-dafd-4ba8-b3a0-d76f7bb9b959 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1314 microversion: 2.1 time: 0.706097 Jul 02 21:17:34.818716 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1917/3783] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:34 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:34.828545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:34.829337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:34.838611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:34.839067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:34.839867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:34.845164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:35.761280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:35.762579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:35.763174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:35.763611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:35.764171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:35.767023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:35.777496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:35.777945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:35.778791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:35.779216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:35.799177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Getting quotas for project 6ec66c4ca37f47dcb3d18f89f3fe2a75. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:35.807836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Getting quotas for user 7e89c1afe4de42e68f65d0a700c63b4e and project 6ec66c4ca37f47dcb3d18f89f3fe2a75. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:35.830347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:35.833233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:35.853910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:35.869712 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f89afa0-2337-4dee-8f92-925b003b11f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 1.057580 Jul 02 21:17:35.871015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1918/3784] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:34 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:35.883859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:35.884753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:35.895910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:35.896577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:35.897782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:35.898391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:35.924654 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8fe177d-ff9e-4c87-a326-c2b8c14457c4 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.384612 Jul 02 21:17:35.930971 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1867/3785] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:17:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:17:35.937556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cf28e1ed-5f8c-4724-b0a6-4fe7d4c9fffb req-933dc35a-074e-4be6-a8ee-8738b5f17587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85341d1d-7094-41ea-b6f6-f637d68a8169", "name": "network-vif-plugged", "status": "completed", "tag": "cb165b8f-70c3-4ab9-a06e-d7eb8b0bf496"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:35.956059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cf28e1ed-5f8c-4724-b0a6-4fe7d4c9fffb req-933dc35a-074e-4be6-a8ee-8738b5f17587 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:35.963327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cf28e1ed-5f8c-4724-b0a6-4fe7d4c9fffb req-933dc35a-074e-4be6-a8ee-8738b5f17587 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.012629 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cf28e1ed-5f8c-4724-b0a6-4fe7d4c9fffb req-933dc35a-074e-4be6-a8ee-8738b5f17587 service nova] Creating event network-vif-plugged:cb165b8f-70c3-4ab9-a06e-d7eb8b0bf496 for instance 85341d1d-7094-41ea-b6f6-f637d68a8169 on nch1-master-1 Jul 02 21:17:36.026189 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cf28e1ed-5f8c-4724-b0a6-4fe7d4c9fffb req-933dc35a-074e-4be6-a8ee-8738b5f17587 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092797 Jul 02 21:17:36.029340 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1868/3786] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:36.042082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-42454f1d-8c4d-4c67-97dd-267c0fa5096b req-ec97806f-ac60-42e2-af7a-93f13983f3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a01794da-b81d-47ba-b8a4-05a57954ff14", "tag": "2d6ad206-3709-4149-8bf2-0de5883a6288"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:36.062317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-42454f1d-8c4d-4c67-97dd-267c0fa5096b req-ec97806f-ac60-42e2-af7a-93f13983f3aa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:36.064942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-42454f1d-8c4d-4c67-97dd-267c0fa5096b req-ec97806f-ac60-42e2-af7a-93f13983f3aa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.078613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:36.101576 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-42454f1d-8c4d-4c67-97dd-267c0fa5096b req-ec97806f-ac60-42e2-af7a-93f13983f3aa service nova] Creating event network-changed:2d6ad206-3709-4149-8bf2-0de5883a6288 for instance a01794da-b81d-47ba-b8a4-05a57954ff14 on nch2-master-1 Jul 02 21:17:36.114920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-42454f1d-8c4d-4c67-97dd-267c0fa5096b req-ec97806f-ac60-42e2-af7a-93f13983f3aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083956 Jul 02 21:17:36.119033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1869/3787] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:36.129438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c4ab476c-3795-4737-bdb2-099f1c5b1cbc req-426255f3-76e1-4481-bfc9-ae1b9ad6b751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f015c339-e9ca-40e0-a386-e506cff5d120", "name": "network-vif-deleted", "tag": "cf33b2f7-f156-4448-b1d7-fd9f774c40c2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:36.141878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c4ab476c-3795-4737-bdb2-099f1c5b1cbc req-426255f3-76e1-4481-bfc9-ae1b9ad6b751 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:36.143255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c4ab476c-3795-4737-bdb2-099f1c5b1cbc req-426255f3-76e1-4481-bfc9-ae1b9ad6b751 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.161173 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c4ab476c-3795-4737-bdb2-099f1c5b1cbc req-426255f3-76e1-4481-bfc9-ae1b9ad6b751 service nova] Creating event network-vif-deleted:cf33b2f7-f156-4448-b1d7-fd9f774c40c2 for instance f015c339-e9ca-40e0-a386-e506cff5d120 on nch1-master-1 Jul 02 21:17:36.170019 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c4ab476c-3795-4737-bdb2-099f1c5b1cbc req-426255f3-76e1-4481-bfc9-ae1b9ad6b751 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048476 Jul 02 21:17:36.171417 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1870/3788] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:36.179646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:36.180702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] [instance: f015c339-e9ca-40e0-a386-e506cff5d120] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:36.188959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:36.190398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.191876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:36.192416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.216268 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] HTTP exception thrown: Instance f015c339-e9ca-40e0-a386-e506cff5d120 could not be found. Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Request method failure captured: Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 HTTP/1.1 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXE-g766GtjWpOek4_o0FCap0NcvgYR10Z52YL4NaZiQROYkg6rWAIJkW4yrj7c0Yde3GlvqPFqIpJmXJk6jxZTg6CdBiyPl6w9GRL9p2LYG3ePfqWgdx-M_jY05qHI6lHDDpljg9ecHvxI1kXqGGzKhWo3IYsNmDx3ciu-qSzCDTc Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6cc0bf706fb941f59a94a88a811468c7 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsTestJSON-795268209 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6cc0bf706fb941f59a94a88a811468c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6cc0bf706fb941f59a94a88a811468c7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6cc0bf706fb941f59a94a88a811468c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6cc0bf706fb941f59a94a88a811468c7"}]}] Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsTestJSON-795268209 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6cc0bf706fb941f59a94a88a811468c7 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsTestJSON-795268209 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsTestJSON-795268209-project Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4157aea6b829422398f3f1fcf3abe116 Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsTestJSON-795268209-project Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance f015c339-e9ca-40e0-a386-e506cff5d120 could not be found. Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'f015c339-e9ca-40e0-a386-e506cff5d120'} Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f015c339-e9ca-40e0-a386-e506cff5d120 could not be found. Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f015c339-e9ca-40e0-a386-e506cff5d120 could not be found. Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:17:36.218210 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f015c339-e9ca-40e0-a386-e506cff5d120 could not be found. Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] Returning 404 to user: Instance f015c339-e9ca-40e0-a386-e506cff5d120 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98f8d13c-19e2-4431-a28b-423e1c457749 tempest-InstanceActionsTestJSON-795268209 tempest-InstanceActionsTestJSON-795268209-project] 10.222.0.43 "GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120" status: 404 len: 111 microversion: 2.1 time: 0.049101 Jul 02 21:17:36.227645 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1871/3789] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:36 2022] GET /compute/v2.1/servers/f015c339-e9ca-40e0-a386-e506cff5d120 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:17:36.228722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:36.228722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:36.246345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:36.246805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.251927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:36.254312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:36.961741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:36.978612 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a5dd240d-7a21-443e-ae2c-b3640f63c3c7 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1314 microversion: 2.1 time: 0.754560 Jul 02 21:17:36.979344 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1872/3790] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:36 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:36.992705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:36.993336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:37.010473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:37.012890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:37.013564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:37.014768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:37.015375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:37.035071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:37.036832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:37.038178 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75b18652-c917-447e-aecb-b09886752f8a tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2950 microversion: 2.32 time: 1.166021 Jul 02 21:17:37.038762 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1919/3791] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:35 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2950 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:37.053586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:37.065342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:37.075050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:37.075857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:37.077044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:37.077741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:37.252819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:37.265884 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d2f8c3c-c93b-498a-9ee5-0165a145f13c tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1228 microversion: 2.1 time: 0.285075 Jul 02 21:17:37.267452 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1873/3792] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:36 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1228 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:37.273416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:37.274503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:37.282809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:37.283262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:37.284175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:37.284520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:37.480179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-acb0aca1-d261-4eda-9030-57541afe5d2d tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.210929 Jul 02 21:17:37.483324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1874/3793] 10.222.0.43 () {60 vars in 1315 bytes} [Sat Jul 2 21:17:37 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478/os-interface => generated 1831 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:37.504440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:37.513158 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-847e6ae9-2436-474e-99ca-c8a69d6bf9a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1293 microversion: 2.1 time: 0.466804 Jul 02 21:17:37.520564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1920/3794] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:37 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1293 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:37.996371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:37.997893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:38.018068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:38.018529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:38.019705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:38.024368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:38.267802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:38.277838 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4317566a-4f0a-4b6a-9089-52480d20a00b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1314 microversion: 2.1 time: 0.285429 Jul 02 21:17:38.279229 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1875/3795] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:37 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:38.290333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:38.292456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:38.308402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:38.310676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:38.313293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:38.314526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:38.507747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:38.520647 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-08f27b68-a6a3-4480-abd0-fdbc87fdc151 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1276 microversion: 2.1 time: 0.238980 Jul 02 21:17:38.522362 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1921/3796] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:38 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:38.533082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:38.533736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:38.541258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:38.541709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:38.542551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:38.542992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:38.972816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:38.992084 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83a57230-7388-4607-8d3a-b0d71eab1989 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1474 microversion: 2.1 time: 0.463682 Jul 02 21:17:39.004301 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1876/3797] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:38 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1474 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:39.211101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-599897715", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:39.300961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:39.302415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:39.326074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:39.338535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:39.339202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:39.340079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:39.340529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:39.807356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:39.817607 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4118a13e-a589-47c6-9fa1-1c2b7f86baa2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1314 microversion: 2.1 time: 0.526514 Jul 02 21:17:39.818207 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1877/3798] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:39 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:39.835399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:39.836395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:39.846247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:39.847011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:39.848761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:39.849480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:40.059234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:40.084577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-899ff187-02ad-48d3-9ad2-2d527a0ac155 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1282 microversion: 2.1 time: 0.260922 Jul 02 21:17:40.085483 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1878/3799] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:39 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1282 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:40.103358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-46595e44-d507-4192-b4ec-4043d6a95cc0 req-6bddbe45-fbc7-4c07-9bd1-7e438879aab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01794da-b81d-47ba-b8a4-05a57954ff14", "name": "network-vif-plugged", "status": "completed", "tag": "2d6ad206-3709-4149-8bf2-0de5883a6288"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:40.126278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-46595e44-d507-4192-b4ec-4043d6a95cc0 req-6bddbe45-fbc7-4c07-9bd1-7e438879aab1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:40.128775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-46595e44-d507-4192-b4ec-4043d6a95cc0 req-6bddbe45-fbc7-4c07-9bd1-7e438879aab1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:40.153849 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-46595e44-d507-4192-b4ec-4043d6a95cc0 req-6bddbe45-fbc7-4c07-9bd1-7e438879aab1 service nova] Creating event network-vif-plugged:2d6ad206-3709-4149-8bf2-0de5883a6288 for instance a01794da-b81d-47ba-b8a4-05a57954ff14 on nch2-master-1 Jul 02 21:17:40.162283 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-46595e44-d507-4192-b4ec-4043d6a95cc0 req-6bddbe45-fbc7-4c07-9bd1-7e438879aab1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073531 Jul 02 21:17:40.163683 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1879/3800] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:40.748351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:40.749724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:40.750503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:40.751261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:40.751919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:40.765426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:40.766173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:40.768082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:40.769281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:40.793728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:40.802473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:40.818641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:40.821656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: d9c9e71a-cc20-46ab-9ad6-b9f56ec98901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:40.840678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:40.842189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:40.860386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:40.860836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:40.863084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:40.863496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:40.905613 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c6fa405-1332-45e6-a199-4faabe4f2727 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.699019 Jul 02 21:17:40.908701 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1922/3801] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:17:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:17:40.921229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6a76b142-5e66-4fa3-b33e-c3586f20e712 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:40.922112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6a76b142-5e66-4fa3-b33e-c3586f20e712 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: d9c9e71a-cc20-46ab-9ad6-b9f56ec98901] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:40.964605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6a76b142-5e66-4fa3-b33e-c3586f20e712 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: d9c9e71a-cc20-46ab-9ad6-b9f56ec98901] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:17:41.265369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:41.283120 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-966cc476-2092-463a-87b0-1e03857064c5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1314 microversion: 2.1 time: 0.446938 Jul 02 21:17:41.287189 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1880/3802] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:40 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:41.308275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:41.311140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:41.335673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:41.337172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:41.338738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:41.340511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:41.398226 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6a76b142-5e66-4fa3-b33e-c3586f20e712 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901" status: 204 len: 0 microversion: 2.1 time: 0.483094 Jul 02 21:17:41.402647 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1923/3803] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:17:40 2022] DELETE /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:17:41.418195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb03df9b-0d51-4c75-96f7-ee04d5639b3e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:41.419908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fb03df9b-0d51-4c75-96f7-ee04d5639b3e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: d9c9e71a-cc20-46ab-9ad6-b9f56ec98901] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:41.483236 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-fb03df9b-0d51-4c75-96f7-ee04d5639b3e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb03df9b-0d51-4c75-96f7-ee04d5639b3e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 HTTP/1.1 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd9c9e71a-cc20-46ab-9ad6-b9f56ec98901'} Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:17:41.499151 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb03df9b-0d51-4c75-96f7-ee04d5639b3e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:17:41.504763 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fb03df9b-0d51-4c75-96f7-ee04d5639b3e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901" status: 404 len: 111 microversion: 2.1 time: 0.097397 Jul 02 21:17:41.513451 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1924/3804] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:41 2022] GET /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:17:41.670812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1256152987", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:41.836480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:17:42.116221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:42.128198 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e04637b2-4fc1-4150-94a9-64700e518dc6 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.836907 Jul 02 21:17:42.129015 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1881/3805] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:41 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:42.303873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:42.305701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:42.315707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:42.317241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:42.318535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:42.318858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:43.412766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:43.421645 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17e981f0-d48c-47b0-b2f7-278973ebc468 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1502 microversion: 2.1 time: 1.123101 Jul 02 21:17:43.422640 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1882/3806] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:42 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1502 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:43.455357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:43.459222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:43.473404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:43.473913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:43.474693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:43.475128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.201795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:44.203104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:44.203817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:44.204532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:44.205310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:44.227557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:44.228553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.231397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:44.231932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.261693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:44.272962 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbcbfac8-bff0-4074-a72f-be2bf6e6fceb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.830031 Jul 02 21:17:44.282535 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1883/3807] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:43 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:44.291755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:44.298696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:44.305201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:44.318343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:44.319100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.320661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:44.323362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.328074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:44.388432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:44.399931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:44.488569 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70f78951-fdc1-480f-8d74-e6aaa91bbf09 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14/action" status: 202 len: 0 microversion: 2.1 time: 0.203981 Jul 02 21:17:44.492248 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1884/3808] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:17:44 2022] POST /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:17:44.517902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:44.518621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:44.526145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:44.526889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.527860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:44.528602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:44.571970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2100d19-ecd7-4ac5-9693-a4c6c9d8bf90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.907637 Jul 02 21:17:44.574007 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1925/3809] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:17:44.596527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f068c5e9-7e78-4b87-af4e-45122ec26235 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:44.597226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f068c5e9-7e78-4b87-af4e-45122ec26235 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:44.909412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f068c5e9-7e78-4b87-af4e-45122ec26235 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:44.922412 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f068c5e9-7e78-4b87-af4e-45122ec26235 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1221 microversion: 2.1 time: 0.338961 Jul 02 21:17:44.923528 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1926/3810] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:44 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:45.144827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-45a85160-1faf-44e7-a5ea-42323103214d req-aeac5486-e7c3-4f62-ad46-6b45bad46932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522cf594-507b-4b58-bc86-0e6451bffb95", "tag": "db000a98-2f3a-4669-bf8d-8660ee028598"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:45.167686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-45a85160-1faf-44e7-a5ea-42323103214d req-aeac5486-e7c3-4f62-ad46-6b45bad46932 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:45.177871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-45a85160-1faf-44e7-a5ea-42323103214d req-aeac5486-e7c3-4f62-ad46-6b45bad46932 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:45.208470 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-45a85160-1faf-44e7-a5ea-42323103214d req-aeac5486-e7c3-4f62-ad46-6b45bad46932 service nova] Creating event network-changed:db000a98-2f3a-4669-bf8d-8660ee028598 for instance 522cf594-507b-4b58-bc86-0e6451bffb95 on nch1-master-1 Jul 02 21:17:45.223405 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-45a85160-1faf-44e7-a5ea-42323103214d req-aeac5486-e7c3-4f62-ad46-6b45bad46932 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082814 Jul 02 21:17:45.227251 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1927/3811] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:45.305417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:45.306204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:45.323432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:45.325917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:45.326812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:45.327339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:45.570739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:45.586498 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e6659d5-c4ae-425b-b32f-8318c632983f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1507 microversion: 2.1 time: 1.080384 Jul 02 21:17:45.587621 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1885/3812] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:44 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1507 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:45.939758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:45.941009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:45.941842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:45.948066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:45.949167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:45.952295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-68c1d7b0-e5c5-44d9-9427-cd96ca15f26b tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.656129 Jul 02 21:17:45.952937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:45.953608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:45.954684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:45.955256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:45.963602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1928/3813] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:45 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:46.052095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:46.078194 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f540a6a6-384a-493c-aa41-05b042c81c4c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1273 microversion: 2.1 time: 0.140927 Jul 02 21:17:46.087956 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1886/3814] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:45 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1273 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:46.606246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:46.606964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:46.614671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:46.615525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:46.615977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:46.616447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:46.642150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:46.971056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:46.972450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:46.983192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:46.984185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:46.985771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:46.986733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:47.132554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:47.142767 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20d84d5f-1ac6-4f2b-906d-1be19440d33a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1487 microversion: 2.1 time: 0.540555 Jul 02 21:17:47.155531 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1929/3815] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:46 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1487 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:47.167846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:47.168531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:47.191007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:47.204423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:47.205300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:47.205754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:47.766966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:47.776285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:47.778038 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db6bd923-895b-4d2a-975e-83f5054069f4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1279 microversion: 2.1 time: 0.618748 Jul 02 21:17:47.779019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:47.779381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1930/3816] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:47 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1279 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:47.791927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:47.793000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:47.799285 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51a45afc-b4b7-486a-ae5f-6edba91b60ca tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.833238 Jul 02 21:17:47.800210 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1887/3817] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:46 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:47.810474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:47.813203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:47.814248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:47.814689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:47.846470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lazy-loading 'flavor' on Instance uuid a01794da-b81d-47ba-b8a4-05a57954ff14 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:17:48.023537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1589854933", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": "none"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:48.110251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:17:48.111613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:17:48.112240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:17:48.112605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:17:48.113023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:17:48.136574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.136965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.137813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.138247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.157874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Getting quotas for project a2af6b3a0a814ce7afb1ae17717f006d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:17:48.165572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Getting quotas for user 6fd3a7fe3e614b9f91c7905c1e2464a8 and project a2af6b3a0a814ce7afb1ae17717f006d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:17:48.208444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:17:48.212324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:17:48.267743 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad1e7985-0297-4508-a354-ed157e4ef870 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14/action" status: 202 len: 0 microversion: 2.1 time: 0.486212 Jul 02 21:17:48.275420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1931/3818] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:17:47 2022] POST /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:17:48.288948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:48.290006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:48.300466 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3238b08e-d5eb-4609-9814-56bb7bd9a404 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.495869 Jul 02 21:17:48.302529 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1888/3819] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:17:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:17:48.314711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a7d73e8-54dd-4f51-b73b-29ffba0e3452 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:48.315745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a7d73e8-54dd-4f51-b73b-29ffba0e3452 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:48.342943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.343772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.354233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.355030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.578773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a7d73e8-54dd-4f51-b73b-29ffba0e3452 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:48.594845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a7d73e8-54dd-4f51-b73b-29ffba0e3452 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:48.607548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a7d73e8-54dd-4f51-b73b-29ffba0e3452 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:48.612494 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a7d73e8-54dd-4f51-b73b-29ffba0e3452 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1281 microversion: 2.47 time: 0.302591 Jul 02 21:17:48.624321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1889/3820] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:48 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1281 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:48.797881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:48.807446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:48.813464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:48.815645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4417589-bce1-4fa8-84e2-9fc59fe0afbb tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1493 microversion: 2.1 time: 0.538138 Jul 02 21:17:48.818358 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1932/3821] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:48 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1493 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:48.833770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:48.835447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:48.845511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.846386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.847403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.848238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.856928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.858702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:48.859649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:48.860962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:49.156015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:49.186273 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7d6c0ff-f328-412e-b184-1486ee3191e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1279 microversion: 2.1 time: 0.392725 Jul 02 21:17:49.189693 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1890/3822] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:48 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1279 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:49.570407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:49.583204 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8821a246-2d94-4bb5-8af9-614e2e76fe72 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.759238 Jul 02 21:17:49.586402 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1933/3823] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:48 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:49.634408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:49.635036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:49.646930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:49.647345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:49.648607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:49.649216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:49.835583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:49.837544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:49.857882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:49.859252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:49.860377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:49.861026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:49.913313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:49.957944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:49.968258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:49.971291 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e69458f3-c45e-4b09-85e0-042ea20b3cef tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1333 microversion: 2.47 time: 0.340937 Jul 02 21:17:49.974170 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1891/3824] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:49 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1333 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:50.207081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:50.207747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:50.221560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:50.222355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:50.223508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:50.224313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:50.855973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:50.870667 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e8777c4-b8e0-4197-8d40-a53ea66da689 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1514 microversion: 2.1 time: 1.038431 Jul 02 21:17:50.873191 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1934/3825] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:49 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1514 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:50.899693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:50.915396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:50.933254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:50.935038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:50.936890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:50.940534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:51.252788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:51.263635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7b438c5-ba54-4c4e-82ea-e01326e6a37b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 1.061799 Jul 02 21:17:51.277290 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1892/3826] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:50 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:51.292093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:51.293101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:51.311564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:51.312697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:51.313644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:51.315401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:51.530011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:51.545120 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-69beed00-4522-46b9-a0d2-9a46ed95bfdc tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.668609 Jul 02 21:17:51.552956 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1935/3827] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:50 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:51.595842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:51.612606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:51.614301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:51.615514 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc872a00-2c73-47c3-8512-0e7c24edfb9d tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1339 microversion: 2.47 time: 0.336688 Jul 02 21:17:51.616135 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1893/3828] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:51 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1339 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:51.899820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:51.902234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:51.910356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:51.911150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:51.912203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:51.913148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:52.282536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:52.283176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:52.299094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:52.310108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:52.320188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:52.327141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:52.530764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:52.548330 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d2a07c31-3858-4245-a758-8233ca74fc5b tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1514 microversion: 2.1 time: 0.653031 Jul 02 21:17:52.550431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1936/3829] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:51 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1514 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:52.569102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-8ef27ebe-ba7e-4d0f-bc7b-8b2200380a8f req-c6802b94-254a-4131-a4fc-a04e1743de83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5be14be9-4dc3-4992-8853-cf7bb88302a4", "tag": "13372403-b196-459f-a251-7f8856b0ede3"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:52.591242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8ef27ebe-ba7e-4d0f-bc7b-8b2200380a8f req-c6802b94-254a-4131-a4fc-a04e1743de83 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:52.592412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8ef27ebe-ba7e-4d0f-bc7b-8b2200380a8f req-c6802b94-254a-4131-a4fc-a04e1743de83 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:52.674480 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-8ef27ebe-ba7e-4d0f-bc7b-8b2200380a8f req-c6802b94-254a-4131-a4fc-a04e1743de83 service nova] Creating event network-changed:13372403-b196-459f-a251-7f8856b0ede3 for instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 on nch1-master-1 Jul 02 21:17:52.708835 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-8ef27ebe-ba7e-4d0f-bc7b-8b2200380a8f req-c6802b94-254a-4131-a4fc-a04e1743de83 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153650 Jul 02 21:17:52.710924 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1937/3830] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:52.723738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3ae60d1e-9ff5-424e-ab8b-671eb717cd56 req-5cc142b7-c1ca-403f-a96a-21a4b5371164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01794da-b81d-47ba-b8a4-05a57954ff14", "name": "network-vif-plugged", "status": "completed", "tag": "2d6ad206-3709-4149-8bf2-0de5883a6288"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:52.745876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:52.748858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3ae60d1e-9ff5-424e-ab8b-671eb717cd56 req-5cc142b7-c1ca-403f-a96a-21a4b5371164 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:52.753667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3ae60d1e-9ff5-424e-ab8b-671eb717cd56 req-5cc142b7-c1ca-403f-a96a-21a4b5371164 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:52.783941 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3ae60d1e-9ff5-424e-ab8b-671eb717cd56 req-5cc142b7-c1ca-403f-a96a-21a4b5371164 service nova] Creating event network-vif-plugged:2d6ad206-3709-4149-8bf2-0de5883a6288 for instance a01794da-b81d-47ba-b8a4-05a57954ff14 on nch2-master-1 Jul 02 21:17:52.794529 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3ae60d1e-9ff5-424e-ab8b-671eb717cd56 req-5cc142b7-c1ca-403f-a96a-21a4b5371164 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079601 Jul 02 21:17:52.795918 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1938/3831] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:52.804737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:52.805823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:52.813608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:52.814438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:52.815862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:52.816521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:53.776070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:53.790925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:53.797741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c9023ed-1976-4bfd-8374-f664ea9f55b7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 1.000271 Jul 02 21:17:53.798704 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1939/3832] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:52 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:53.811095 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-380d3afc-2213-4cc4-8324-767c2f3c6bb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 1.533104 Jul 02 21:17:53.820476 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1894/3833] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:52 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:53.822126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:53.822960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:53.825905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:53.826751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:53.834560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:53.835265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:53.836266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:53.836866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:53.851038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:53.851485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:53.852709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:53.853283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.154945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:54.177678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:54.183438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:54.191477 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6c3e117-b7e4-4880-8545-6ee82c55be40 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1360 microversion: 2.47 time: 0.385505 Jul 02 21:17:54.192322 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1940/3834] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:53 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1360 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:54.210728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2050772554"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:54.212093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:54.219711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:54.220261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.221270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:54.221763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.279602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:54.399602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:54.420516 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcc8f1cb-dbe0-4158-acf9-48ee27d2cf7a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 0.605820 Jul 02 21:17:54.422311 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1895/3835] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:53 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:54.762271 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03e010dd-9bc6-46e3-8ac4-059a1a244590 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "POST /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1/action" status: 202 len: 52 microversion: 2.47 time: 0.555520 Jul 02 21:17:54.763260 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1941/3836] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:17:54 2022] POST /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1/action => generated 52 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 02 21:17:54.784438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:54.785087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:54.832693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:54.832693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:54.837068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:54.845180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.852081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:54.852932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:54.853438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.853902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.856483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:54.857098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:54.962369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=24 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:55.015195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:17:55.245685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20c84edc-281d-459d-9f28-f98fe7ba8cda tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "DELETE /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 204 len: 0 microversion: 2.47 time: 0.471278 Jul 02 21:17:55.246331 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1896/3837] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:17:54 2022] DELETE /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:17:55.264828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:55.265485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:55.298062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.298543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.299346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.302283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.659129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:55.671415 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-adb8ca0d-1af7-4072-9bff-eb86cd02a72a tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.859417 Jul 02 21:17:55.673416 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1942/3838] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:54 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:55.686290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-669ab831-eb39-43be-a7c8-908b17ec04d1 req-cc281e73-cc8b-4d27-a981-aca480b8b354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522cf594-507b-4b58-bc86-0e6451bffb95", "name": "network-vif-plugged", "status": "completed", "tag": "db000a98-2f3a-4669-bf8d-8660ee028598"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:17:55.699322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:55.708791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb6d91d3-57e4-42be-bb17-e62738d94c8d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 0.458582 Jul 02 21:17:55.724475 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1897/3839] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:55 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:55.728030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-669ab831-eb39-43be-a7c8-908b17ec04d1 req-cc281e73-cc8b-4d27-a981-aca480b8b354 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.728693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-669ab831-eb39-43be-a7c8-908b17ec04d1 req-cc281e73-cc8b-4d27-a981-aca480b8b354 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.737676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:55.738519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:55.751039 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-669ab831-eb39-43be-a7c8-908b17ec04d1 req-cc281e73-cc8b-4d27-a981-aca480b8b354 service nova] Creating event network-vif-plugged:db000a98-2f3a-4669-bf8d-8660ee028598 for instance 522cf594-507b-4b58-bc86-0e6451bffb95 on nch1-master-1 Jul 02 21:17:55.755629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.756346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.757908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.758433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.794448 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-669ab831-eb39-43be-a7c8-908b17ec04d1 req-cc281e73-cc8b-4d27-a981-aca480b8b354 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119449 Jul 02 21:17:55.795087 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1943/3840] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:17:55.824834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:55.825605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:55.847588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.848252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.857183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:55.857659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:55.977171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:55.993011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:55.995972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:55.999756 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-840331f4-3d45-47a0-a204-7c556870d002 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1366 microversion: 2.47 time: 0.273981 Jul 02 21:17:56.010404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1898/3841] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:55 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:56.173608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:56.199220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:56.246585 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d04b3a38-cce2-4130-816b-4b6fe6dcd2e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 0.423940 Jul 02 21:17:56.247253 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1944/3842] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:55 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:56.689710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:56.690585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:56.707202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:56.711261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:56.712328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:56.712937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:56.739483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:56.743726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:56.764181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:56.770113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:56.773217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:56.776737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.298384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:57.335833 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6be4b3cc-a652-43f9-90f5-87c4c44733f7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 0.575230 Jul 02 21:17:57.340100 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1945/3843] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:56 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:17:57.357787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:57.361008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:57.379891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:57.389316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:57.391046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.393748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:57.395619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.408084 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e5b5b85-9e30-445f-a720-d8d86ff8731d tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.722392 Jul 02 21:17:57.422384 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1899/3844] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:56 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:57.436300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:57.437213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:57.446163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:57.457587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:57.461649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.467491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:57.471047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.562734 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2a4752c-84b5-4243-8715-53573f4ae582 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/ips" status: 200 len: 152 microversion: 2.20 time: 0.124009 Jul 02 21:17:57.563687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1900/3845] 10.222.0.43 () {60 vars in 1288 bytes} [Sat Jul 2 21:17:57 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/ips => generated 152 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:17:57.590822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:57.597110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:57.620455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:57.627714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.629102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:57.632712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:57.639244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:57.657189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:57.662774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:57.668272 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-533456c2-ea77-4ead-af96-513cb1bddbc7 tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1366 microversion: 2.47 time: 0.326484 Jul 02 21:17:57.672182 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1946/3846] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:57 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:58.107257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:58.119173 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1241a2c0-a5c9-4549-b1bd-aec52ddf7332 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 0.551327 Jul 02 21:17:58.120141 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1901/3847] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:57 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:58.368917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:58.372375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:58.432479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:58.433418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:58.443418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:58.444841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:58.447821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:58.465051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:58.467887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:58.491242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:58.495252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:58.499665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:58.503059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:58.592005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:58.873380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:58.895626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-883f4389-59b6-4762-b83d-a23406d38dc5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1324 microversion: 2.1 time: 0.448263 Jul 02 21:17:58.899937 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1902/3848] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:58 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:58.914177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:58.916795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:58.935052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:58.945104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:58.947655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:58.948446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:59.098919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:59.099900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:59.100718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lazy-loading 'fault' on Instance uuid 31d5ac29-f90c-4d13-8724-513b0f6274e1 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:17:59.442260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:59.462225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:59.471765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6fd3a7fe3e614b9f91c7905c1e2464a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2af6b3a0a814ce7afb1ae17717f006d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:59.476685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16caae5c-f14d-4793-944e-e6e5f6d1bd1a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 200 len: 1371 microversion: 2.47 time: 0.575335 Jul 02 21:17:59.478520 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1903/3849] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:17:58 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 1371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:17:59.485622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:59.502629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:17:59.513870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:59.530007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38300d5e-8a15-45b1-bbb8-1b3e014e8c90 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 1.161659 Jul 02 21:17:59.531668 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1947/3850] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:58 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:17:59.552758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:59.555281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:59.556644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:59.557803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:59.585250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:17:59.917251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:17:59.918390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:17:59.930804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:59.939979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:17:59.943647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:17:59.944381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.354183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:00.370431 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-214c94ca-2e2e-4035-aace-b0b3b4b02358 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 0.889798 Jul 02 21:18:00.382460 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1904/3851] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:59 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:00.458135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:00.473301 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a92c283-ff0a-4a9e-94c9-b29c2c7abfa5 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 200 len: 1520 microversion: 2.1 time: 0.560734 Jul 02 21:18:00.492227 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1948/3852] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:17:59 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:18:00.500415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:00.501276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] [instance: 31d5ac29-f90c-4d13-8724-513b0f6274e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:00.511655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.220"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:00.512879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:00.512879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.513580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:00.514361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:00.514613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.533736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:00.534993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.535974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:00.536596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.537617 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] HTTP exception thrown: Instance 31d5ac29-f90c-4d13-8724-513b0f6274e1 could not be found. Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Request method failure captured: Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 HTTP/1.1 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLX7vDe4BjzDKgtGwnV6t_HBQi5y65wwbZi2JZkDuF8m9VNtj3uJatIY4zeLqgcCjfH4JVc3y7j_ORCcnzzecwHHuYE0r2qrKXP2ZV9Luq9Cj6TCBHMbg3DGYhtmb5Vxo-Q19mxGhqB9PrQpopRwPZ58F8dKGDxfbgNrgiBvJmQm_9k Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.47 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a2af6b3a0a814ce7afb1ae17717f006d Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAaction247Test-1178789705 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2af6b3a0a814ce7afb1ae17717f006d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a2af6b3a0a814ce7afb1ae17717f006d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a2af6b3a0a814ce7afb1ae17717f006d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a2af6b3a0a814ce7afb1ae17717f006d"}]}] Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAaction247Test-1178789705 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a2af6b3a0a814ce7afb1ae17717f006d Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAaction247Test-1178789705 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAaction247Test-1178789705-project Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 6fd3a7fe3e614b9f91c7905c1e2464a8 Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAaction247Test-1178789705-project Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 31d5ac29-f90c-4d13-8724-513b0f6274e1 could not be found. Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '31d5ac29-f90c-4d13-8724-513b0f6274e1'} Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d5ac29-f90c-4d13-8724-513b0f6274e1 could not be found. Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d5ac29-f90c-4d13-8724-513b0f6274e1 could not be found. Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:00.539463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d5ac29-f90c-4d13-8724-513b0f6274e1 could not be found. Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:00.543599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] Returning 404 to user: Instance 31d5ac29-f90c-4d13-8724-513b0f6274e1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:00.546858 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85dbdbd6-3847-498d-aba3-4891c3e2206a tempest-ServersAaction247Test-1178789705 tempest-ServersAaction247Test-1178789705-project] 10.222.0.43 "GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1" status: 404 len: 111 microversion: 2.47 time: 0.049694 Jul 02 21:18:00.552771 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1905/3853] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:00 2022] GET /compute/v2.1/servers/31d5ac29-f90c-4d13-8724-513b0f6274e1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:18:00.568752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:00.569508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:00.584269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:00.584906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.586015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:00.589996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:00.625449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Acquired lock "refresh_cache-c8182629-4371-4352-a82f-219a9f2141e2" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:18:01.106958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:01.118792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb1497c2-3fb3-47ff-b299-9f3249083901 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 0.563999 Jul 02 21:18:01.119718 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1906/3854] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:00 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:01.141652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:01.142570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:01.153685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:01.154157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:01.155320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:01.157661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:01.189759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lazy-loading 'flavor' on Instance uuid 41d3b10c-40d5-490f-b9d0-27b2a1231b76 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:18:01.884983 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ee6a9d2-7ec0-4e2a-b0f3-c780841efd52 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/action" status: 202 len: 0 microversion: 2.20 time: 0.752303 Jul 02 21:18:01.892626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1907/3855] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:18:01 2022] POST /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:01.909903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:01.911333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:01.924022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:01.924753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:01.926898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:01.927760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:03.280632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:03.289082 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6edbde4d-4211-4730-9e3d-1257d310fb2c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 1.392729 Jul 02 21:18:03.290416 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1908/3856] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:01 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:03.320580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:03.321441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:03.330905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:03.331622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:03.333022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:03.333490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:03.813904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:03.839168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:03.841384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:03.842956 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e51adaa6-2bdd-4a40-bad1-6672b4a0c5a6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 0.551453 Jul 02 21:18:03.843673 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1909/3857] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:03 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:03.853652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:03.854494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:03.873777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:03.874543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:03.876488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:03.882381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:04.368489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:04.369192 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9bb0e3c-ab02-4f04-9dc3-bac863d4c692 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 0.523404 Jul 02 21:18:04.375321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1910/3858] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:03 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:04.388396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b8aaabe2-da58-4f75-a050-b5b9d9cd84ad req-4f520f27-bbf8-4713-b0a4-9e00beff9842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5be14be9-4dc3-4992-8853-cf7bb88302a4", "name": "network-vif-plugged", "status": "completed", "tag": "13372403-b196-459f-a251-7f8856b0ede3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:04.408138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b8aaabe2-da58-4f75-a050-b5b9d9cd84ad req-4f520f27-bbf8-4713-b0a4-9e00beff9842 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:04.409717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b8aaabe2-da58-4f75-a050-b5b9d9cd84ad req-4f520f27-bbf8-4713-b0a4-9e00beff9842 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:04.439287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b8aaabe2-da58-4f75-a050-b5b9d9cd84ad req-4f520f27-bbf8-4713-b0a4-9e00beff9842 service nova] Creating event network-vif-plugged:13372403-b196-459f-a251-7f8856b0ede3 for instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 on nch1-master-1 Jul 02 21:18:04.454866 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b8aaabe2-da58-4f75-a050-b5b9d9cd84ad req-4f520f27-bbf8-4713-b0a4-9e00beff9842 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077637 Jul 02 21:18:04.456377 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1911/3859] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:04.467530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:04.473075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:04.487190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:04.490045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:04.492906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:04.494262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:05.350707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:05.361898 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-096a1b12-85b6-432d-8bd3-8ec5367acc27 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 0.900939 Jul 02 21:18:05.363241 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1912/3860] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:04 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:05.369306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:05.370627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:05.390903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:05.391575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:05.392570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:05.393162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:06.177991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:18:06.436244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:06.508648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:06.516539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:06.518678 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6aae5aa-1799-44d7-947d-7ebd13560cd8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 1.154142 Jul 02 21:18:06.537729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1913/3861] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:05 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:06.552915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:06.558045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:06.576701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:06.579313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:06.580635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:06.583157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:06.909830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:06.922433 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7bfd899-9546-4f17-a806-4bfc39f4f40e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1321 microversion: 2.1 time: 0.382212 Jul 02 21:18:06.926736 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1914/3862] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:06 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:06.944723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0a3fc6e2-bbc9-47dc-a147-b1c051a88f3d req-8dfc0f75-05de-42a7-a39e-65499c12beb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:06.979069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a3fc6e2-bbc9-47dc-a147-b1c051a88f3d req-8dfc0f75-05de-42a7-a39e-65499c12beb2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:06.979851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a3fc6e2-bbc9-47dc-a147-b1c051a88f3d req-8dfc0f75-05de-42a7-a39e-65499c12beb2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:07.013877 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0a3fc6e2-bbc9-47dc-a147-b1c051a88f3d req-8dfc0f75-05de-42a7-a39e-65499c12beb2 service nova] Creating event network-changed:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:18:07.027151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0a3fc6e2-bbc9-47dc-a147-b1c051a88f3d req-8dfc0f75-05de-42a7-a39e-65499c12beb2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097579 Jul 02 21:18:07.030123 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1915/3863] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:07.074807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:07.076092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:07.086393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:07.086990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:07.087868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:07.088495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:09.071948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:09.089887 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2225dda6-5793-498c-95da-2a27e49480e6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 2.057871 Jul 02 21:18:09.107736 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1916/3864] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:07 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:09.117380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:09.118004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:09.159063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:09.159530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:09.160386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:09.161044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:10.321454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Updating instance_info_cache with network_info: [{"id": "6d7798cb-af68-44cd-be7c-88e49d36d6a7", "address": "fa:16:3e:b7:93:62", "network": {"id": "bb524285-cec5-4598-9c67-5611fb01bfa2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-719962142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6ec66c4ca37f47dcb3d18f89f3fe2a75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d7798cb-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:18:10.370053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Releasing lock "refresh_cache-c8182629-4371-4352-a82f-219a9f2141e2" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:18:10.374516 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db81729f-18f2-449a-8818-735dfc3cb797 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action" status: 202 len: 0 microversion: 2.1 time: 9.868922 Jul 02 21:18:10.382549 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1949/3865] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:00 2022] POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action => generated 0 bytes in 9878 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jul 02 21:18:10.395083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:10.396146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:10.411876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:10.412819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:10.415815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:10.416582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:10.815665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:10.827118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:10.840798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:10.856478 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0e1198e-dc4c-4e1f-896d-076eb0b1cb96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 1.747307 Jul 02 21:18:10.860522 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1917/3866] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:09 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:10.871105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:10.882678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:10.902253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:10.903927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:10.905601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:10.908705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:11.183522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:11.193836 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75dc0489-d00b-4499-91d5-48760bff636c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1502 microversion: 2.1 time: 0.809687 Jul 02 21:18:11.197633 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1950/3867] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:10 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1502 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:11.245440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.220"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:11.247155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:11.260464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:11.264929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:11.266680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:11.267342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:11.349502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Acquired lock "refresh_cache-522cf594-507b-4b58-bc86-0e6451bffb95" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:18:11.825157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:11.885178 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b987d1dc-4283-4e8c-b210-173f0f678c18 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 1.020533 Jul 02 21:18:11.892843 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1918/3868] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:10 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:11.908701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:11.909766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:11.934708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:11.935551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:11.936605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:11.937298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:12.477019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:12.486831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cc36a9b-63c2-4b84-82e7-2b3fccfc8de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1502 microversion: 2.1 time: 0.592494 Jul 02 21:18:12.487434 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1919/3869] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:11 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1502 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:12.525438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:12.526111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:12.543482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:12.554292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:12.555493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:12.556168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:13.450879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:13.479487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:13.485460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:13.489658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dcb5cec-2cc9-44b8-bf63-ac4b02260824 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 0.983074 Jul 02 21:18:13.490888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1920/3870] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:12 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:13.534712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:13.535373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:13.562371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:13.562852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:13.568147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:13.568554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:13.598768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:13.682444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:18:13.968607 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed89ad6b-aea4-4798-9140-c47738af7f29 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 204 len: 0 microversion: 2.1 time: 0.473331 Jul 02 21:18:13.970846 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1921/3871] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:13 2022] DELETE /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:13.988858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:13.994928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:14.019016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:14.019753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:14.020993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:14.021585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:14.489104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:14.522345 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd16f924-1027-4c74-ad6d-8f3b3053a0e2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1509 microversion: 2.1 time: 0.526880 Jul 02 21:18:14.535488 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1922/3872] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:13 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1509 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:14.547291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:14.548650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:14.566531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:14.567564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:14.568489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:14.569820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:15.054145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:15.067945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9077f656-ffa4-44d2-9237-6f987354e82b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 200 len: 1508 microversion: 2.1 time: 0.530822 Jul 02 21:18:15.068731 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1923/3873] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:14 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 1508 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:15.088856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:15.089926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:15.112228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:15.112696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:15.116345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:15.117026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:16.314399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:16.334899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:16.341599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:16.346983 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbbbbc6b-9443-4877-9392-870257881355 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 1.273648 Jul 02 21:18:16.349840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1924/3874] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:15 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:16.363155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-268788441", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "cee92be4-408c-4f6e-b7ac-a0517d16edc0"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:16.482822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] validate_networks() for [('cee92be4-408c-4f6e-b7ac-a0517d16edc0', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:18:17.845267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.network.neutron [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] re-assign floating IP 172.35.6.220 from instance c8182629-4371-4352-a82f-219a9f2141e2 Jul 02 21:18:17.931756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:18:18.302603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:18:18.304466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:18:18.306886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:18:18.308324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:18:18.309969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:18:18.329168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:18.330096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:18.334041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:18.334846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:18.386457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Getting quotas for project c7534889ba5b48338c27c0556be3c6f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:18:18.407579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Getting quotas for user 2016769bf3a34d22992b45f9974b99a2 and project c7534889ba5b48338c27c0556be3c6f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:18:18.436210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:18:18.441287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:18:18.573908 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc323d04-0eed-49de-a539-dc845c33bf8b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.222608 Jul 02 21:18:18.575579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1925/3875] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:18:18.582800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:18.584067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:18.596492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:18.597398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:18.598581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:18.599035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:19.732731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:19.742792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45ee303a-a9ee-4b6c-9de0-0e45b940be0f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1506 microversion: 2.1 time: 1.165236 Jul 02 21:18:19.752363 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1926/3876] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:18 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1506 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:19.757486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:19.758348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:19.773753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:19.774284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:19.775152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:19.780756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:19.811474 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 HTTP/1.1 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5be14be9-4dc3-4992-8853-cf7bb88302a4'} Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:19.816818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:19.821324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:19.821324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:19.821324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:19.821324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:19.821324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:18:19.821324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:19.822927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:19.824297 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7c73fcf-d89d-4731-9175-7e419a3e3967 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 404 len: 111 microversion: 2.1 time: 0.070422 Jul 02 21:18:19.825456 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1927/3877] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:19 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:20.004582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1342722823", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:20.077694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] validate_networks() for [('e98efb69-10a3-4c3c-a1e6-9bad8e859690', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:18:20.389991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Updating instance_info_cache with network_info: [{"id": "6d7798cb-af68-44cd-be7c-88e49d36d6a7", "address": "fa:16:3e:b7:93:62", "network": {"id": "bb524285-cec5-4598-9c67-5611fb01bfa2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-719962142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6ec66c4ca37f47dcb3d18f89f3fe2a75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d7798cb-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:18:20.411627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:18:21.254585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=26 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:21.439338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:18:21.441084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:18:21.441883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:18:21.442475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:18:21.443144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:18:21.467366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:21.468114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:21.469262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:21.473117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:21.544639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Getting quotas for project a95706cb67b642f58f6c0bdf8e65d766. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:18:21.581008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Getting quotas for user 678fafac5b764cd18ed9f40c6ac09be6 and project a95706cb67b642f58f6c0bdf8e65d766. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:18:21.603335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:18:21.614588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:18:21.676925 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f380a974-6bc6-40c5-bd47-4b38b5d5c884 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.850153 Jul 02 21:18:21.678622 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1928/3878] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:18:21.685313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:21.686171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:21.693546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:21.695082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:21.696826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:21.697508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:22.461638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:22.482615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:22.493842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:22.499198 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-750a0d03-569f-4a84-bc72-eb88a0eeb6fa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 0.817534 Jul 02 21:18:22.502533 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1929/3879] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:21 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:22.516986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-75718eac-9691-473f-8ee1-37770eb91bb9 req-5e61c020-fb5c-4959-835b-d4c3a223c3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:22.544537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75718eac-9691-473f-8ee1-37770eb91bb9 req-5e61c020-fb5c-4959-835b-d4c3a223c3e9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:22.545316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75718eac-9691-473f-8ee1-37770eb91bb9 req-5e61c020-fb5c-4959-835b-d4c3a223c3e9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:22.589965 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-75718eac-9691-473f-8ee1-37770eb91bb9 req-5e61c020-fb5c-4959-835b-d4c3a223c3e9 service nova] Creating event network-changed:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:18:22.600303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-75718eac-9691-473f-8ee1-37770eb91bb9 req-5e61c020-fb5c-4959-835b-d4c3a223c3e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095154 Jul 02 21:18:22.601132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1930/3880] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:22.614686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:22.620781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:22.638692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:22.639698 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:22.643937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:22.645620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:22.929103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:22.943724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-454d28a6-b5e8-42a6-a829-e43a617b5a5e tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1276 microversion: 2.1 time: 0.340425 Jul 02 21:18:22.949915 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1931/3881] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:22 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:22.956190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-abd743fb-e437-4102-b77c-633d49897b24 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: .version_select at 0x7fabea116820>, body: {"keypair": {"name": "tempest-key-1519860899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5bm5wgvMABv/6RY5jXUokJ480vI1urPSiLiN5FxI86hL8OuNIAau2HIX5Z8IhePExgsZsSoEoKy25C3ie+FaXFGMd9KXTLoZln8yNuhyKepsRHEI+M6XJkx4tZuAdQNA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:22.971441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:23.037773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-abd743fb-e437-4102-b77c-633d49897b24 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:18:23.055917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-abd743fb-e437-4102-b77c-633d49897b24 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:18:23.145644 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-abd743fb-e437-4102-b77c-633d49897b24 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.194276 Jul 02 21:18:23.153037 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1932/3882] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:18:22 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:23.158828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0ca0bd09-536a-415b-bc28-a0de3f2e4fda req-bc803819-8952-4649-8225-941c1926bf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01794da-b81d-47ba-b8a4-05a57954ff14", "name": "network-vif-unplugged", "status": "completed", "tag": "2d6ad206-3709-4149-8bf2-0de5883a6288"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:23.201294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0ca0bd09-536a-415b-bc28-a0de3f2e4fda req-bc803819-8952-4649-8225-941c1926bf30 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:23.202017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0ca0bd09-536a-415b-bc28-a0de3f2e4fda req-bc803819-8952-4649-8225-941c1926bf30 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:23.227992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_external_events [req-0ca0bd09-536a-415b-bc28-a0de3f2e4fda req-bc803819-8952-4649-8225-941c1926bf30 service nova] Unable to find a host for instance a01794da-b81d-47ba-b8a4-05a57954ff14. Dropping event network-vif-unplugged {{(pid=131044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 02 21:18:23.229365 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0ca0bd09-536a-415b-bc28-a0de3f2e4fda req-bc803819-8952-4649-8225-941c1926bf30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.074795 Jul 02 21:18:23.230535 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1933/3883] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 02 21:18:23.237361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:23.238647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:23.250729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:23.251432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:23.252802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:23.283549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:23.889714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Updating instance_info_cache with network_info: [{"id": "db000a98-2f3a-4669-bf8d-8660ee028598", "address": "fa:16:3e:fb:e6:5c", "network": {"id": "bb524285-cec5-4598-9c67-5611fb01bfa2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-719962142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6ec66c4ca37f47dcb3d18f89f3fe2a75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdb000a98-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:18:23.921750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Releasing lock "refresh_cache-522cf594-507b-4b58-bc86-0e6451bffb95" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:18:23.924950 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-72ef47a0-0577-471f-9bf5-bd75ead2acbb tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95/action" status: 202 len: 0 microversion: 2.1 time: 12.714703 Jul 02 21:18:23.928566 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1951/3884] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:11 2022] POST /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95/action => generated 0 bytes in 12730 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:18:23.941366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:23.942031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:23.979026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:23.996732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:24.005246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:24.005858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:24.341571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:24.350837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:24.379091 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ba5bca9-97d1-41b1-b24a-187527f3f07d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 200 len: 1449 microversion: 2.1 time: 1.147289 Jul 02 21:18:24.389782 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef4b7079-f1b1-40ae-be89-9ead0426512c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1282 microversion: 2.1 time: 0.459597 Jul 02 21:18:24.392389 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1952/3885] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:23 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1282 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:24.393522 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1934/3886] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:23 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 1449 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:24.406794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:24.407435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:24.412219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eda9ee4a-42ca-4ae2-aee5-fc0a4ca4665e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '.version_select at 0x7fabd73714c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:24.416727 ncdv-master-1 devstack@n-api.service[131045]: WARNING oslo_db.sqlalchemy.utils [None req-eda9ee4a-42ca-4ae2-aee5-fc0a4ca4665e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 02 21:18:24.441113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:24.441758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:24.443088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eda9ee4a-42ca-4ae2-aee5-fc0a4ca4665e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.035540 Jul 02 21:18:24.448198 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1953/3887] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:18:24 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:24.450478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:24.450965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:24.473613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.220"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:25.912420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:25.926247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:25.928464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:25.929924 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-479cce47-780e-4bce-aaf0-dc84691ccff2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 1.535431 Jul 02 21:18:25.942025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:25.948725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:25.949537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:25.950657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:25.951171 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1935/3888] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:24 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:25.952608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:25.961717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:25.963791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:25.984358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:25.991807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:25.993055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:25.993713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:26.758560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:26.793573 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75ae22df-313c-4465-88ff-eede8dd1d971 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1318 microversion: 2.1 time: 0.823061 Jul 02 21:18:26.796983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1936/3889] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:25 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:26.802508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:26.821675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:26.832700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:26.833356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:26.835966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:26.837890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:26.884631 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] HTTP exception thrown: Floating IP 172.35.6.220 is not associated with instance c8182629-4371-4352-a82f-219a9f2141e2. Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Request method failure captured: Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action HTTP/1.1 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 49 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXOBVlmES0FGK8v5eS-G3k9oETyNLd3rNGQ7YDgZdPFySeKMqUEfHHCKvPSWE-lwncuVBzJOjyeEquY0tpBB9dR1HH1xFM391n_nfzYI1wlUyMSpC7nASdZ_r6kHB8E9INegGcOfIEKFKUDKMKFP83BiH5R5o7dFtmTM65yHoqILvI Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ec66c4ca37f47dcb3d18f89f3fe2a75", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}] Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 7e89c1afe4de42e68f65d0a700c63b4e Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: {"removeFloatingIp": {"address": "172.35.6.220"}} Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: exception: Floating IP 172.35.6.220 is not associated with instance c8182629-4371-4352-a82f-219a9f2141e2. Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c8182629-4371-4352-a82f-219a9f2141e2', 'body': {'removeFloatingIp': {'address': '172.35.6.220'}}} Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.6.220 is not associated with instance c8182629-4371-4352-a82f-219a9f2141e2. Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.6.220 is not associated with instance c8182629-4371-4352-a82f-219a9f2141e2. Jul 02 21:18:26.887517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:26.894527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Returning 409 to user: Floating IP 172.35.6.220 is not associated with instance c8182629-4371-4352-a82f-219a9f2141e2. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:26.895603 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e4fadb7b-1f5b-43a0-82d2-0ea5f9514999 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action" status: 409 len: 146 microversion: 2.1 time: 2.446361 Jul 02 21:18:26.896762 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1954/3890] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:24 2022] POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action => generated 146 bytes in 2448 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:18:26.908306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1504906654", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "key_name": "tempest-key-1519860899", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:26.983162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:18:27.334727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:27.354034 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03663ed9-6a87-41a1-8d1d-f3aea06a2a02 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.555457 Jul 02 21:18:27.370459 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1937/3891] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:26 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:27.378662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9ccdd885-db8f-4c49-8d5b-aa8a29f69d2c req-87e9f78f-446f-403f-87e7-af409f354a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522cf594-507b-4b58-bc86-0e6451bffb95", "tag": "db000a98-2f3a-4669-bf8d-8660ee028598"}, {"server_uuid": "5be14be9-4dc3-4992-8853-cf7bb88302a4", "name": "network-vif-deleted", "tag": "13372403-b196-459f-a251-7f8856b0ede3"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:27.390767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ccdd885-db8f-4c49-8d5b-aa8a29f69d2c req-87e9f78f-446f-403f-87e7-af409f354a7f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:27.391825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ccdd885-db8f-4c49-8d5b-aa8a29f69d2c req-87e9f78f-446f-403f-87e7-af409f354a7f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:27.412493 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9ccdd885-db8f-4c49-8d5b-aa8a29f69d2c req-87e9f78f-446f-403f-87e7-af409f354a7f service nova] Creating event network-changed:db000a98-2f3a-4669-bf8d-8660ee028598 for instance 522cf594-507b-4b58-bc86-0e6451bffb95 on nch1-master-1 Jul 02 21:18:27.413427 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9ccdd885-db8f-4c49-8d5b-aa8a29f69d2c req-87e9f78f-446f-403f-87e7-af409f354a7f service nova] Creating event network-vif-deleted:13372403-b196-459f-a251-7f8856b0ede3 for instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 on nch1-master-1 Jul 02 21:18:27.423542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9ccdd885-db8f-4c49-8d5b-aa8a29f69d2c req-87e9f78f-446f-403f-87e7-af409f354a7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050854 Jul 02 21:18:27.424884 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1938/3892] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:27.435372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9d1ae864-8c93-4e70-896a-b7881255cec2 req-51e6a69e-6c8b-4abe-8033-2b5557b8ae32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "name": "network-vif-plugged", "status": "completed", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:27.453287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d1ae864-8c93-4e70-896a-b7881255cec2 req-51e6a69e-6c8b-4abe-8033-2b5557b8ae32 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:27.453805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d1ae864-8c93-4e70-896a-b7881255cec2 req-51e6a69e-6c8b-4abe-8033-2b5557b8ae32 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:27.487952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9d1ae864-8c93-4e70-896a-b7881255cec2 req-51e6a69e-6c8b-4abe-8033-2b5557b8ae32 service nova] Creating event network-vif-plugged:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:18:27.498897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9d1ae864-8c93-4e70-896a-b7881255cec2 req-51e6a69e-6c8b-4abe-8033-2b5557b8ae32 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071934 Jul 02 21:18:27.499764 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1939/3893] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:27.506873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:27.507610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:27.514667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:27.515127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:27.515917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:27.516393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:28.065956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:28.076264 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f92f6f9d-5171-4dbf-bb64-7bffd21265b8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1324 microversion: 2.1 time: 0.575078 Jul 02 21:18:28.080505 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1940/3894] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:27 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:28.096853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3fe8ef2a-3cb3-45dd-8b8b-809669582410 req-d11b799c-f585-404d-b866-68d621f30cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a33be86-415d-42ca-a13f-7ec8880cfad5", "tag": "8dc45078-0a43-4c8c-bf7e-491d459b0b33"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:28.110262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3fe8ef2a-3cb3-45dd-8b8b-809669582410 req-d11b799c-f585-404d-b866-68d621f30cc7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:28.111045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3fe8ef2a-3cb3-45dd-8b8b-809669582410 req-d11b799c-f585-404d-b866-68d621f30cc7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:28.131831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3fe8ef2a-3cb3-45dd-8b8b-809669582410 req-d11b799c-f585-404d-b866-68d621f30cc7 service nova] Creating event network-changed:8dc45078-0a43-4c8c-bf7e-491d459b0b33 for instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 on nch2-master-1 Jul 02 21:18:28.140542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3fe8ef2a-3cb3-45dd-8b8b-809669582410 req-d11b799c-f585-404d-b866-68d621f30cc7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049064 Jul 02 21:18:28.141850 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1941/3895] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:28.147158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.220"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:28.582576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:28.590309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:28.591012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:28.591963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:28.598206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:28.627131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:28.860577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:18:28.861742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:18:28.862443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:18:28.863276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:18:28.864433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:18:28.890256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:28.893583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:28.894692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:28.909922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:28.931912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=63,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=3,nova_cell1:RELEASE=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:28.954619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:18:28.970809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:18:28.989658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:18:28.992716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:18:29.077414 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7265277-9e60-43d5-b64b-990118d0574f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.179285 Jul 02 21:18:29.084985 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1955/3896] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:18:29.108190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:29.117330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:29.144940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:29.145476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:29.146351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:29.146854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:29.492849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Acquired lock "refresh_cache-522cf594-507b-4b58-bc86-0e6451bffb95" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:18:30.412273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:30.428798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:30.430918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:30.432870 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6872e661-3a78-4a8d-8b5e-e64142a63d5a tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 1.346867 Jul 02 21:18:30.437166 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1956/3897] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:29 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:30.443888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:30.457500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:30.476582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:30.477184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:30.487829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:30.488644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.106159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:31.121896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9b7e253-787d-4114-9ba9-70480b5dc360 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.680628 Jul 02 21:18:31.122529 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1957/3898] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:30 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:31.139707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:31.140810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:31.148703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:31.150977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.152069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:31.152672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.482479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:31.494907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e133801e-d1b4-416f-b463-4c2954654f8c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1318 microversion: 2.1 time: 0.358580 Jul 02 21:18:31.502060 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1958/3899] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:31 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:31.507313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:31.513224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:31.517282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:31.530192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:31.530652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.531455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:31.531900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.641365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:31.651252 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-460b738e-1ea7-4d30-b3fd-ab37c7464b5a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1287 microversion: 2.1 time: 0.147701 Jul 02 21:18:31.652654 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1959/3900] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:31 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:31.657849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:31.658680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:31.667136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:31.667921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.668935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:31.669593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:31.750612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Building network info cache for instance {{(pid=131044) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:18:32.032707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:32.045799 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fee89cbd-01be-457f-8645-4a0e9e686094 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1324 microversion: 2.1 time: 0.391607 Jul 02 21:18:32.050387 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1960/3901] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:31 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:32.091861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-fb905513-ea20-489d-90a3-59d3de3754c9 req-2ba89615-556e-4f68-a91d-ecc99264b8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4614ecfd-c219-46ed-98a8-857a539fa0a2", "tag": "89e5da5c-28f4-4de2-a88c-006aaa8c80a8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:32.111760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fb905513-ea20-489d-90a3-59d3de3754c9 req-2ba89615-556e-4f68-a91d-ecc99264b8f9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:32.112237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fb905513-ea20-489d-90a3-59d3de3754c9 req-2ba89615-556e-4f68-a91d-ecc99264b8f9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:32.137903 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-fb905513-ea20-489d-90a3-59d3de3754c9 req-2ba89615-556e-4f68-a91d-ecc99264b8f9 service nova] Creating event network-changed:89e5da5c-28f4-4de2-a88c-006aaa8c80a8 for instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 on nch1-master-1 Jul 02 21:18:32.159971 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-fb905513-ea20-489d-90a3-59d3de3754c9 req-2ba89615-556e-4f68-a91d-ecc99264b8f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107838 Jul 02 21:18:32.160989 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1961/3902] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:32.172132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:32.177571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:32.193731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:32.194375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:32.195470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:32.196269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:32.663695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:32.679408 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-765d02a0-5e68-4d40-9a1b-d41fa330ad98 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.514545 Jul 02 21:18:32.680032 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1962/3903] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:32 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:32.686644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:32.694521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:32.709121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:32.709844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:32.710800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:32.711385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:32.994576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:33.008421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Updating instance_info_cache with network_info: [{"id": "db000a98-2f3a-4669-bf8d-8660ee028598", "address": "fa:16:3e:fb:e6:5c", "network": {"id": "bb524285-cec5-4598-9c67-5611fb01bfa2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-719962142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6ec66c4ca37f47dcb3d18f89f3fe2a75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdb000a98-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:18:33.011493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:33.013282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:33.017499 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2397b1d9-8ca5-4590-b4b3-5f134a827dec tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 0.336254 Jul 02 21:18:33.019822 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1963/3904] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:32 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:33.024745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:33.036708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:33.044633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Releasing lock "refresh_cache-522cf594-507b-4b58-bc86-0e6451bffb95" {{(pid=131044) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:18:33.046997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.050839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.054535 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-629722e0-1e8a-4828-a658-dcad2572024f tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95/action" status: 202 len: 0 microversion: 2.1 time: 4.902810 Jul 02 21:18:33.055141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.058307 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1942/3905] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:28 2022] POST /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95/action => generated 0 bytes in 4915 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:18:33.058844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.085253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:33.086257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:33.115401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:33.118622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.119351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.120624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.121279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.425445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:33.442942 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8fcc54e7-5e20-41e8-81cc-253f029292ba tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1318 microversion: 2.1 time: 0.421513 Jul 02 21:18:33.443888 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1964/3906] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:33 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:33.455457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:33.460246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:33.461626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:33.469592 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bbf36311-2a5a-4679-9fea-09c92ea945a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.409832 Jul 02 21:18:33.482164 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1943/3907] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:33 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:33.487736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:33.488278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.488456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:33.488755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.489569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.490003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.497438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.498206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.499540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.500205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.533894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:18:33.737094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67e611a3-78bb-429b-a0d0-d979d36fd601 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "DELETE /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 204 len: 0 microversion: 2.1 time: 0.253834 Jul 02 21:18:33.737745 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1944/3908] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:33 2022] DELETE /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:33.752592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:33.753489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:33.770721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.771478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.772458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.773040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.849433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:33.859320 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44ea8884-8700-4ba2-92ae-bc8a2f7cf0e5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.412380 Jul 02 21:18:33.860457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1965/3909] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:33 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:33.865423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.6.220"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:33.866754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:33.877218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.883293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.884908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:33.886909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:33.953656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Acquired lock "refresh_cache-c8182629-4371-4352-a82f-219a9f2141e2" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:18:34.201893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:34.219400 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c38f37a9-16d3-4f79-a8ee-1506f1e5c716 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1324 microversion: 2.1 time: 0.473424 Jul 02 21:18:34.220642 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1945/3910] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:33 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1324 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:34.241315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-472bff3a-32ba-42e8-96e4-05a329a6d3ec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:34.289925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472bff3a-32ba-42e8-96e4-05a329a6d3ec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:34.290738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-472bff3a-32ba-42e8-96e4-05a329a6d3ec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:34.320307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-472bff3a-32ba-42e8-96e4-05a329a6d3ec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:18:34.397986 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-472bff3a-32ba-42e8-96e4-05a329a6d3ec tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.174650 Jul 02 21:18:34.398590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1946/3911] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:34 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:18:34.407877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:34.414231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:34.433694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:34.439764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:34.440995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:34.441822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:34.774820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:34.787554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:34.794893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:34.796689 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fe4c1c6-4dc6-47aa-9e71-3bc59e7c2e75 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 0.396909 Jul 02 21:18:34.799144 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1947/3912] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:34 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:34.817459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fa8d7720-80f4-4805-aab1-e0c3a28e86fb req-8d99d13c-675a-4190-8542-392793ffe130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "522cf594-507b-4b58-bc86-0e6451bffb95", "tag": "db000a98-2f3a-4669-bf8d-8660ee028598"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:34.866632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa8d7720-80f4-4805-aab1-e0c3a28e86fb req-8d99d13c-675a-4190-8542-392793ffe130 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:34.867280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fa8d7720-80f4-4805-aab1-e0c3a28e86fb req-8d99d13c-675a-4190-8542-392793ffe130 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:34.895016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fa8d7720-80f4-4805-aab1-e0c3a28e86fb req-8d99d13c-675a-4190-8542-392793ffe130 service nova] Creating event network-changed:db000a98-2f3a-4669-bf8d-8660ee028598 for instance 522cf594-507b-4b58-bc86-0e6451bffb95 on nch1-master-1 Jul 02 21:18:34.916184 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fa8d7720-80f4-4805-aab1-e0c3a28e86fb req-8d99d13c-675a-4190-8542-392793ffe130 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113596 Jul 02 21:18:34.917451 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1948/3913] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:34.933137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:34.933923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:34.946685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:34.949948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:34.953016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:34.953640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:36.085443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:36.093925 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66799b1f-6073-4ade-9909-97df61f99b5d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 1.175066 Jul 02 21:18:36.103562 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1949/3914] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:34 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:36.119680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:36.138047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:36.152815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:36.153267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:36.162462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:36.162934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:37.911667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:37.921765 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-800696d0-2ab8-4095-b834-a9ac401f6563 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1318 microversion: 2.1 time: 1.816637 Jul 02 21:18:37.923232 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1950/3915] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:36 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1318 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:37.929022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:37.929849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:37.940769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:37.941462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:37.942429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:37.943012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:38.390584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:38.406358 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-251acf3c-1838-4f44-9fcb-283ea1da88ae tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.481817 Jul 02 21:18:38.409517 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1951/3916] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:37 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:38.418694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2aee367d-c1cf-47e3-a65a-36b93b7e3ada req-ea5203d0-ad94-4d37-96c5-d05f10649cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a33be86-415d-42ca-a13f-7ec8880cfad5", "name": "network-vif-plugged", "status": "completed", "tag": "8dc45078-0a43-4c8c-bf7e-491d459b0b33"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:38.433354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2aee367d-c1cf-47e3-a65a-36b93b7e3ada req-ea5203d0-ad94-4d37-96c5-d05f10649cdf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:38.434117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2aee367d-c1cf-47e3-a65a-36b93b7e3ada req-ea5203d0-ad94-4d37-96c5-d05f10649cdf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:38.455647 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2aee367d-c1cf-47e3-a65a-36b93b7e3ada req-ea5203d0-ad94-4d37-96c5-d05f10649cdf service nova] Creating event network-vif-plugged:8dc45078-0a43-4c8c-bf7e-491d459b0b33 for instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 on nch2-master-1 Jul 02 21:18:38.466333 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2aee367d-c1cf-47e3-a65a-36b93b7e3ada req-ea5203d0-ad94-4d37-96c5-d05f10649cdf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054049 Jul 02 21:18:38.467241 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1952/3917] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:38.477652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:38.479183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:38.487277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:38.487965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:38.489536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:38.490138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:38.828139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:38.830825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:18:38.841526 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0ad8a7e-c9cb-4995-ad83-4f6df48ffcce tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1324 microversion: 2.1 time: 0.371206 Jul 02 21:18:38.844303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1953/3918] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:38 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1324 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:38.855048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:38.857652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:38.868474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:38.873528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:38.874455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:38.874998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:38.932672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:38.984544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:39.211453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:39.225729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:39.227496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:39.229055 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e531e363-dee5-4c88-9751-e58c4f97b1b3 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 0.381997 Jul 02 21:18:39.229788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1954/3919] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:38 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:39.234655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4161c577-d14f-4f2c-b8ef-82e3b4f4f13f req-a394b902-673f-4eef-94ec-6962ea254571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58f35c43-b533-4afb-b402-2055a3f75cdf", "tag": "10e4f17e-b15a-4595-b32f-705c2b81782b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:39.246041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4161c577-d14f-4f2c-b8ef-82e3b4f4f13f req-a394b902-673f-4eef-94ec-6962ea254571 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:39.247185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4161c577-d14f-4f2c-b8ef-82e3b4f4f13f req-a394b902-673f-4eef-94ec-6962ea254571 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:39.264327 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4161c577-d14f-4f2c-b8ef-82e3b4f4f13f req-a394b902-673f-4eef-94ec-6962ea254571 service nova] Creating event network-changed:10e4f17e-b15a-4595-b32f-705c2b81782b for instance 58f35c43-b533-4afb-b402-2055a3f75cdf on nch2-master-1 Jul 02 21:18:39.279712 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4161c577-d14f-4f2c-b8ef-82e3b4f4f13f req-a394b902-673f-4eef-94ec-6962ea254571 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040780 Jul 02 21:18:39.280964 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1955/3920] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:39.286221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:39.287309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:39.296396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:39.297167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:39.298162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:39.298982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:39.566213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:39.580990 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6eac9743-63d2-4a1d-9a6d-02fdb290f795 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.296173 Jul 02 21:18:39.581617 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1956/3921] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:39 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:39.602895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-376797ea-bbd3-4bf5-821f-adb54074aa28 req-87f118ac-6cf9-4f8d-b694-4c4d21c8191e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:39.617765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-376797ea-bbd3-4bf5-821f-adb54074aa28 req-87f118ac-6cf9-4f8d-b694-4c4d21c8191e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:39.618408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-376797ea-bbd3-4bf5-821f-adb54074aa28 req-87f118ac-6cf9-4f8d-b694-4c4d21c8191e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:39.638030 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-376797ea-bbd3-4bf5-821f-adb54074aa28 req-87f118ac-6cf9-4f8d-b694-4c4d21c8191e service nova] Creating event network-changed:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:18:39.644144 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-376797ea-bbd3-4bf5-821f-adb54074aa28 req-87f118ac-6cf9-4f8d-b694-4c4d21c8191e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050523 Jul 02 21:18:39.645441 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1957/3922] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:39.651477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:39.652944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:39.661547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:39.662273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:39.663433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:39.664016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:39.668923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:40.097606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Updating instance_info_cache with network_info: [{"id": "6d7798cb-af68-44cd-be7c-88e49d36d6a7", "address": "fa:16:3e:b7:93:62", "network": {"id": "bb524285-cec5-4598-9c67-5611fb01bfa2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-719962142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.6.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6ec66c4ca37f47dcb3d18f89f3fe2a75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d7798cb-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:18:40.126601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Releasing lock "refresh_cache-c8182629-4371-4352-a82f-219a9f2141e2" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:18:40.131298 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-932c6bfb-42b5-4af4-b5ed-2c955e775331 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action" status: 202 len: 0 microversion: 2.1 time: 6.269543 Jul 02 21:18:40.133293 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1966/3923] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:33 2022] POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action => generated 0 bytes in 6272 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:18:40.146506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:40.158375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:40.161541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:40.163483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b9d8e21-24d9-4577-ac62-406c21eb4f1c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1318 microversion: 2.1 time: 0.515695 Jul 02 21:18:40.165561 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1958/3924] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:39 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:40.181910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:40.182415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:40.183501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:40.184109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:40.186362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:40.188032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:40.215388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:40.216641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:40.221862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:40.222520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:40.559764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:40.583255 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-41742d0a-22e9-4ac4-bded-bb33608b8577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.444271 Jul 02 21:18:40.609403 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1967/3925] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:40 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:40.617727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-be90a65e-5c7e-4377-aa5b-7aceb59da11e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '.version_select at 0x7fabd7849c10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:40.673827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:40.686640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf17f6c4-1438-4ec3-b697-906bbc1889a0 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1520 microversion: 2.1 time: 0.518507 Jul 02 21:18:40.687983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1959/3926] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:40 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1520 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:40.695791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:40.702588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:40.719133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:40.719769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:40.728278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:40.729409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:41.115497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:41.128366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:41.132335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:41.142843 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db7748b2-df0b-4e1c-a8d5-fa06fde5373f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1739 microversion: 2.20 time: 0.446589 Jul 02 21:18:41.146945 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1960/3927] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:40 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:41.169329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:41.170117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:41.170527 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-be90a65e-5c7e-4377-aa5b-7aceb59da11e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/3114c14b-ee02-497d-970e-1007a05d157a" status: 200 len: 184 microversion: 2.1 time: 0.558693 Jul 02 21:18:41.181424 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1968/3928] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:18:40 2022] GET /compute/v2.1/os-floating-ips/3114c14b-ee02-497d-970e-1007a05d157a => generated 184 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:41.187101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0bfe91eb-9afc-4cad-a23c-f73368dd54a7 req-5ae08706-000e-4a6a-bca5-d08aaae05a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4614ecfd-c219-46ed-98a8-857a539fa0a2", "name": "network-vif-plugged", "status": "completed", "tag": "89e5da5c-28f4-4de2-a88c-006aaa8c80a8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:41.197644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0bfe91eb-9afc-4cad-a23c-f73368dd54a7 req-5ae08706-000e-4a6a-bca5-d08aaae05a09 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:41.198347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0bfe91eb-9afc-4cad-a23c-f73368dd54a7 req-5ae08706-000e-4a6a-bca5-d08aaae05a09 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:41.211173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:41.212279 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0bfe91eb-9afc-4cad-a23c-f73368dd54a7 req-5ae08706-000e-4a6a-bca5-d08aaae05a09 service nova] Creating event network-vif-plugged:89e5da5c-28f4-4de2-a88c-006aaa8c80a8 for instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 on nch1-master-1 Jul 02 21:18:41.214819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:41.218579 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0bfe91eb-9afc-4cad-a23c-f73368dd54a7 req-5ae08706-000e-4a6a-bca5-d08aaae05a09 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035403 Jul 02 21:18:41.219782 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1969/3929] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:41.227187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e96a2186-e2c4-44d2-8246-241d8b4a0507 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1534867933", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e96a2186-e2c4-44d2-8246-241d8b4a0507 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 243 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1534867933", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1534867933', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'e98efb69-10a3-4c3c-a1e6-9bad8e859690'}]}}} Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:18:41.230812 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:41.235354 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:41.236563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:41.236563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:41.237766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e96a2186-e2c4-44d2-8246-241d8b4a0507 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:41.238798 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e96a2186-e2c4-44d2-8246-241d8b4a0507 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017546 Jul 02 21:18:41.239555 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1970/3930] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:41 2022] POST /compute/v2.1/servers => generated 175 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:18:41.249807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.6.220"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:41.759873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:41.767720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:41.768454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:41.773011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:41.773682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:42.400915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:42.423140 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7aad1ab2-3be1-4961-af4a-0b635a81b117 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 1.270505 Jul 02 21:18:42.423140 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1961/3931] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:41 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:42.431017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:42.432256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:42.440188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:42.441603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:42.443268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:42.443855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:42.673630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Acquired lock "refresh_cache-c8182629-4371-4352-a82f-219a9f2141e2" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 02 21:18:42.706594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:42.718531 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3fc15322-784a-4fa7-9d18-98956eb3ab06 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1318 microversion: 2.1 time: 0.290060 Jul 02 21:18:42.729102 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1962/3932] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:42 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:42.734773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ad9020d-4cb4-465e-8d68-759698c5f5c4 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:42.738125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ad9020d-4cb4-465e-8d68-759698c5f5c4 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 54da0de9-19bf-4b1f-a9e4-9acea3453960] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:42.749188 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7ad9020d-4cb4-465e-8d68-759698c5f5c4 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] HTTP exception thrown: Instance 54da0de9-19bf-4b1f-a9e4-9acea3453960 could not be found. Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ad9020d-4cb4-465e-8d68-759698c5f5c4 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/54da0de9-19bf-4b1f-a9e4-9acea3453960/metadata HTTP/1.1 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 54da0de9-19bf-4b1f-a9e4-9acea3453960 could not be found. Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'server_id': '54da0de9-19bf-4b1f-a9e4-9acea3453960'} Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54da0de9-19bf-4b1f-a9e4-9acea3453960 could not be found. Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54da0de9-19bf-4b1f-a9e4-9acea3453960 could not be found. Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:42.760352 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:42.764996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:42.764996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:42.764996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54da0de9-19bf-4b1f-a9e4-9acea3453960 could not be found. Jul 02 21:18:42.764996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:42.766567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ad9020d-4cb4-465e-8d68-759698c5f5c4 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 404 to user: Instance 54da0de9-19bf-4b1f-a9e4-9acea3453960 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:42.767913 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ad9020d-4cb4-465e-8d68-759698c5f5c4 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/54da0de9-19bf-4b1f-a9e4-9acea3453960/metadata" status: 404 len: 111 microversion: 2.1 time: 0.037452 Jul 02 21:18:42.770696 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1963/3933] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:18:42 2022] GET /compute/v2.1/servers/54da0de9-19bf-4b1f-a9e4-9acea3453960/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:42.778674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-19231b9c-2cb6-49af-bb04-aa8f1c5abfc1 req-f9314bed-a9f4-4421-aeef-95bd9461bb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "522cf594-507b-4b58-bc86-0e6451bffb95", "name": "network-vif-deleted", "tag": "db000a98-2f3a-4669-bf8d-8660ee028598"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:42.793722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-19231b9c-2cb6-49af-bb04-aa8f1c5abfc1 req-f9314bed-a9f4-4421-aeef-95bd9461bb71 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:42.794387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-19231b9c-2cb6-49af-bb04-aa8f1c5abfc1 req-f9314bed-a9f4-4421-aeef-95bd9461bb71 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:42.814661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-19231b9c-2cb6-49af-bb04-aa8f1c5abfc1 req-f9314bed-a9f4-4421-aeef-95bd9461bb71 service nova] Creating event network-vif-deleted:db000a98-2f3a-4669-bf8d-8660ee028598 for instance 522cf594-507b-4b58-bc86-0e6451bffb95 on nch1-master-1 Jul 02 21:18:42.824965 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-19231b9c-2cb6-49af-bb04-aa8f1c5abfc1 req-f9314bed-a9f4-4421-aeef-95bd9461bb71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051363 Jul 02 21:18:42.826092 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1964/3934] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:42.834772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:42.835738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:42.844554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:42.845854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:42.847504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:42.848158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:43.101212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:43.114457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e9b7476-ff50-4ac1-bd49-288cae799a94 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.286510 Jul 02 21:18:43.125285 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1965/3935] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:42 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:43.133208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:43.134428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:43.152649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:43.154661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:43.157490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:43.158342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:43.458705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:43.476360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:43.479290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:43.482017 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14dd80be-b5c0-4813-9acd-407338d8f488 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1721 microversion: 2.20 time: 0.354362 Jul 02 21:18:43.493824 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1966/3936] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:43 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:43.493824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc0d2aa1-55a0-451b-bd2d-b75c8dae5ab9 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-329011631", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc0d2aa1-55a0-451b-bd2d-b75c8dae5ab9 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 498 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-329011631", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-329011631', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e98efb69-10a3-4c3c-a1e6-9bad8e859690'}]}}} Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:18:43.495882 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc0d2aa1-55a0-451b-bd2d-b75c8dae5ab9 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:43.498500 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc0d2aa1-55a0-451b-bd2d-b75c8dae5ab9 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013199 Jul 02 21:18:43.514399 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1967/3937] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:43 2022] POST /compute/v2.1/servers => generated 687 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:18:43.521012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:43.521682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:43.531209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:43.531667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:43.532604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:43.533050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:43.868573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Building network info cache for instance {{(pid=131045) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 02 21:18:43.940102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:43.953852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf7575eb-9cc1-4c0e-a2e0-adb69a4b08e8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.438039 Jul 02 21:18:43.966055 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1968/3938] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:43 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:43.973416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7454ae7f-890a-4073-942e-753e9b43cd53 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-90140124", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7454ae7f-890a-4073-942e-753e9b43cd53 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 498 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-90140124", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-90140124', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e98efb69-10a3-4c3c-a1e6-9bad8e859690'}]}}} Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:18:43.978390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7454ae7f-890a-4073-942e-753e9b43cd53 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:43.981896 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7454ae7f-890a-4073-942e-753e9b43cd53 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.012657 Jul 02 21:18:43.991454 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1969/3939] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:43 2022] POST /compute/v2.1/servers => generated 689 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:18:43.997364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5a2e266b-9cbf-4de1-8742-b62aea00665d req-879706e2-ce10-4c6d-8a9c-4822ea372c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f35c43-b533-4afb-b402-2055a3f75cdf", "name": "network-vif-plugged", "status": "completed", "tag": "10e4f17e-b15a-4595-b32f-705c2b81782b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:44.010520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a2e266b-9cbf-4de1-8742-b62aea00665d req-879706e2-ce10-4c6d-8a9c-4822ea372c90 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:44.011788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5a2e266b-9cbf-4de1-8742-b62aea00665d req-879706e2-ce10-4c6d-8a9c-4822ea372c90 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:44.026845 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5a2e266b-9cbf-4de1-8742-b62aea00665d req-879706e2-ce10-4c6d-8a9c-4822ea372c90 service nova] Creating event network-vif-plugged:10e4f17e-b15a-4595-b32f-705c2b81782b for instance 58f35c43-b533-4afb-b402-2055a3f75cdf on nch2-master-1 Jul 02 21:18:44.034788 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5a2e266b-9cbf-4de1-8742-b62aea00665d req-879706e2-ce10-4c6d-8a9c-4822ea372c90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042401 Jul 02 21:18:44.038731 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1970/3940] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:44.046598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:44.047939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:44.057923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:44.059049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:44.060276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:44.061204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:44.391621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:44.415698 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c1acc475-fa0f-4307-8f4d-06dccb43623a tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1507 microversion: 2.1 time: 0.373102 Jul 02 21:18:44.418706 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1971/3941] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:44 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:44.437478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8f2fa535-173a-416f-9714-6f7592b5d7fd req-327199e5-04d7-496d-9183-3858019e4bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:44.462471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8f2fa535-173a-416f-9714-6f7592b5d7fd req-327199e5-04d7-496d-9183-3858019e4bcc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:44.464234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8f2fa535-173a-416f-9714-6f7592b5d7fd req-327199e5-04d7-496d-9183-3858019e4bcc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:44.476668 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8f2fa535-173a-416f-9714-6f7592b5d7fd req-327199e5-04d7-496d-9183-3858019e4bcc service nova] Creating event network-changed:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:18:44.488893 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8f2fa535-173a-416f-9714-6f7592b5d7fd req-327199e5-04d7-496d-9183-3858019e4bcc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068531 Jul 02 21:18:44.499730 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1972/3942] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:44.506001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e921139-7287-42ed-a53f-ca23dbc8a150 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-514744464", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e921139-7287-42ed-a53f-ca23dbc8a150 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 753 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-514744464", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-514744464', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e98efb69-10a3-4c3c-a1e6-9bad8e859690'}]}}} Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:18:44.518240 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:18:44.520660 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:18:44.522826 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:44.522826 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:44.522826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e921139-7287-42ed-a53f-ca23dbc8a150 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:44.522826 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e921139-7287-42ed-a53f-ca23dbc8a150 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.019405 Jul 02 21:18:44.522826 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1973/3943] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:44 2022] POST /compute/v2.1/servers => generated 1197 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 02 21:18:44.540528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:44.541414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:44.577553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:44.578002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:44.578798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:44.579409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:44.981429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:44.990391 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-651208e5-66d3-4be6-be7f-8c6277363953 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.466150 Jul 02 21:18:44.991050 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1974/3944] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:44 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:45.000519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.001345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.017144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.018886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.023978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.024496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.318604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Updating instance_info_cache with network_info: [{"id": "6d7798cb-af68-44cd-be7c-88e49d36d6a7", "address": "fa:16:3e:b7:93:62", "network": {"id": "bb524285-cec5-4598-9c67-5611fb01bfa2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-719962142-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6ec66c4ca37f47dcb3d18f89f3fe2a75", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6d7798cb-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131045) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:18:45.340992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Releasing lock "refresh_cache-c8182629-4371-4352-a82f-219a9f2141e2" {{(pid=131045) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 02 21:18:45.341936 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ea6ea8df-082c-4f78-ab7f-e4b4ab5fe4ed tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action" status: 202 len: 0 microversion: 2.1 time: 4.101253 Jul 02 21:18:45.346882 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1971/3945] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:41 2022] POST /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2/action => generated 0 bytes in 4106 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 02 21:18:45.353366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2301625-d1a6-48b8-ba65-c80bb34c0dba tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1913901720", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2301625-d1a6-48b8-ba65-c80bb34c0dba tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 1266 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1913901720", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "e98efb69-10a3-4c3c-a1e6-9bad8e859690"}]}} Jul 02 21:18:45.360712 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1913901720', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'e98efb69-10a3-4c3c-a1e6-9bad8e859690'}]}}} Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.364086 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:18:45.366306 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:18:45.370714 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 02 21:18:45.370714 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.370714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2301625-d1a6-48b8-ba65-c80bb34c0dba tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:45.370714 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2301625-d1a6-48b8-ba65-c80bb34c0dba tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.018167 Jul 02 21:18:45.371224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:45.371356 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1972/3946] 10.222.0.43 () {60 vars in 1147 bytes} [Sat Jul 2 21:18:45 2022] POST /compute/v2.1/servers => generated 2221 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 02 21:18:45.384404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:45.390923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.391720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.395713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:45.398292 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e1bca55-c0d1-4352-a65d-1e7d8a5693a0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1721 microversion: 2.20 time: 0.401923 Jul 02 21:18:45.402390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1975/3947] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:44 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1721 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:45.407901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.408697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.409155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.409707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.409933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.410538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.437702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.438434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.439459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.440214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.482087 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] HTTP exception thrown: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Request method failure captured: Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 HTTP/1.1 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXOBVlmES0FGK8v5eS-G3k9oETyNLd3rNGQ7YDgZdPFySeKMqUEfHHCKvPSWE-lwncuVBzJOjyeEquY0tpBB9dR1HH1xFM391n_nfzYI1wlUyMSpC7nASdZ_r6kHB8E9INegGcOfIEKFKUDKMKFP83BiH5R5o7dFtmTM65yHoqILvI Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ec66c4ca37f47dcb3d18f89f3fe2a75", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}] Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 7e89c1afe4de42e68f65d0a700c63b4e Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '522cf594-507b-4b58-bc86-0e6451bffb95'} Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:45.487632 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Returning 404 to user: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-438ca597-f08f-4828-ba7b-22fea0e47dfe tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "DELETE /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 404 len: 111 microversion: 2.1 time: 0.085509 Jul 02 21:18:45.492361 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1976/3948] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:45 2022] DELETE /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:45.505291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e30e8f07-e4ab-4100-b94e-69fbfcd9562c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.505917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e30e8f07-e4ab-4100-b94e-69fbfcd9562c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: aeb69386-9730-4056-966e-0e9da5d8fa32] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.513902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:45.521006 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e30e8f07-e4ab-4100-b94e-69fbfcd9562c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] HTTP exception thrown: Instance aeb69386-9730-4056-966e-0e9da5d8fa32 could not be found. Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e30e8f07-e4ab-4100-b94e-69fbfcd9562c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/aeb69386-9730-4056-966e-0e9da5d8fa32/metadata/test2 HTTP/1.1 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance aeb69386-9730-4056-966e-0e9da5d8fa32 could not be found. Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'server_id': 'aeb69386-9730-4056-966e-0e9da5d8fa32', 'id': 'test2'} Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aeb69386-9730-4056-966e-0e9da5d8fa32 could not be found. Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aeb69386-9730-4056-966e-0e9da5d8fa32 could not be found. Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.525139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.532007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:45.532007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:45.532007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aeb69386-9730-4056-966e-0e9da5d8fa32 could not be found. Jul 02 21:18:45.532007 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.532007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e30e8f07-e4ab-4100-b94e-69fbfcd9562c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 404 to user: Instance aeb69386-9730-4056-966e-0e9da5d8fa32 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:45.532007 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e30e8f07-e4ab-4100-b94e-69fbfcd9562c tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/aeb69386-9730-4056-966e-0e9da5d8fa32/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.039642 Jul 02 21:18:45.540301 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1977/3949] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 21:18:45 2022] GET /compute/v2.1/servers/aeb69386-9730-4056-966e-0e9da5d8fa32/metadata/test2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:45.551188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.551981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: 522cf594-507b-4b58-bc86-0e6451bffb95] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.565413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.566209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.567385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.568201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.586198 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] HTTP exception thrown: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Request method failure captured: Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 HTTP/1.1 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXOBVlmES0FGK8v5eS-G3k9oETyNLd3rNGQ7YDgZdPFySeKMqUEfHHCKvPSWE-lwncuVBzJOjyeEquY0tpBB9dR1HH1xFM391n_nfzYI1wlUyMSpC7nASdZ_r6kHB8E9INegGcOfIEKFKUDKMKFP83BiH5R5o7dFtmTM65yHoqILvI Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ec66c4ca37f47dcb3d18f89f3fe2a75", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}] Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 7e89c1afe4de42e68f65d0a700c63b4e Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '522cf594-507b-4b58-bc86-0e6451bffb95'} Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.589145 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. Jul 02 21:18:45.593435 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:45.596584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Returning 404 to user: Instance 522cf594-507b-4b58-bc86-0e6451bffb95 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:45.598674 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76a17c58-defc-4c4c-889b-a687328a32af tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95" status: 404 len: 111 microversion: 2.1 time: 0.052992 Jul 02 21:18:45.611966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1978/3950] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:45 2022] GET /compute/v2.1/servers/522cf594-507b-4b58-bc86-0e6451bffb95 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:45.619484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.620106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.628209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.628677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.629519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.629973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.664082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:18:45.776173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:45.788894 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccd64197-ebf9-4e39-952c-d647c4885aa9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1681 microversion: 2.1 time: 0.416747 Jul 02 21:18:45.789688 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1973/3951] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:45 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1681 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:45.797219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-275e71b8-bbd9-4dd1-931c-56f68fae6c2e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '.version_select at 0x7fabd754fdc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.809470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f195fb78-afc2-43d9-8e34-f3698790607d tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 204 len: 0 microversion: 2.1 time: 0.194718 Jul 02 21:18:45.812422 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1979/3952] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:45 2022] DELETE /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:45.832808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:45.833571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:45.844901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.845660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:45.848361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:45.849232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:46.317418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:46.335431 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75ce9257-5eea-43f9-b63e-3d2d382a03f8 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1526 microversion: 2.1 time: 0.511442 Jul 02 21:18:46.336796 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1980/3953] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:45 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1526 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:46.342875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:46.345536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:46.369435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:46.370739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:46.372056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:46.372766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:46.419319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:46.627647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:46.638754 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adf9863e-1cd3-4d7f-aaec-f8f32a33f5a9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.300595 Jul 02 21:18:46.639703 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1981/3954] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:46 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:46.653133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:46.654246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:46.661347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:46.662106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:46.663292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:46.664087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:46.921012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:46.931618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:46.934155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:46.935872 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6f6ee12-3abd-4119-8604-6ce53eacf3f7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1724 microversion: 2.20 time: 0.294468 Jul 02 21:18:46.937073 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1982/3955] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:46 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:46.942329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:46.943133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:46.955707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:46.956202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:46.957105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:46.958265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:47.663757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:47.675399 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbfe5095-8519-4c60-9cef-f84d3e3c0bd0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1658 microversion: 2.1 time: 0.736568 Jul 02 21:18:47.686714 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1983/3956] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:46 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1658 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:47.693574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb6fa52b-f4db-4f5b-80e7-c80177b5e350"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:47.694719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:47.701271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:47.701922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:47.702881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:47.703462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:47.839479 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-275e71b8-bbd9-4dd1-931c-56f68fae6c2e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/3114c14b-ee02-497d-970e-1007a05d157a" status: 202 len: 0 microversion: 2.1 time: 2.048427 Jul 02 21:18:47.840488 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1974/3957] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:18:45 2022] DELETE /compute/v2.1/os-floating-ips/3114c14b-ee02-497d-970e-1007a05d157a => generated 0 bytes in 2050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:18:47.847337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:47.849417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:47.862600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:47.864084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:47.865047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:47.865990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.034965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:48.043831 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d8aaf2b9-3215-410a-8355-51f6743cadc5 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1526 microversion: 2.1 time: 0.201927 Jul 02 21:18:48.045076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1975/3958] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:47 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1526 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:48.064236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:48.065726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:48.074148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.075068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.076227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.077997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.101807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:48.122350 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aef58ffa-086b-45f7-b80a-4cb15ae4cf96 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.432738 Jul 02 21:18:48.123284 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1984/3959] 10.222.0.43 () {62 vars in 1363 bytes} [Sat Jul 2 21:18:47 2022] POST /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-volume_attachments => generated 188 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:18:48.136017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-644bed5c-a7aa-4ea9-82a4-def7c07ebdab req-a88f4f4d-20a4-4314-833d-afa17215fa66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "name": "network-vif-unplugged", "status": "completed", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:48.153030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-644bed5c-a7aa-4ea9-82a4-def7c07ebdab req-a88f4f4d-20a4-4314-833d-afa17215fa66 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.153760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-644bed5c-a7aa-4ea9-82a4-def7c07ebdab req-a88f4f4d-20a4-4314-833d-afa17215fa66 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.178607 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-644bed5c-a7aa-4ea9-82a4-def7c07ebdab req-a88f4f4d-20a4-4314-833d-afa17215fa66 service nova] Creating event network-vif-unplugged:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:18:48.187230 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-644bed5c-a7aa-4ea9-82a4-def7c07ebdab req-a88f4f4d-20a4-4314-833d-afa17215fa66 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062214 Jul 02 21:18:48.188013 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1985/3960] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:48.193476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1fd2216e-c138-4066-be75-3c3b4a0649b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:48.212355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd2216e-c138-4066-be75-3c3b4a0649b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.240710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1fd2216e-c138-4066-be75-3c3b4a0649b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.301490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1fd2216e-c138-4066-be75-3c3b4a0649b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 21:18:48.389473 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1fd2216e-c138-4066-be75-3c3b4a0649b8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.199798 Jul 02 21:18:48.392052 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1986/3961] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:48 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:18:48.398999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:48.426810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:48.427521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:48.440438 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5eef0d5c-7554-48ff-b377-ea7ebc38b83a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1329 microversion: 2.1 time: 0.393877 Jul 02 21:18:48.441610 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1976/3962] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:48 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1329 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:48.446920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.447288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.448177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.448622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.449539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:48.450434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:48.458356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.459304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.460395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.461093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.513296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:18:48.668021 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be0fb4d8-5854-4cf6-81a4-c817973f172e tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 204 len: 0 microversion: 2.1 time: 0.270102 Jul 02 21:18:48.682242 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1987/3963] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:48 2022] DELETE /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:48.688372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:48.688970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:48.701666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.703218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.704089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.704532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.767838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:48.783961 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b6c9360-84ea-409c-a456-532f96f7fc59 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1667 microversion: 2.1 time: 0.339958 Jul 02 21:18:48.784869 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1977/3964] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:48 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1667 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:48.798933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:48.800332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:48.809698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.810551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.811495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.812731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.844511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:18:48.944924 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-401262eb-3ee8-49ff-9b3e-c7951da06e8d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 204 len: 0 microversion: 2.1 time: 0.158327 Jul 02 21:18:48.945523 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1978/3965] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:48 2022] DELETE /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:48.954239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:48.959473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:48.967093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.967800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:48.968771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:48.969392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.117675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8f4315b0-aae6-46f9-8be1-f3bf1afda405 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-volume_attachments/eb6fa52b-f4db-4f5b-80e7-c80177b5e350" status: 202 len: 0 microversion: 2.20 time: 0.434223 Jul 02 21:18:49.119511 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1988/3966] 10.222.0.43 () {60 vars in 1456 bytes} [Sat Jul 2 21:18:48 2022] DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-volume_attachments/eb6fa52b-f4db-4f5b-80e7-c80177b5e350 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:49.128412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:49.133108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:49.146215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.146424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.146699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.147469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.147914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.155295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-31137c21-cba0-439e-a867-b9263e4b4b47 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1525 microversion: 2.1 time: 0.205098 Jul 02 21:18:49.156248 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1979/3967] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:48 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1525 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:49.162643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:49.163371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:49.178554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.179303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.180532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.181126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.414123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.419032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.423179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d479c19-e692-4faf-9749-15df21887ffe tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1513 microversion: 2.1 time: 0.302316 Jul 02 21:18:49.424252 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1989/3968] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:49 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:49.430045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:49.430739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:49.437585 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a6a2fc4-e2f0-4e76-991f-098e308b4463 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1526 microversion: 2.1 time: 0.280024 Jul 02 21:18:49.438488 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1980/3969] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:49 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1526 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:49.448633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.449263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.450192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.450880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.460911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:49.461689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:49.469118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.469662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.471657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.472231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.527842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=7,nova_cell1:UPDATE=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:49.582825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06b7441f-b9f6-4ca4-9093-d02e82bf5af5 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "POST /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/action" status: 202 len: 0 microversion: 2.20 time: 0.156353 Jul 02 21:18:49.584065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1990/3970] 10.222.0.43 () {62 vars in 1318 bytes} [Sat Jul 2 21:18:49 2022] POST /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:49.593713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:49.594619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:49.605993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.606817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.607826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.608504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.645364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.656005 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7278e022-2dc1-4958-9ff9-ac3b845df5ce tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1509 microversion: 2.1 time: 0.200426 Jul 02 21:18:49.656941 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1981/3971] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:49 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:49.698943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:49.701751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:49.712372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.713360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.714267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:49.715712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:49.971535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.990254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.992330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:49.994463 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-512d2c42-0283-486b-b995-5db888d49bbd tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1672 microversion: 2.20 time: 0.405594 Jul 02 21:18:49.995295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1991/3972] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:49 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1672 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:50.013961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:50.015030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:50.022340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.023004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:50.024391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.025561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.026292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.034102 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-041f6208-b7eb-42ce-ba11-a56e5125f3ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1509 microversion: 2.1 time: 0.353218 Jul 02 21:18:50.045292 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1982/3973] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:49 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1509 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:50.053504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:50.054701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:50.083651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.084699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.086014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.086783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.168701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:18:50.237279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:50.267986 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae1abbb3-d7f5-4cfe-a313-cdd51458971d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1667 microversion: 2.1 time: 0.257027 Jul 02 21:18:50.272625 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1992/3974] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:50 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1667 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:50.292907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8042309f-ad8a-4635-a3ee-b86f46756d3b req-8c98118d-8e5a-44ae-aff7-a45850204f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a33be86-415d-42ca-a13f-7ec8880cfad5", "name": "network-vif-deleted", "tag": "8dc45078-0a43-4c8c-bf7e-491d459b0b33"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:50.318190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8042309f-ad8a-4635-a3ee-b86f46756d3b req-8c98118d-8e5a-44ae-aff7-a45850204f38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.318992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8042309f-ad8a-4635-a3ee-b86f46756d3b req-8c98118d-8e5a-44ae-aff7-a45850204f38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.346951 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8042309f-ad8a-4635-a3ee-b86f46756d3b req-8c98118d-8e5a-44ae-aff7-a45850204f38 service nova] Creating event network-vif-deleted:8dc45078-0a43-4c8c-bf7e-491d459b0b33 for instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 on nch2-master-1 Jul 02 21:18:50.353520 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8042309f-ad8a-4635-a3ee-b86f46756d3b req-8c98118d-8e5a-44ae-aff7-a45850204f38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073480 Jul 02 21:18:50.355189 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1993/3975] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:50.361995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:50.363230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:50.372830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.373506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.374452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.375111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.441247 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f6255979-88d4-4d20-be39-3a29cbe305e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 204 len: 0 microversion: 2.1 time: 0.390703 Jul 02 21:18:50.470748 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1983/3976] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:18:50 2022] DELETE /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:18:50.482353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:50.483877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:50.497193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.497905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.498920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.499599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.681590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:50.693425 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47437c62-34cd-4e71-8570-03d4823624ef tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1525 microversion: 2.1 time: 0.336436 Jul 02 21:18:50.694418 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1994/3977] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:50 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1525 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:50.700474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:50.701258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:50.710513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.711357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.712913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.713507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.772628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.773352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.773973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lazy-loading 'fault' on Instance uuid 5a33be86-415d-42ca-a13f-7ec8880cfad5 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:18:50.794556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:50.805476 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a5a3a45-4013-4f0d-bf1e-8569857c9c35 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1513 microversion: 2.1 time: 0.332122 Jul 02 21:18:50.806682 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1984/3978] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:50 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:50.813454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:50.814599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:50.822420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.823595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.824933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:50.825631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:50.862589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:50.887502 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fcc55d7b-b2e4-46ab-b03c-9ea31deff526 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1314 microversion: 2.1 time: 0.189708 Jul 02 21:18:50.889362 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1995/3979] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:50 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:51.016709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:51.018064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:51.025750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.026551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.027429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.028099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.118731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:51.141817 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4bbfc666-df45-4bac-9aaa-5f3b19e0b1c8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1515 microversion: 2.1 time: 0.333554 Jul 02 21:18:51.143317 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1985/3980] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:50 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1515 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:51.283692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:51.290151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:51.290848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:51.294315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:51.298219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.299073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.300276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:51.300451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.300721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.302225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:51.303848 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4693192-8646-4578-9caa-dced669601f9 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1672 microversion: 2.20 time: 0.291213 Jul 02 21:18:51.314054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1996/3981] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:51 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1672 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:18:51.473766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:51.486402 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e95e6749-2b41-498b-93fb-81f03824579d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1667 microversion: 2.1 time: 0.201958 Jul 02 21:18:51.487403 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1986/3982] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:51 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1667 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:51.711231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:51.712132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:51.732452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.733051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.734049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.735124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.830919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:51.831563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:51.846556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.848500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:51.849616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:51.851404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.300837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:52.311139 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf05e41e-ad16-47fa-bb84-c4f8ed0f0a64 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1525 microversion: 2.1 time: 0.603997 Jul 02 21:18:52.317848 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1997/3983] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:51 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1525 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:52.341304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:52.342233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:52.349172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.352759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.353921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.354587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.442722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.453653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.455389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lazy-loading 'fault' on Instance uuid 5a33be86-415d-42ca-a13f-7ec8880cfad5 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:18:52.568364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '678fafac5b764cd18ed9f40c6ac09be6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a95706cb67b642f58f6c0bdf8e65d766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:52.577622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86777de0-dbc3-4073-a688-c368d87d9f25 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 200 len: 1314 microversion: 2.1 time: 0.249554 Jul 02 21:18:52.578888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1998/3984] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:52 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:52.594871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:52.596309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:52.604635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.605409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.606393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.607063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.657459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:52.668413 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7697e41-757c-4961-9101-31729223a7f8 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1513 microversion: 2.1 time: 0.843786 Jul 02 21:18:52.679641 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1987/3985] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:51 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1513 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:52.689391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:52.690246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:52.698166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.699590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:52.700623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:52.701305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.087034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.106713 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d25fd936-99f9-4040-9be8-5e02fde81c1f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1515 microversion: 2.1 time: 0.517385 Jul 02 21:18:53.107322 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 1999/3986] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:52 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1515 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:53.121611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:53.122609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:53.129952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.130414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.131188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.131622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.157962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.172538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.174017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.175596 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b471d8dd-bcb3-4a6f-8812-332cf7501e7c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.494574 Jul 02 21:18:53.176179 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1988/3987] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:52 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:53.334368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:53.335174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:53.343346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.343757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.344585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.344998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.378353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:53.571158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.580146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e89c1afe4de42e68f65d0a700c63b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec66c4ca37f47dcb3d18f89f3fe2a75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.583165 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-592bfcd1-65b3-4de8-b88c-578ac75edc31 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1667 microversion: 2.1 time: 0.474537 Jul 02 21:18:53.584657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2000/3988] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:53 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1667 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:53.588951 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-310b471f-c5d3-46bc-8f4d-9a95743a0d37 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 200 len: 1483 microversion: 2.1 time: 0.258502 Jul 02 21:18:53.594919 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1989/3989] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:53 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 1483 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:18:53.595559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ffd7958a-a9b0-4f83-a316-b86a02f5fc40 req-86004195-9b99-4c65-9609-a33e94e2cbaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58f35c43-b533-4afb-b402-2055a3f75cdf", "name": "network-vif-deleted", "tag": "10e4f17e-b15a-4595-b32f-705c2b81782b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:53.618336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4052e7a4-cf02-4272-a710-a53dc60277ac req-273af8eb-2fc1-45f9-9da4-ef61a9bf286c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8182629-4371-4352-a82f-219a9f2141e2", "name": "network-vif-deleted", "tag": "6d7798cb-af68-44cd-be7c-88e49d36d6a7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:53.632365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ffd7958a-a9b0-4f83-a316-b86a02f5fc40 req-86004195-9b99-4c65-9609-a33e94e2cbaf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.635818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ffd7958a-a9b0-4f83-a316-b86a02f5fc40 req-86004195-9b99-4c65-9609-a33e94e2cbaf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.661063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4052e7a4-cf02-4272-a710-a53dc60277ac req-273af8eb-2fc1-45f9-9da4-ef61a9bf286c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.663806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4052e7a4-cf02-4272-a710-a53dc60277ac req-273af8eb-2fc1-45f9-9da4-ef61a9bf286c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.710578 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ffd7958a-a9b0-4f83-a316-b86a02f5fc40 req-86004195-9b99-4c65-9609-a33e94e2cbaf service nova] Creating event network-vif-deleted:10e4f17e-b15a-4595-b32f-705c2b81782b for instance 58f35c43-b533-4afb-b402-2055a3f75cdf on nch2-master-1 Jul 02 21:18:53.715695 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4052e7a4-cf02-4272-a710-a53dc60277ac req-273af8eb-2fc1-45f9-9da4-ef61a9bf286c service nova] Creating event network-vif-deleted:6d7798cb-af68-44cd-be7c-88e49d36d6a7 for instance c8182629-4371-4352-a82f-219a9f2141e2 on nch1-master-1 Jul 02 21:18:53.728672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ffd7958a-a9b0-4f83-a316-b86a02f5fc40 req-86004195-9b99-4c65-9609-a33e94e2cbaf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141106 Jul 02 21:18:53.729810 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2001/3990] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:53.738877 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4052e7a4-cf02-4272-a710-a53dc60277ac req-273af8eb-2fc1-45f9-9da4-ef61a9bf286c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140026 Jul 02 21:18:53.739556 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1990/3991] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:53.749910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:53.750570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] [instance: 5a33be86-415d-42ca-a13f-7ec8880cfad5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:53.758060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:53.761561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:53.779183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.779909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.781030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.783434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.785855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.789835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.800242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:53.806960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:53.854817 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] HTTP exception thrown: Instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 could not be found. Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Request method failure captured: Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 HTTP/1.1 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLYYZTgZflSN8XGuVlcYMaEiBYtM1MQoCoWTBGV-G9UzWcdxeQxSFcoQ8dYxHVh16nQe9tQMmLO08-KeqmvG29YRr_SSWk8tqxSvn8cVuvX1FdSmGezgyU6gbRDl7d1M9EUUpRzULpT_if-nI7OTnnozTSB83wilGoBUsed9O5G1Osw Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a95706cb67b642f58f6c0bdf8e65d766", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a95706cb67b642f58f6c0bdf8e65d766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a95706cb67b642f58f6c0bdf8e65d766"}]}] Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a95706cb67b642f58f6c0bdf8e65d766 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1238596660 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 678fafac5b764cd18ed9f40c6ac09be6 Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1238596660-project Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 could not be found. Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '5a33be86-415d-42ca-a13f-7ec8880cfad5'} Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 could not be found. Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 could not be found. Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:53.857248 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 could not be found. Jul 02 21:18:53.861187 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:53.869229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] Returning 404 to user: Instance 5a33be86-415d-42ca-a13f-7ec8880cfad5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:53.870590 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7e6e97c-131c-4f9c-b738-f96d73b63fc7 tempest-ServerMetadataNegativeTestJSON-1238596660 tempest-ServerMetadataNegativeTestJSON-1238596660-project] 10.222.0.43 "GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5" status: 404 len: 111 microversion: 2.1 time: 0.139146 Jul 02 21:18:53.871231 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2002/3992] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:53 2022] GET /compute/v2.1/servers/5a33be86-415d-42ca-a13f-7ec8880cfad5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:53.957904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:53.966841 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-23c77ee6-68c8-44b7-9529-70f4df6d68ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 200 len: 1471 microversion: 2.1 time: 0.224629 Jul 02 21:18:53.978884 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1991/3993] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:53 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:54.124625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:54.125192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:54.132644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.133409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.134468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.135264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.182235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.182867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.183558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lazy-loading 'fault' on Instance uuid 58f35c43-b533-4afb-b402-2055a3f75cdf {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:18:54.195792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:54.196521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:54.209614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.215209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.217833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.218983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.328849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:54.347352 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b86d7703-9c48-487b-8015-d8d20f76aba8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 200 len: 1319 microversion: 2.1 time: 0.226665 Jul 02 21:18:54.348033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2003/3994] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:54 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:54.574543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:54.588949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:54.597767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:54.603497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:54.605042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:54.605754 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a382c2db-c1c5-4707-aff1-2f3dc01fcafe tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.414880 Jul 02 21:18:54.608005 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1992/3995] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:54 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:18:54.620208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.627711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:54.627925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.628653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] [instance: c8182629-4371-4352-a82f-219a9f2141e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:54.630186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.634693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.647241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.648199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.649440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.650693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.669009 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] HTTP exception thrown: Instance c8182629-4371-4352-a82f-219a9f2141e2 could not be found. Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Request method failure captured: Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 HTTP/1.1 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXOBVlmES0FGK8v5eS-G3k9oETyNLd3rNGQ7YDgZdPFySeKMqUEfHHCKvPSWE-lwncuVBzJOjyeEquY0tpBB9dR1HH1xFM391n_nfzYI1wlUyMSpC7nASdZ_r6kHB8E9INegGcOfIEKFKUDKMKFP83BiH5R5o7dFtmTM65yHoqILvI Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6ec66c4ca37f47dcb3d18f89f3fe2a75", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6ec66c4ca37f47dcb3d18f89f3fe2a75"}]}] Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 6ec66c4ca37f47dcb3d18f89f3fe2a75 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-596392110 Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 7e89c1afe4de42e68f65d0a700c63b4e Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-596392110-project Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c8182629-4371-4352-a82f-219a9f2141e2 could not be found. Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c8182629-4371-4352-a82f-219a9f2141e2'} Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8182629-4371-4352-a82f-219a9f2141e2 could not be found. Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8182629-4371-4352-a82f-219a9f2141e2 could not be found. Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:54.672517 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8182629-4371-4352-a82f-219a9f2141e2 could not be found. Jul 02 21:18:54.676361 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:54.678095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] Returning 404 to user: Instance c8182629-4371-4352-a82f-219a9f2141e2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:54.679191 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce8e841e-a26a-45e9-b47a-e34cb34b7fc7 tempest-FloatingIPsAssociationTestJSON-596392110 tempest-FloatingIPsAssociationTestJSON-596392110-project] 10.222.0.43 "GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2" status: 404 len: 111 microversion: 2.1 time: 0.055789 Jul 02 21:18:54.681161 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1993/3996] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:54 2022] GET /compute/v2.1/servers/c8182629-4371-4352-a82f-219a9f2141e2 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:54.987988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:54.988860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: 4614ecfd-c219-46ed-98a8-857a539fa0a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:54.996705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.997590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:54.998613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:54.999873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:55.018049 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] HTTP exception thrown: Instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 could not be found. Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Request method failure captured: Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 HTTP/1.1 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLX2zSoWjuf76ybRNsqVLLUwkModkAOgohyZpqanDi3pIhzUi3yFkIiiMADs5tzxdPn_IEim9oc9I_dLNOxARbXHQcAp4I-dSNEHJLJ3ld03uFkxzt2HqtdBnMZh5i4otZqAaBp4udjlGTitYsc5LyBlKcOKQh55q1wLj89NHxEOnr8 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c7534889ba5b48338c27c0556be3c6f0 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1740353321 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c7534889ba5b48338c27c0556be3c6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c7534889ba5b48338c27c0556be3c6f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c7534889ba5b48338c27c0556be3c6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c7534889ba5b48338c27c0556be3c6f0"}]}] Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-VolumesSnapshotTestJSON-1740353321 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c7534889ba5b48338c27c0556be3c6f0 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1740353321 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-VolumesSnapshotTestJSON-1740353321-project Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 2016769bf3a34d22992b45f9974b99a2 Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-VolumesSnapshotTestJSON-1740353321-project Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 could not be found. Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '4614ecfd-c219-46ed-98a8-857a539fa0a2'} Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 could not be found. Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 could not be found. Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:55.021924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 could not be found. Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Returning 404 to user: Instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:55.028341 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e4b51d3-8e37-48b5-a47f-cf0c2d4ae606 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2" status: 404 len: 111 microversion: 2.1 time: 0.042683 Jul 02 21:18:55.029217 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1994/3997] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:54 2022] GET /compute/v2.1/servers/4614ecfd-c219-46ed-98a8-857a539fa0a2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:18:55.144808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:55.158641 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-730b0493-bbfe-4d50-938c-ef472831ec68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.559292 Jul 02 21:18:55.159642 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2004/3998] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:54 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:55.182937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:55.186208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:55.200512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:55.200991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:55.203793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:55.204523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:55.376409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:55.377409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:55.395376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:55.396207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:55.397149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:55.397741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:55.422406 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf HTTP/1.1 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '58f35c43-b533-4afb-b402-2055a3f75cdf'} Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.425814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:18:55.430519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:18:55.430519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:18:55.430519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:18:55.430519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:18:55.430519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:18:55.430519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:18:55.432193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:18:55.433479 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-deac3633-74e5-4a54-89f8-8ce7dbc33cb0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 404 len: 111 microversion: 2.1 time: 0.066708 Jul 02 21:18:55.434080 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2005/3999] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:55 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:18:55.446347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53b658bc-0328-4377-986b-bc2180142941 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '.version_select at 0x7fabd7896d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:55.469622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53b658bc-0328-4377-986b-bc2180142941 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-key-1519860899" status: 202 len: 0 microversion: 2.1 time: 0.028227 Jul 02 21:18:55.482590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2006/4000] 10.222.0.43 () {58 vars in 1208 bytes} [Sat Jul 2 21:18:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1519860899 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:18:55.528870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1416387884", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:55.601274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:18:56.214695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:56.227572 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac7e209b-c6f5-49a3-ae47-b5b2182bca9a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 1.053932 Jul 02 21:18:56.230602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1995/4001] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:55 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:56.247622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:56.248347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:56.258485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:56.259106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:56.260621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:56.262091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:56.917634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:56.935697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:56.946989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:56.952554 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f76084c1-40de-4724-a405-c8e2ee27ae9b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.718813 Jul 02 21:18:56.955291 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1996/4002] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:56 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:18:56.983371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-8ed6a211-4a3d-48d0-94cc-e4576200aeb0 req-b5b9b721-57dc-46cc-9fb0-b64e57c368a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4614ecfd-c219-46ed-98a8-857a539fa0a2", "name": "network-vif-deleted", "tag": "89e5da5c-28f4-4de2-a88c-006aaa8c80a8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:57.022065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8ed6a211-4a3d-48d0-94cc-e4576200aeb0 req-b5b9b721-57dc-46cc-9fb0-b64e57c368a4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.022972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8ed6a211-4a3d-48d0-94cc-e4576200aeb0 req-b5b9b721-57dc-46cc-9fb0-b64e57c368a4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.075383 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-8ed6a211-4a3d-48d0-94cc-e4576200aeb0 req-b5b9b721-57dc-46cc-9fb0-b64e57c368a4 service nova] Creating event network-vif-deleted:89e5da5c-28f4-4de2-a88c-006aaa8c80a8 for instance 4614ecfd-c219-46ed-98a8-857a539fa0a2 on nch1-master-1 Jul 02 21:18:57.084818 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-8ed6a211-4a3d-48d0-94cc-e4576200aeb0 req-b5b9b721-57dc-46cc-9fb0-b64e57c368a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125365 Jul 02 21:18:57.085580 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1997/4003] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:18:57.091922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:57.107464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:57.121326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.122027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.123081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.123681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.383581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:18:57.384243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:18:57.384607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:18:57.385024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:18:57.385448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:18:57.405401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.405890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.406696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.407138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.459918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:18:57.468923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:57.474694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:18:57.489364 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f974257-0194-471e-bfc5-434ec3f7ea0a tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.392564 Jul 02 21:18:57.491812 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1998/4004] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:57 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:57.509696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:57.511626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:57.519031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:18:57.523297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:18:57.532359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.535034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.537315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:57.543686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:57.640526 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb6b4a18-54df-4d46-b891-d15827010c09 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.116874 Jul 02 21:18:57.651620 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2007/4005] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:18:57.657002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edefecea-e318-4944-a090-3848e752113a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:57.663823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-edefecea-e318-4944-a090-3848e752113a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:57.698484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:57.926391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edefecea-e318-4944-a090-3848e752113a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:57.945479 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edefecea-e318-4944-a090-3848e752113a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1209 microversion: 2.1 time: 0.292084 Jul 02 21:18:57.955256 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2008/4006] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:57 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1209 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:57.974443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:57.975140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:58.007402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:58.012911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:58.015146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:58.017593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:58.449038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:58.458289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64af89f5-10bd-4013-9be9-ad2bb2dd40ef tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.954256 Jul 02 21:18:58.464288 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 1999/4007] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:57 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:58.480594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:58.481481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:58.498442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:58.501136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:58.504250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:58.508277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:58.797285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:58.822586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:58.825073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:58.841378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebf06bfd-a7f2-4517-983a-18c0f8632543 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.862252 Jul 02 21:18:58.842771 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2009/4008] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:57 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:18:58.974898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:58.975832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:58.996217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:58.997288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.012149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.013323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.277952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:59.298706 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcf8b5b8-5bce-409a-a2f1-4e9308fd28a5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1205 microversion: 2.1 time: 0.332708 Jul 02 21:18:59.310468 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2010/4009] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:58 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1205 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:59.369327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:18:59.401717 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e8993ec-8412-486e-bc61-77c0d68c4018 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.927711 Jul 02 21:18:59.402331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2000/4010] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:58 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:18:59.425125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:18:59.427447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:59.451940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.452480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.453322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.453884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.462192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:18:59.501189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lazy-loading 'flavor' on Instance uuid 42f5e581-653c-47dd-beca-62493c2367ba {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:18:59.648798 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f618df10-e8f3-4b44-992d-897b578f3cad tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.230122 Jul 02 21:18:59.650671 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2011/4011] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:18:59 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:18:59.662263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:59.662908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:59.680406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.681173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.682740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.683390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.864341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:18:59.865370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:18:59.878450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.884187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:18:59.885598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:18:59.886226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:00.326312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:00.348981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f68a1c2-5786-44f0-a6b2-c9d70fd8aee2 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1679 microversion: 2.1 time: 0.693424 Jul 02 21:19:00.360108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2001/4012] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:18:59 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1679 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:00.365949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:00.366574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:00.395081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:00.395725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:00.403483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:00.404393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:00.559676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:00.581756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:00.588646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:00.594382 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b91ce58a-2211-4d82-95d6-c9a61fa7dd1f tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.734887 Jul 02 21:19:00.595065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2012/4013] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:18:59 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:00.609511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1443355597", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "cee92be4-408c-4f6e-b7ac-a0517d16edc0"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:00.772452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] validate_networks() for [('cee92be4-408c-4f6e-b7ac-a0517d16edc0', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:19:00.884021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:00.915417 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8209d0b6-4851-4445-89fb-e8f3f6037c15 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1269 microversion: 2.1 time: 0.551694 Jul 02 21:19:00.915417 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2002/4014] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:00 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1269 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:01.384763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:01.385595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:01.406063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:01.408894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:01.412131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:01.416279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:02.028015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:02.042412 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3d7fcd5-59fc-46a5-8c2d-bb463344102c tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1662 microversion: 2.1 time: 0.662638 Jul 02 21:19:02.044447 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2003/4015] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:01 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1662 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:02.056737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:02.060170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:02.085838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:02.087828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:02.100354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:02.101717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:02.900676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:19:02.902093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:19:02.902786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:19:02.903384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:19:02.904382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:19:03.006467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.012014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.013369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.017331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.081130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Getting quotas for project c7534889ba5b48338c27c0556be3c6f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:19:03.104613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Getting quotas for user 2016769bf3a34d22992b45f9974b99a2 and project c7534889ba5b48338c27c0556be3c6f0. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:19:03.143634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:19:03.149612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:19:03.293693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:03.309901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:03.311406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:03.312647 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a5a280b4-a5e6-4b04-8068-871f624a7f2b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 1.267053 Jul 02 21:19:03.320206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2004/4016] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:02 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:03.328952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d58dc41d-4322-4298-a8d5-37cb46da5c00 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.729435 Jul 02 21:19:03.330266 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2013/4017] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:19:03.337991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:03.339150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:03.349572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.350448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.351965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.353400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.353572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:03.364450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:03.389468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.392691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.393763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.396229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.581577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a30b61a-ef47-4ee4-98f4-a626b2b6bad8 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action" status: 202 len: 0 microversion: 2.1 time: 0.245784 Jul 02 21:19:03.586510 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2014/4018] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:19:03 2022] POST /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:19:03.629327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c367310b-18f7-4337-b18d-46137e81d856 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:03.630618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c367310b-18f7-4337-b18d-46137e81d856 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:03.655610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:03.677858 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a54caf7-ad55-4904-b9d0-7649f15b4ef2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1267 microversion: 2.1 time: 0.355851 Jul 02 21:19:03.697005 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2005/4019] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:03 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1267 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:03.699062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:03.700696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:03.719397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.743185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.747301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:03.747789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:03.804155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c367310b-18f7-4337-b18d-46137e81d856 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:03.816202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c367310b-18f7-4337-b18d-46137e81d856 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1219 microversion: 2.1 time: 0.225925 Jul 02 21:19:03.817370 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2015/4020] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:03 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:04.331131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:04.331835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:04.344722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:04.345177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:04.345976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:04.346402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:04.918559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:04.946263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5299b465-a490-4d9b-9b0c-b033260bb588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1668 microversion: 2.1 time: 1.251364 Jul 02 21:19:04.958669 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2006/4021] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:03 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1668 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:04.970656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:04.985121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:05.004031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:05.004031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:05.005034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:05.006296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:05.093908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:05.120628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:05.127562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:05.133127 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3251b9e7-6a66-46ac-a593-43820681b430 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.803965 Jul 02 21:19:05.136637 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2016/4022] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:04 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:19:05.153255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:05.157533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:05.181727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:05.183815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:05.186923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:05.187859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:05.457406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:05.471940 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfdfef36-aa31-4cc4-862f-00f6a5b59d33 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1271 microversion: 2.1 time: 0.333400 Jul 02 21:19:05.475685 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2017/4023] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:05 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1271 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:05.869176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:05.885811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9b665bb5-c51a-449d-9805-5a61f43331ed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.925204 Jul 02 21:19:05.890422 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2007/4024] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:04 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:05.976166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:05.977440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:05.990165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:05.990864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:05.991826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:05.992442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:06.153447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:06.154974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:06.169466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:06.171755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:06.176387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:06.183670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:07.429824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:07.441172 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53d28c2f-ff0a-4932-99f7-ca0650adb515 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1668 microversion: 2.1 time: 1.472073 Jul 02 21:19:07.441739 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2018/4025] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:05 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1668 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:07.447543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:07.469115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:07.476336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:07.479002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:07.480100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:07.484156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:07.571373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:07.585673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:07.599603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:07.605661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:07.613641 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0c7552e8-408b-43d6-b581-c7cc7b7f745b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 1.464653 Jul 02 21:19:07.614626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2008/4026] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:06 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:19:07.624587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:07.627091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:07.642064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:07.646208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:07.647315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:07.648158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:07.725171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:07.736132 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e11ac47-243a-45b7-b2a6-c3c9d8066648 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1277 microversion: 2.1 time: 0.293121 Jul 02 21:19:07.740249 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2019/4027] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:07 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1277 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:07.967833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:07.979904 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a09c97cf-6fc8-458b-bdeb-0c77b1f2deff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.363904 Jul 02 21:19:07.994459 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2009/4028] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:07 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:08.462540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:08.463276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:08.486570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:08.488417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:08.490006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:08.491505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:08.635166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:08.635922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:08.649983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:08.654717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:08.655823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:08.656617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:10.565182 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:19:10.566180 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 (ip 10.222.0.43) !!! Jul 02 21:19:10.782502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:10.810758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:10.812236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:10.823676 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f2a8709-ad5a-45a6-8125-8475a5329317 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 2.191793 Jul 02 21:19:10.838247 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2010/4029] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:08 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:10.844777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:10.845939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:10.853587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:10.854412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:10.855417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:10.855918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:10.895298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:10.909941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbd54785-d204-4101-a7bd-54c2bddc4999 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 2.449233 Jul 02 21:19:10.916134 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2020/4030] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:08 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 2459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:10.927008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:10.931911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:10.957032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:10.957950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:10.959084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:10.959887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.327680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:11.335354 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a68b573-f8fc-4b9a-8e50-a8adcb52b60d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.495415 Jul 02 21:19:11.338980 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2011/4031] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:10 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:11.349937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5269236a-83a1-4e1e-a058-551fe8a5cd14 req-31576aa7-3671-4bbf-bdf6-3dfb1eea7aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e7d3e8-1524-46a1-9d29-c70323e380bf", "tag": "0a474375-7cff-43c6-a3fe-2d343b013116"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:11.365375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5269236a-83a1-4e1e-a058-551fe8a5cd14 req-31576aa7-3671-4bbf-bdf6-3dfb1eea7aae service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.365822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5269236a-83a1-4e1e-a058-551fe8a5cd14 req-31576aa7-3671-4bbf-bdf6-3dfb1eea7aae service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.383713 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5269236a-83a1-4e1e-a058-551fe8a5cd14 req-31576aa7-3671-4bbf-bdf6-3dfb1eea7aae service nova] Creating event network-changed:0a474375-7cff-43c6-a3fe-2d343b013116 for instance 30e7d3e8-1524-46a1-9d29-c70323e380bf on nch2-master-1 Jul 02 21:19:11.391188 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5269236a-83a1-4e1e-a058-551fe8a5cd14 req-31576aa7-3671-4bbf-bdf6-3dfb1eea7aae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050930 Jul 02 21:19:11.395053 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2012/4032] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:11.405478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:11.406362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:11.414839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.415454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.416519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.417104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.468858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:11.478431 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7769386-4302-44e4-ae1e-ca0097795a59 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.560894 Jul 02 21:19:11.480135 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2021/4033] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:10 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:11.738949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:11.749421 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27c95b65-f00f-48a5-9f26-16b9b92120b6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1671 microversion: 2.1 time: 0.352874 Jul 02 21:19:11.751764 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2013/4034] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:11 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1671 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:11.771258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:11.772006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:11.779530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.783786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.786880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.787508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.845351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:11.845968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:11.850781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:11.854053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.854538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.855312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:11.855745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:11.874351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Working on deleting snapshot 87a2e6fa-baed-4bbf-ac98-07a49358bea7 from shelved instance... Jul 02 21:19:12.146587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:12.159037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:12.164476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:12.165970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4890f337-ba07-414f-800b-32e766cbff8d tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.324937 Jul 02 21:19:12.167662 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2014/4035] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:11 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:19:12.351849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:12.353017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:12.361729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:12.362647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:12.364925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:12.366489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:12.646084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:12.659266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b71fba85-7230-4e1b-8ee8-21300789ce5b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.311228 Jul 02 21:19:12.663250 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2015/4036] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:12 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:12.668349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:12.676790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:12.688911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:12.691648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:12.697840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:12.698248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:13.049551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:13.202886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Doing local delete in cell de9904c6-61a4-467b-9f20-25602691bcd4(cell1) {{(pid=131044) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 02 21:19:13.204254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:13.204860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:13.205446 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 02 21:19:13.219323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] deallocate_for_instance() {{(pid=131044) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 02 21:19:13.288257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:13.304290 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5a7da095-762e-45a6-91f1-b2756b65a8aa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.637498 Jul 02 21:19:13.306477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2016/4037] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:12 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:13.319382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:13.322957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:13.342108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:13.347142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:13.348432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:13.349106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:13.808905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:13.847273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:13.863831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:13.874548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:13.877003 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a4f03641-89e2-4242-9920-cfc4938f5de7 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.567059 Jul 02 21:19:13.877842 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2017/4038] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:13 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:13.890735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-30b6048d-9009-4e5f-8214-6a968c601a60 req-aab48145-eb49-4043-aacb-70ffb28cb6bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca136582-61db-4de1-9a8b-d60b41641f6a", "tag": "b80cab7c-84ba-41cc-9654-b67793d7de64"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:13.901831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-30b6048d-9009-4e5f-8214-6a968c601a60 req-aab48145-eb49-4043-aacb-70ffb28cb6bd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:13.902762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-30b6048d-9009-4e5f-8214-6a968c601a60 req-aab48145-eb49-4043-aacb-70ffb28cb6bd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:13.938525 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-30b6048d-9009-4e5f-8214-6a968c601a60 req-aab48145-eb49-4043-aacb-70ffb28cb6bd service nova] Creating event network-changed:b80cab7c-84ba-41cc-9654-b67793d7de64 for instance ca136582-61db-4de1-9a8b-d60b41641f6a on nch1-master-1 Jul 02 21:19:13.946422 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-30b6048d-9009-4e5f-8214-6a968c601a60 req-aab48145-eb49-4043-aacb-70ffb28cb6bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066365 Jul 02 21:19:13.951800 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2018/4039] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:13.968480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:13.969226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:13.987768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:13.987768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:13.999123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:13.999779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:14.290598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Updating instance_info_cache with network_info: [] {{(pid=131044) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 02 21:19:14.466129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:14.478686 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fa175cb9-2993-45cf-b5cb-0230dc324fea tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.523586 Jul 02 21:19:14.491304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2019/4040] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:13 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:14.505383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:14.509319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:14.530134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:14.531980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:14.533764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:14.534454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:14.783925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:14.904539 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63844728-1887-4a82-84bb-7df4b05736ce tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 204 len: 0 microversion: 2.1 time: 3.121740 Jul 02 21:19:14.906658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2022/4041] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:11 2022] DELETE /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 0 bytes in 3142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:19:14.912579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:14.913538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:14.920763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:14.921570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:14.922636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:14.923289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.095903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:15.113496 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a683de7f-9065-4901-85b1-c5dab329e6a1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.620321 Jul 02 21:19:15.116093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2020/4042] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:14 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:15.123585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:15.132228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: a01794da-b81d-47ba-b8a4-05a57954ff14] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:15.143032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.143739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.145024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.145730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.169435 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] HTTP exception thrown: Instance a01794da-b81d-47ba-b8a4-05a57954ff14 could not be found. Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Request method failure captured: Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 HTTP/1.1 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLQ9gAFNCpDNoVjVjLKqvdOZRR6wL_Fze-ofTWXa4xg-poFl1LUrUiPGK8EZI5QEbnV3-HO2VR02AmHsvDPofHvuv75CF9_KWm6wWOAgv6sn821PxM5ENxp57ZN_-xvUjJ6Q-58w21j6k9Vc3T8k0EIoGy_2oW_cnysErpJCniIM7CQ Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_756410b2ad7345779f62a9db9835456f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/756410b2ad7345779f62a9db9835456f"}]}] Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 419f3872408c4d8c9a2980d6397d0aea Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance a01794da-b81d-47ba-b8a4-05a57954ff14 could not be found. Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a01794da-b81d-47ba-b8a4-05a57954ff14'} Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a01794da-b81d-47ba-b8a4-05a57954ff14 could not be found. Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a01794da-b81d-47ba-b8a4-05a57954ff14 could not be found. Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:15.171472 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a01794da-b81d-47ba-b8a4-05a57954ff14 could not be found. Jul 02 21:19:15.176321 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:15.177661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Returning 404 to user: Instance a01794da-b81d-47ba-b8a4-05a57954ff14 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:15.178801 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6b2d00b3-db32-478a-92cd-c22a35549245 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14" status: 404 len: 111 microversion: 2.1 time: 0.061326 Jul 02 21:19:15.179667 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2021/4043] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:15 2022] GET /compute/v2.1/servers/a01794da-b81d-47ba-b8a4-05a57954ff14 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:15.189574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:15.190554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:15.200952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.202162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.203786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.204652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.250678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:15.372155 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-77d39543-ea90-43e0-9aa8-015221c2521d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 204 len: 0 microversion: 2.1 time: 0.184689 Jul 02 21:19:15.376556 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2022/4044] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:15 2022] DELETE /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:19:15.384344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:15.385447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:15.396424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.397417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.400173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.401465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.567430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:15.585105 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-25526728-dce4-4f5b-8a4c-8d5ee96f0012 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1465 microversion: 2.1 time: 0.205858 Jul 02 21:19:15.587189 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2023/4045] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:15 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1465 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:15.593795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:15.594848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:15.610690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.611157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.614171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.614629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:15.826148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:15.866350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:15.869962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:15.879032 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9517a77-0dc6-4827-9920-89da67c854f6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.969991 Jul 02 21:19:15.890232 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2023/4046] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:14 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:15.969486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a965ed85-853a-44b3-a95b-75f01fefb5ee req-0d1d200c-3f05-4988-8b44-3b157aceb2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a01794da-b81d-47ba-b8a4-05a57954ff14", "name": "network-vif-deleted", "tag": "2d6ad206-3709-4149-8bf2-0de5883a6288"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:15.982365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a965ed85-853a-44b3-a95b-75f01fefb5ee req-0d1d200c-3f05-4988-8b44-3b157aceb2b7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:15.983558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a965ed85-853a-44b3-a95b-75f01fefb5ee req-0d1d200c-3f05-4988-8b44-3b157aceb2b7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:16.000491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.compute.server_external_events [req-a965ed85-853a-44b3-a95b-75f01fefb5ee req-0d1d200c-3f05-4988-8b44-3b157aceb2b7 service nova] Unable to find a host for instance a01794da-b81d-47ba-b8a4-05a57954ff14. Dropping event network-vif-deleted {{(pid=131044) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 02 21:19:16.002338 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a965ed85-853a-44b3-a95b-75f01fefb5ee req-0d1d200c-3f05-4988-8b44-3b157aceb2b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.038639 Jul 02 21:19:16.004354 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2024/4047] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 02 21:19:16.004987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:16.024253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94e57ba7-b02a-43ac-a886-a37a438269ed tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.435384 Jul 02 21:19:16.025616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2024/4048] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:15 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:16.134442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:16.135419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:16.150511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:16.156898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:16.158464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:16.159111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:16.603519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:16.605269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:16.633222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:16.635225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:16.637702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:16.643628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:17.196941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:17.200268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:17.217951 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a1182769-6438-4282-90cc-a3c98c072f68 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1465 microversion: 2.1 time: 0.618754 Jul 02 21:19:17.219419 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2025/4049] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:16 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1465 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:17.225537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:17.226339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:17.233606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:17.236965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:17.237983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:17.238502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:17.377632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:17.391293 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8b46b5b-d722-40d7-8d09-47c34ff72154 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 1.261490 Jul 02 21:19:17.392888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2025/4050] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:16 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:17.411071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:17.412167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:17.425967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:17.426838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:17.429016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:17.429642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:17.687299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:17.696921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:17.706037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:17.707453 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32494611-bfae-4109-ac48-8787e8bfb8c6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.486746 Jul 02 21:19:17.708180 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2026/4051] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:17 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:17.846724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:17.865031 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89650ad9-de27-42e1-b398-42173bb8434b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.470402 Jul 02 21:19:17.865383 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2026/4052] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:17 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:18.235361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:18.235984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:18.254456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.256020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:18.257066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.257844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:18.378066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c6ae2c37-f9db-4dd5-8971-4ea7d41d8d5a req-5e4b9a99-86e3-4d86-b2f3-5596147e247a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8693d34f-7523-432a-9444-a92c0db2379b", "name": "network-vif-deleted", "tag": "466b4eac-080d-45ee-8ca9-1f03a25acf5f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:18.393752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c6ae2c37-f9db-4dd5-8971-4ea7d41d8d5a req-5e4b9a99-86e3-4d86-b2f3-5596147e247a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.397203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c6ae2c37-f9db-4dd5-8971-4ea7d41d8d5a req-5e4b9a99-86e3-4d86-b2f3-5596147e247a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:18.411082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:18.426891 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ebb83eb5-611f-4693-8705-c397bb3f1a52 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 200 len: 1465 microversion: 2.1 time: 0.192369 Jul 02 21:19:18.431922 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2027/4053] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:18 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 1465 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:18.444207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:18.444758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:18.447952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c6ae2c37-f9db-4dd5-8971-4ea7d41d8d5a req-5e4b9a99-86e3-4d86-b2f3-5596147e247a service nova] Creating event network-vif-deleted:466b4eac-080d-45ee-8ca9-1f03a25acf5f for instance 8693d34f-7523-432a-9444-a92c0db2379b on nch2-master-1 Jul 02 21:19:18.455207 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c6ae2c37-f9db-4dd5-8971-4ea7d41d8d5a req-5e4b9a99-86e3-4d86-b2f3-5596147e247a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082220 Jul 02 21:19:18.461595 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2027/4054] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:18.461761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.462402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:18.463231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.463678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:18.728080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:18.728876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:18.751066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.752759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:18.755726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:18.759731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.208978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:19.224626 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f422889-749c-4112-b3cc-047e15b2dd31 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.791405 Jul 02 21:19:19.225214 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2028/4055] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:18 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:19.241218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:19.247713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:19.254828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.255507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.256503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.257094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.276673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:19.286564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:19.294623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:19.296119 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c78a4893-8faf-4197-b019-7a50d53287aa tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.573399 Jul 02 21:19:19.297169 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2028/4056] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:18 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:19:19.444382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:19.447413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 8693d34f-7523-432a-9444-a92c0db2379b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:19.462909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.466022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.466777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.467223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.505083 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] HTTP exception thrown: Instance 8693d34f-7523-432a-9444-a92c0db2379b could not be found. Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Request method failure captured: Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b HTTP/1.1 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQ9gAFNCpDNoVjVjLKqvdOZRR6wL_Fze-ofTWXa4xg-poFl1LUrUiPGK8EZI5QEbnV3-HO2VR02AmHsvDPofHvuv75CF9_KWm6wWOAgv6sn821PxM5ENxp57ZN_-xvUjJ6Q-58w21j6k9Vc3T8k0EIoGy_2oW_cnysErpJCniIM7CQ Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_756410b2ad7345779f62a9db9835456f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/756410b2ad7345779f62a9db9835456f"}]}] Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 419f3872408c4d8c9a2980d6397d0aea Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8693d34f-7523-432a-9444-a92c0db2379b could not be found. Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8693d34f-7523-432a-9444-a92c0db2379b'} Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8693d34f-7523-432a-9444-a92c0db2379b could not be found. Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8693d34f-7523-432a-9444-a92c0db2379b could not be found. Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:19.510289 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8693d34f-7523-432a-9444-a92c0db2379b could not be found. Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Returning 404 to user: Instance 8693d34f-7523-432a-9444-a92c0db2379b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:19.514728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-582df4c2-1cd1-4873-8746-8ddf887706a6 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b" status: 404 len: 111 microversion: 2.1 time: 0.072573 Jul 02 21:19:19.515887 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2029/4057] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:19 2022] GET /compute/v2.1/servers/8693d34f-7523-432a-9444-a92c0db2379b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:19:19.527125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:19.527652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:19.544172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.544521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.545325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.545767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.624598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:19.809062 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7a1a4bf-f98a-48af-9842-24163ec1d7b9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 204 len: 0 microversion: 2.1 time: 0.288568 Jul 02 21:19:19.814155 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2030/4058] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:19 2022] DELETE /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:19:19.823838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:19.825693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:19.834945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.835842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.837281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:19.846145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:19.914570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:19.925685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-532cf61a-6b06-4bf8-b483-d8ad16067075 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.689092 Jul 02 21:19:19.926285 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2029/4059] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:19 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:20.162716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:20.179561 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adcbc0fb-22eb-4f04-a381-400757a2d588 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1508 microversion: 2.1 time: 0.362790 Jul 02 21:19:20.195077 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2031/4060] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:19 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1508 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:20.242975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:20.243784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:20.255378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:20.255986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:20.258376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:20.259837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:20.317005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:20.318018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:20.338827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:20.346122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:20.347071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:20.357869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:20.781388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:20.808212 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c03fb4f9-965e-4fac-95f8-bf30611109b7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.561074 Jul 02 21:19:20.819464 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2030/4061] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:20 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:20.828726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:20.843279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:20.853166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:20.854600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2eaba1e9-ba86-47f8-8f0f-318027de07c2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.542571 Jul 02 21:19:20.858358 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2032/4062] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:20 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:20.946799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:20.947829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:20.989243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:20.996994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:20.998169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:20.998784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:21.038310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a5ab2317-2b73-4cd1-b02d-e3d3ac649c23 req-f468e20a-7d41-4a70-94c8-282270ddd348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e7d3e8-1524-46a1-9d29-c70323e380bf", "name": "network-vif-plugged", "status": "completed", "tag": "0a474375-7cff-43c6-a3fe-2d343b013116"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:21.053539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5ab2317-2b73-4cd1-b02d-e3d3ac649c23 req-f468e20a-7d41-4a70-94c8-282270ddd348 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:21.057564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a5ab2317-2b73-4cd1-b02d-e3d3ac649c23 req-f468e20a-7d41-4a70-94c8-282270ddd348 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:21.102662 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a5ab2317-2b73-4cd1-b02d-e3d3ac649c23 req-f468e20a-7d41-4a70-94c8-282270ddd348 service nova] Creating event network-vif-plugged:0a474375-7cff-43c6-a3fe-2d343b013116 for instance 30e7d3e8-1524-46a1-9d29-c70323e380bf on nch2-master-1 Jul 02 21:19:21.110011 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a5ab2317-2b73-4cd1-b02d-e3d3ac649c23 req-f468e20a-7d41-4a70-94c8-282270ddd348 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077286 Jul 02 21:19:21.111797 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2033/4063] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:21.213265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:21.214762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:21.223638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:21.224643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:21.226018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:21.226951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:21.472390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:21.486655 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8dbcc2cb-25ac-4c1d-8d8d-c7db7f2fe611 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.544929 Jul 02 21:19:21.491001 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2031/4064] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:20 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:21.579435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:21.590992 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17e36275-82ee-46fa-9906-501c2f6b6b3f tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 200 len: 1508 microversion: 2.1 time: 0.396833 Jul 02 21:19:21.600974 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2034/4065] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:21 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 1508 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:21.827445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:21.829275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:21.843661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:21.844536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:21.848536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:21.849287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:22.162328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb4db3b9-cf25-49d0-b615-ae2f59b5b727 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Action: 'create', calling method: .version_select at 0x7fabe462e1f0>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:22.480116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:22.495755 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8afa89f1-61a9-49eb-8d95-eeffe70edbd8 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1309 microversion: 2.1 time: 0.672435 Jul 02 21:19:22.497302 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2035/4066] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:21 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1309 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:22.503059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:22.503676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:22.511660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:22.513048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:22.514119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:22.515499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:22.985088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:22.997586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:23.012490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:23.023693 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-708869e5-83e5-41d8-81a4-a29743718899 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.524832 Jul 02 21:19:23.035553 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2036/4067] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:22 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:23.041305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:23.042208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:23.050371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:23.051147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:23.052285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:23.053064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:23.923426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:23.936031 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea115871-a452-4a0c-a8bc-70b6e208798f tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.898607 Jul 02 21:19:23.957333 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2037/4068] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:23 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:23.970524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:23.971230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: b0dc4641-20a8-4679-82a3-c8f9ddcc801d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:23.980617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:23.981509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:23.982719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:23.983287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:23.988427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:24.004305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] HTTP exception thrown: Instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d could not be found. Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Request method failure captured: Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d HTTP/1.1 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQ9gAFNCpDNoVjVjLKqvdOZRR6wL_Fze-ofTWXa4xg-poFl1LUrUiPGK8EZI5QEbnV3-HO2VR02AmHsvDPofHvuv75CF9_KWm6wWOAgv6sn821PxM5ENxp57ZN_-xvUjJ6Q-58w21j6k9Vc3T8k0EIoGy_2oW_cnysErpJCniIM7CQ Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_756410b2ad7345779f62a9db9835456f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/756410b2ad7345779f62a9db9835456f"}]}] Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 419f3872408c4d8c9a2980d6397d0aea Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d could not be found. Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b0dc4641-20a8-4679-82a3-c8f9ddcc801d'} Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d could not be found. Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d could not be found. Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:24.006359 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d could not be found. Jul 02 21:19:24.011337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:24.013977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Returning 404 to user: Instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:24.015035 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-623b9035-bc55-4d22-a133-6ae06ce3d664 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d" status: 404 len: 111 microversion: 2.1 time: 0.056385 Jul 02 21:19:24.016111 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2038/4069] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:23 2022] GET /compute/v2.1/servers/b0dc4641-20a8-4679-82a3-c8f9ddcc801d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:24.024718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b1d55fc3-647f-4a84-b479-8102bf382607 req-aab981b0-9521-49f1-a74b-75d801f00eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0dc4641-20a8-4679-82a3-c8f9ddcc801d", "name": "network-vif-deleted", "tag": "87c6cf33-62a5-4113-aeb4-491f187a244d"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:24.034500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b1d55fc3-647f-4a84-b479-8102bf382607 req-aab981b0-9521-49f1-a74b-75d801f00eca service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.035167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b1d55fc3-647f-4a84-b479-8102bf382607 req-aab981b0-9521-49f1-a74b-75d801f00eca service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.053852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b1d55fc3-647f-4a84-b479-8102bf382607 req-aab981b0-9521-49f1-a74b-75d801f00eca service nova] Creating event network-vif-deleted:87c6cf33-62a5-4113-aeb4-491f187a244d for instance b0dc4641-20a8-4679-82a3-c8f9ddcc801d on nch1-master-1 Jul 02 21:19:24.059772 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b1d55fc3-647f-4a84-b479-8102bf382607 req-aab981b0-9521-49f1-a74b-75d801f00eca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042023 Jul 02 21:19:24.061803 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2039/4070] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:24.074854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9c34d7a4-18bc-4c9e-aba5-5c9bdc628524 req-d84b3bbe-134a-4a71-9828-61db86f6720e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca136582-61db-4de1-9a8b-d60b41641f6a", "name": "network-vif-plugged", "status": "completed", "tag": "b80cab7c-84ba-41cc-9654-b67793d7de64"}, {"server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "name": "network-vif-plugged", "status": "completed", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:24.087802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9c34d7a4-18bc-4c9e-aba5-5c9bdc628524 req-d84b3bbe-134a-4a71-9828-61db86f6720e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.088695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9c34d7a4-18bc-4c9e-aba5-5c9bdc628524 req-d84b3bbe-134a-4a71-9828-61db86f6720e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.107228 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9c34d7a4-18bc-4c9e-aba5-5c9bdc628524 req-d84b3bbe-134a-4a71-9828-61db86f6720e service nova] Creating event network-vif-plugged:b80cab7c-84ba-41cc-9654-b67793d7de64 for instance ca136582-61db-4de1-9a8b-d60b41641f6a on nch1-master-1 Jul 02 21:19:24.108104 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9c34d7a4-18bc-4c9e-aba5-5c9bdc628524 req-d84b3bbe-134a-4a71-9828-61db86f6720e service nova] Creating event network-vif-plugged:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:19:24.119088 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9c34d7a4-18bc-4c9e-aba5-5c9bdc628524 req-d84b3bbe-134a-4a71-9828-61db86f6720e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055513 Jul 02 21:19:24.119864 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2040/4071] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:24.127269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:24.128409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:24.141652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.142478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.143519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.144764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.667729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:24.684672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05a1d029-83f2-4496-9285-1599fa902af7 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1489 microversion: 2.1 time: 0.560292 Jul 02 21:19:24.701346 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2041/4072] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:24 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1489 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:24.718245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:24.720571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:24.732944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.734114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.735722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.736465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.800312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:24.944759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:24.975150 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-858e0847-ab15-4c45-8ca1-0ec3bd7ff202 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 204 len: 0 microversion: 2.1 time: 0.265261 Jul 02 21:19:24.980949 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2042/4073] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:24 2022] DELETE /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:19:24.987777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:24.988659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:24.995809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.996541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:24.997632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:24.998221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:25.277090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:25.296356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:25.297984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:25.301567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1413e532-69c7-43dc-8423-162367f2eda2 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1730 microversion: 2.20 time: 0.319147 Jul 02 21:19:25.303313 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2043/4074] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:24 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:25.309693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:25.311244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:25.328961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:25.330203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:25.331918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:25.333135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:25.808252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:25.840720 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d7f398c-dc52-4222-b3d9-f6646d9fa858 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1319 microversion: 2.1 time: 0.535307 Jul 02 21:19:25.853843 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2044/4075] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:25 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:25.874112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1416387884", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:25.988027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:19:26.196139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb4db3b9-cf25-49d0-b615-ae2f59b5b727 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.571406 Jul 02 21:19:26.196764 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2032/4076] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:19:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:26.202800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:26.204265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:26.210056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:26.222497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:26.223074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:26.223946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:26.226659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:26.828729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:26.839747 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d0112ae3-e610-4c36-b6e7-cc3b7875a8e0 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 200 len: 1496 microversion: 2.1 time: 0.641657 Jul 02 21:19:26.854631 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2033/4077] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:26 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 1496 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:26.885898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-569273b6-2ab2-461f-9f70-1521e152f733 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Action: 'create', calling method: .version_select at 0x7fabe4a47ca0>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:27.709682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:19:27.710226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:19:27.710586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:19:27.711067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:19:27.711482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:19:27.722569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:27.723329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:27.724497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:27.725488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:27.751730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:19:27.758132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:19:27.772607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:19:27.776482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:19:27.843934 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb7ae49b-aa79-4e9b-bada-adcf62db0760 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.987415 Jul 02 21:19:27.850454 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2045/4078] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:19:27.857163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:27.857786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:27.866216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:27.866665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:27.868346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:27.868346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:28.410138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:28.423956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:28.427488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:28.430815 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93438b6e-b55f-4831-981b-c58fca532fdc tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1717 microversion: 2.20 time: 0.578621 Jul 02 21:19:28.458624 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2046/4079] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:27 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1717 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:28.477390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:28.478857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:28.506554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:28.507296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:28.508544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:28.512957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.261596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:29.274717 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a653598-05ba-436d-9b1f-b06f887d65c7 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1508 microversion: 2.1 time: 0.814464 Jul 02 21:19:29.277919 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2047/4080] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:28 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1508 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:29.294705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:29.296381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:29.313521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.314071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.314956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.316171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.585807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:29.594613 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1cecbc24-43cc-4af0-95b2-1daff52b2b78 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1261 microversion: 2.1 time: 0.311192 Jul 02 21:19:29.598321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2048/4081] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:29 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1261 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:29.624286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:29.625107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: aabecf20-fdf3-4810-8009-53c57ae31700] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:29.641081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.641483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.649393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.650081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.688742 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] HTTP exception thrown: Instance aabecf20-fdf3-4810-8009-53c57ae31700 could not be found. Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Request method failure captured: Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 HTTP/1.1 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQ9gAFNCpDNoVjVjLKqvdOZRR6wL_Fze-ofTWXa4xg-poFl1LUrUiPGK8EZI5QEbnV3-HO2VR02AmHsvDPofHvuv75CF9_KWm6wWOAgv6sn821PxM5ENxp57ZN_-xvUjJ6Q-58w21j6k9Vc3T8k0EIoGy_2oW_cnysErpJCniIM7CQ Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_756410b2ad7345779f62a9db9835456f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/756410b2ad7345779f62a9db9835456f"}]}] Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 419f3872408c4d8c9a2980d6397d0aea Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance aabecf20-fdf3-4810-8009-53c57ae31700 could not be found. Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'aabecf20-fdf3-4810-8009-53c57ae31700'} Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aabecf20-fdf3-4810-8009-53c57ae31700 could not be found. Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aabecf20-fdf3-4810-8009-53c57ae31700 could not be found. Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:29.693625 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aabecf20-fdf3-4810-8009-53c57ae31700 could not be found. Jul 02 21:19:29.698072 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:29.701576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Returning 404 to user: Instance aabecf20-fdf3-4810-8009-53c57ae31700 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:29.702674 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b477e43-177e-4638-9ed1-d3270c3b992d tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700" status: 404 len: 111 microversion: 2.1 time: 0.103235 Jul 02 21:19:29.703412 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2049/4082] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:29 2022] GET /compute/v2.1/servers/aabecf20-fdf3-4810-8009-53c57ae31700 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:29.710905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6a81be4d-85ab-4ea9-970c-255d9b285fc6 req-35904e84-2dee-4178-8d9a-6fce9f1fa5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aabecf20-fdf3-4810-8009-53c57ae31700", "name": "network-vif-deleted", "tag": "85eb89b4-63d1-4a1c-a06e-1e9e6834a3bd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:29.743252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6a81be4d-85ab-4ea9-970c-255d9b285fc6 req-35904e84-2dee-4178-8d9a-6fce9f1fa5d3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.743710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6a81be4d-85ab-4ea9-970c-255d9b285fc6 req-35904e84-2dee-4178-8d9a-6fce9f1fa5d3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.760392 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6a81be4d-85ab-4ea9-970c-255d9b285fc6 req-35904e84-2dee-4178-8d9a-6fce9f1fa5d3 service nova] Creating event network-vif-deleted:85eb89b4-63d1-4a1c-a06e-1e9e6834a3bd for instance aabecf20-fdf3-4810-8009-53c57ae31700 on nch1-master-1 Jul 02 21:19:29.767709 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6a81be4d-85ab-4ea9-970c-255d9b285fc6 req-35904e84-2dee-4178-8d9a-6fce9f1fa5d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060693 Jul 02 21:19:29.768912 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2050/4083] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:29.774873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "792de71d-1208-4d3b-90d3-efdd17ab60ab", "device": "/dev/sdb"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:29.776312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:29.783475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.789900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:29.791061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:29.791505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:30.437646 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3600f952-3e31-4017-a0ea-71677959bf91 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "POST /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667141 Jul 02 21:19:30.439450 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2051/4084] 10.222.0.43 () {60 vars in 1322 bytes} [Sat Jul 2 21:19:29 2022] POST /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:30.444985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:30.449187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:30.461077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:30.466813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:30.470623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:30.472133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:30.568091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:30.607142 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-569273b6-2ab2-461f-9f70-1521e152f733 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.739836 Jul 02 21:19:30.609489 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2034/4085] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:19:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:30.615757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:30.616403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:30.640655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:30.643170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:30.646336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:30.646808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:30.785797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:30.806976 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-01d82d67-3b6d-4557-82ab-8aa9a67ae3e3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1267 microversion: 2.1 time: 0.195721 Jul 02 21:19:30.815996 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2035/4086] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:30 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:30.830307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a4084bae-8df6-43e8-b4d6-52a9efa8b40f tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Action: 'create', calling method: .version_select at 0x7fabd747ea60>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:30.854431 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e567c3c-c9d1-43aa-b8bb-7f0213f69b19 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "DELETE /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 204 len: 0 microversion: 2.1 time: 0.412723 Jul 02 21:19:30.855295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2052/4087] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:30 2022] DELETE /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:19:30.864906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:30.865872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:30.873369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:30.874132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:30.875405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:30.876063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:31.737629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:31.753448 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-879a6637-f552-483e-b194-b4bfb54d47d4 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1677 microversion: 2.1 time: 0.887568 Jul 02 21:19:31.754113 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2053/4088] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:30 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1677 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:31.829315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:31.830215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:31.842024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:31.844810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:31.846248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:31.848888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:31.904868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:32.193097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:32.208376 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e9b0e74-ba4c-45c5-8a22-5c0a1b61351d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.383690 Jul 02 21:19:32.219890 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2054/4089] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:31 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:32.771051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:32.772569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:32.779340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:32.780070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:32.781123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:32.781756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:33.207476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:33.236469 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f88d4dc-7b38-43f4-84b9-97fd3456d1e9 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1677 microversion: 2.1 time: 0.469276 Jul 02 21:19:33.237089 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2055/4090] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:32 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1677 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:19:33.245060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:33.247091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:33.259105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:33.259791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:33.260803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:33.261520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:33.619984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:33.634320 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7e138a2c-27f2-464e-9b17-9339d1b45270 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.394017 Jul 02 21:19:33.636437 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2056/4091] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:33 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:33.656704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d51d42e5-8412-4c7f-832f-afc22472561e req-588a7a1f-2264-4881-b0bc-125a2f4002ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641", "tag": "3eff3d94-6f27-4315-af9f-c2df71b6f71e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:33.681824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d51d42e5-8412-4c7f-832f-afc22472561e req-588a7a1f-2264-4881-b0bc-125a2f4002ac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:33.682286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d51d42e5-8412-4c7f-832f-afc22472561e req-588a7a1f-2264-4881-b0bc-125a2f4002ac service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:33.712127 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d51d42e5-8412-4c7f-832f-afc22472561e req-588a7a1f-2264-4881-b0bc-125a2f4002ac service nova] Creating event network-changed:3eff3d94-6f27-4315-af9f-c2df71b6f71e for instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 on nch2-master-1 Jul 02 21:19:33.742522 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d51d42e5-8412-4c7f-832f-afc22472561e req-588a7a1f-2264-4881-b0bc-125a2f4002ac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089481 Jul 02 21:19:33.747005 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2057/4092] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:19:34.257578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:34.258211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:34.271999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:34.272490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:34.273364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:34.273803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:34.393437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '419f3872408c4d8c9a2980d6397d0aea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '756410b2ad7345779f62a9db9835456f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:34.404696 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96f2eaa5-6844-459f-9bc8-bdfe37fb97b5 tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 200 len: 1609 microversion: 2.1 time: 0.153402 Jul 02 21:19:34.415893 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2058/4093] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:34 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 1609 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:34.448768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-24e0cb27-9414-488d-bd45-45c6f9ff274c req-d53b6ec0-d315-4ba0-b9ab-4cb963bc1790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f5e581-653c-47dd-beca-62493c2367ba", "name": "network-vif-deleted", "tag": "9986b8c2-e928-46d2-85e4-ce45a5a4a1e5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:34.465678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-24e0cb27-9414-488d-bd45-45c6f9ff274c req-d53b6ec0-d315-4ba0-b9ab-4cb963bc1790 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:34.467255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-24e0cb27-9414-488d-bd45-45c6f9ff274c req-d53b6ec0-d315-4ba0-b9ab-4cb963bc1790 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:34.498409 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-24e0cb27-9414-488d-bd45-45c6f9ff274c req-d53b6ec0-d315-4ba0-b9ab-4cb963bc1790 service nova] Creating event network-vif-deleted:9986b8c2-e928-46d2-85e4-ce45a5a4a1e5 for instance 42f5e581-653c-47dd-beca-62493c2367ba on nch2-master-1 Jul 02 21:19:34.505943 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a4084bae-8df6-43e8-b4d6-52a9efa8b40f tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.688359 Jul 02 21:19:34.507229 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2036/4094] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:19:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:34.519923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b83deb61-5bce-4532-9f7c-499e4b0d541b tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Action: 'create', calling method: .version_select at 0x7fabe4770b80>, body: {"pool": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:34.522949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-24e0cb27-9414-488d-bd45-45c6f9ff274c req-d53b6ec0-d315-4ba0-b9ab-4cb963bc1790 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084020 Jul 02 21:19:34.524584 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2059/4095] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:34.658254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:34.662316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:34.672910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:34.674278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:34.675726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:34.676792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:35.014139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:35.025815 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49314dc9-d27c-4aa9-8cc6-2c6982f46847 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.375367 Jul 02 21:19:35.032267 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2060/4096] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:34 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:19:35.424292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:35.425014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] [instance: 42f5e581-653c-47dd-beca-62493c2367ba] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:35.438650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:35.439533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:35.443923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:35.444866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:35.485651 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] HTTP exception thrown: Instance 42f5e581-653c-47dd-beca-62493c2367ba could not be found. Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Request method failure captured: Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba HTTP/1.1 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLQ9gAFNCpDNoVjVjLKqvdOZRR6wL_Fze-ofTWXa4xg-poFl1LUrUiPGK8EZI5QEbnV3-HO2VR02AmHsvDPofHvuv75CF9_KWm6wWOAgv6sn821PxM5ENxp57ZN_-xvUjJ6Q-58w21j6k9Vc3T8k0EIoGy_2oW_cnysErpJCniIM7CQ Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_756410b2ad7345779f62a9db9835456f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/756410b2ad7345779f62a9db9835456f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/756410b2ad7345779f62a9db9835456f"}]}] Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 756410b2ad7345779f62a9db9835456f Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-629868272 Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 419f3872408c4d8c9a2980d6397d0aea Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-629868272-project Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 42f5e581-653c-47dd-beca-62493c2367ba could not be found. Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '42f5e581-653c-47dd-beca-62493c2367ba'} Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f5e581-653c-47dd-beca-62493c2367ba could not be found. Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f5e581-653c-47dd-beca-62493c2367ba could not be found. Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:35.487747 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f5e581-653c-47dd-beca-62493c2367ba could not be found. Jul 02 21:19:35.491377 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:35.499665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Returning 404 to user: Instance 42f5e581-653c-47dd-beca-62493c2367ba could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:35.501002 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95e07808-532b-4e96-bdde-ecbb6ab1bc8e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba" status: 404 len: 111 microversion: 2.1 time: 0.082081 Jul 02 21:19:35.501799 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2061/4097] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:35 2022] GET /compute/v2.1/servers/42f5e581-653c-47dd-beca-62493c2367ba => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:19:35.511177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f572cecc-b4ec-4566-92fa-30c54205cc1e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] Calling method '.version_select at 0x7fabe468a940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:35.554672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f572cecc-b4ec-4566-92fa-30c54205cc1e tempest-ServerActionsTestJSON-629868272 tempest-ServerActionsTestJSON-629868272-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055412481" status: 202 len: 0 microversion: 2.1 time: 0.047735 Jul 02 21:19:35.555526 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2062/4098] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:19:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055412481 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:19:36.051237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:36.052011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:36.067983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:36.076724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:36.077932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:36.081463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:37.021657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:37.028442 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e779e058-c0a7-4b86-9b97-8c8bf4ac4527 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.982632 Jul 02 21:19:37.039279 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2063/4099] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:36 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:19:37.578064 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b83deb61-5bce-4532-9f7c-499e4b0d541b tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.062570 Jul 02 21:19:37.579077 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2037/4100] 10.222.0.43 () {60 vars in 1169 bytes} [Sat Jul 2 21:19:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:19:37.589473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c87e1a45-eb37-453d-ae4f-84124813a3cd tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabe48d1c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:37.739447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:37.766311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:38.047006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:38.049634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:38.063289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:38.064514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:38.068370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:38.069056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:38.575058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:38.582689 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c87e1a45-eb37-453d-ae4f-84124813a3cd tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/c6b9c71d-f99c-4f90-9ead-8c252de59a65" status: 200 len: 141 microversion: 2.1 time: 0.997139 Jul 02 21:19:38.583328 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2064/4101] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:19:37 2022] GET /compute/v2.1/os-floating-ips/c6b9c71d-f99c-4f90-9ead-8c252de59a65 => generated 141 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:38.585720 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b1a898fd-5b57-43b8-9eb5-752db328cfcc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.543408 Jul 02 21:19:38.593045 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2038/4102] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:38 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:38.602777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd61846e-7cd7-4928-b8f8-a2f06afe0fea tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabe456b820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:39.603571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:39.604845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:39.622181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:39.622883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:39.624109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:39.624733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:40.170049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:40.200597 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c836b6c1-5f98-43ba-a6a2-9abdf2180543 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.598360 Jul 02 21:19:40.210108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2039/4103] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:39 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:40.282792 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd61846e-7cd7-4928-b8f8-a2f06afe0fea tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/c6b9c71d-f99c-4f90-9ead-8c252de59a65" status: 202 len: 0 microversion: 2.1 time: 1.691894 Jul 02 21:19:40.283538 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2065/4104] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:19:38 2022] DELETE /compute/v2.1/os-floating-ips/c6b9c71d-f99c-4f90-9ead-8c252de59a65 => generated 0 bytes in 1693 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:19:40.294572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3053a3d5-38c2-4e43-b8dd-710c55f750b0 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabd74eae50>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:40.614798 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3053a3d5-38c2-4e43-b8dd-710c55f750b0 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.323979 Jul 02 21:19:40.615896 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2040/4105] 10.222.0.43 () {58 vars in 1163 bytes} [Sat Jul 2 21:19:40 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:19:40.627391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-207037ea-0e4e-4851-a00b-7143ec78731c tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabe468a9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:40.967188 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-207037ea-0e4e-4851-a00b-7143ec78731c tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.344733 Jul 02 21:19:40.967990 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2066/4106] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:19:40 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:40.987764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c9bc8d18-cc59-43ac-b995-e587aeafcbe6 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabea2bdc10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:41.219446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:41.220092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:41.227242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:41.227978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:41.228989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:41.229599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:41.973717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:41.983108 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c305fa7f-219e-439a-bae9-cb621f6fc2e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.768488 Jul 02 21:19:41.984291 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2067/4107] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:41 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:19:41.989389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d183cf4e-7789-4664-a0af-05e9e72683c7 req-3a1f62bd-ee7a-40dd-a4f4-e417d17bde42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641", "name": "network-vif-plugged", "status": "completed", "tag": "3eff3d94-6f27-4315-af9f-c2df71b6f71e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:41.997982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d183cf4e-7789-4664-a0af-05e9e72683c7 req-3a1f62bd-ee7a-40dd-a4f4-e417d17bde42 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:41.998727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d183cf4e-7789-4664-a0af-05e9e72683c7 req-3a1f62bd-ee7a-40dd-a4f4-e417d17bde42 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:42.010989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d183cf4e-7789-4664-a0af-05e9e72683c7 req-3a1f62bd-ee7a-40dd-a4f4-e417d17bde42 service nova] Creating event network-vif-plugged:3eff3d94-6f27-4315-af9f-c2df71b6f71e for instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 on nch2-master-1 Jul 02 21:19:42.017130 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d183cf4e-7789-4664-a0af-05e9e72683c7 req-3a1f62bd-ee7a-40dd-a4f4-e417d17bde42 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Jul 02 21:19:42.020228 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2068/4108] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:42.953810 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c9bc8d18-cc59-43ac-b995-e587aeafcbe6 tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/0488c6e5-e8b6-4572-ac39-c3552e469411" status: 202 len: 0 microversion: 2.1 time: 1.977063 Jul 02 21:19:42.955244 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2041/4109] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:19:40 2022] DELETE /compute/v2.1/os-floating-ips/0488c6e5-e8b6-4572-ac39-c3552e469411 => generated 0 bytes in 1979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:19:42.965633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5563b113-ce6d-41cf-8061-898f27b6198b tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabe468ee50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:43.002549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:43.003379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:43.018687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:43.019287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:43.020268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:43.020823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:43.484985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:43.493932 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c23f842f-92ac-4495-9527-4c681559a9d9 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1309 microversion: 2.1 time: 0.497297 Jul 02 21:19:43.504733 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2042/4110] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:42 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:19:44.521669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:44.522295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:44.534688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:44.535142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:44.535930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:44.536388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:45.278577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5563b113-ce6d-41cf-8061-898f27b6198b tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/a5bacb08-7c36-4a82-b137-654ae9ab07ed" status: 202 len: 0 microversion: 2.1 time: 2.318913 Jul 02 21:19:45.280600 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2069/4111] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:19:42 2022] DELETE /compute/v2.1/os-floating-ips/a5bacb08-7c36-4a82-b137-654ae9ab07ed => generated 0 bytes in 2322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:19:45.305790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:45.321654 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c78ba26f-3076-4943-8da8-29d0eb2bbb79 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1490 microversion: 2.1 time: 0.803684 Jul 02 21:19:45.322515 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2043/4112] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:44 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1490 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:45.338829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acc1477d-f54d-4131-a626-78471e286cac tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] Calling method '.version_select at 0x7fabe467aee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:45.643503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:45.644445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:45.654462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:45.655101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:45.656076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:45.656717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:45.688320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:45.838278 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6629302-d4e3-4190-a2a2-dcd00b0c4fe1 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 204 len: 0 microversion: 2.32 time: 0.554036 Jul 02 21:19:45.839292 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2070/4113] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:19:45 2022] DELETE /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:19:45.857376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:45.858192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:45.865370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:45.865824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:45.866691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:45.867142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:46.283681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:46.295018 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2136e4b-136b-44f2-8c42-1d95948eb8d5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1489 microversion: 2.1 time: 0.452457 Jul 02 21:19:46.296874 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2071/4114] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:45 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1489 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:46.310955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:46.312367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:46.323555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:46.324181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:46.325153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:46.325796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:46.844799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:46.854814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:46.859797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:46.865589 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc647e11-a37d-4685-b91a-378327a34582 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2956 microversion: 2.32 time: 0.566035 Jul 02 21:19:46.866411 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2072/4115] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:46 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2956 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:46.880340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:46.881248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:46.902047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:46.902754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:46.903700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:46.904439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.285713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:47.295484 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-507e0d23-5d23-475c-838d-af3f0a786d6f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1490 microversion: 2.1 time: 0.425304 Jul 02 21:19:47.298539 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2073/4116] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:46 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1490 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:47.317545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:47.318052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:47.335845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:47.336333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.337147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:47.337571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.378834 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acc1477d-f54d-4131-a626-78471e286cac tempest-FloatingIPDetailsTestJSON-272616378 tempest-FloatingIPDetailsTestJSON-272616378-project] 10.222.0.43 "DELETE /compute/v2.1/os-floating-ips/257be1f3-38dd-433c-b400-2e9656633bec" status: 202 len: 0 microversion: 2.1 time: 2.053073 Jul 02 21:19:47.379546 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2044/4117] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:19:45 2022] DELETE /compute/v2.1/os-floating-ips/257be1f3-38dd-433c-b400-2e9656633bec => generated 0 bytes in 2054 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:19:47.389441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:47.517733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d01b220-9e2f-49fe-953b-ca2d9033840f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 204 len: 0 microversion: 2.1 time: 0.203261 Jul 02 21:19:47.518800 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2074/4118] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:47 2022] DELETE /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:19:47.530306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:47.531817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:47.553070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:47.555801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.555801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:47.556622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.562758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=74 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:47.874987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:47.893344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:47.894243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:47.904788 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e5701f1-d5cf-4066-aa0d-ce6c3150c83c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1496 microversion: 2.1 time: 0.380182 Jul 02 21:19:47.906333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:47.906786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.907590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:47.908003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:47.911559 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2045/4119] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:47 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1496 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:47.911828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:48.300276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:48.314582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:48.316630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:48.318428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-806032ec-ee19-42d8-9f09-98a042bf770c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2956 microversion: 2.32 time: 0.432993 Jul 02 21:19:48.332607 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2075/4120] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:47 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2956 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:19:48.930155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:48.931799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:48.944601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:48.945155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:48.945962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:48.946445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:49.266153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:49.278723 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5f222a7-da4e-450e-bc48-ca28a5991011 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1496 microversion: 2.1 time: 0.352862 Jul 02 21:19:49.291018 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2046/4121] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:48 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1496 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:49.339191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:49.339809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:49.353539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:49.368075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:49.372496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:49.374606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:50.216374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:50.238381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:50.241407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:50.243547 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eaf381eb-6acf-4033-9b15-cd8ecd2e7c1e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2956 microversion: 2.32 time: 0.908507 Jul 02 21:19:50.256977 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2076/4122] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:49 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2956 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:50.297364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:50.299979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:50.316704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:50.317173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:50.317982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:50.318436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:50.597358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:50.607092 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-083330b1-d7fe-4f7a-88b8-42c07607e5e2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1496 microversion: 2.1 time: 0.313624 Jul 02 21:19:50.607715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2047/4123] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:50 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1496 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:51.268158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:51.268819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:51.274914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:51.284859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:51.287444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:51.288531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:51.292385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:51.623345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:51.632686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:51.653286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:51.654070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:51.655713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:51.673528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:51.676588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:51.676837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:51.678726 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a9abd84-1ad7-45e4-a6e8-d60ae8e38d37 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2956 microversion: 2.32 time: 0.417235 Jul 02 21:19:51.680599 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2077/4124] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:51 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2956 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:51.686691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-06833d44-ba9f-495f-ae5f-aa8640c17ffe req-77f2457d-0f2c-44cc-9fd5-79f19ccf2ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641", "name": "network-vif-deleted", "tag": "3eff3d94-6f27-4315-af9f-c2df71b6f71e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:51.692950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:51.697748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-06833d44-ba9f-495f-ae5f-aa8640c17ffe req-77f2457d-0f2c-44cc-9fd5-79f19ccf2ba8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:51.698534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-06833d44-ba9f-495f-ae5f-aa8640c17ffe req-77f2457d-0f2c-44cc-9fd5-79f19ccf2ba8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:51.722796 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-06833d44-ba9f-495f-ae5f-aa8640c17ffe req-77f2457d-0f2c-44cc-9fd5-79f19ccf2ba8 service nova] Creating event network-vif-deleted:3eff3d94-6f27-4315-af9f-c2df71b6f71e for instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 on nch2-master-1 Jul 02 21:19:51.734301 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-06833d44-ba9f-495f-ae5f-aa8640c17ffe req-77f2457d-0f2c-44cc-9fd5-79f19ccf2ba8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052199 Jul 02 21:19:51.737598 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2078/4125] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:51.866219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:51.881208 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8be97b0c-c966-423f-8b4d-3acd8419d46b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 200 len: 1294 microversion: 2.1 time: 0.260833 Jul 02 21:19:51.892749 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2048/4126] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:51 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 1294 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:52.700468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:52.701825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:52.713267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:52.722359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:52.723934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:52.724613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:52.898765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:52.899379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:52.907038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:52.907698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:52.908671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:52.909259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:52.926481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 HTTP/1.1 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641'} Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:52.928988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:52.933688 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:52.933688 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:52.933688 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:52.933688 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:52.933688 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:19:52.933688 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:19:52.934847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:52.935865 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-24459eed-f4ce-4fbf-a715-cba1dff0d22c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 404 len: 111 microversion: 2.1 time: 0.041127 Jul 02 21:19:52.937309 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2049/4127] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:52 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:52.945527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:52.946313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:52.954009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:52.954691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:52.955835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:52.956622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:53.004474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:19:53.166987 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a432c0d-24fb-4f1d-af14-246305ced785 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 204 len: 0 microversion: 2.1 time: 0.225184 Jul 02 21:19:53.167704 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2050/4128] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:19:52 2022] DELETE /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:19:53.187687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:53.188991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:53.197319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:53.198113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:53.199082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:53.200112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:53.354551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:53.377971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:53.386944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:53.393058 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90676abc-a19b-4276-a19e-aba19bc9a914 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2956 microversion: 2.32 time: 0.697511 Jul 02 21:19:53.395614 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2079/4129] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:52 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2956 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:53.976154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:53.984286 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6cdd224c-325a-4283-addb-4b54ef8e0a54 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1495 microversion: 2.1 time: 0.808527 Jul 02 21:19:53.989154 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2051/4130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:53 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1495 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:19:54.415253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:54.417128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:54.434576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:54.441408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:54.445546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:54.446578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:54.517460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-da146993-42c1-4db8-9b65-0abdf2e125ae req-6e045855-489c-4b33-8bbc-55a5f82cd100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-unplugged", "status": "completed", "tag": "912378a0-41d0-4582-b82a-6871699c6ef3"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:54.537195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-da146993-42c1-4db8-9b65-0abdf2e125ae req-6e045855-489c-4b33-8bbc-55a5f82cd100 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:54.540840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-da146993-42c1-4db8-9b65-0abdf2e125ae req-6e045855-489c-4b33-8bbc-55a5f82cd100 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:54.579659 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-da146993-42c1-4db8-9b65-0abdf2e125ae req-6e045855-489c-4b33-8bbc-55a5f82cd100 service nova] Creating event network-vif-unplugged:912378a0-41d0-4582-b82a-6871699c6ef3 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:19:54.594467 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-da146993-42c1-4db8-9b65-0abdf2e125ae req-6e045855-489c-4b33-8bbc-55a5f82cd100 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081443 Jul 02 21:19:54.595564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2052/4131] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:55.008022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:55.008907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:55.021862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:55.024349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:55.025324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:55.029080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:55.307680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:55.322091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:55.323983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:55.325763 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4cb2ea4c-7fee-4fc6-acc5-76dfa65304ec tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2935 microversion: 2.32 time: 0.915253 Jul 02 21:19:55.326579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2080/4132] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:54 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2935 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:55.433255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:55.441352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b359821a-762e-4a16-9977-f91182127815 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1495 microversion: 2.1 time: 0.439335 Jul 02 21:19:55.445003 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2053/4133] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:55 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1495 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:56.346084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:56.347475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:56.354995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:56.355828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:56.356704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:56.357353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:56.459395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:56.460930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:56.464371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:19:56.498924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:56.499998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:56.514860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:56.515714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:57.008984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:57.027667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:57.034141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:57.038640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7bded010-d113-454f-81b3-9df5ccbfd763 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2914 microversion: 2.32 time: 0.693471 Jul 02 21:19:57.040188 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2081/4134] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:56 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2914 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:57.053834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-88db7b79-01cb-4371-87d7-89bd1e9a9f5f req-46ffa54f-51e3-46c3-b6dd-98851b474b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-unplugged", "status": "completed", "tag": "a1ebac5d-ae30-4272-8209-39af7edd756f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:57.075664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88db7b79-01cb-4371-87d7-89bd1e9a9f5f req-46ffa54f-51e3-46c3-b6dd-98851b474b65 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:57.079259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88db7b79-01cb-4371-87d7-89bd1e9a9f5f req-46ffa54f-51e3-46c3-b6dd-98851b474b65 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:57.094033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:57.113814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-88db7b79-01cb-4371-87d7-89bd1e9a9f5f req-46ffa54f-51e3-46c3-b6dd-98851b474b65 service nova] Creating event network-vif-unplugged:a1ebac5d-ae30-4272-8209-39af7edd756f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:19:57.114695 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5678eeb-7fea-447b-9a0a-efa9470c3718 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1495 microversion: 2.1 time: 0.652833 Jul 02 21:19:57.116136 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2054/4135] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:56 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1495 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:57.133315 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-88db7b79-01cb-4371-87d7-89bd1e9a9f5f req-46ffa54f-51e3-46c3-b6dd-98851b474b65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084218 Jul 02 21:19:57.134892 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2082/4136] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:57.548948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bab61195-8837-4148-a317-28097e53e5a8 req-e4a6fc9c-f470-448a-87f6-43224ca700b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e7d3e8-1524-46a1-9d29-c70323e380bf", "name": "network-vif-deleted", "tag": "0a474375-7cff-43c6-a3fe-2d343b013116"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:57.595041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bab61195-8837-4148-a317-28097e53e5a8 req-e4a6fc9c-f470-448a-87f6-43224ca700b2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:57.596640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bab61195-8837-4148-a317-28097e53e5a8 req-e4a6fc9c-f470-448a-87f6-43224ca700b2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:57.658955 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bab61195-8837-4148-a317-28097e53e5a8 req-e4a6fc9c-f470-448a-87f6-43224ca700b2 service nova] Creating event network-vif-deleted:0a474375-7cff-43c6-a3fe-2d343b013116 for instance 30e7d3e8-1524-46a1-9d29-c70323e380bf on nch2-master-1 Jul 02 21:19:57.680135 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bab61195-8837-4148-a317-28097e53e5a8 req-e4a6fc9c-f470-448a-87f6-43224ca700b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137412 Jul 02 21:19:57.689964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2055/4137] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:58.067861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:58.068661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:58.088621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:58.089087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:58.092096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:58.092607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:58.137936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:58.139113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:58.159387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:58.170039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:58.172609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:58.173864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:58.263064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:58.272876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:58.273579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lazy-loading 'fault' on Instance uuid 30e7d3e8-1524-46a1-9d29-c70323e380bf {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:19:58.468197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:58.491303 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4211d381-7ecf-40c4-a579-1af84ac59a88 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 200 len: 1299 microversion: 2.1 time: 0.357680 Jul 02 21:19:58.492778 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2056/4138] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:58 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 1299 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:19:58.619768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:58.629875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:58.632121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:19:58.633556 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0396cde8-d354-4c0c-af26-2915c7ab9955 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2914 microversion: 2.32 time: 0.571279 Jul 02 21:19:58.634732 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2083/4139] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:58 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2914 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:19:59.227730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-unplugged", "status": "completed", "tag": "7392035b-5277-47d7-afbf-73666c9b1f2f"}, {"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-unplugged", "status": "completed", "tag": "fa77338d-8218-440b-9196-cfd58e7c0468"}, {"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-unplugged", "status": "completed", "tag": "bd1eb072-75bb-4a9c-98b2-5be5c1f7e968"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:59.251052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:59.252400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:59.270324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] Creating event network-vif-unplugged:7392035b-5277-47d7-afbf-73666c9b1f2f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:19:59.270870 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] Creating event network-vif-unplugged:fa77338d-8218-440b-9196-cfd58e7c0468 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:19:59.271419 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] Creating event network-vif-unplugged:bd1eb072-75bb-4a9c-98b2-5be5c1f7e968 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:19:59.277493 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b20cf030-94df-4e84-9cbc-55ab27a7aad4 req-5a2fdfa7-fb04-4ef1-ba54-a258472ba1bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.056168 Jul 02 21:19:59.278767 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2057/4140] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:19:59.513950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:59.514512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:59.534566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:59.535037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:59.542972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:59.543442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:59.611079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf HTTP/1.1 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '30e7d3e8-1524-46a1-9d29-c70323e380bf'} Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:59.612831 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:19:59.617739 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70a4bde2-bd93-4348-b988-a74581e23349 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 404 len: 111 microversion: 2.1 time: 0.109942 Jul 02 21:19:59.630289 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2084/4141] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:19:59 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:19:59.659034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:19:59.661530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:19:59.685139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:59.686710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:59.689091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:59.692840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:59.750240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-01b1d878-8ec2-4c68-8287-bd7f38e448ad req-da3fa310-041b-45c1-9882-6dd3c1f7f39f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-deleted", "tag": "7392035b-5277-47d7-afbf-73666c9b1f2f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:59.767650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01b1d878-8ec2-4c68-8287-bd7f38e448ad req-da3fa310-041b-45c1-9882-6dd3c1f7f39f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:19:59.768027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-01b1d878-8ec2-4c68-8287-bd7f38e448ad req-da3fa310-041b-45c1-9882-6dd3c1f7f39f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:19:59.805496 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-01b1d878-8ec2-4c68-8287-bd7f38e448ad req-da3fa310-041b-45c1-9882-6dd3c1f7f39f service nova] Creating event network-vif-deleted:7392035b-5277-47d7-afbf-73666c9b1f2f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:19:59.819063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-01b1d878-8ec2-4c68-8287-bd7f38e448ad req-da3fa310-041b-45c1-9882-6dd3c1f7f39f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073543 Jul 02 21:19:59.824235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2085/4142] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:19:59.835864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-120326213", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:19:59.939026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:20:00.194957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:00.211137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:00.212993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:00.215023 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5d94cec0-a286-4f23-8c4d-8cce36f88154 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2867 microversion: 2.32 time: 0.564546 Jul 02 21:20:00.216575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2058/4143] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:19:59 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2867 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:00.983475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:20:00.983931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:20:00.984938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:20:00.985370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:20:00.986074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:20:01.004389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:01.004851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:01.005679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:01.009143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:01.064324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:20:01.084373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:20:01.125529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:20:01.135143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:20:01.238993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:01.240307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:01.257920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2dabd9c-f573-4ca4-84ff-77eb8410e353 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432276 Jul 02 21:20:01.262746 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2086/4144] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:19:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:20:01.275789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1563e3eb-3506-4c2c-81ec-dda619707d2a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:01.276469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1563e3eb-3506-4c2c-81ec-dda619707d2a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:01.279864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:01.285704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:01.289190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:01.289402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:01.411716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1563e3eb-3506-4c2c-81ec-dda619707d2a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:01.419883 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1563e3eb-3506-4c2c-81ec-dda619707d2a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1208 microversion: 2.1 time: 0.150594 Jul 02 21:20:01.431359 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2087/4145] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:01 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1208 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:01.960022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:01.990095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:02.005014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:02.012986 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-439855ee-cb2c-46f6-bedc-f8f529377656 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2706 microversion: 2.32 time: 0.779202 Jul 02 21:20:02.018010 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2059/4146] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:01 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2706 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:02.259917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c558ec57-d352-4fd1-98eb-273609103a0c req-214a3f6d-c148-45ea-86d8-45250fd4ae69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-deleted", "tag": "fa77338d-8218-440b-9196-cfd58e7c0468"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:02.281212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c558ec57-d352-4fd1-98eb-273609103a0c req-214a3f6d-c148-45ea-86d8-45250fd4ae69 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.282721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c558ec57-d352-4fd1-98eb-273609103a0c req-214a3f6d-c148-45ea-86d8-45250fd4ae69 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.335999 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c558ec57-d352-4fd1-98eb-273609103a0c req-214a3f6d-c148-45ea-86d8-45250fd4ae69 service nova] Creating event network-vif-deleted:fa77338d-8218-440b-9196-cfd58e7c0468 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:20:02.354322 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c558ec57-d352-4fd1-98eb-273609103a0c req-214a3f6d-c148-45ea-86d8-45250fd4ae69 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095658 Jul 02 21:20:02.356527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2088/4147] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:02.398732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:02.399831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:02.419430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.420213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.423370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.424368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.449185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:02.450265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:02.475368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.497431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.498512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.501371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.534147 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acf079d0-3196-4cab-a142-3636d92d4237 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.140122 Jul 02 21:20:02.539276 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2060/4148] 10.222.0.43 () {60 vars in 1342 bytes} [Sat Jul 2 21:20:02 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:02.703116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:02.703820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:02.715694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.716508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.717523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:02.717982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:02.841171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:20:02.917376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:03.124201 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2353e1b4-5d94-481e-a987-8bbbe373fe6b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 204 len: 0 microversion: 2.20 time: 0.429257 Jul 02 21:20:03.132855 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2061/4149] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:20:02 2022] DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:20:03.164450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:03.170353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:03.209589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:03.210071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:03.220250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:03.221159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:03.863708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:03.873941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4293d063-839f-4196-8223-4bd5daffdb04 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1204 microversion: 2.1 time: 1.429514 Jul 02 21:20:03.887373 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2089/4150] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:02 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1204 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:03.892800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:03.893677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:03.904691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:03.905588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:03.906525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:03.907108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:04.176714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:04.198627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:04.202066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:04.207278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-42e45365-1159-4fa9-848d-500e1e439c9c tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2419 microversion: 2.32 time: 1.071585 Jul 02 21:20:04.219116 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2062/4151] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:03 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2419 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:04.427637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:04.436242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:04.440745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:04.443035 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ea32500-85d3-408d-ac80-80311f83d08c tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 0.554574 Jul 02 21:20:04.444943 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2090/4152] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:03 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:04.506722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d58a7968-8696-4d2c-ae5f-07c668a8a274 req-e82ba2f4-0e1d-415e-9e7f-c1e65f11f2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-deleted", "tag": "912378a0-41d0-4582-b82a-6871699c6ef3"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:04.530014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d58a7968-8696-4d2c-ae5f-07c668a8a274 req-e82ba2f4-0e1d-415e-9e7f-c1e65f11f2ab service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:04.530472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d58a7968-8696-4d2c-ae5f-07c668a8a274 req-e82ba2f4-0e1d-415e-9e7f-c1e65f11f2ab service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:04.576261 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d58a7968-8696-4d2c-ae5f-07c668a8a274 req-e82ba2f4-0e1d-415e-9e7f-c1e65f11f2ab service nova] Creating event network-vif-deleted:912378a0-41d0-4582-b82a-6871699c6ef3 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:20:04.605297 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d58a7968-8696-4d2c-ae5f-07c668a8a274 req-e82ba2f4-0e1d-415e-9e7f-c1e65f11f2ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102914 Jul 02 21:20:04.605804 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2063/4153] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:04.896249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:04.897098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:04.920911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:04.921384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:04.922210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:04.922985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:05.115096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:05.123886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b53f4b74-c197-4c94-9fe2-40e64349062a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1266 microversion: 2.1 time: 0.233837 Jul 02 21:20:05.130680 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2091/4154] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:04 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:05.229128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:05.229860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:05.243868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:05.245204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:05.249371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:05.250371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:05.465402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:05.465402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:05.491650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:05.493265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:05.498606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:05.499130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:05.810462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:05.825599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:05.828264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:05.830556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-89d5c27e-2c86-4725-9a46-7cd507a9eb2e tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2258 microversion: 2.32 time: 0.607078 Jul 02 21:20:05.831692 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2064/4155] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:05 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2258 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:06.149260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:06.149919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:06.179995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:06.180495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:06.181319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:06.189709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:06.272839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:06.290077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:06.293686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:06.296196 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fb0ceca8-b3e3-4d93-8037-cf6d6776a864 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1723 microversion: 2.20 time: 0.837085 Jul 02 21:20:06.313221 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2092/4156] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:05 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1723 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:20:06.357037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:06.365917 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-deddcc76-c110-4d39-815f-ad206f322301 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1266 microversion: 2.1 time: 0.221896 Jul 02 21:20:06.375146 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2065/4157] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:06 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:06.771378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1978613438", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "148d8878-5ad4-4039-be6a-5701d390e4ad"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:06.852681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:06.853418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:06.860628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] validate_networks() for [('148d8878-5ad4-4039-be6a-5701d390e4ad', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:20:06.876005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:06.877148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:06.878265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:06.880526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:07.322856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:07.357897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:07.362577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:07.366594 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-67d718be-f641-4503-a7f3-65603421899b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 2211 microversion: 2.32 time: 0.518667 Jul 02 21:20:07.374230 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2066/4158] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:06 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 2211 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:07.387866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e1992f94-0b3a-40dd-8043-57701a572328 req-9d9a4bc9-a839-44b1-831c-557f672fd2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-deleted", "tag": "bd1eb072-75bb-4a9c-98b2-5be5c1f7e968"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:07.417543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e1992f94-0b3a-40dd-8043-57701a572328 req-9d9a4bc9-a839-44b1-831c-557f672fd2d3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:07.419964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e1992f94-0b3a-40dd-8043-57701a572328 req-9d9a4bc9-a839-44b1-831c-557f672fd2d3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:07.433192 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e1992f94-0b3a-40dd-8043-57701a572328 req-9d9a4bc9-a839-44b1-831c-557f672fd2d3 service nova] Creating event network-vif-deleted:bd1eb072-75bb-4a9c-98b2-5be5c1f7e968 for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:20:07.439055 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e1992f94-0b3a-40dd-8043-57701a572328 req-9d9a4bc9-a839-44b1-831c-557f672fd2d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063307 Jul 02 21:20:07.440289 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2067/4159] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:07.455828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:07.456835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:07.466329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:07.467742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:07.468802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:07.469463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:07.602075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:07.612372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:07.630916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:07.633206 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0c09f60b-f97d-4279-bb27-fc6c212d51d4 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1656 microversion: 2.20 time: 0.191579 Jul 02 21:20:07.634377 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2068/4160] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:07 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1656 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:07.651010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:07.657804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:07.679059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:07.679830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:07.684628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:07.685311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:09.659732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:09.676556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f9e3755-9775-468d-a6d9-71efe949b31b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 2.032296 Jul 02 21:20:09.678124 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2069/4161] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:07 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:09.700844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:09.701839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:09.722196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:09.731968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:09.736177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:09.739102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:09.880159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:20:09.880789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:20:09.881284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:20:09.882939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:20:09.883579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:20:09.964927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:09.977576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:09.980440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:09.982280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:09.984445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:09.990919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:09.994256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:10.003909 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a022f5c6-6515-4ef9-b2ee-46de7c7f2c8b tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1986 microversion: 2.32 time: 0.316344 Jul 02 21:20:10.005378 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2070/4162] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:09 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1986 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:10.022623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:10.023601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:10.059585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:10.060272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:10.061719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:10.062343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:10.097603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Getting quotas for project 526d9ed0cb294ddcadf746f088e0fcbc. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:20:10.119115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Getting quotas for user 4e2f3260319f40858f1fec2d708d3c87 and project 526d9ed0cb294ddcadf746f088e0fcbc. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:20:10.186498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:20:10.188925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:20:10.385606 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-293ccea6-591b-4d9b-93e2-53eefa055e4b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.070492 Jul 02 21:20:10.393179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:10.400991 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2093/4163] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:20:10.412435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:10.414053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '984631f5a77a48c5a9619e33e608dd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f644f2d1c56c43cf851deb020af7161e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:10.415760 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f10fc391-64d7-4fd1-a386-8fbe7dc356c8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 200 len: 1656 microversion: 2.20 time: 0.409052 Jul 02 21:20:10.418255 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2071/4164] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:10 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 1656 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:20:10.420969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7c6fd74c-b9b6-44a8-8f64-dea9045fd923 req-3ee5be7c-f543-4628-b426-64e7cdcfe3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41d3b10c-40d5-490f-b9d0-27b2a1231b76", "name": "network-vif-deleted", "tag": "dbcc3774-aa15-48e8-828f-03c7a766ddf7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:10.423914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1265af28-bfff-44ad-8352-740df38f036f tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:10.424824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1265af28-bfff-44ad-8352-740df38f036f tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:10.452209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7c6fd74c-b9b6-44a8-8f64-dea9045fd923 req-3ee5be7c-f543-4628-b426-64e7cdcfe3b2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:10.453071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7c6fd74c-b9b6-44a8-8f64-dea9045fd923 req-3ee5be7c-f543-4628-b426-64e7cdcfe3b2 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:10.530250 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7c6fd74c-b9b6-44a8-8f64-dea9045fd923 req-3ee5be7c-f543-4628-b426-64e7cdcfe3b2 service nova] Creating event network-vif-deleted:dbcc3774-aa15-48e8-828f-03c7a766ddf7 for instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 on nch2-master-1 Jul 02 21:20:10.547091 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7c6fd74c-b9b6-44a8-8f64-dea9045fd923 req-3ee5be7c-f543-4628-b426-64e7cdcfe3b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137344 Jul 02 21:20:10.549439 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2094/4165] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:10.573037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e4524b0d-8a30-4fad-b98a-9dd9c595f87e req-60f8611b-5b2b-469b-afa6-9186d6c4aed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1a94448-09e0-4e16-aa9a-6279ca312478", "name": "network-vif-deleted", "tag": "a1ebac5d-ae30-4272-8209-39af7edd756f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:10.621730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4524b0d-8a30-4fad-b98a-9dd9c595f87e req-60f8611b-5b2b-469b-afa6-9186d6c4aed8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:10.624315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e4524b0d-8a30-4fad-b98a-9dd9c595f87e req-60f8611b-5b2b-469b-afa6-9186d6c4aed8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:10.669019 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e4524b0d-8a30-4fad-b98a-9dd9c595f87e req-60f8611b-5b2b-469b-afa6-9186d6c4aed8 service nova] Creating event network-vif-deleted:a1ebac5d-ae30-4272-8209-39af7edd756f for instance b1a94448-09e0-4e16-aa9a-6279ca312478 on nch2-master-1 Jul 02 21:20:10.686851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e4524b0d-8a30-4fad-b98a-9dd9c595f87e req-60f8611b-5b2b-469b-afa6-9186d6c4aed8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129984 Jul 02 21:20:10.693740 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2095/4166] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:10.719124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:10.721515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:10.755794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:10.756659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:10.762375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:10.764710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:10.887060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1265af28-bfff-44ad-8352-740df38f036f tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:10.923456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1265af28-bfff-44ad-8352-740df38f036f tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1217 microversion: 2.1 time: 0.485074 Jul 02 21:20:10.924650 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2072/4167] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:10 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1217 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:11.025207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:11.026283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:11.040387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:11.041283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:11.043298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:11.044020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:11.602565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:11.622308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:11.628263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0f5b2e7e4efe478abdc85fc51fa064de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7da173babe7403fa85f5aab929e3068', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:11.632381 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd0cc37a-2dd1-4a49-8720-3cecdd3af775 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 200 len: 1604 microversion: 2.32 time: 0.611118 Jul 02 21:20:11.635084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2073/4168] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:11 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 1604 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:20:11.646543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:11.649377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:11.668661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:11.669132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:11.671481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:11.674692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:11.720375 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] HTTP exception thrown: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Request method failure captured: Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 HTTP/1.1 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRxSC2T0Ci8MuwTucQDxvgTuvFI95SbYVYK4v6NjWN5o03ksen1itRFai2UNEd64aTa9y5vipLxW28NAyXeQ2Wi8MF76lsHPIpDqlJRoMVTt83OdtgJXlUHvMKN3FUBbL9KCxsjhoRAJ_q51NrZjKGzxYup0ICakqiyQZoi7gW7gKI Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f644f2d1c56c43cf851deb020af7161e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f644f2d1c56c43cf851deb020af7161e"}]}] Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 984631f5a77a48c5a9619e33e608dd59 Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '41d3b10c-40d5-490f-b9d0-27b2a1231b76'} Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:11.726910 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:11.731485 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:11.733441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Returning 404 to user: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:11.734477 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-edce5937-23e7-48e5-ba66-499aed146991 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 404 len: 111 microversion: 2.20 time: 0.098159 Jul 02 21:20:11.736588 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2074/4169] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:11 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:11.754962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-116fa9c8-68df-4237-95aa-5c3d1eae7386 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '.version_select at 0x7fabea31bd30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:11.817616 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-116fa9c8-68df-4237-95aa-5c3d1eae7386 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594701096" status: 204 len: 0 microversion: 2.20 time: 0.077233 Jul 02 21:20:11.818892 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2075/4170] 10.222.0.43 () {60 vars in 1258 bytes} [Sat Jul 2 21:20:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594701096 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:20:11.833215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:11.846288 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a6b2674b-1ce1-44ad-be6e-3610f44a8032 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 1.149652 Jul 02 21:20:11.848396 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2096/4171] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:10 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:11.948413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:11.952910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:11.969789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:11.970249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:11.977583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:11.978073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:12.173816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:12.199886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2058c574-7cae-4727-a97a-015b402a9b44 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1213 microversion: 2.1 time: 0.263126 Jul 02 21:20:12.212418 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2076/4172] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:11 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1213 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:12.661471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:12.665580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:12.678145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:12.680852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:12.681912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:12.684377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:12.712480 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] HTTP exception thrown: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Request method failure captured: Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 HTTP/1.1 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLUVQiMvpdurU8QlUiI25M4Jf_JaSxPXtTYpddqfHC3ekfr719JwwtyCe3xtcbiAy6JmFt_aEXd4ZZifVBEA24GRox1TcXNzSRc97tcyZGJtk1Opa3Y243Wh-AnyM_3mxDY2FuRaZCYBZ3kr7OKPyp2zWZRgW9T-C2knkjARnz3_1dY Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.32 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: b7da173babe7403fa85f5aab929e3068 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7da173babe7403fa85f5aab929e3068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b7da173babe7403fa85f5aab929e3068", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7da173babe7403fa85f5aab929e3068"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b7da173babe7403fa85f5aab929e3068"}]}] Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: b7da173babe7403fa85f5aab929e3068 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest-1312932753-project Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 0f5b2e7e4efe478abdc85fc51fa064de Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest-1312932753-project Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b1a94448-09e0-4e16-aa9a-6279ca312478'} Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:12.715443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:12.719340 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:12.723714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Returning 404 to user: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:12.725407 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e9df99c-ae50-4cc7-8e24-b232453a9aa3 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 404 len: 111 microversion: 2.32 time: 0.074964 Jul 02 21:20:12.727977 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2097/4173] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:12 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:12.738649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e38a1f4-7f1a-4094-b5a5-c6f99804f2b5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '.version_select at 0x7fabea31bdc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:12.783885 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e38a1f4-7f1a-4094-b5a5-c6f99804f2b5 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318357403" status: 204 len: 0 microversion: 2.32 time: 0.049553 Jul 02 21:20:12.785875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-388c8a49-da5e-44aa-af6f-c7688156cdb5 req-30e72afd-af27-4782-b3b9-a8c13bd47010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce5ff0b-22b8-42f6-b04a-ea5dabab16e6", "tag": "11836265-aa9e-4885-93cf-fac198441083"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:12.787642 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2077/4174] 10.222.0.43 () {60 vars in 1261 bytes} [Sat Jul 2 21:20:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318357403 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:20:12.806868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-388c8a49-da5e-44aa-af6f-c7688156cdb5 req-30e72afd-af27-4782-b3b9-a8c13bd47010 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:12.810307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-388c8a49-da5e-44aa-af6f-c7688156cdb5 req-30e72afd-af27-4782-b3b9-a8c13bd47010 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:12.846618 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-388c8a49-da5e-44aa-af6f-c7688156cdb5 req-30e72afd-af27-4782-b3b9-a8c13bd47010 service nova] Creating event network-changed:11836265-aa9e-4885-93cf-fac198441083 for instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 on nch2-master-1 Jul 02 21:20:12.857819 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-388c8a49-da5e-44aa-af6f-c7688156cdb5 req-30e72afd-af27-4782-b3b9-a8c13bd47010 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082861 Jul 02 21:20:12.866001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:12.867018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:12.874233 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2098/4175] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:12.883994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:12.889000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:12.890196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:12.890764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:13.221923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:13.222724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:13.230821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:13.231496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:13.232517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:13.233111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:13.444876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:13.452848 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b711beb-88c8-4b6b-ac5e-1a7c1187ca68 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1275 microversion: 2.1 time: 0.238292 Jul 02 21:20:13.460422 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2099/4176] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:13 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:13.515767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:13.533467 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-636b10d5-6193-4222-9368-7bb6f4fe4de4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 0.671445 Jul 02 21:20:13.534094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2078/4177] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:12 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:14.478445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:14.479251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:14.495299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:14.496028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:14.496928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:14.499520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:14.535013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:14.551811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:14.552724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:14.570338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:14.572378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:14.575414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:14.575781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:14.867509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:14.878658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f299aafd-4cfa-411b-bf81-e8748699441b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1275 microversion: 2.1 time: 0.405248 Jul 02 21:20:14.879875 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2100/4178] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:14 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:15.376281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:15.391573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e782a00-e807-4055-83d5-8d49399a8442 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 0.844246 Jul 02 21:20:15.393197 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2079/4179] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:14 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:15.895465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:15.896444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:15.907829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:15.914932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:15.916090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:15.916788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.365470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:16.382441 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-52f8a3ca-e801-406c-86d3-4a0096177562 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 0.490811 Jul 02 21:20:16.388792 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2101/4180] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:15 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:16.404865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:16.406294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:16.421792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:16.423292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:16.424950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:16.425628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.427921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:16.430198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.446447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:16.447591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.450741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:16.452174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.481411 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] HTTP exception thrown: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Request method failure captured: Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 HTTP/1.1 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRxSC2T0Ci8MuwTucQDxvgTuvFI95SbYVYK4v6NjWN5o03ksen1itRFai2UNEd64aTa9y5vipLxW28NAyXeQ2Wi8MF76lsHPIpDqlJRoMVTt83OdtgJXlUHvMKN3FUBbL9KCxsjhoRAJ_q51NrZjKGzxYup0ICakqiyQZoi7gW7gKI Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f644f2d1c56c43cf851deb020af7161e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f644f2d1c56c43cf851deb020af7161e"}]}] Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 984631f5a77a48c5a9619e33e608dd59 Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '41d3b10c-40d5-490f-b9d0-27b2a1231b76'} Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:16.484739 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.489329 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.491771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Returning 404 to user: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:16.498998 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-788d019d-c27a-48bd-b530-c6ae814c7ad6 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 404 len: 111 microversion: 2.20 time: 0.102042 Jul 02 21:20:16.501559 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2080/4181] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:20:16 2022] DELETE /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:16.513503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:16.514517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 41d3b10c-40d5-490f-b9d0-27b2a1231b76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:16.524697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:16.525291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.526209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:16.527570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:16.555267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] HTTP exception thrown: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Request method failure captured: Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 HTTP/1.1 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLRxSC2T0Ci8MuwTucQDxvgTuvFI95SbYVYK4v6NjWN5o03ksen1itRFai2UNEd64aTa9y5vipLxW28NAyXeQ2Wi8MF76lsHPIpDqlJRoMVTt83OdtgJXlUHvMKN3FUBbL9KCxsjhoRAJ_q51NrZjKGzxYup0ICakqiyQZoi7gW7gKI Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f644f2d1c56c43cf851deb020af7161e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f644f2d1c56c43cf851deb020af7161e"}]}] Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 984631f5a77a48c5a9619e33e608dd59 Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '41d3b10c-40d5-490f-b9d0-27b2a1231b76'} Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.557180 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:16.562265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Returning 404 to user: Instance 41d3b10c-40d5-490f-b9d0-27b2a1231b76 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:16.563283 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17c65a8f-e063-4b7f-a5df-cc3b4f3760b8 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76" status: 404 len: 111 microversion: 2.20 time: 0.056950 Jul 02 21:20:16.568391 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2081/4182] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:16 2022] GET /compute/v2.1/servers/41d3b10c-40d5-490f-b9d0-27b2a1231b76 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:17.192438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:17.203019 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63df9baa-d6df-4a7b-b7c8-9cad333d6499 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 0.791355 Jul 02 21:20:17.206238 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2102/4183] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:16 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:17.405991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:17.406692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:17.419969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.420502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.421303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.421839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.675232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:17.688650 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-73bd3e4d-9403-420d-8e24-3f71b1567541 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 0.287590 Jul 02 21:20:17.693635 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2082/4184] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:17 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:17.767400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:17.767907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:17.780528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.782074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.785495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.792186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.822746 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] HTTP exception thrown: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.825083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0d44676d-421e-44a9-a5d3-838c82b7492e req-7685d298-7eb3-43fc-a7f2-e89f192c4775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db69ffbe-2bdd-4146-ab18-1bd266baafbe", "tag": "a4f0aa38-6f9b-4c78-920c-d25e8d16926a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Request method failure captured: Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae HTTP/1.1 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRxSC2T0Ci8MuwTucQDxvgTuvFI95SbYVYK4v6NjWN5o03ksen1itRFai2UNEd64aTa9y5vipLxW28NAyXeQ2Wi8MF76lsHPIpDqlJRoMVTt83OdtgJXlUHvMKN3FUBbL9KCxsjhoRAJ_q51NrZjKGzxYup0ICakqiyQZoi7gW7gKI Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f644f2d1c56c43cf851deb020af7161e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f644f2d1c56c43cf851deb020af7161e"}]}] Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 984631f5a77a48c5a9619e33e608dd59 Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '52054dc2-a0ff-49cd-88cc-e822331aabae'} Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:17.828283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Returning 404 to user: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1dfab734-e33e-4214-b091-efb14aac0ad0 tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 404 len: 111 microversion: 2.20 time: 0.066764 Jul 02 21:20:17.833857 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2103/4185] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:20:17 2022] DELETE /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:17.838957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0d44676d-421e-44a9-a5d3-838c82b7492e req-7685d298-7eb3-43fc-a7f2-e89f192c4775 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.839308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0d44676d-421e-44a9-a5d3-838c82b7492e req-7685d298-7eb3-43fc-a7f2-e89f192c4775 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.855967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:17.867066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] [instance: 52054dc2-a0ff-49cd-88cc-e822331aabae] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:17.876909 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0d44676d-421e-44a9-a5d3-838c82b7492e req-7685d298-7eb3-43fc-a7f2-e89f192c4775 service nova] Creating event network-changed:a4f0aa38-6f9b-4c78-920c-d25e8d16926a for instance db69ffbe-2bdd-4146-ab18-1bd266baafbe on nch1-master-1 Jul 02 21:20:17.881906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.888663 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0d44676d-421e-44a9-a5d3-838c82b7492e req-7685d298-7eb3-43fc-a7f2-e89f192c4775 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067408 Jul 02 21:20:17.890335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.890827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2083/4186] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:17.891725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:17.892437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:17.921071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] HTTP exception thrown: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Request method failure captured: Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae HTTP/1.1 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLRxSC2T0Ci8MuwTucQDxvgTuvFI95SbYVYK4v6NjWN5o03ksen1itRFai2UNEd64aTa9y5vipLxW28NAyXeQ2Wi8MF76lsHPIpDqlJRoMVTt83OdtgJXlUHvMKN3FUBbL9KCxsjhoRAJ_q51NrZjKGzxYup0ICakqiyQZoi7gW7gKI Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.20 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f644f2d1c56c43cf851deb020af7161e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f644f2d1c56c43cf851deb020af7161e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f644f2d1c56c43cf851deb020af7161e"}]}] Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f644f2d1c56c43cf851deb020af7161e Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224937377 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 984631f5a77a48c5a9619e33e608dd59 Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224937377-project Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '52054dc2-a0ff-49cd-88cc-e822331aabae'} Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.924519 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] Returning 404 to user: Instance 52054dc2-a0ff-49cd-88cc-e822331aabae could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:17.928564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65559fbd-8fe4-4093-8a0a-792ecc49266b tempest-AttachVolumeShelveTestJSON-1224937377 tempest-AttachVolumeShelveTestJSON-1224937377-project] 10.222.0.43 "GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae" status: 404 len: 111 microversion: 2.20 time: 0.091232 Jul 02 21:20:17.933702 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2104/4187] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:17 2022] GET /compute/v2.1/servers/52054dc2-a0ff-49cd-88cc-e822331aabae => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:18.224536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:18.224819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:18.236112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:18.236823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:18.237839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:18.238471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:18.302174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:18.719258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:18.725101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:18.770179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:18.778651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:18.782947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:18.785039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:19.374220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:19.385214 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-359fb404-1d0e-4498-b941-7b3f45deec28 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 1.166814 Jul 02 21:20:19.386319 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2084/4188] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:18 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:19.570139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:19.606146 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e3ee71b-b8eb-4249-bb63-58737115cba4 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 0.899725 Jul 02 21:20:19.606783 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2105/4189] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:18 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:20.215614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f2f31b72-2d83-4961-9401-be85e2c57fae req-bf295d9c-5337-48b5-ad5e-15f735ea0cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce5ff0b-22b8-42f6-b04a-ea5dabab16e6", "name": "network-vif-plugged", "status": "completed", "tag": "11836265-aa9e-4885-93cf-fac198441083"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:20.234629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f2f31b72-2d83-4961-9401-be85e2c57fae req-bf295d9c-5337-48b5-ad5e-15f735ea0cd9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:20.235086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f2f31b72-2d83-4961-9401-be85e2c57fae req-bf295d9c-5337-48b5-ad5e-15f735ea0cd9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:20.293171 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f2f31b72-2d83-4961-9401-be85e2c57fae req-bf295d9c-5337-48b5-ad5e-15f735ea0cd9 service nova] Creating event network-vif-plugged:11836265-aa9e-4885-93cf-fac198441083 for instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 on nch2-master-1 Jul 02 21:20:20.303450 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f2f31b72-2d83-4961-9401-be85e2c57fae req-bf295d9c-5337-48b5-ad5e-15f735ea0cd9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091099 Jul 02 21:20:20.305593 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2085/4190] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:20.405167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:20.405804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:20.408802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:20.421638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:20.444018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:20.444511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:20.445377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:20.445832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:20.623743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:20.625375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:20.641415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:20.643397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:20.645493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:20.647084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:20.904312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:21.137585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:21.150295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86feff12-e976-4ee4-9c12-4bf5dc93a5d6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 0.528428 Jul 02 21:20:21.150536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:21.154015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2086/4191] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:20 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:21.167244 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb8013a3-8978-467e-98eb-e4c022b4abb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1308 microversion: 2.1 time: 0.767329 Jul 02 21:20:21.169945 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2106/4192] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:20 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1308 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:22.196991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:22.199555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:22.200205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:22.201355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:22.211091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:22.215170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:22.216510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:22.223911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:22.225528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:22.226778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:22.227247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:22.228761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:22.230077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:22.962851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:22.983356 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c526a20a-db2e-4769-b815-ee830df4c357 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1488 microversion: 2.1 time: 0.798054 Jul 02 21:20:23.006540 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2107/4193] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:22 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1488 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:23.218081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:23.228622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e1fc0ed-8bcc-4965-a540-070b543ec89b tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 1.058607 Jul 02 21:20:23.260100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49917dcb-b59c-4def-80b2-4f2e1cb5dc23 tempest-FloatingIPDetailsNegativeTestJSON-764482812 tempest-FloatingIPDetailsNegativeTestJSON-764482812-project] Calling method '.version_select at 0x7fabea2065e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:23.266996 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2087/4194] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:22 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:23.282292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:23.283511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:23.303541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.304003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.307778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.308262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.481887 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f6f0a42-702d-44d3-ba07-c5d013557458 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "PUT /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1083 microversion: 2.1 time: 0.209750 Jul 02 21:20:23.482787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2088/4195] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:20:23 2022] PUT /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1083 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:23.509281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:23.511277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:23.532846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.533300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.547595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.552158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.590274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG neutronclient.v2_0.client [None req-49917dcb-b59c-4def-80b2-4f2e1cb5dc23 tempest-FloatingIPDetailsNegativeTestJSON-764482812 tempest-FloatingIPDetailsNegativeTestJSON-764482812-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f8d534c3-9c8f-46e4-b075-3251136f4f1c could not be found", "detail": ""}} {{(pid=131044) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 02 21:20:23.591075 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-49917dcb-b59c-4def-80b2-4f2e1cb5dc23 tempest-FloatingIPDetailsNegativeTestJSON-764482812 tempest-FloatingIPDetailsNegativeTestJSON-764482812-project] HTTP exception thrown: Floating IP not found for ID f8d534c3-9c8f-46e4-b075-3251136f4f1c Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49917dcb-b59c-4def-80b2-4f2e1cb5dc23 tempest-FloatingIPDetailsNegativeTestJSON-764482812 tempest-FloatingIPDetailsNegativeTestJSON-764482812-project] Request method failure captured: Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-floating-ips/f8d534c3-9c8f-46e4-b075-3251136f4f1c HTTP/1.1 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLaWHoyuXv-VJoHV3D2NNWhcvKL7jWfDZz4hjGgRFQghKb3g0GWHTIhu2aAz1gmpQ-pl-LJatOjsZkfZ7T4oDwXix9XSXqsYTGHKCMAjxeFHro986p-RyJXyUx8o47WLZPWuj1wYrrchhBTzPXOY5Ivfd8aqpvlmIXxZsYu0W3ZCihk Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 2285f4b2708d4e6b9199bf99155b3636 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-764482812 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2285f4b2708d4e6b9199bf99155b3636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2285f4b2708d4e6b9199bf99155b3636", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2285f4b2708d4e6b9199bf99155b3636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2285f4b2708d4e6b9199bf99155b3636"}]}] Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-764482812 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 2285f4b2708d4e6b9199bf99155b3636 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-764482812 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-764482812-project Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 1ab5af7b863740afb627155828fa6a51 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-764482812-project Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: exception: Floating IP not found for ID f8d534c3-9c8f-46e4-b075-3251136f4f1c Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'f8d534c3-9c8f-46e4-b075-3251136f4f1c'} Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f8d534c3-9c8f-46e4-b075-3251136f4f1c could not be found Jul 02 21:20:23.594793 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-abadf1b1-aeb0-48f2-bf7c-18ca5089bb48'] Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f8d534c3-9c8f-46e4-b075-3251136f4f1c. Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f8d534c3-9c8f-46e4-b075-3251136f4f1c Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f8d534c3-9c8f-46e4-b075-3251136f4f1c Jul 02 21:20:23.599195 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.603801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-49917dcb-b59c-4def-80b2-4f2e1cb5dc23 tempest-FloatingIPDetailsNegativeTestJSON-764482812 tempest-FloatingIPDetailsNegativeTestJSON-764482812-project] Returning 404 to user: Floating IP not found for ID f8d534c3-9c8f-46e4-b075-3251136f4f1c {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:23.603989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-49917dcb-b59c-4def-80b2-4f2e1cb5dc23 tempest-FloatingIPDetailsNegativeTestJSON-764482812 tempest-FloatingIPDetailsNegativeTestJSON-764482812-project] 10.222.0.43 "GET /compute/v2.1/os-floating-ips/f8d534c3-9c8f-46e4-b075-3251136f4f1c" status: 404 len: 111 microversion: 2.1 time: 0.595798 Jul 02 21:20:23.610375 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2108/4196] 10.222.0.43 () {58 vars in 1259 bytes} [Sat Jul 2 21:20:23 2022] GET /compute/v2.1/os-floating-ips/f8d534c3-9c8f-46e4-b075-3251136f4f1c => generated 111 bytes in 603 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:20:23.900742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:23.901265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:23.916880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.918484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.921591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.922555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.959432 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] HTTP exception thrown: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Request method failure captured: Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 HTTP/1.1 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLUVQiMvpdurU8QlUiI25M4Jf_JaSxPXtTYpddqfHC3ekfr719JwwtyCe3xtcbiAy6JmFt_aEXd4ZZifVBEA24GRox1TcXNzSRc97tcyZGJtk1Opa3Y243Wh-AnyM_3mxDY2FuRaZCYBZ3kr7OKPyp2zWZRgW9T-C2knkjARnz3_1dY Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.32 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: b7da173babe7403fa85f5aab929e3068 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7da173babe7403fa85f5aab929e3068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b7da173babe7403fa85f5aab929e3068", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7da173babe7403fa85f5aab929e3068"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b7da173babe7403fa85f5aab929e3068"}]}] Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: b7da173babe7403fa85f5aab929e3068 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest-1312932753-project Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 0f5b2e7e4efe478abdc85fc51fa064de Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest-1312932753-project Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b1a94448-09e0-4e16-aa9a-6279ca312478'} Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:23.961112 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Returning 404 to user: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:23.965153 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32e80807-a194-4d63-b4d3-bce9b6e512a2 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 404 len: 111 microversion: 2.32 time: 0.068543 Jul 02 21:20:23.976474 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2109/4197] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:20:23 2022] DELETE /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 02 21:20:23.981618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:23.982247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] [instance: b1a94448-09e0-4e16-aa9a-6279ca312478] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:23.998654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:23.999113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:23.999926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:24.003069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:24.024071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] HTTP exception thrown: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Request method failure captured: Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 HTTP/1.1 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLUVQiMvpdurU8QlUiI25M4Jf_JaSxPXtTYpddqfHC3ekfr719JwwtyCe3xtcbiAy6JmFt_aEXd4ZZifVBEA24GRox1TcXNzSRc97tcyZGJtk1Opa3Y243Wh-AnyM_3mxDY2FuRaZCYBZ3kr7OKPyp2zWZRgW9T-C2knkjARnz3_1dY Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.32 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: b7da173babe7403fa85f5aab929e3068 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7da173babe7403fa85f5aab929e3068"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_b7da173babe7403fa85f5aab929e3068", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/b7da173babe7403fa85f5aab929e3068"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/b7da173babe7403fa85f5aab929e3068"}]}] Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: b7da173babe7403fa85f5aab929e3068 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1312932753 Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TaggedBootDevicesTest-1312932753-project Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 0f5b2e7e4efe478abdc85fc51fa064de Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TaggedBootDevicesTest-1312932753-project Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b1a94448-09e0-4e16-aa9a-6279ca312478'} Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:24.042078 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] Returning 404 to user: Instance b1a94448-09e0-4e16-aa9a-6279ca312478 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ae79652-5666-4244-82b0-ff8312c265c7 tempest-TaggedBootDevicesTest-1312932753 tempest-TaggedBootDevicesTest-1312932753-project] 10.222.0.43 "GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478" status: 404 len: 111 microversion: 2.32 time: 0.065947 Jul 02 21:20:24.046382 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2110/4198] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:20:23 2022] GET /compute/v2.1/servers/b1a94448-09e0-4e16-aa9a-6279ca312478 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:20:24.282982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:24.283606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:24.291335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:24.291795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:24.292615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:24.293691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:25.045877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:25.060309 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44682351-dc3c-4af0-93b7-50b3420cd168 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1509 microversion: 2.1 time: 1.563483 Jul 02 21:20:25.063248 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2089/4199] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:23 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1509 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:25.079074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:25.081033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:25.108475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:25.111754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:25.114620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:25.118855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:25.797939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:25.810843 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-667f45f7-6476-4abf-b78b-4cb4b08000d3 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 1.531647 Jul 02 21:20:25.811943 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2111/4200] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:24 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:26.190535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:26.204468 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45b50d6e-2c1f-4a30-8e2c-0a01b8915441 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1509 microversion: 2.1 time: 1.129527 Jul 02 21:20:26.211875 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2090/4201] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:25 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1509 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:26.227779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:26.228393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:26.240245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:26.240763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:26.241585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:26.245691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:26.288579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:20:26.435483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-097f3594-8e6f-4830-b45d-fd051f39c96c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 204 len: 0 microversion: 2.1 time: 0.210318 Jul 02 21:20:26.441746 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2112/4202] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:20:26 2022] DELETE /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:20:26.445296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:26.445932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:26.453633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:26.454089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:26.461671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:26.462762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:26.829404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:26.830294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:26.843270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:26.843806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:26.845344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:26.847902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:26.899971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:26.912212 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e0437c48-0930-4057-a101-5d888bf571fa tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1515 microversion: 2.1 time: 0.470731 Jul 02 21:20:26.928379 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2091/4203] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:26 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:27.177789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c346c31b-01ab-4bb3-8113-e88d85f73b34 req-ff222900-03bb-4bc7-845b-7737ea758fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db69ffbe-2bdd-4146-ab18-1bd266baafbe", "name": "network-vif-plugged", "status": "completed", "tag": "a4f0aa38-6f9b-4c78-920c-d25e8d16926a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:27.202654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:27.206261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c346c31b-01ab-4bb3-8113-e88d85f73b34 req-ff222900-03bb-4bc7-845b-7737ea758fd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:27.207239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c346c31b-01ab-4bb3-8113-e88d85f73b34 req-ff222900-03bb-4bc7-845b-7737ea758fd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:27.232146 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c346c31b-01ab-4bb3-8113-e88d85f73b34 req-ff222900-03bb-4bc7-845b-7737ea758fd8 service nova] Creating event network-vif-plugged:a4f0aa38-6f9b-4c78-920c-d25e8d16926a for instance db69ffbe-2bdd-4146-ab18-1bd266baafbe on nch1-master-1 Jul 02 21:20:27.240500 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c346c31b-01ab-4bb3-8113-e88d85f73b34 req-ff222900-03bb-4bc7-845b-7737ea758fd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072185 Jul 02 21:20:27.245134 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2092/4204] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:27.416983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:27.431586 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17ad4b27-5dc5-4011-9424-ed12800f5d54 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 0.606561 Jul 02 21:20:27.432870 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2113/4205] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:26 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:27.935897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:27.936836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:27.947112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:27.947826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:27.948817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:27.949427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:28.311909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:28.320601 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f44379d2-8edb-4693-ab0d-fe5c29676498 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1515 microversion: 2.1 time: 0.391559 Jul 02 21:20:28.321631 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2093/4206] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:27 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1515 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:28.449316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:28.449936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:28.457549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:28.458211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:28.459116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:28.459622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:28.818650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:28.826722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc20a450-f3cd-41d3-8f24-5fb4e9d85ff8 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1317 microversion: 2.1 time: 0.381276 Jul 02 21:20:28.827784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2114/4207] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:28 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:29.341486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:29.342670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:29.358266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:29.360904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:29.361980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:29.364504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:29.845444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:29.846071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:29.857505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:29.857972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:29.865208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:29.865208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.412070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:30.425685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-67448bb7-6141-490d-a378-e0a8ea2431fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 200 len: 1515 microversion: 2.1 time: 1.089944 Jul 02 21:20:30.430319 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2094/4208] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:29 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 1515 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:30.450681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-33915773-1afe-45c8-b872-4fa4626ce4f6 req-5fba74be-96fd-4fdb-831c-c2b08749923b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce5ff0b-22b8-42f6-b04a-ea5dabab16e6", "name": "network-vif-deleted", "tag": "11836265-aa9e-4885-93cf-fac198441083"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:30.467210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-33915773-1afe-45c8-b872-4fa4626ce4f6 req-5fba74be-96fd-4fdb-831c-c2b08749923b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.469186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-33915773-1afe-45c8-b872-4fa4626ce4f6 req-5fba74be-96fd-4fdb-831c-c2b08749923b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.492962 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-33915773-1afe-45c8-b872-4fa4626ce4f6 req-5fba74be-96fd-4fdb-831c-c2b08749923b service nova] Creating event network-vif-deleted:11836265-aa9e-4885-93cf-fac198441083 for instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 on nch2-master-1 Jul 02 21:20:30.515741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-33915773-1afe-45c8-b872-4fa4626ce4f6 req-5fba74be-96fd-4fdb-831c-c2b08749923b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084058 Jul 02 21:20:30.517860 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2095/4209] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:30.572887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:30.582290 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22eb7888-afaf-423d-9058-1c29834d20f7 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1507 microversion: 2.1 time: 0.742330 Jul 02 21:20:30.595238 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2115/4210] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:29 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1507 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:30.603946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:30.606494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:30.615131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.616723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.617305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.617754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.663962 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4b973c5f-a689-4419-a518-ef3449e8cc33 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe/ips" status: 200 len: 110 microversion: 2.1 time: 0.066974 Jul 02 21:20:30.674345 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2096/4211] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:20:30 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe/ips => generated 110 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:30.678373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:30.678886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:30.689520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.689894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.690732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.691166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.729044 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63b28995-d801-4181-9d00-ed192b2ee3cc tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe/ips" status: 200 len: 110 microversion: 2.1 time: 0.055243 Jul 02 21:20:30.736624 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2116/4212] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:20:30 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe/ips => generated 110 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:30.749259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:30.750351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:30.769199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.769732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.772673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.775821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.811147 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-696ff1fd-1d46-4a7c-8d5c-27740d3b9653 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe/ips/tempest-ServerAddressesTestJSON-1547800502-network" status: 200 len: 95 microversion: 2.1 time: 0.072394 Jul 02 21:20:30.812386 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2097/4213] 10.222.0.43 () {58 vars in 1400 bytes} [Sat Jul 2 21:20:30 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe/ips/tempest-ServerAddressesTestJSON-1547800502-network => generated 95 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:20:30.823411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:30.824222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:30.833560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.834015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.835809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:30.836538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:30.877560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:20:30.977885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:31.037635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2f80b6e-163d-42e3-bebc-46f5dccb2dc6 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "DELETE /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 204 len: 0 microversion: 2.1 time: 0.218027 Jul 02 21:20:31.042730 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2117/4214] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:20:30 2022] DELETE /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:20:31.050379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:31.051227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:31.062883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:31.064071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:31.066407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:31.067301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:31.443320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:31.459680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:31.463174 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75b8803a-c856-4a21-8c4a-98b70f322dfb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1513 microversion: 2.1 time: 0.418314 Jul 02 21:20:31.466986 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2098/4215] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:31 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:31.475888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:31.508306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:31.509624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:31.518464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:31.519689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:31.562140 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 HTTP/1.1 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'bce5ff0b-22b8-42f6-b04a-ea5dabab16e6'} Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:31.569645 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:31.573603 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:31.573603 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:31.573603 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:31.573603 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:31.573603 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:20:31.573603 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:20:31.576017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:31.577162 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-326a01cf-c3b6-480b-92fe-f8c0a0167223 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 404 len: 111 microversion: 2.1 time: 0.134139 Jul 02 21:20:31.584451 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2118/4216] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:31 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:20:31.763970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-414340798", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "c57b1b54-1fea-4d88-a056-efacd1fde971"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:31.878282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] validate_networks() for [('c57b1b54-1fea-4d88-a056-efacd1fde971', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:20:32.482316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:32.483666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:32.491580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:32.492136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:32.493079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:32.493796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:33.293157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:33.328506 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66d63af8-690d-4a61-9991-9907dba3b2cb tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1513 microversion: 2.1 time: 0.849130 Jul 02 21:20:33.330861 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2119/4217] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:32 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1513 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:33.758016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:20:33.761361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:20:33.762089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:20:33.762726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:20:33.763839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:20:33.791242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:33.795476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:33.802587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:33.804558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:33.854060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:20:33.862812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Getting quotas for user 4572a43d0b7e465eabd506fb52a502ba and project f989b228325c4640957dcfe068f652d3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:20:33.922490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:20:33.927646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:20:34.080137 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce7451dd-771c-43e7-b325-db10e4211f51 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.320164 Jul 02 21:20:34.082266 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2099/4218] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:20:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:20:34.095913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54626684-015c-49a1-af57-a74bcb7ccda1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:34.100849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54626684-015c-49a1-af57-a74bcb7ccda1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:34.360407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:34.361503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:34.363223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54626684-015c-49a1-af57-a74bcb7ccda1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:34.371399 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54626684-015c-49a1-af57-a74bcb7ccda1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1208 microversion: 2.1 time: 0.280505 Jul 02 21:20:34.388352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:34.389321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:34.390482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:34.391531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:34.394872 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2120/4219] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:34 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1208 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:34.590549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-78b6a78e-b571-4e30-8f08-f0020158adf8 req-94c0c767-5ea6-43a7-95f9-32eadc1743eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db69ffbe-2bdd-4146-ab18-1bd266baafbe", "name": "network-vif-deleted", "tag": "a4f0aa38-6f9b-4c78-920c-d25e8d16926a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:34.609891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-78b6a78e-b571-4e30-8f08-f0020158adf8 req-94c0c767-5ea6-43a7-95f9-32eadc1743eb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:34.613731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-78b6a78e-b571-4e30-8f08-f0020158adf8 req-94c0c767-5ea6-43a7-95f9-32eadc1743eb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:34.646628 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-78b6a78e-b571-4e30-8f08-f0020158adf8 req-94c0c767-5ea6-43a7-95f9-32eadc1743eb service nova] Creating event network-vif-deleted:a4f0aa38-6f9b-4c78-920c-d25e8d16926a for instance db69ffbe-2bdd-4146-ab18-1bd266baafbe on nch1-master-1 Jul 02 21:20:34.667307 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-78b6a78e-b571-4e30-8f08-f0020158adf8 req-94c0c767-5ea6-43a7-95f9-32eadc1743eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074865 Jul 02 21:20:34.669621 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2121/4220] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 02 21:20:34.787846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e2f3260319f40858f1fec2d708d3c87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '526d9ed0cb294ddcadf746f088e0fcbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:34.807210 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b79214b4-823d-4ef1-9e0b-5c7efa5f3206 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 200 len: 1471 microversion: 2.1 time: 0.462597 Jul 02 21:20:34.818396 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2100/4221] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:34 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:35.409582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:35.409973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:35.441950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:35.449953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:35.450945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:35.451407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:35.795920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:35.811509 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4935f348-c3d0-4a6e-938d-dfe51b1ac8e6 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1212 microversion: 2.1 time: 0.413211 Jul 02 21:20:35.816647 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2122/4222] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:35 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1212 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:35.832014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:35.834083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] [instance: db69ffbe-2bdd-4146-ab18-1bd266baafbe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:35.851412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:35.856467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:35.860178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:35.863307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:35.919278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] HTTP exception thrown: Instance db69ffbe-2bdd-4146-ab18-1bd266baafbe could not be found. Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Request method failure captured: Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe HTTP/1.1 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLaFDGxiI1MfclJ8JIBo4UV7AXufqmd6V8CzH9aDnlMUYO6ZbrDxGdVr8kbOxuotGNDHdtLbe7HBhVwMkhvhBSa9PLnsSFm9vKojhVucr6Jwnk6Wz4D6_RgD_Fgrb-0x6CgXarskrKZlyy4Vbf_9KQzOoaTEPQ-ckEtdBOCFLux_JPo Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 526d9ed0cb294ddcadf746f088e0fcbc Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerAddressesTestJSON-841368591 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/526d9ed0cb294ddcadf746f088e0fcbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_526d9ed0cb294ddcadf746f088e0fcbc", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/526d9ed0cb294ddcadf746f088e0fcbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/526d9ed0cb294ddcadf746f088e0fcbc"}]}] Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerAddressesTestJSON-841368591 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 526d9ed0cb294ddcadf746f088e0fcbc Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerAddressesTestJSON-841368591 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerAddressesTestJSON-841368591-project Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4e2f3260319f40858f1fec2d708d3c87 Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerAddressesTestJSON-841368591-project Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance db69ffbe-2bdd-4146-ab18-1bd266baafbe could not be found. Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'db69ffbe-2bdd-4146-ab18-1bd266baafbe'} Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db69ffbe-2bdd-4146-ab18-1bd266baafbe could not be found. Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db69ffbe-2bdd-4146-ab18-1bd266baafbe could not be found. Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:20:35.925883 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db69ffbe-2bdd-4146-ab18-1bd266baafbe could not be found. Jul 02 21:20:35.929886 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:20:35.932715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] Returning 404 to user: Instance db69ffbe-2bdd-4146-ab18-1bd266baafbe could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:20:35.937034 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0626bc30-9be0-4d27-8fdb-60522181bfe5 tempest-ServerAddressesTestJSON-841368591 tempest-ServerAddressesTestJSON-841368591-project] 10.222.0.43 "GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe" status: 404 len: 111 microversion: 2.1 time: 0.108753 Jul 02 21:20:35.945046 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2101/4223] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:35 2022] GET /compute/v2.1/servers/db69ffbe-2bdd-4146-ab18-1bd266baafbe => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:20:36.841026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:36.842362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:36.861682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:36.863685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:36.867779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:36.868529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:37.567394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:37.575880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-829a8340-b54a-4e76-bc4c-4b86bed19542 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1266 microversion: 2.1 time: 0.739200 Jul 02 21:20:37.579742 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2123/4224] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:36 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1266 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:38.596684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:38.598329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:38.606384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:38.607514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:38.609411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:38.610358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:38.769370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:38.782103 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8267c587-a5c6-48f8-ac33-9a6bbb5eb8fc tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1266 microversion: 2.1 time: 0.189790 Jul 02 21:20:38.792561 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2102/4225] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:38 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:39.799665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:39.801582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:39.815618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:39.816835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:39.818191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:39.818965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:40.720526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:40.753107 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a4cf72d-ee4a-4c7e-ab40-fbc8258ea871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.951764 Jul 02 21:20:40.754010 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2124/4226] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:39 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:41.772068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:41.773398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:41.791935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:41.792709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:41.793690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:41.795077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:42.419217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:42.431935 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b1530202-7fd7-42fd-b7d5-a8b8c70191b5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.664855 Jul 02 21:20:42.443594 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2103/4227] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:41 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:43.451015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:43.456898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:43.470968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:43.478829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:43.479838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:43.480542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:43.782499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5a6a3ef0-0b15-4b78-b8dd-ccca1bc5d11b req-fed6df86-e1f6-4908-8642-7c897d02a169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "768d4e27-39af-4c7a-a421-edddbe8337d6", "tag": "11acd4a4-200a-422a-98d8-22890491e672"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:43.798960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5a6a3ef0-0b15-4b78-b8dd-ccca1bc5d11b req-fed6df86-e1f6-4908-8642-7c897d02a169 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:43.800812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5a6a3ef0-0b15-4b78-b8dd-ccca1bc5d11b req-fed6df86-e1f6-4908-8642-7c897d02a169 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:43.815613 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5a6a3ef0-0b15-4b78-b8dd-ccca1bc5d11b req-fed6df86-e1f6-4908-8642-7c897d02a169 service nova] Creating event network-changed:11acd4a4-200a-422a-98d8-22890491e672 for instance 768d4e27-39af-4c7a-a421-edddbe8337d6 on nch2-master-1 Jul 02 21:20:43.822144 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5a6a3ef0-0b15-4b78-b8dd-ccca1bc5d11b req-fed6df86-e1f6-4908-8642-7c897d02a169 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044198 Jul 02 21:20:43.823625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2104/4228] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:43.991919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:44.001842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1fd85a9-1d88-4479-88fc-0cf45c88077f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.556168 Jul 02 21:20:44.003048 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2125/4229] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:43 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:45.016201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:45.017012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:45.022295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:45.023021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:45.043091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:45.043567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:45.044341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:45.044953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:45.069800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:45.839960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:45.853692 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d50cac80-dcb3-4afd-8cf1-87c0c77317ff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.832885 Jul 02 21:20:45.858614 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2105/4230] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:45 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:46.880222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:46.881030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:46.883385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:46.902692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:46.903585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:46.906766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:46.909468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:47.256086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:47.271553 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c49a72ec-f545-48b3-b8c1-e84c77ea2181 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.395848 Jul 02 21:20:47.281336 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2126/4231] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:46 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:48.292641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:48.293438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:48.318897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:48.323269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:48.324981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:48.327090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:48.669678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:48.679319 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5745deff-2ead-4d8c-9e76-76c23ea0fbff tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.390991 Jul 02 21:20:48.694601 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2106/4232] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:48 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:49.702124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:49.703475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:49.719798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:49.723595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:49.727755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:49.729553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:50.148299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:50.158925 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5176018a-232d-4331-8831-c71ceb9c6957 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.463464 Jul 02 21:20:50.160763 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2127/4233] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:49 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:51.178037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:51.179300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:51.192676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:51.193414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:51.197322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:51.200697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:51.673478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:51.692309 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2578010-afb0-4ea4-8c8f-a539a948b150 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.518286 Jul 02 21:20:51.693745 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2107/4234] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:51 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:52.714182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:52.714963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:52.730683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:52.738377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:52.738947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:52.739865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:52.740613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:53.108443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-73d43169-69a3-4455-b801-fcb6b3cf00cf req-9749cf5a-8dae-444b-9195-0cdd28661082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768d4e27-39af-4c7a-a421-edddbe8337d6", "name": "network-vif-plugged", "status": "completed", "tag": "11acd4a4-200a-422a-98d8-22890491e672"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:53.135107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-73d43169-69a3-4455-b801-fcb6b3cf00cf req-9749cf5a-8dae-444b-9195-0cdd28661082 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:53.135644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-73d43169-69a3-4455-b801-fcb6b3cf00cf req-9749cf5a-8dae-444b-9195-0cdd28661082 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:53.155811 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-73d43169-69a3-4455-b801-fcb6b3cf00cf req-9749cf5a-8dae-444b-9195-0cdd28661082 service nova] Creating event network-vif-plugged:11acd4a4-200a-422a-98d8-22890491e672 for instance 768d4e27-39af-4c7a-a421-edddbe8337d6 on nch2-master-1 Jul 02 21:20:53.162129 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-73d43169-69a3-4455-b801-fcb6b3cf00cf req-9749cf5a-8dae-444b-9195-0cdd28661082 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060658 Jul 02 21:20:53.163066 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2108/4235] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:53.464545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:53.475012 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-696b7320-300e-4af1-a510-66c84ec81bd5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 0.767726 Jul 02 21:20:53.478612 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2128/4236] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:52 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:54.384866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1942896329", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "5354096e-b039-4010-8707-3aebf48750f0"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:54.495535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:54.496192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:54.519209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] validate_networks() for [('5354096e-b039-4010-8707-3aebf48750f0', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:20:54.546148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:54.553889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:54.554961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:54.555569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:55.595089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:55.615319 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87fd55c7-45f1-4c81-8359-b2a5a2d1a025 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1308 microversion: 2.1 time: 1.118263 Jul 02 21:20:55.626523 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2129/4237] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:54 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1308 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:56.091072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c2b33ba-3714-4b8e-8ae0-10751b7ad16c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Action: 'create', calling method: .version_select at 0x7fabea1f2790>, body: {"keypair": {"name": "tempest-keypair-432767255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPkpQdMZuYCd0nnIbj8jKk+gAM2kCluEJ2GpCWCdnPjcgg2yDRvWwpjkkQ45K2/isgEc7A0s78YEY3jChjnFUAyrmWVTjfV7IiIQez4/lSh61rNpOF1F0Hi3F3H4h+idUA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:56.121486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2c2b33ba-3714-4b8e-8ae0-10751b7ad16c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:20:56.131200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-2c2b33ba-3714-4b8e-8ae0-10751b7ad16c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for user a90caf8a110549e39bbaf7ec50a6207d and project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:20:56.171906 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c2b33ba-3714-4b8e-8ae0-10751b7ad16c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.453309 Jul 02 21:20:56.173203 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2130/4238] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:20:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:20:56.176482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c2b33ba-3714-4b8e-8ae0-10751b7ad16c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:56.177692 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c2b33ba-3714-4b8e-8ae0-10751b7ad16c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001813 Jul 02 21:20:56.193136 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2131/4239] 10.222.0.43 () {56 vars in 885 bytes} [Sat Jul 2 21:20:56 2022] GET /compute/ => generated 377 bytes in 19 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 02 21:20:56.641374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:56.642324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:56.678722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:56.680267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:56.682858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:56.685247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:57.438923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:20:57.440018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:20:57.440773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:20:57.441694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:20:57.442351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:20:57.464329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:57.465380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:57.470573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:57.472450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:57.537838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:20:57.573487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for user fa780176ae5f4a618e42a47531b0d4a5 and project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:20:57.611375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:20:57.621576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:20:57.700726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:57.714512 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14b3a4fe-3770-4723-af80-386872404476 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1489 microversion: 2.1 time: 1.081221 Jul 02 21:20:57.717756 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2132/4240] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:56 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1489 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:57.743412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1701387177"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:20:57.744636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:57.765979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:57.766866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:57.767912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:57.770721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:57.837027 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d93ef3f9-281d-446b-b703-56a5c9042da1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.718326 Jul 02 21:20:57.849333 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2109/4241] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:20:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:20:57.854588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-96173c51-f8e1-41b0-be6a-ea96c57a212a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:57.858486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-96173c51-f8e1-41b0-be6a-ea96c57a212a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:58.038901 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aee36b7c-710c-4ec1-aead-586190abd201 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "PUT /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1075 microversion: 2.1 time: 0.299834 Jul 02 21:20:58.040153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2133/4242] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:20:57 2022] PUT /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1075 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:58.056689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:58.057528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:58.070070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:58.070492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:58.071313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:58.105366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:58.537190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-96173c51-f8e1-41b0-be6a-ea96c57a212a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:58.553239 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-96173c51-f8e1-41b0-be6a-ea96c57a212a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1208 microversion: 2.1 time: 0.699584 Jul 02 21:20:58.554698 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2110/4243] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:57 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1208 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:20:59.286781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:59.303104 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98541221-3e2f-4abd-86e2-7d2e7ee9f520 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1501 microversion: 2.1 time: 1.247328 Jul 02 21:20:59.306763 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2134/4244] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:58 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1501 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:20:59.326398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:59.327321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:59.346401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:20:59.349701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:59.352420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:59.353325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:59.353767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:59.571312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:20:59.572026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:20:59.584442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:59.585237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:59.588378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:20:59.588888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:20:59.934067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:20:59.956232 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2aa3736-d9dd-4f8c-9603-c3b9b9668d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1260 microversion: 2.1 time: 0.387737 Jul 02 21:20:59.979480 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2135/4245] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:59 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1260 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:00.126372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:00.138155 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d30fd2dd-5212-41cf-b58e-7d92618efcb5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1501 microversion: 2.1 time: 0.816276 Jul 02 21:21:00.141234 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2111/4246] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:20:59 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1501 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:00.155352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4eb6405-c415-4665-8152-4cf507c9c93b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:00.163851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4eb6405-c415-4665-8152-4cf507c9c93b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:00.165349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4eb6405-c415-4665-8152-4cf507c9c93b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:00.202642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4eb6405-c415-4665-8152-4cf507c9c93b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:21:00.285450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:00.296580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4eb6405-c415-4665-8152-4cf507c9c93b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "POST /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6/action" status: 202 len: 0 microversion: 2.1 time: 0.144712 Jul 02 21:21:00.298586 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2136/4247] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:21:00 2022] POST /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:21:00.307605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:00.308512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:00.321882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:00.327502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:00.328867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:00.330672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:00.834536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:00.851781 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ae85a9e-0337-466b-9c58-19d197c5422a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.547178 Jul 02 21:21:00.854317 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2112/4248] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:00 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:00.997060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:00.998023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:01.007141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:01.007851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:01.010681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:01.011460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:01.130687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:01.139499 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c8ce4662-662b-4eaa-a05f-3453fc0355e9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1266 microversion: 2.1 time: 0.148174 Jul 02 21:21:01.140404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2137/4249] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:00 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:01.871058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:01.871710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:01.882596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:01.882963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:01.886572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:01.886572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:02.363486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e471373b-ac74-4f6c-a2f6-5910def4e0b9 tempest-ComputeTenantNetworksTest-774114516 tempest-ComputeTenantNetworksTest-774114516-project] Calling method '.version_select at 0x7fabd79a3700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:02.762464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:02.780766 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-953d6865-be50-4775-9d3f-534e5cd49a72 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.913773 Jul 02 21:21:02.781381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2113/4250] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:01 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:02.797315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:02.798992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:02.802908 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e471373b-ac74-4f6c-a2f6-5910def4e0b9 tempest-ComputeTenantNetworksTest-774114516 tempest-ComputeTenantNetworksTest-774114516-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.713108 Jul 02 21:21:02.803687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2138/4251] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:21:02 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:02.810742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-254920998", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cc96c2d-fdad-4762-b6c0-6497636d934f"}], "security_groups": [{"name": "tempest-securitygroup--2018898851"}], "key_name": "tempest-keypair-432767255", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:02.823349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:02.828695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:02.829753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:02.830363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:03.257377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] validate_networks() for [('9cc96c2d-fdad-4762-b6c0-6497636d934f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:21:03.431639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:03.465922 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-72cd1daa-073f-46c1-a411-5f69d1aba7f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.671775 Jul 02 21:21:03.470575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2114/4252] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:02 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:03.489519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f3885dc-3721-42bd-bf8d-320937996667 tempest-ComputeTenantNetworksTest-774114516 tempest-ComputeTenantNetworksTest-774114516-project] Calling method '.version_select at 0x7fabe495aaf0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:03.855468 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f3885dc-3721-42bd-bf8d-320937996667 tempest-ComputeTenantNetworksTest-774114516 tempest-ComputeTenantNetworksTest-774114516-project] 10.222.0.43 "GET /compute/v2.1/os-tenant-networks/66d4abb0-a964-4837-bfaf-dea855241f83" status: 200 len: 140 microversion: 2.1 time: 0.383470 Jul 02 21:21:03.861681 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2115/4253] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:21:03 2022] GET /compute/v2.1/os-tenant-networks/66d4abb0-a964-4837-bfaf-dea855241f83 => generated 140 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:03.866750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:03.867965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:03.886561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:03.887137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:03.888216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:03.889190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:04.324168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:04.340003 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-257bf0e3-9139-4d90-9826-be3309779780 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.482734 Jul 02 21:21:04.341191 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2116/4254] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:03 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:04.487695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:04.489389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:04.499192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:04.500131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:04.503733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:04.506980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:04.593551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:21:04.597258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:21:04.605759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:21:04.606786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:21:04.609196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:21:04.750415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:04.756112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:04.768491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:04.771975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:04.854645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:21:04.871551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for user a90caf8a110549e39bbaf7ec50a6207d and project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:21:04.911048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:21:04.914700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:21:04.992254 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e3bfff90-fe78-4696-b905-17a849e1bff0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.186485 Jul 02 21:21:04.993614 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2139/4255] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:21:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:21:05.010910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5d84ad1-535d-4a38-af02-58a1990c2558 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:05.013348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5d84ad1-535d-4a38-af02-58a1990c2558 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:05.327969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5d84ad1-535d-4a38-af02-58a1990c2558 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:05.350797 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5d84ad1-535d-4a38-af02-58a1990c2558 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1236 microversion: 2.1 time: 0.346307 Jul 02 21:21:05.351968 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2140/4256] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:05 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1236 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:05.362533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:05.364371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:05.381118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:05.385848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:05.387025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:05.388369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:05.501795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:05.518399 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed3c53b3-bfb3-4242-a1ec-7546047fd487 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 1.034184 Jul 02 21:21:05.521269 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2117/4257] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:04 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:05.814468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-3ea1f149-0bb9-4277-b214-70878ab8e945 req-77b86c7e-f070-48b1-84e4-7141c8a93847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db16f871-de37-42d1-8bba-2920d24d495b", "tag": "86165fa0-ccc3-4def-81a9-2fb64b4d43da"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:05.840493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3ea1f149-0bb9-4277-b214-70878ab8e945 req-77b86c7e-f070-48b1-84e4-7141c8a93847 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:05.841493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-3ea1f149-0bb9-4277-b214-70878ab8e945 req-77b86c7e-f070-48b1-84e4-7141c8a93847 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:05.876367 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-3ea1f149-0bb9-4277-b214-70878ab8e945 req-77b86c7e-f070-48b1-84e4-7141c8a93847 service nova] Creating event network-changed:86165fa0-ccc3-4def-81a9-2fb64b4d43da for instance db16f871-de37-42d1-8bba-2920d24d495b on nch1-master-1 Jul 02 21:21:05.893056 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-3ea1f149-0bb9-4277-b214-70878ab8e945 req-77b86c7e-f070-48b1-84e4-7141c8a93847 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080703 Jul 02 21:21:05.893743 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2118/4258] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:06.156574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:06.168920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4d575607-c31b-4773-87da-28c504462ef5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.815025 Jul 02 21:21:06.169527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2141/4259] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:05 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:06.371589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:06.372555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:06.407892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:06.411322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:06.416546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:06.418109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:06.539299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:06.540284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:06.554066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:06.555115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:06.557897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:06.559550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:07.335067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:07.346781 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e46b9a07-190c-4f11-958c-4cb38d80bc90 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1232 microversion: 2.1 time: 0.981871 Jul 02 21:21:07.349497 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2119/4260] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:06 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1232 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:07.362374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:07.364989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:07.381048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:07.384866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:07.386114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:07.391725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:07.505079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:07.690610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:07.699931 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37f6b3e9-208c-41c3-b58d-0e830806ffe9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 1.165925 Jul 02 21:21:07.712784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2142/4261] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:06 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:08.170378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20e02322-839b-4e99-be1d-d5f106a143c9 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Action: 'create', calling method: .version_select at 0x7fabe42a4af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1506108419", "metadata": {"Type": "work"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:08.189135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:08.206675 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f89aa435-27a6-4c72-959d-1df824ad6c5c tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.855112 Jul 02 21:21:08.214611 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2120/4262] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:07 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:08.366880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:08.367577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:08.379037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:08.379500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:08.380323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:08.380763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:08.519740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:08.532287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-400ebac5-b0fd-47cc-a8c9-8c95dda9bddc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1294 microversion: 2.1 time: 0.170456 Jul 02 21:21:08.538477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2121/4263] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:08 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1294 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:08.702282 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20e02322-839b-4e99-be1d-d5f106a143c9 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.712902 Jul 02 21:21:08.703455 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2143/4264] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:07 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 715 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 02 21:21:08.711587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:08.719387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-92fa3c37-9c03-4397-8a34-fd6eed1640ba tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Calling method '.version_select at 0x7fabea31b940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:08.723938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:08.725084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:08.742380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:08.755995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:08.756896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:08.757344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:08.888142 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-92fa3c37-9c03-4397-8a34-fd6eed1640ba tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb" status: 200 len: 346 microversion: 2.1 time: 0.177235 Jul 02 21:21:08.888930 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2122/4265] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:08 2022] GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb => generated 346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:09.120078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:09.137363 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b64d36d-93cc-445d-b0c3-d84def362a89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.423604 Jul 02 21:21:09.138117 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2144/4266] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:08 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:09.232996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:09.233913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:09.248771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:09.249522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:09.251099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:09.251787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:09.550607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:09.551225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:09.568549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:09.568999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:09.569831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:09.570269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:09.803317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:09.811414 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5cbecaed-1c0b-453f-919b-fb7f9b41ae92 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.583684 Jul 02 21:21:09.812007 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2123/4267] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:09 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:09.901960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6ad1246-9597-421a-949e-c2f9ee89a7b4 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Calling method '.version_select at 0x7fabe4694040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:09.964252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:09.986156 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-627f4da5-a55e-4faf-a65a-19b65bd6a638 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 0.439926 Jul 02 21:21:09.997901 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2145/4268] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:09 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:10.050512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:10.051284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:10.066615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:10.067069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:10.073864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:10.074610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:10.092274 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6ad1246-9597-421a-949e-c2f9ee89a7b4 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb" status: 200 len: 347 microversion: 2.1 time: 0.195294 Jul 02 21:21:10.093477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2124/4269] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:09 2022] GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb => generated 347 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:10.106834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-15568979-51a3-47e3-a64a-1f6868f7cb9f tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Calling method '.version_select at 0x7fabea187b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:10.216980 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-15568979-51a3-47e3-a64a-1f6868f7cb9f tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb" status: 200 len: 347 microversion: 2.1 time: 0.115725 Jul 02 21:21:10.218019 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2125/4270] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:10 2022] GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb => generated 347 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:10.225978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:10.226886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:10.267523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:10.274291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:10.275534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:10.278708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:10.301842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lazy-loading 'services' on Instance uuid ca136582-61db-4de1-9a8b-d60b41641f6a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:21:10.472948 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f8e8982-15ce-4bda-9806-bee3118bf376 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a/os-volume_attachments/792de71d-1208-4d3b-90d3-efdd17ab60ab" status: 202 len: 0 microversion: 2.1 time: 0.423820 Jul 02 21:21:10.478946 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2146/4271] 10.222.0.43 () {58 vars in 1415 bytes} [Sat Jul 2 21:21:10 2022] DELETE /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a/os-volume_attachments/792de71d-1208-4d3b-90d3-efdd17ab60ab => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:21:10.515761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1b5e832-d8be-4993-b4f1-99d7f8eb4424 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Calling method '.version_select at 0x7fabe4e52d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:10.664385 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1b5e832-d8be-4993-b4f1-99d7f8eb4424 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb" status: 202 len: 0 microversion: 2.1 time: 0.182909 Jul 02 21:21:10.665286 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2147/4272] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:21:10 2022] DELETE /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:21:10.674999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-416a0e91-fa9e-419b-a9f8-8545f0326528 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Calling method '.version_select at 0x7fabe4656430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:10.759399 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-416a0e91-fa9e-419b-a9f8-8545f0326528 tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb" status: 200 len: 346 microversion: 2.1 time: 0.089170 Jul 02 21:21:10.760527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2148/4273] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:10 2022] GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:10.829448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:10.830432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:10.838551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:10.838973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:10.840127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:10.840568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:11.033198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:11.049804 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18765699-b907-444a-85c4-17ce60a40bb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.828055 Jul 02 21:21:11.051665 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2126/4274] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:10 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:11.064083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:11.068090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:11.087245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:11.092505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:11.094641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:11.095352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:11.243965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:11.257161 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1a44e470-87a2-43c4-8f21-a21dff869075 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.433145 Jul 02 21:21:11.257788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2149/4275] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:10 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:11.728886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:11.740324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-39bfc6c2-dc81-484e-9c80-533279dac0e0 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 0.685838 Jul 02 21:21:11.743363 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2127/4276] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:11 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:11.772851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71f9d897-05ad-44fd-8b54-b935f6821e9d tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Calling method '.version_select at 0x7fabe48d1940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:11.841284 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-71f9d897-05ad-44fd-8b54-b935f6821e9d tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] HTTP exception thrown: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71f9d897-05ad-44fd-8b54-b935f6821e9d tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Request method failure captured: Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb HTTP/1.1 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbDskhrRdcKeg0ad16waA7DYaqZ-vIo7-FNbLLGVQMrn09c3ZsVPO0fBRYcNOTbYHPdRaFjgL16g1_Ea1pqKcGfogRoBZyeGmEEOj0VPjXU21oK6L2-JUK4PGUUN2kTR71UU4tC9Rn_ISCgWitLcyRE7YTfPclX9uErkGuSaluFkUA Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 0e3d8ce95c454de9bea4c3a1beff5678 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesGetTestJSON-642642729 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e3d8ce95c454de9bea4c3a1beff5678"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_0e3d8ce95c454de9bea4c3a1beff5678", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/0e3d8ce95c454de9bea4c3a1beff5678"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/0e3d8ce95c454de9bea4c3a1beff5678"}]}] Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesGetTestJSON-642642729 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 0e3d8ce95c454de9bea4c3a1beff5678 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesGetTestJSON-642642729 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesGetTestJSON-642642729-project Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b89bdaabad8b49c789e5382df34c1cb2 Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesGetTestJSON-642642729-project Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '79a7d33a-dc8e-441e-b734-71a414636ddb'} Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. (HTTP 404) (Request-ID: req-d8cbb0ef-476c-4af8-b774-acbb53e7c4e7) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:21:11.843421 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-71f9d897-05ad-44fd-8b54-b935f6821e9d tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] Returning 404 to user: Volume 79a7d33a-dc8e-441e-b734-71a414636ddb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-71f9d897-05ad-44fd-8b54-b935f6821e9d tempest-VolumesGetTestJSON-642642729 tempest-VolumesGetTestJSON-642642729-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb" status: 404 len: 109 microversion: 2.1 time: 0.076316 Jul 02 21:21:11.849675 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2150/4277] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:11 2022] GET /compute/v2.1/os-volumes/79a7d33a-dc8e-441e-b734-71a414636ddb => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:12.071939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:12.074545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:12.088414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:12.089908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:12.091662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:12.092312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:12.276797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:12.278737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:12.302550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:12.303014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:12.303804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:12.304523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:12.517905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:12.521118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:12.533658 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12baf728-5cf8-4d11-8c43-1cf244e3305f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.468031 Jul 02 21:21:12.535667 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2128/4278] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:12 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:12.761903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:12.762984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:12.777535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:12.778080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:12.779083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:12.779644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.110964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:13.124626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1757f90e-0114-4dd5-93da-061e2bf59702 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.849545 Jul 02 21:21:13.137584 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2151/4279] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:12 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:13.144217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:13.148697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:13.164161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:13.164511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.169631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:13.170427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.218094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:21:13.220801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:13.234137 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b237af11-256a-4ba3-9971-f4bd67a6ba78 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 0.476257 Jul 02 21:21:13.234880 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2129/4280] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:12 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:13.399429 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a9039941-7df2-41ef-8cef-92d1205be1fc tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 204 len: 0 microversion: 2.1 time: 0.260263 Jul 02 21:21:13.418865 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2152/4281] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:13 2022] DELETE /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:21:13.428124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:13.428752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:13.444286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:13.445125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.446115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:13.446606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.554700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:13.555667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:13.564611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:13.565356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.566381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:13.566993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:13.727688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:13.741473 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b22125eb-cc4f-451e-b015-97dfee6779cb tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1514 microversion: 2.1 time: 0.318031 Jul 02 21:21:13.751200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2130/4282] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:13 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:13.868279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:13.897304 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b315ef2-af63-4355-9552-65896eadc833 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.348458 Jul 02 21:21:13.904145 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2153/4283] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:13 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:14.142751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:14.143521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:14.171588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d6ae460d-a77e-4019-a359-61a920929190 req-1c05c068-f2bb-47c4-bcc4-20aba1c57494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7695c9ea-dedd-41a5-bbd1-1b9027f019ad", "tag": "e0a9e6df-73b9-43ae-9f31-6212c2d7755a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:14.173817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.174292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.179461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.180221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.190067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d6ae460d-a77e-4019-a359-61a920929190 req-1c05c068-f2bb-47c4-bcc4-20aba1c57494 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.192411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d6ae460d-a77e-4019-a359-61a920929190 req-1c05c068-f2bb-47c4-bcc4-20aba1c57494 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.216717 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d6ae460d-a77e-4019-a359-61a920929190 req-1c05c068-f2bb-47c4-bcc4-20aba1c57494 service nova] Creating event network-changed:e0a9e6df-73b9-43ae-9f31-6212c2d7755a for instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad on nch2-master-1 Jul 02 21:21:14.229113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d6ae460d-a77e-4019-a359-61a920929190 req-1c05c068-f2bb-47c4-bcc4-20aba1c57494 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062144 Jul 02 21:21:14.230114 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2154/4284] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:14.263240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:14.264551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:14.276316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.277006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.277932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.278518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.464352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:14.481676 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33610105-14f9-4062-821c-9eba03c1a02f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.342784 Jul 02 21:21:14.486621 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2131/4285] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:14 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:14.585408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:14.601531 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc509dda-6f77-4d58-a3ab-d656eeae2f97 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 0.352192 Jul 02 21:21:14.604714 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2155/4286] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:14 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:14.759655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:14.760617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:14.773231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.773691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.776780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.777430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.916259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:14.917352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:14.920687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:14.940272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.946385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:14.962033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:14.962884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:15.348975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:15.455170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:15.464196 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b308f562-5af7-49c1-a822-46353fe820e0 tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1514 microversion: 2.1 time: 0.708901 Jul 02 21:21:15.468177 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2132/4287] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:14 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1514 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:15.600322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:15.612351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85ab24af-2909-49ae-8d31-d049ff403985 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.701195 Jul 02 21:21:15.619286 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2156/4288] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:14 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:15.930847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-24755335", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "3f91c781-8508-403b-afaa-0b18dc2b6a6a"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:16.065808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] validate_networks() for [('3f91c781-8508-403b-afaa-0b18dc2b6a6a', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:21:16.142168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94e90b7f-ff27-477c-ba33-02db9878065d tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Action: 'create', calling method: .version_select at 0x7fabe460c790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719418113", "metadata": {"Type": "work"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94e90b7f-ff27-477c-ba33-02db9878065d tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Request method failure captured: Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 121 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbLOo8v2BAfpjbWamKkr0h3jO6I8AqHW8DYj5NO47DmBoGcpAxzBR7vWZ26dwniNxtnAnyNDJHm4n7rSWth53eyVZLwpy_ezW_inlAz1Pi0ROG1SOd6vkUGpwVl7vhlBA5rOdwlbUPzwOtehdq1K58f5CqgkhEOaQZO9AWmOgfZrH4 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25bbd43e7dcd4d58a70eaedd73280f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25bbd43e7dcd4d58a70eaedd73280f2d"}]}] Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 658cca224eff470b9670fe04d4c7d5dd Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-719418113", "metadata": {"Type": "work"}}} Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-719418113', 'metadata': {'Type': 'work'}}}} Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '#$%' Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:21:16.148739 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:16.152924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94e90b7f-ff27-477c-ba33-02db9878065d tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:16.154151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94e90b7f-ff27-477c-ba33-02db9878065d tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.533211 Jul 02 21:21:16.159155 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2157/4289] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 534 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:21:16.178496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:16.185898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:16.207690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:16.208556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:16.209376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:16.209820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:16.832789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:16.843685 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51e62b49-4126-441a-b9a9-c59d133bb29e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.682697 Jul 02 21:21:16.844609 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2158/4290] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:16 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:16.851409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2c637185-453f-4e75-9e9e-50a5bb4593ca req-bea487ef-dd02-45dc-9c38-1e5189ef9be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db16f871-de37-42d1-8bba-2920d24d495b", "name": "network-vif-plugged", "status": "completed", "tag": "86165fa0-ccc3-4def-81a9-2fb64b4d43da"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:16.887029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c637185-453f-4e75-9e9e-50a5bb4593ca req-bea487ef-dd02-45dc-9c38-1e5189ef9be5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:16.888021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c637185-453f-4e75-9e9e-50a5bb4593ca req-bea487ef-dd02-45dc-9c38-1e5189ef9be5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:16.906326 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2c637185-453f-4e75-9e9e-50a5bb4593ca req-bea487ef-dd02-45dc-9c38-1e5189ef9be5 service nova] Creating event network-vif-plugged:86165fa0-ccc3-4def-81a9-2fb64b4d43da for instance db16f871-de37-42d1-8bba-2920d24d495b on nch1-master-1 Jul 02 21:21:16.913598 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2c637185-453f-4e75-9e9e-50a5bb4593ca req-bea487ef-dd02-45dc-9c38-1e5189ef9be5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067127 Jul 02 21:21:16.915200 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2159/4291] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:16.922209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:16.923194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:16.948073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:16.948703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:16.949945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:16.950622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:16.956898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:17.447431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:17.462259 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1564387b-9fe8-4d13-8dbf-20b2955a61b7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 0.545397 Jul 02 21:21:17.463059 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2160/4292] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:16 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:17.467401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4611d56-d8de-46c2-bfa8-113567962652 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Action: 'create', calling method: .version_select at 0x7fabea228a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1565839444", "metadata": {"Type": "work"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4611d56-d8de-46c2-bfa8-113567962652 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Request method failure captured: Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 120 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbLOo8v2BAfpjbWamKkr0h3jO6I8AqHW8DYj5NO47DmBoGcpAxzBR7vWZ26dwniNxtnAnyNDJHm4n7rSWth53eyVZLwpy_ezW_inlAz1Pi0ROG1SOd6vkUGpwVl7vhlBA5rOdwlbUPzwOtehdq1K58f5CqgkhEOaQZO9AWmOgfZrH4 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25bbd43e7dcd4d58a70eaedd73280f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25bbd43e7dcd4d58a70eaedd73280f2d"}]}] Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 658cca224eff470b9670fe04d4c7d5dd Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1565839444", "metadata": {"Type": "work"}}} Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1565839444', 'metadata': {'Type': 'work'}}}} Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '0' Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:21:17.483814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4611d56-d8de-46c2-bfa8-113567962652 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4611d56-d8de-46c2-bfa8-113567962652 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021657 Jul 02 21:21:17.488629 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2161/4293] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:21:17.494614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:17.495235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:17.503491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.503948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.504764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.505453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.628008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:17.645718 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-422e5f6e-d01e-4e87-8467-b75f13e95d3c tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1304 microversion: 2.1 time: 0.158583 Jul 02 21:21:17.650740 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2162/4294] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:17 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:17.661020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:21:17.661460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:21:17.661826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:21:17.662553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:21:17.663246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:21:17.673407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:17.674033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:17.686529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.690369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.691169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.692414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.694043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.696844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.702176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.702785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.734227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Getting quotas for project e693f5f3d3df486696086ea98714bcbf. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:21:17.748773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Getting quotas for user e1b7350d87a14f6dbd97ba52e3ed0a7d and project e693f5f3d3df486696086ea98714bcbf. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:21:17.785338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:21:17.787766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:21:17.876580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-87d277be-7679-4078-b54f-beb4f32f760f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.406259 Jul 02 21:21:17.884084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2133/4295] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:21:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:21:17.892405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6796ff57-90fd-4f2d-b4f2-6522bb73fb1f req-dde66d49-0805-4f4e-84cb-5e67a01dd2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca136582-61db-4de1-9a8b-d60b41641f6a", "name": "network-vif-deleted", "tag": "b80cab7c-84ba-41cc-9654-b67793d7de64"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:17.907190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6796ff57-90fd-4f2d-b4f2-6522bb73fb1f req-dde66d49-0805-4f4e-84cb-5e67a01dd2b0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:17.908107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6796ff57-90fd-4f2d-b4f2-6522bb73fb1f req-dde66d49-0805-4f4e-84cb-5e67a01dd2b0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:17.962189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6796ff57-90fd-4f2d-b4f2-6522bb73fb1f req-dde66d49-0805-4f4e-84cb-5e67a01dd2b0 service nova] Creating event network-vif-deleted:b80cab7c-84ba-41cc-9654-b67793d7de64 for instance ca136582-61db-4de1-9a8b-d60b41641f6a on nch1-master-1 Jul 02 21:21:17.976634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6796ff57-90fd-4f2d-b4f2-6522bb73fb1f req-dde66d49-0805-4f4e-84cb-5e67a01dd2b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088418 Jul 02 21:21:17.977523 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2134/4296] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:17.997908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f903af5b-d0f2-48e5-9f84-cc0db21e16e8 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Action: 'create', calling method: .version_select at 0x7fabe473cf70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-423231109", "metadata": {"Type": "work"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f903af5b-d0f2-48e5-9f84-cc0db21e16e8 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Request method failure captured: Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 118 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLbLOo8v2BAfpjbWamKkr0h3jO6I8AqHW8DYj5NO47DmBoGcpAxzBR7vWZ26dwniNxtnAnyNDJHm4n7rSWth53eyVZLwpy_ezW_inlAz1Pi0ROG1SOd6vkUGpwVl7vhlBA5rOdwlbUPzwOtehdq1K58f5CqgkhEOaQZO9AWmOgfZrH4 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25bbd43e7dcd4d58a70eaedd73280f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25bbd43e7dcd4d58a70eaedd73280f2d"}]}] Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 658cca224eff470b9670fe04d4c7d5dd Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-423231109", "metadata": {"Type": "work"}}} Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-423231109', 'metadata': {'Type': 'work'}}}} Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi '' Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:21:18.005924 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 02 21:21:18.010639 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.014453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f903af5b-d0f2-48e5-9f84-cc0db21e16e8 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:18.015349 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f903af5b-d0f2-48e5-9f84-cc0db21e16e8 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033004 Jul 02 21:21:18.018600 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2135/4297] 10.222.0.43 () {60 vars in 1155 bytes} [Sat Jul 2 21:21:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:21:18.031593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.034991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:18.045406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.046475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.047271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.047713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.063276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:18.091189 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9895a95f-57ba-4f9b-9dc7-ace5bcb7a1c5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1308 microversion: 2.1 time: 0.420143 Jul 02 21:21:18.094368 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2163/4298] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:17 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:18.109914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bd1aee0-482e-4c05-a77d-b6ffa6633b7f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.116363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9bd1aee0-482e-4c05-a77d-b6ffa6633b7f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:18.257344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bd1aee0-482e-4c05-a77d-b6ffa6633b7f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:18.284619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bd1aee0-482e-4c05-a77d-b6ffa6633b7f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:18.287656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bd1aee0-482e-4c05-a77d-b6ffa6633b7f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:18.296344 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bd1aee0-482e-4c05-a77d-b6ffa6633b7f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1257 microversion: 2.21 time: 0.199619 Jul 02 21:21:18.297657 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2164/4299] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:18 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1257 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:18.307526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-310a783d-999e-4c7e-9d51-5fc608066993 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Calling method '.version_select at 0x7fabe48d1670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.352866 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-310a783d-999e-4c7e-9d51-5fc608066993 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] HTTP exception thrown: Volume tempest-invalid-1521743132 could not be found. Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-310a783d-999e-4c7e-9d51-5fc608066993 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Request method failure captured: Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1521743132 HTTP/1.1 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbLOo8v2BAfpjbWamKkr0h3jO6I8AqHW8DYj5NO47DmBoGcpAxzBR7vWZ26dwniNxtnAnyNDJHm4n7rSWth53eyVZLwpy_ezW_inlAz1Pi0ROG1SOd6vkUGpwVl7vhlBA5rOdwlbUPzwOtehdq1K58f5CqgkhEOaQZO9AWmOgfZrH4 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25bbd43e7dcd4d58a70eaedd73280f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25bbd43e7dcd4d58a70eaedd73280f2d"}]}] Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 658cca224eff470b9670fe04d4c7d5dd Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume tempest-invalid-1521743132 could not be found. Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'tempest-invalid-1521743132'} Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1521743132 could not be found. (HTTP 404) (Request-ID: req-a6a00db3-3b64-41d0-83be-282212ee67e9) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:18.364065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1521743132 could not be found. Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1521743132 could not be found. Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1521743132 could not be found. Jul 02 21:21:18.368860 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.375180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-310a783d-999e-4c7e-9d51-5fc608066993 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Returning 404 to user: Volume tempest-invalid-1521743132 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:18.379965 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-310a783d-999e-4c7e-9d51-5fc608066993 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1521743132" status: 404 len: 99 microversion: 2.1 time: 0.080971 Jul 02 21:21:18.382509 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2165/4300] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:21:18 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1521743132 => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:21:18.398307 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08de12af-1131-40eb-b644-92a649e3bfce tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009794 Jul 02 21:21:18.400436 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2166/4301] 10.222.0.43 () {58 vars in 1139 bytes} [Sat Jul 2 21:21:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 02 21:21:18.411425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:18.411739 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c654083-7ea9-49a9-a5f9-935be8bbcece tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005455 Jul 02 21:21:18.416762 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2167/4302] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:21:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 02 21:21:18.423855 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e20a3ee7-c094-463e-a874-6c1cfd5089b1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.403936 Jul 02 21:21:18.425055 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2136/4303] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:18 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:18.428621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-018fcfe6-8906-4b8f-95d5-89a24b369174 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Calling method '.version_select at 0x7fabea153670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.479400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.480162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:18.491287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-018fcfe6-8906-4b8f-95d5-89a24b369174 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] HTTP exception thrown: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-018fcfe6-8906-4b8f-95d5-89a24b369174 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Request method failure captured: Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/os-volumes/3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f HTTP/1.1 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbLOo8v2BAfpjbWamKkr0h3jO6I8AqHW8DYj5NO47DmBoGcpAxzBR7vWZ26dwniNxtnAnyNDJHm4n7rSWth53eyVZLwpy_ezW_inlAz1Pi0ROG1SOd6vkUGpwVl7vhlBA5rOdwlbUPzwOtehdq1K58f5CqgkhEOaQZO9AWmOgfZrH4 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25bbd43e7dcd4d58a70eaedd73280f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25bbd43e7dcd4d58a70eaedd73280f2d"}]}] Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 658cca224eff470b9670fe04d4c7d5dd Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f'} Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. (HTTP 404) (Request-ID: req-a4ea7efe-6ed0-4fa3-8d05-b1919d8f9e08) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:21:18.495305 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-018fcfe6-8906-4b8f-95d5-89a24b369174 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Returning 404 to user: Volume 3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-018fcfe6-8906-4b8f-95d5-89a24b369174 tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f" status: 404 len: 109 microversion: 2.1 time: 0.075445 Jul 02 21:21:18.500167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2168/4304] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:21:18 2022] DELETE /compute/v2.1/os-volumes/3805c2d4-2ea0-48eb-bf33-ca8e07c9d22f => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:21:18.511989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4f64768-46bb-4929-9980-2823b0f3fb0a tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Calling method '.version_select at 0x7fabe42ad310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.514212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.520220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.521163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.524583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.571459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b4f64768-46bb-4929-9980-2823b0f3fb0a tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] HTTP exception thrown: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4f64768-46bb-4929-9980-2823b0f3fb0a tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Request method failure captured: Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/os-volumes/a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 HTTP/1.1 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbLOo8v2BAfpjbWamKkr0h3jO6I8AqHW8DYj5NO47DmBoGcpAxzBR7vWZ26dwniNxtnAnyNDJHm4n7rSWth53eyVZLwpy_ezW_inlAz1Pi0ROG1SOd6vkUGpwVl7vhlBA5rOdwlbUPzwOtehdq1K58f5CqgkhEOaQZO9AWmOgfZrH4 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_25bbd43e7dcd4d58a70eaedd73280f2d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/25bbd43e7dcd4d58a70eaedd73280f2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/25bbd43e7dcd4d58a70eaedd73280f2d"}]}] Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 25bbd43e7dcd4d58a70eaedd73280f2d Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesNegativeTest-553222984 Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 658cca224eff470b9670fe04d4c7d5dd Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesNegativeTest-553222984-project Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: exception: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a9978bf2-f2fe-40f8-9af9-af6971f9a2b1'} Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. (HTTP 404) (Request-ID: req-77c34632-bf7e-452e-a3b1-60f6610dd303) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 02 21:21:18.574602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4f64768-46bb-4929-9980-2823b0f3fb0a tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] Returning 404 to user: Volume a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4f64768-46bb-4929-9980-2823b0f3fb0a tempest-VolumesNegativeTest-553222984 tempest-VolumesNegativeTest-553222984-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a9978bf2-f2fe-40f8-9af9-af6971f9a2b1" status: 404 len: 109 microversion: 2.1 time: 0.070547 Jul 02 21:21:18.578742 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2169/4305] 10.222.0.43 () {58 vars in 1244 bytes} [Sat Jul 2 21:21:18 2022] GET /compute/v2.1/os-volumes/a9978bf2-f2fe-40f8-9af9-af6971f9a2b1 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:18.665009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:18.666427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:18.685623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.687060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.689610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.690289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.792383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:18.792855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:18.793321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lazy-loading 'fault' on Instance uuid ca136582-61db-4de1-9a8b-d60b41641f6a {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:21:18.897806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2016769bf3a34d22992b45f9974b99a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7534889ba5b48338c27c0556be3c6f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:18.908626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-caa26970-be2c-417f-a082-dd16c336751b tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 200 len: 1309 microversion: 2.1 time: 0.247004 Jul 02 21:21:18.911041 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2170/4306] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:18 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 1309 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:19.110289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:19.110911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:19.123309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.123771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.124601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.125036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.296732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:19.314257 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0ef74fb-9977-45f7-92d6-d60fc934f5be tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 0.830633 Jul 02 21:21:19.318402 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2137/4307] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:18 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:19.336508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:19.338447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:19.352433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.355015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.358801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.359434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.495766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:19.510001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:19.513310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:19.517326 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38249aa8-8041-4db7-a058-9d413555e1bb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1261 microversion: 2.21 time: 0.197858 Jul 02 21:21:19.519508 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2138/4308] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:19 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1261 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:19.525612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:19.526446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:19.534961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.535421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.536249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.536716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.543303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:19.553681 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12897566-5ec1-44c5-adbb-615152489113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1486 microversion: 2.1 time: 0.447238 Jul 02 21:21:19.554299 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2171/4309] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:19 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1486 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:19.577274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:19.578180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:19.584571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:19.586338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.586973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.587745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.588316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.718071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2aa13408-f29e-4b7f-b413-90113f994637 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b/action" status: 202 len: 0 microversion: 2.1 time: 0.147653 Jul 02 21:21:19.738464 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2172/4310] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:21:19 2022] POST /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:21:19.753122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:19.754223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:19.763944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.765928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.766752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.767196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.920085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:19.935661 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-81ac978a-9ae7-460a-bd58-67cbeab6e7c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.414659 Jul 02 21:21:19.936914 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2139/4311] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:19 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:19.945257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:19.946405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] [instance: ca136582-61db-4de1-9a8b-d60b41641f6a] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:19.980360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.981064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:19.982242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:19.983031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:20.002482 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] HTTP exception thrown: Instance ca136582-61db-4de1-9a8b-d60b41641f6a could not be found. Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Request method failure captured: Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a HTTP/1.1 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLX2zSoWjuf76ybRNsqVLLUwkModkAOgohyZpqanDi3pIhzUi3yFkIiiMADs5tzxdPn_IEim9oc9I_dLNOxARbXHQcAp4I-dSNEHJLJ3ld03uFkxzt2HqtdBnMZh5i4otZqAaBp4udjlGTitYsc5LyBlKcOKQh55q1wLj89NHxEOnr8 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c7534889ba5b48338c27c0556be3c6f0 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1740353321 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c7534889ba5b48338c27c0556be3c6f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c7534889ba5b48338c27c0556be3c6f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c7534889ba5b48338c27c0556be3c6f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c7534889ba5b48338c27c0556be3c6f0"}]}] Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-VolumesSnapshotTestJSON-1740353321 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c7534889ba5b48338c27c0556be3c6f0 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1740353321 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-VolumesSnapshotTestJSON-1740353321-project Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 2016769bf3a34d22992b45f9974b99a2 Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-VolumesSnapshotTestJSON-1740353321-project Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance ca136582-61db-4de1-9a8b-d60b41641f6a could not be found. Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'ca136582-61db-4de1-9a8b-d60b41641f6a'} Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca136582-61db-4de1-9a8b-d60b41641f6a could not be found. Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca136582-61db-4de1-9a8b-d60b41641f6a could not be found. Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:20.004955 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca136582-61db-4de1-9a8b-d60b41641f6a could not be found. Jul 02 21:21:20.008927 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:20.011026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] Returning 404 to user: Instance ca136582-61db-4de1-9a8b-d60b41641f6a could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:20.012097 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-84bb8009-20c5-45f7-b8e0-98d8e7847d5d tempest-VolumesSnapshotTestJSON-1740353321 tempest-VolumesSnapshotTestJSON-1740353321-project] 10.222.0.43 "GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a" status: 404 len: 111 microversion: 2.1 time: 0.072906 Jul 02 21:21:20.013821 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2140/4312] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:19 2022] GET /compute/v2.1/servers/ca136582-61db-4de1-9a8b-d60b41641f6a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:20.064159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:20.073845 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4be7077c-ea30-42c2-ae37-6503ec98636f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1491 microversion: 2.1 time: 0.332368 Jul 02 21:21:20.128603 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2173/4313] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:19 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1491 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:20.333175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:20.333824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:20.344802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:20.345382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:20.346269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:20.352973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:20.526324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4350ed28-7430-4331-bc48-6313fc1e6fd9 req-e1cb7473-2a25-4e1c-bbc3-b08fc044ad86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7695c9ea-dedd-41a5-bbd1-1b9027f019ad", "name": "network-vif-plugged", "status": "completed", "tag": "e0a9e6df-73b9-43ae-9f31-6212c2d7755a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:20.554739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4350ed28-7430-4331-bc48-6313fc1e6fd9 req-e1cb7473-2a25-4e1c-bbc3-b08fc044ad86 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:20.555181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4350ed28-7430-4331-bc48-6313fc1e6fd9 req-e1cb7473-2a25-4e1c-bbc3-b08fc044ad86 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:20.596833 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4350ed28-7430-4331-bc48-6313fc1e6fd9 req-e1cb7473-2a25-4e1c-bbc3-b08fc044ad86 service nova] Creating event network-vif-plugged:e0a9e6df-73b9-43ae-9f31-6212c2d7755a for instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad on nch2-master-1 Jul 02 21:21:20.611206 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4350ed28-7430-4331-bc48-6313fc1e6fd9 req-e1cb7473-2a25-4e1c-bbc3-b08fc044ad86 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092759 Jul 02 21:21:20.613479 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2174/4314] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:20.619141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:20.627273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:20.640911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:20.643650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:20.644634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:20.645491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:21.131373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:21.145999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:21.151617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:21.156334 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-361622eb-4b05-471c-ac0c-ba376be8ba09 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1315 microversion: 2.21 time: 0.541438 Jul 02 21:21:21.157708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2175/4315] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:20 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:21.173440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:21.181470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:21.194236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:21.194687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:21.195467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:21.195905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:21.393460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:21.402037 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ad23a9e-7a15-4a9e-bf95-60962583f119 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1362 microversion: 2.1 time: 1.074424 Jul 02 21:21:21.412772 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2141/4316] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:20 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1362 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:21.418599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:21.419428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:21.427600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:21.428361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:21.429338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:21.429995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:21.641595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:21.653056 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c3f5e5c-37fa-45c6-b8e7-0b2e82d5578a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.491578 Jul 02 21:21:21.655268 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2176/4317] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:21 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:21.850689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:21.858654 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-662703b8-26f7-4d0f-89d1-5dfc0f70b6c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 200 len: 1471 microversion: 2.1 time: 0.444321 Jul 02 21:21:21.859246 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2142/4318] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:21 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 1471 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:21.877274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1604302415"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:21.878697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:21.885675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:21.886582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:21.887707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:21.888175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.184849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:22.185634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:22.218030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.219579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.226588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.228959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.343352 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83beafa9-6afe-404b-9cb1-e8f542d9fa5e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b/action" status: 202 len: 0 microversion: 2.1 time: 0.468719 Jul 02 21:21:22.346404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2177/4319] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:21:21 2022] POST /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:21:22.357494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-787ba60f-55cb-4aea-bde9-804536c69f72 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe4075dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:22.458686 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-787ba60f-55cb-4aea-bde9-804536c69f72 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.105483 Jul 02 21:21:22.459585 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2178/4320] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:22 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:22.469929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:22.479508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:22.490813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.491362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.492355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.493012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.512345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:22.528335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:22.533187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:22.537803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f51577f-0a42-433d-91fb-242408c907ac tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1315 microversion: 2.21 time: 0.360072 Jul 02 21:21:22.553968 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2143/4321] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:22 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:22.674717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:22.675487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:22.686625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.687439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.688736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.689368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.907542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:22.917059 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a89044e9-63bf-47a8-a848-de767ef727bd tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1549 microversion: 2.1 time: 0.452537 Jul 02 21:21:22.917961 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2179/4322] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:22 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1549 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:22.937780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:22.938701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:22.947115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.947959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.949026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:22.949679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:22.982609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:22.995101 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c47da868-99a0-4742-b812-580ace8b0577 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.325486 Jul 02 21:21:22.996580 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2144/4323] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:22 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:23.184801 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-505cbf0d-9fa4-413a-9d80-fd9e00d75289 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.253017 Jul 02 21:21:23.185600 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2180/4324] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:21:22 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad/os-interface => generated 285 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:23.474091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1860766b-4e8f-4017-9a4e-3d6b8008d9e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe45fab80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:23.547555 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1860766b-4e8f-4017-9a4e-3d6b8008d9e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.077863 Jul 02 21:21:23.549333 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2145/4325] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:23 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:23.561961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:23.562673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:23.571443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:23.572166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:23.573403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:23.574059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:24.013787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:24.015576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:24.023732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:24.024521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:24.027119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:24.027119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:24.134173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:24.151849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:24.153693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:24.155074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8390f6c0-2d47-433e-853f-130dec11f25a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.597322 Jul 02 21:21:24.156328 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2181/4326] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:23 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:24.559896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:24.564856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fc9a735-4a22-487d-b425-173408934d9e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe48d1700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:24.572762 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-61b58002-dd55-451b-a0e7-fdbcebcfe13d tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.563086 Jul 02 21:21:24.573723 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2146/4327] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:24 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:24.658905 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fc9a735-4a22-487d-b425-173408934d9e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.099589 Jul 02 21:21:24.660073 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2182/4328] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:24 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:25.176686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:25.177540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:25.189663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:25.190109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:25.191198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:25.191998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:25.595631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:25.597286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:25.633134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:25.633615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:25.639439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:25.644478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:25.744516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:25.759073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:25.763402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:25.764712 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4afac0aa-fd8c-4fac-9b88-8e97e5406e33 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.593420 Jul 02 21:21:25.768397 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2147/4329] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:25 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:25.779231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fe30ef6-1ba7-48e2-afb2-94172444dc6d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea12f040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:25.851807 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2fe30ef6-1ba7-48e2-afb2-94172444dc6d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.080592 Jul 02 21:21:25.857887 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2148/4330] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:25 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:26.421505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-36ad2a51-f83a-44e6-bad1-7a79862fc38d req-8fc04d65-b234-422e-bdfb-97a79333ec2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8501a710-70c6-4043-9f66-97a7d95f30f1", "tag": "be56cc15-bb5b-4125-8e27-f03292a24baf"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:26.439797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-36ad2a51-f83a-44e6-bad1-7a79862fc38d req-8fc04d65-b234-422e-bdfb-97a79333ec2d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:26.440643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-36ad2a51-f83a-44e6-bad1-7a79862fc38d req-8fc04d65-b234-422e-bdfb-97a79333ec2d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:26.468916 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-36ad2a51-f83a-44e6-bad1-7a79862fc38d req-8fc04d65-b234-422e-bdfb-97a79333ec2d service nova] Creating event network-changed:be56cc15-bb5b-4125-8e27-f03292a24baf for instance 8501a710-70c6-4043-9f66-97a7d95f30f1 on nch1-master-1 Jul 02 21:21:26.477993 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-36ad2a51-f83a-44e6-bad1-7a79862fc38d req-8fc04d65-b234-422e-bdfb-97a79333ec2d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060979 Jul 02 21:21:26.479262 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2149/4331] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:26.527131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:26.537640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37a01572-238e-4560-b8b9-061cecf3cd47 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1511 microversion: 2.1 time: 0.950381 Jul 02 21:21:26.545374 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2183/4332] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:25 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1511 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:26.788648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:26.789358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:26.796303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:26.796750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:26.799613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:26.799613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:26.866144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47b4364b-3ff6-41b1-817f-71aa0e65c7e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe42ad0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:26.923218 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47b4364b-3ff6-41b1-817f-71aa0e65c7e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.061264 Jul 02 21:21:26.923936 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2184/4333] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:26 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:27.423813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:27.441500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:27.447466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:27.451576 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-52b87d90-89f5-42ad-bdf9-f9cf78675ab1 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.667681 Jul 02 21:21:27.453905 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2150/4334] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:26 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:27.557199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:27.558193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:27.597252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:27.602805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:27.603726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:27.604207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:27.611700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:27.936653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dc9e79a0-5200-4b8c-bd0d-fdf02a322c39 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76ea280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:27.947737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:27.948584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:28.015167 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dc9e79a0-5200-4b8c-bd0d-fdf02a322c39 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.082330 Jul 02 21:21:28.015764 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2151/4335] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:27 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:28.277504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:28.279904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:28.297678 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ca10262-d2cf-482b-9e32-4548db598871 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1488 microversion: 2.1 time: 0.745431 Jul 02 21:21:28.298297 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2185/4336] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:27 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1488 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:28.317582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-224644021"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:28.318844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:28.337002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:28.337625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:28.338611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:28.339183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:28.397635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:28.464794 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-df758be6-6745-4d9b-bc91-0b0538020680 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "PUT /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1060 microversion: 2.1 time: 0.151814 Jul 02 21:21:28.471181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:28.471803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:28.477142 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2152/4337] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:21:28 2022] PUT /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1060 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:28.481532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:28.483576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:28.484579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:28.485170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:28.495911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:28.501666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:28.517646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:28.518328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:28.519288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:28.520666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.029339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:29.043085 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14f2c923-1a6f-43f1-989b-ece4f6f4eda4 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1487 microversion: 2.1 time: 0.556988 Jul 02 21:21:29.044275 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2153/4338] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:28 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1487 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:29.056235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ebda5cb5-e023-4489-9440-6e5ebe078bff req-6ca8d097-71a5-43b3-836b-faa37b2fe700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7695c9ea-dedd-41a5-bbd1-1b9027f019ad", "tag": "e0a9e6df-73b9-43ae-9f31-6212c2d7755a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:29.059144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:29.072724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:29.072956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ebda5cb5-e023-4489-9440-6e5ebe078bff req-6ca8d097-71a5-43b3-836b-faa37b2fe700 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.073437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ebda5cb5-e023-4489-9440-6e5ebe078bff req-6ca8d097-71a5-43b3-836b-faa37b2fe700 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.075118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:29.077580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ea02ccd-4751-48ee-a07c-24a27b7aecfb tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.611058 Jul 02 21:21:29.078592 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2186/4339] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:28 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:21:29.101753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-81ce33fd-bd2f-40ef-b9bc-5546950f8ec9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd799dd30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:29.112573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ebda5cb5-e023-4489-9440-6e5ebe078bff req-6ca8d097-71a5-43b3-836b-faa37b2fe700 service nova] Creating event network-changed:e0a9e6df-73b9-43ae-9f31-6212c2d7755a for instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad on nch2-master-1 Jul 02 21:21:29.124026 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ebda5cb5-e023-4489-9440-6e5ebe078bff req-6ca8d097-71a5-43b3-836b-faa37b2fe700 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076877 Jul 02 21:21:29.124880 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2154/4340] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:29.134844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:29.136659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:29.155123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.156522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.157693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.158472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.195285 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-81ce33fd-bd2f-40ef-b9bc-5546950f8ec9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.114119 Jul 02 21:21:29.196181 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2187/4341] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:29 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:29.402506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:29.418116 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9475c04f-3132-48c3-a906-06bcb01fc822 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1487 microversion: 2.1 time: 0.291847 Jul 02 21:21:29.419059 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2155/4342] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:29 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1487 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:29.436710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:29.438288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:29.450457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.453147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.454573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.456153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.474125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-da0a93a5-7947-4780-b238-89e011533c05 req-d20a5454-fc71-43d9-bc6e-0815b3ef215c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db16f871-de37-42d1-8bba-2920d24d495b", "name": "network-vif-plugged", "status": "completed", "tag": "86165fa0-ccc3-4def-81a9-2fb64b4d43da"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:29.481090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:29.488972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-da0a93a5-7947-4780-b238-89e011533c05 req-d20a5454-fc71-43d9-bc6e-0815b3ef215c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.489472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-da0a93a5-7947-4780-b238-89e011533c05 req-d20a5454-fc71-43d9-bc6e-0815b3ef215c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.508556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-da0a93a5-7947-4780-b238-89e011533c05 req-d20a5454-fc71-43d9-bc6e-0815b3ef215c service nova] Creating event network-vif-plugged:86165fa0-ccc3-4def-81a9-2fb64b4d43da for instance db16f871-de37-42d1-8bba-2920d24d495b on nch1-master-1 Jul 02 21:21:29.510295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:21:29.519921 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-da0a93a5-7947-4780-b238-89e011533c05 req-d20a5454-fc71-43d9-bc6e-0815b3ef215c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053143 Jul 02 21:21:29.522003 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2156/4343] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:29.644767 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1232ae13-8fc4-4cfe-96de-9aac1a1a3436 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 204 len: 0 microversion: 2.1 time: 0.213287 Jul 02 21:21:29.646031 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2188/4344] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:29 2022] DELETE /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:21:29.654933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:29.655647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:29.671573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.672287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.673244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:29.673912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:29.849442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:29.864148 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3018b038-90d1-4e63-9c40-188012cc390e tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1493 microversion: 2.1 time: 0.213180 Jul 02 21:21:29.865503 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2157/4345] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:29 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1493 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:30.101332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:30.102239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:30.118363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:30.119080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:30.120307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:30.120916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:30.210899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5e7999c-089e-4318-9dc3-3655563d4ad5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea1875e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:30.278449 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5e7999c-089e-4318-9dc3-3655563d4ad5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.071497 Jul 02 21:21:30.284554 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2158/4346] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:30 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:30.580867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:30.589287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:30.591009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:30.592364 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a917aa39-68f5-40e7-82e8-6fc36d5b0d67 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.495598 Jul 02 21:21:30.602827 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2189/4347] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:30 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:30.888516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:30.889415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:30.901544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:30.902003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:30.902802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:30.903243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:31.295225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a99b8aa4-df69-4463-92c3-4038f65795d3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd785ef70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:31.382070 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a99b8aa4-df69-4463-92c3-4038f65795d3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.091820 Jul 02 21:21:31.384353 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2190/4348] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:31 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:31.416851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:31.428667 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4fa04be8-87a7-4df4-878f-a35767fff946 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1493 microversion: 2.1 time: 0.550183 Jul 02 21:21:31.431843 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2159/4349] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:30 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1493 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:31.616728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:31.617944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:31.632459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:31.633922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:31.636248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:31.637515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:32.237149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:32.260470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:32.261962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:32.263094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd31536c-bcf1-4a7e-a156-3a6835d1e587 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.655769 Jul 02 21:21:32.264828 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2191/4350] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:31 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:32.396593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3cc32ef-f45c-465a-8a94-389828d99792 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe495a3a0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:32.449899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:32.450782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:32.474419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:32.476541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:32.477797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:32.480734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:32.501705 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3cc32ef-f45c-465a-8a94-389828d99792 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.109755 Jul 02 21:21:32.507752 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2160/4351] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:32 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:32.840449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bb39a79e-8e69-47e0-b6d8-be85f4260e48 req-48cb7b69-eb4b-4174-953f-c7a295bc9f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "768d4e27-39af-4c7a-a421-edddbe8337d6", "name": "network-vif-deleted", "tag": "11acd4a4-200a-422a-98d8-22890491e672"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:32.848290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:32.871118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bb39a79e-8e69-47e0-b6d8-be85f4260e48 req-48cb7b69-eb4b-4174-953f-c7a295bc9f48 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:32.873984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bb39a79e-8e69-47e0-b6d8-be85f4260e48 req-48cb7b69-eb4b-4174-953f-c7a295bc9f48 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:32.893536 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0325daa-f051-4ba2-81b5-3453ed9031fe tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 200 len: 1451 microversion: 2.1 time: 0.445542 Jul 02 21:21:32.897968 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2192/4352] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:32 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 1451 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:32.934183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bb39a79e-8e69-47e0-b6d8-be85f4260e48 req-48cb7b69-eb4b-4174-953f-c7a295bc9f48 service nova] Creating event network-vif-deleted:11acd4a4-200a-422a-98d8-22890491e672 for instance 768d4e27-39af-4c7a-a421-edddbe8337d6 on nch2-master-1 Jul 02 21:21:32.964287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bb39a79e-8e69-47e0-b6d8-be85f4260e48 req-48cb7b69-eb4b-4174-953f-c7a295bc9f48 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127970 Jul 02 21:21:32.966425 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2161/4353] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:33.283891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:33.285176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:33.305984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:33.307557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:33.310022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:33.311221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:33.516219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e6347b88-3ecb-42a2-8416-d78eead9253e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea15b310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:33.624779 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e6347b88-3ecb-42a2-8416-d78eead9253e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.113310 Jul 02 21:21:33.625998 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2162/4354] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:33 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:33.680662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:33.693320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:33.699977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:33.702263 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f4951d2-08ea-4db6-887d-406334f0284b tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.423982 Jul 02 21:21:33.703454 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2193/4355] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:33 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:33.912380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:33.913756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:33.931887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:33.932771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:33.938445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:33.940847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:33.973785 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 HTTP/1.1 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '768d4e27-39af-4c7a-a421-edddbe8337d6'} Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:33.975523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:33.980146 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-23fbe0c0-1764-4aef-b9d7-f4c21df2729a tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 404 len: 111 microversion: 2.1 time: 0.070185 Jul 02 21:21:33.995534 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2163/4356] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:33 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:33.999297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.000140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.011719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.013860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.016596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.017073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.069647 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 HTTP/1.1 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '768d4e27-39af-4c7a-a421-edddbe8337d6'} Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.071938 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.076001 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.081904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.083105 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c2df6ec-a5d7-4f46-a01f-7e43215c7fb3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 404 len: 111 microversion: 2.1 time: 0.090189 Jul 02 21:21:34.092877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.093858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 768d4e27-39af-4c7a-a421-edddbe8337d6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.103467 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2194/4357] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:33 2022] DELETE /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:21:34.107229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.108379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.109219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.109884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.132702 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 HTTP/1.1 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '768d4e27-39af-4c7a-a421-edddbe8337d6'} Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.136298 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.140327 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.140327 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.140327 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.140327 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.140327 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. Jul 02 21:21:34.140327 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.142432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 768d4e27-39af-4c7a-a421-edddbe8337d6 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.143977 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc835ac7-d938-4f55-b0ec-36b3ba3fb1a3 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6" status: 404 len: 111 microversion: 2.1 time: 0.055532 Jul 02 21:21:34.153216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.154830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.161761 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2164/4358] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/768d4e27-39af-4c7a-a421-edddbe8337d6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.166551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.167318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.168419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.171049 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.203720 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 HTTP/1.1 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'bce5ff0b-22b8-42f6-b04a-ea5dabab16e6'} Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.205804 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.209664 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.212291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.213282 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4a255ec-fd40-4889-9c79-9b5d66f7c748 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 404 len: 111 microversion: 2.1 time: 0.064073 Jul 02 21:21:34.220436 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2195/4359] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:34 2022] DELETE /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.227520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.228538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: bce5ff0b-22b8-42f6-b04a-ea5dabab16e6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.238892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.239555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.241462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.243005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.281771 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 HTTP/1.1 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'bce5ff0b-22b8-42f6-b04a-ea5dabab16e6'} Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.283730 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9aaa6bd3-5376-41f8-9f3b-c8d8ac4ffe5f tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6" status: 404 len: 111 microversion: 2.1 time: 0.062692 Jul 02 21:21:34.292199 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2165/4360] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/bce5ff0b-22b8-42f6-b04a-ea5dabab16e6 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.300740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.300740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.355801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.358053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.362043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.362554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.427852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 HTTP/1.1 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641'} Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.429469 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fbeed82a-f864-4bcd-8aad-9500a3fa5aee tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 404 len: 111 microversion: 2.1 time: 0.140225 Jul 02 21:21:34.433954 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2196/4361] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:34 2022] DELETE /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.444413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.445117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.463558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.464082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.464880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.468229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.506059 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 HTTP/1.1 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641'} Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.507902 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.512592 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0903ddbb-3b0b-4e62-9aa7-534e57595741 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641" status: 404 len: 111 microversion: 2.1 time: 0.073461 Jul 02 21:21:34.513181 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2166/4362] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/9ba52b53-49d4-4e96-b6a3-e6b7cc9d8641 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.520898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.521653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.540262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.542846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.546892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.547379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.589738 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf HTTP/1.1 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '30e7d3e8-1524-46a1-9d29-c70323e380bf'} Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.596706 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.600872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.607645 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a6c8dad-a369-41db-8b4c-f3c09cb2c688 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 404 len: 111 microversion: 2.1 time: 0.082587 Jul 02 21:21:34.611309 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2197/4363] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:34 2022] DELETE /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.619834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.620506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 30e7d3e8-1524-46a1-9d29-c70323e380bf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.634533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.635206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.637179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.639685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5ff1576-b69c-4471-a276-af06e71b692a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd799d940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.640117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.694045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf HTTP/1.1 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '30e7d3e8-1524-46a1-9d29-c70323e380bf'} Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.701520 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 30e7d3e8-1524-46a1-9d29-c70323e380bf could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.706285 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b47a426c-3d79-4842-983c-c2415fa509a2 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf" status: 404 len: 111 microversion: 2.1 time: 0.087648 Jul 02 21:21:34.710666 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2167/4364] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/30e7d3e8-1524-46a1-9d29-c70323e380bf => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.722642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.723163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.740410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.740879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.741669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.742316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.754751 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5ff1576-b69c-4471-a276-af06e71b692a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.116812 Jul 02 21:21:34.763068 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2198/4365] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:34.773248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.779230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.781733 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf HTTP/1.1 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '58f35c43-b533-4afb-b402-2055a3f75cdf'} Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.788364 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.793547 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.794917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.794917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.794917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.794917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.796850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.799054 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-37989524-d9d5-41b2-b9e7-7cd5b54255e0 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 404 len: 111 microversion: 2.1 time: 0.087341 Jul 02 21:21:34.811992 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2168/4366] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:34 2022] DELETE /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.817447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.818152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 58f35c43-b533-4afb-b402-2055a3f75cdf] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.838103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.838423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.839395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.840073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.857417 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf HTTP/1.1 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '58f35c43-b533-4afb-b402-2055a3f75cdf'} Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.859977 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.864852 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.864852 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.864852 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.864852 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.864852 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. Jul 02 21:21:34.864852 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.865764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 58f35c43-b533-4afb-b402-2055a3f75cdf could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.866659 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb0f9158-a80d-47ac-930b-c2cf9436f152 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf" status: 404 len: 111 microversion: 2.1 time: 0.053281 Jul 02 21:21:34.867290 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2169/4367] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/58f35c43-b533-4afb-b402-2055a3f75cdf => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.887165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.887701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.895893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.896378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.897381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.897987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.919394 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 HTTP/1.1 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '5be14be9-4dc3-4992-8853-cf7bb88302a4'} Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.921943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.927951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.930582 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a8b6381c-1ab2-4d63-994f-20af1a0293cb tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 404 len: 111 microversion: 2.1 time: 0.046868 Jul 02 21:21:34.931827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2170/4368] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:34 2022] DELETE /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:34.949347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:34.952442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 5be14be9-4dc3-4992-8853-cf7bb88302a4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:34.960424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.961246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.962852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:34.963497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:34.979878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 HTTP/1.1 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '5be14be9-4dc3-4992-8853-cf7bb88302a4'} Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.982613 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:34.986555 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:34.986555 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:34.986555 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:34.986555 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:34.986555 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. Jul 02 21:21:34.986555 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:34.988480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 5be14be9-4dc3-4992-8853-cf7bb88302a4 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:34.989566 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4e663e8-e70c-4c55-8a47-19ff21e08395 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4" status: 404 len: 111 microversion: 2.1 time: 0.050809 Jul 02 21:21:34.990595 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2171/4369] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/5be14be9-4dc3-4992-8853-cf7bb88302a4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:35.006868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05aa11c9-6343-4546-b39f-4b8844a519f1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:35.007496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-05aa11c9-6343-4546-b39f-4b8844a519f1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: d9c9e71a-cc20-46ab-9ad6-b9f56ec98901] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:35.021271 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-05aa11c9-6343-4546-b39f-4b8844a519f1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05aa11c9-6343-4546-b39f-4b8844a519f1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 HTTP/1.1 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd9c9e71a-cc20-46ab-9ad6-b9f56ec98901'} Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:35.022849 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05aa11c9-6343-4546-b39f-4b8844a519f1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:35.027734 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-05aa11c9-6343-4546-b39f-4b8844a519f1 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901" status: 404 len: 111 microversion: 2.1 time: 0.028179 Jul 02 21:21:35.033817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2172/4370] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:34 2022] DELETE /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:35.039566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55c3aebf-a6d4-4e71-88e9-bf0315dda5c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:35.040436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55c3aebf-a6d4-4e71-88e9-bf0315dda5c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: d9c9e71a-cc20-46ab-9ad6-b9f56ec98901] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:35.049145 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-55c3aebf-a6d4-4e71-88e9-bf0315dda5c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55c3aebf-a6d4-4e71-88e9-bf0315dda5c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 HTTP/1.1 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd9c9e71a-cc20-46ab-9ad6-b9f56ec98901'} Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:35.051042 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:35.055013 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:35.055013 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:35.055013 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. Jul 02 21:21:35.055013 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:35.056977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55c3aebf-a6d4-4e71-88e9-bf0315dda5c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:35.058195 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55c3aebf-a6d4-4e71-88e9-bf0315dda5c5 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901" status: 404 len: 111 microversion: 2.1 time: 0.023236 Jul 02 21:21:35.059385 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2173/4371] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:35 2022] GET /compute/v2.1/servers/d9c9e71a-cc20-46ab-9ad6-b9f56ec98901 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:21:35.070010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:35.071004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:35.085265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:35.086129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:35.088007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:35.089197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:35.139005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:21:35.258732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:35.282561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:35.287397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:35.291730 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02d9e785-10f6-469d-8a28-dd22942f298f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.527045 Jul 02 21:21:35.300248 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2199/4372] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:34 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:35.340703 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9bd96df6-4d5b-4720-9d73-ad3e24eb4a8b tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "DELETE /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 204 len: 0 microversion: 2.1 time: 0.274276 Jul 02 21:21:35.341330 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2174/4373] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:35 2022] DELETE /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:21:35.355703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:35.356846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:35.372409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:35.374155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:35.377754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:35.383757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:35.626174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5519c7c1-f929-476a-8a53-9f6b28177582 req-5ed08a9e-3782-420a-a5f5-4bacc8095b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8501a710-70c6-4043-9f66-97a7d95f30f1", "name": "network-vif-plugged", "status": "completed", "tag": "be56cc15-bb5b-4125-8e27-f03292a24baf"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:35.641464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5519c7c1-f929-476a-8a53-9f6b28177582 req-5ed08a9e-3782-420a-a5f5-4bacc8095b52 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:35.642064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5519c7c1-f929-476a-8a53-9f6b28177582 req-5ed08a9e-3782-420a-a5f5-4bacc8095b52 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:35.672755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5519c7c1-f929-476a-8a53-9f6b28177582 req-5ed08a9e-3782-420a-a5f5-4bacc8095b52 service nova] Creating event network-vif-plugged:be56cc15-bb5b-4125-8e27-f03292a24baf for instance 8501a710-70c6-4043-9f66-97a7d95f30f1 on nch1-master-1 Jul 02 21:21:35.673345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:35.681153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5519c7c1-f929-476a-8a53-9f6b28177582 req-5ed08a9e-3782-420a-a5f5-4bacc8095b52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059299 Jul 02 21:21:35.684106 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2175/4374] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:35.686553 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c081781d-8fe3-404d-b7cb-191a9afb8001 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1480 microversion: 2.1 time: 0.340465 Jul 02 21:21:35.690121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2200/4375] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:35 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1480 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:35.769308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a564186-4971-47b5-a8a2-625f7cebd434 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea2c1ee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:35.889386 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a564186-4971-47b5-a8a2-625f7cebd434 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.125323 Jul 02 21:21:35.897562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2176/4376] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:35 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:36.316354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:36.319022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:36.332590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:36.333425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:36.334927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:36.335773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:36.707804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:36.708643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:36.722511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:36.722990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:36.723792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:36.726836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:36.735597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:36.748101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:36.751286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:36.754063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65079376-6c57-495e-b954-ece4077f1d38 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.444993 Jul 02 21:21:36.757518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2201/4377] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:36 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:36.904008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16feabd7-3dff-430e-8211-8cd3e4dadfab tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd785e820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:36.958600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16feabd7-3dff-430e-8211-8cd3e4dadfab tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.058265 Jul 02 21:21:36.967197 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2202/4378] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:36 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:37.281136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:37.310374 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-960dbff1-c4e5-4f6b-8eaf-be4ce2cb50ef tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1480 microversion: 2.1 time: 0.608919 Jul 02 21:21:37.323874 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2177/4379] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:36 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1480 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:37.778324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:37.780961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:37.798782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:37.801657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:37.802822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:37.808590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:37.976917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a704f9d3-bb7c-4dda-a7bd-05423997ede3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea327a60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:38.060263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a704f9d3-bb7c-4dda-a7bd-05423997ede3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.088878 Jul 02 21:21:38.061245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2178/4380] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:37 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:38.192498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:38.202308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:38.204812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:38.206582 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2b092ca-02a6-48d0-86b8-087224cfda5e tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1357 microversion: 2.21 time: 0.435346 Jul 02 21:21:38.207832 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2203/4381] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:37 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1357 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:21:38.330552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:38.332022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:38.344774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:38.345570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:38.346589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:38.347721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:38.683354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fb30983c-abab-4d1e-a1ae-d331cf45db3b req-c33c8c97-76de-4e04-b2fd-89c29b44650d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85341d1d-7094-41ea-b6f6-f637d68a8169", "name": "network-vif-deleted", "tag": "cb165b8f-70c3-4ab9-a06e-d7eb8b0bf496"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:38.699561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fb30983c-abab-4d1e-a1ae-d331cf45db3b req-c33c8c97-76de-4e04-b2fd-89c29b44650d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:38.699992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fb30983c-abab-4d1e-a1ae-d331cf45db3b req-c33c8c97-76de-4e04-b2fd-89c29b44650d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:38.715803 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fb30983c-abab-4d1e-a1ae-d331cf45db3b req-c33c8c97-76de-4e04-b2fd-89c29b44650d service nova] Creating event network-vif-deleted:cb165b8f-70c3-4ab9-a06e-d7eb8b0bf496 for instance 85341d1d-7094-41ea-b6f6-f637d68a8169 on nch1-master-1 Jul 02 21:21:38.722361 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fb30983c-abab-4d1e-a1ae-d331cf45db3b req-c33c8c97-76de-4e04-b2fd-89c29b44650d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043641 Jul 02 21:21:38.723524 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2204/4382] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:38.738840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4572a43d0b7e465eabd506fb52a502ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f989b228325c4640957dcfe068f652d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:38.751072 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c776d20-fb2d-4ec5-b129-61df80626bed tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 200 len: 1480 microversion: 2.1 time: 0.424248 Jul 02 21:21:38.762758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2179/4383] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:38 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 1480 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:39.076517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aaa457d9-92ae-4fb4-b911-236699a4d51c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd79a3e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:39.153811 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aaa457d9-92ae-4fb4-b911-236699a4d51c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.083345 Jul 02 21:21:39.161776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2205/4384] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:39 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:39.226278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:39.226993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:39.243293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.243871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.246395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.247118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.645091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:39.656646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:39.659260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:39.660691 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b01caed8-ed7f-45d2-bd3a-9d9f0e46233d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1551 microversion: 2.21 time: 0.439582 Jul 02 21:21:39.664094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2180/4385] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:39 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1551 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:39.682660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:39.683452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:39.699774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.700598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.701667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.702384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.741054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:21:39.773319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:39.774005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] [instance: 85341d1d-7094-41ea-b6f6-f637d68a8169] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:39.786272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.786657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.789597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.790057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.824896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] HTTP exception thrown: Instance 85341d1d-7094-41ea-b6f6-f637d68a8169 could not be found. Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Request method failure captured: Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 HTTP/1.1 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLXV8kjok2T4tkX1fYvHc_ZoCDNx998L4DZUYLyXJIiMl-bBZmi8XR1GMUTmpYZecMOSOizvx1LyW1jU3qL-RzJP8aM1UTY6TkZSANdeLYho2rVygb0BcGZcdrgy4gi0EZqIqtAPScYFVygbhpcGM3sGPYUrEJ_SB8l7D93d6z_lw7w Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f989b228325c4640957dcfe068f652d3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f989b228325c4640957dcfe068f652d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f989b228325c4640957dcfe068f652d3"}]}] Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersTestJSON-624688426 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f989b228325c4640957dcfe068f652d3 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersTestJSON-624688426 Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersTestJSON-624688426-project Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4572a43d0b7e465eabd506fb52a502ba Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersTestJSON-624688426-project Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 85341d1d-7094-41ea-b6f6-f637d68a8169 could not be found. Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '85341d1d-7094-41ea-b6f6-f637d68a8169'} Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85341d1d-7094-41ea-b6f6-f637d68a8169 could not be found. Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85341d1d-7094-41ea-b6f6-f637d68a8169 could not be found. Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:39.830817 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:39.835767 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:39.835767 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:39.835767 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:39.835767 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:39.835767 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85341d1d-7094-41ea-b6f6-f637d68a8169 could not be found. Jul 02 21:21:39.835767 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:39.838470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] Returning 404 to user: Instance 85341d1d-7094-41ea-b6f6-f637d68a8169 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:39.840634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d52980e-f786-4faf-a1ed-832d6063ae80 tempest-ServersTestJSON-624688426 tempest-ServersTestJSON-624688426-project] 10.222.0.43 "GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169" status: 404 len: 111 microversion: 2.1 time: 0.072635 Jul 02 21:21:39.842850 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2181/4386] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:39 2022] GET /compute/v2.1/servers/85341d1d-7094-41ea-b6f6-f637d68a8169 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:21:39.844765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:39.925000 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a285766e-2b73-4d0e-9be6-1b6ebc119de0 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 204 len: 0 microversion: 2.21 time: 0.238537 Jul 02 21:21:39.925932 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2206/4387] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:21:39 2022] DELETE /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:21:39.942337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:39.946016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:39.967883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.968619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:39.984033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:39.984972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:40.175023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7dc7d1f-249a-4cd3-b73c-3a1f4e34ad26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe4075dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:40.280925 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7dc7d1f-249a-4cd3-b73c-3a1f4e34ad26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.110530 Jul 02 21:21:40.290570 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2207/4388] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:40 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:40.445470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:40.450979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:40.463770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:40.466059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:40.467504 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1cbd183c-b8c6-4869-9a3b-2aacdd161a4d tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1557 microversion: 2.21 time: 0.532266 Jul 02 21:21:40.468790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2182/4389] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:39 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1557 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:21:41.300859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5735b8e-1f6f-411e-9f76-daf539231942 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd79959d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:41.397349 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5735b8e-1f6f-411e-9f76-daf539231942 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.104475 Jul 02 21:21:41.399819 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2208/4390] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:41 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:41.486087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:41.486823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:41.495178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:41.495695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:41.510722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:41.511462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:41.873555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:41.888366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:41.890213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:41.895531 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-28f7faf3-18bb-49d2-8358-457b33a40b1f tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1557 microversion: 2.21 time: 0.413554 Jul 02 21:21:41.897328 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2183/4391] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:41 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1557 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:42.416383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ae756c1-460e-466e-94cd-a57e1af1be89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd78b00d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:42.497810 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ae756c1-460e-466e-94cd-a57e1af1be89 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.080525 Jul 02 21:21:42.498729 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2209/4392] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:42 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:42.916691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:42.917462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:42.930234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:42.932609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:42.933551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:42.934958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:43.514576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0eb0e9a-8f92-4be1-8dbc-db3b7c73708c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe4744550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:43.641039 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0eb0e9a-8f92-4be1-8dbc-db3b7c73708c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.133674 Jul 02 21:21:43.641957 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2210/4393] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:43 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:44.376505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:44.390705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:44.395146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:44.399951 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc3b8dc5-02ec-4ae0-9858-319755c78b83 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1557 microversion: 2.21 time: 1.488715 Jul 02 21:21:44.401441 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2184/4394] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:42 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1557 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:44.636425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6c0c0d54-77de-4349-917f-fe96ad6fde95 req-1362bf4e-ce65-4cad-909a-0e5df0934ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8501a710-70c6-4043-9f66-97a7d95f30f1", "name": "network-vif-deleted", "tag": "be56cc15-bb5b-4125-8e27-f03292a24baf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:44.656089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e65b11b4-f102-497e-8e86-e8bf77156a2a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76b0820>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:44.664431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6c0c0d54-77de-4349-917f-fe96ad6fde95 req-1362bf4e-ce65-4cad-909a-0e5df0934ddc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:44.673043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6c0c0d54-77de-4349-917f-fe96ad6fde95 req-1362bf4e-ce65-4cad-909a-0e5df0934ddc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:44.698570 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6c0c0d54-77de-4349-917f-fe96ad6fde95 req-1362bf4e-ce65-4cad-909a-0e5df0934ddc service nova] Creating event network-vif-deleted:be56cc15-bb5b-4125-8e27-f03292a24baf for instance 8501a710-70c6-4043-9f66-97a7d95f30f1 on nch1-master-1 Jul 02 21:21:44.705798 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6c0c0d54-77de-4349-917f-fe96ad6fde95 req-1362bf4e-ce65-4cad-909a-0e5df0934ddc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073377 Jul 02 21:21:44.706432 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2211/4395] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:21:44.809943 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e65b11b4-f102-497e-8e86-e8bf77156a2a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.157867 Jul 02 21:21:44.811154 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2185/4396] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:44 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:45.421260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:45.422241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:45.456890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:45.462637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:45.465357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:45.467034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:45.627106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:45.631682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:45.636397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lazy-loading 'fault' on Instance uuid 8501a710-70c6-4043-9f66-97a7d95f30f1 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:21:45.785324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:45.802253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:45.805763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e1b7350d87a14f6dbd97ba52e3ed0a7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e693f5f3d3df486696086ea98714bcbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:21:45.808661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0ccb718-9dbf-424b-b02b-e8a92ca94675 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 200 len: 1347 microversion: 2.21 time: 0.392260 Jul 02 21:21:45.810020 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2212/4397] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:45 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 1347 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:21:45.841659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4387a722-b63f-4a7f-b57d-22278cd89561 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd780e040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:45.965174 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4387a722-b63f-4a7f-b57d-22278cd89561 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.137027 Jul 02 21:21:45.967826 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2186/4398] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:45 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:46.829105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:46.830238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:46.858763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:46.861632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:46.862703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:46.864546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:46.937684 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] HTTP exception thrown: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Request method failure captured: Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 HTTP/1.1 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbKsxs4tvDBoeDCKEiwfASEw0_bUv4noifAO8XuW55mYpEDRz2FHN0fCF3KBlrICJTVwypAmBsp6dha7QDMRKeUOe2xYM3AUmo4KDwxw6rggfqJsF03LN-A-i8_PArYaubDcKIiXdSsURIw1nx78wTGrHsnhpR5ES3jLSEfKNkdMRU Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.21 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: e693f5f3d3df486696086ea98714bcbf Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e693f5f3d3df486696086ea98714bcbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e693f5f3d3df486696086ea98714bcbf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e693f5f3d3df486696086ea98714bcbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e693f5f3d3df486696086ea98714bcbf"}]}] Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: e693f5f3d3df486696086ea98714bcbf Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsV221TestJSON-1384903121-project Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e1b7350d87a14f6dbd97ba52e3ed0a7d Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsV221TestJSON-1384903121-project Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8501a710-70c6-4043-9f66-97a7d95f30f1'} Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:46.939916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:46.943960 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:46.949274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Returning 404 to user: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:46.950522 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ebd7c51-8ce7-4aa1-b464-f7132f799452 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 404 len: 111 microversion: 2.21 time: 0.126672 Jul 02 21:21:46.951601 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2213/4399] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:46 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:21:46.962100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '.version_select at 0x7fabd76b0430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:46.962717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:46.981647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:46.982105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:46.982968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:46.983418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:46.984699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab7f74a7-e38f-4d60-b487-0648164964a6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7995790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:47.100310 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab7f74a7-e38f-4d60-b487-0648164964a6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.123629 Jul 02 21:21:47.111435 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2214/4400] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:46 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:21:47.283899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd0ac034-432a-4b11-b3c6-277163b5102a tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.327321 Jul 02 21:21:47.288675 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2187/4401] 10.222.0.43 () {60 vars in 1336 bytes} [Sat Jul 2 21:21:46 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1/os-instance-actions => generated 611 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:21:47.305098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:47.305723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:47.325687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:47.326270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:47.329294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:47.330477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:47.389005 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] HTTP exception thrown: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Request method failure captured: Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 HTTP/1.1 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLbKsxs4tvDBoeDCKEiwfASEw0_bUv4noifAO8XuW55mYpEDRz2FHN0fCF3KBlrICJTVwypAmBsp6dha7QDMRKeUOe2xYM3AUmo4KDwxw6rggfqJsF03LN-A-i8_PArYaubDcKIiXdSsURIw1nx78wTGrHsnhpR5ES3jLSEfKNkdMRU Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.21 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: e693f5f3d3df486696086ea98714bcbf Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e693f5f3d3df486696086ea98714bcbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e693f5f3d3df486696086ea98714bcbf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e693f5f3d3df486696086ea98714bcbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e693f5f3d3df486696086ea98714bcbf"}]}] Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: e693f5f3d3df486696086ea98714bcbf Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-InstanceActionsV221TestJSON-1384903121-project Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e1b7350d87a14f6dbd97ba52e3ed0a7d Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-InstanceActionsV221TestJSON-1384903121-project Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8501a710-70c6-4043-9f66-97a7d95f30f1'} Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:47.395635 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Returning 404 to user: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33dc28a0-92e9-457b-9449-be723abcc368 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 404 len: 111 microversion: 2.21 time: 0.097454 Jul 02 21:21:47.399996 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2215/4402] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:21:47 2022] DELETE /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:21:47.408414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:47.409142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] [instance: 8501a710-70c6-4043-9f66-97a7d95f30f1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:47.432381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:47.432944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:47.435400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:47.441687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:47.474721 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] HTTP exception thrown: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Request method failure captured: Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 HTTP/1.1 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLbKsxs4tvDBoeDCKEiwfASEw0_bUv4noifAO8XuW55mYpEDRz2FHN0fCF3KBlrICJTVwypAmBsp6dha7QDMRKeUOe2xYM3AUmo4KDwxw6rggfqJsF03LN-A-i8_PArYaubDcKIiXdSsURIw1nx78wTGrHsnhpR5ES3jLSEfKNkdMRU Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Openstack-Nova-Api-Version: 2.21 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: e693f5f3d3df486696086ea98714bcbf Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e693f5f3d3df486696086ea98714bcbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e693f5f3d3df486696086ea98714bcbf", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e693f5f3d3df486696086ea98714bcbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e693f5f3d3df486696086ea98714bcbf"}]}] Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: e693f5f3d3df486696086ea98714bcbf Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1384903121 Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-InstanceActionsV221TestJSON-1384903121-project Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: e1b7350d87a14f6dbd97ba52e3ed0a7d Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-InstanceActionsV221TestJSON-1384903121-project Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8501a710-70c6-4043-9f66-97a7d95f30f1'} Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.479706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. Jul 02 21:21:47.483879 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:21:47.485547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] Returning 404 to user: Instance 8501a710-70c6-4043-9f66-97a7d95f30f1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:21:47.490111 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-653ff532-0c09-43f7-af22-47c704c20919 tempest-InstanceActionsV221TestJSON-1384903121 tempest-InstanceActionsV221TestJSON-1384903121-project] 10.222.0.43 "GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1" status: 404 len: 111 microversion: 2.21 time: 0.087183 Jul 02 21:21:47.491336 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2188/4403] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:21:47 2022] GET /compute/v2.1/servers/8501a710-70c6-4043-9f66-97a7d95f30f1 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:21:48.132929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89a67a97-8c34-4ea4-9d56-6d98fdd66e1b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea153670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:48.242305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89a67a97-8c34-4ea4-9d56-6d98fdd66e1b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.121260 Jul 02 21:21:48.245069 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2216/4404] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:48 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:49.257759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5cecc09-56ae-4092-b1fd-5767c41a86d1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabea187160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:49.358252 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5cecc09-56ae-4092-b1fd-5767c41a86d1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.102487 Jul 02 21:21:49.361220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2189/4405] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:49 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:50.392272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41942700-b521-4973-a546-1212e00a6ad6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd78b0820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:50.499672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41942700-b521-4973-a546-1212e00a6ad6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.129556 Jul 02 21:21:50.501403 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2217/4406] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:50 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:51.516759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83eab792-b103-48da-8773-132a23c276dc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe4a92c10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:51.595996 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83eab792-b103-48da-8773-132a23c276dc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.085253 Jul 02 21:21:51.596796 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2190/4407] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:51 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:52.611272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ca46c2d-6c20-4889-9d98-de103f4b37a6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe4c2cca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:52.766546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ca46c2d-6c20-4889-9d98-de103f4b37a6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.160358 Jul 02 21:21:52.772463 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2218/4408] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:52 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:53.780397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4a6dcd8-363d-4fff-bf61-2649e9b26938 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd771f550>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:53.892334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4a6dcd8-363d-4fff-bf61-2649e9b26938 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1412 microversion: 2.1 time: 0.116559 Jul 02 21:21:53.896000 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2191/4409] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:53 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:54.906293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c06e177-1126-4e00-a59d-27803b673f85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe456b040>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:54.993386 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c06e177-1126-4e00-a59d-27803b673f85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1421 microversion: 2.1 time: 0.091217 Jul 02 21:21:54.994708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2219/4410] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:54 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:55.009123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-19b881dd-0cbe-4655-9482-eb4864a4f4c3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76b0d30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:55.085777 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-19b881dd-0cbe-4655-9482-eb4864a4f4c3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 200 len: 1421 microversion: 2.1 time: 0.083184 Jul 02 21:21:55.087115 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2192/4411] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:21:55 2022] GET /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:21:55.101431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fca9073c-e10a-4f48-9f7f-6a75756ec31e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd78b0ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:56.657845 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fca9073c-e10a-4f48-9f7f-6a75756ec31e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 204 len: 0 microversion: 2.1 time: 1.558487 Jul 02 21:21:56.662013 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2220/4412] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:55 2022] DELETE /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 0 bytes in 1564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:21:56.668023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:56.668667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:56.688706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:56.688706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:56.688706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:56.688706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:56.726959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:21:56.861470 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb7edb1b-a8b8-49ef-95c2-582e59c911be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 204 len: 0 microversion: 2.1 time: 0.196247 Jul 02 21:21:56.863929 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2193/4413] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:21:56 2022] DELETE /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:21:57.115084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-682025399", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "5354096e-b039-4010-8707-3aebf48750f0"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:57.144742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:57.292799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] validate_networks() for [('5354096e-b039-4010-8707-3aebf48750f0', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:21:57.388706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:21:57.908293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-be60a8dc-b1a4-4eef-a033-44dde820ee24 req-c7d734ef-29db-41ef-8491-444c83527434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db16f871-de37-42d1-8bba-2920d24d495b", "name": "network-vif-unplugged", "status": "completed", "tag": "86165fa0-ccc3-4def-81a9-2fb64b4d43da"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:21:57.934653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-be60a8dc-b1a4-4eef-a033-44dde820ee24 req-c7d734ef-29db-41ef-8491-444c83527434 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:57.936849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-be60a8dc-b1a4-4eef-a033-44dde820ee24 req-c7d734ef-29db-41ef-8491-444c83527434 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:57.964342 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-be60a8dc-b1a4-4eef-a033-44dde820ee24 req-c7d734ef-29db-41ef-8491-444c83527434 service nova] Creating event network-vif-unplugged:86165fa0-ccc3-4def-81a9-2fb64b4d43da for instance db16f871-de37-42d1-8bba-2920d24d495b on nch1-master-1 Jul 02 21:21:57.979482 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-be60a8dc-b1a4-4eef-a033-44dde820ee24 req-c7d734ef-29db-41ef-8491-444c83527434 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076694 Jul 02 21:21:57.980752 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2194/4414] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:21:59.641162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:21:59.643728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:21:59.647933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:21:59.660891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:21:59.664627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:21:59.685867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:59.686456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:59.688119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:21:59.688804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:21:59.723756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:21:59.741178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for user fa780176ae5f4a618e42a47531b0d4a5 and project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:21:59.763140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:21:59.767439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:21:59.857515 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37ebfa66-42da-4d8f-9d74-83bb5daf87cc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.746346 Jul 02 21:21:59.859019 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2221/4415] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:21:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:21:59.870630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4231dcb0-46da-4ec6-a7f7-714e3a93b9b4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:21:59.871452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4231dcb0-46da-4ec6-a7f7-714e3a93b9b4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:21:59.876360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:00.117358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4231dcb0-46da-4ec6-a7f7-714e3a93b9b4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:00.129388 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4231dcb0-46da-4ec6-a7f7-714e3a93b9b4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1207 microversion: 2.1 time: 0.263483 Jul 02 21:22:00.131378 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2195/4416] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:21:59 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1207 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:00.741297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:00.743812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:00.761980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:00.763844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:00.767237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:00.768569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:00.865342 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ec7d117e-08f5-4eea-af5b-9fb4ab8879c3 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad/ips" status: 200 len: 147 microversion: 2.1 time: 0.109463 Jul 02 21:22:00.866881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2222/4417] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:22:00 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad/ips => generated 147 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:01.149248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:01.150039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:01.164745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:01.165497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:01.166521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:01.167685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:01.489139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:01.503357 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0739de4-c47e-45ee-9bae-1b3303461998 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1203 microversion: 2.1 time: 0.356437 Jul 02 21:22:01.513268 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2196/4418] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:01 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1203 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:01.838944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c05b80e3-c524-4de2-b7f0-f1d52b6ff3aa req-46510479-be0a-4e2f-85ff-e36c71ad0cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db16f871-de37-42d1-8bba-2920d24d495b", "name": "network-vif-deleted", "tag": "86165fa0-ccc3-4def-81a9-2fb64b4d43da"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:01.862421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c05b80e3-c524-4de2-b7f0-f1d52b6ff3aa req-46510479-be0a-4e2f-85ff-e36c71ad0cf7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:01.862879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c05b80e3-c524-4de2-b7f0-f1d52b6ff3aa req-46510479-be0a-4e2f-85ff-e36c71ad0cf7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:01.900999 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c05b80e3-c524-4de2-b7f0-f1d52b6ff3aa req-46510479-be0a-4e2f-85ff-e36c71ad0cf7 service nova] Creating event network-vif-deleted:86165fa0-ccc3-4def-81a9-2fb64b4d43da for instance db16f871-de37-42d1-8bba-2920d24d495b on nch1-master-1 Jul 02 21:22:01.922923 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c05b80e3-c524-4de2-b7f0-f1d52b6ff3aa req-46510479-be0a-4e2f-85ff-e36c71ad0cf7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087008 Jul 02 21:22:01.932431 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2223/4419] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:02.539224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:02.545121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:02.565484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:02.575153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:02.576576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:02.584663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:02.785189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:02.823129 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a103ad6-78b1-4bdd-bb2d-b52b8fe21a9b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1265 microversion: 2.1 time: 0.303098 Jul 02 21:22:02.826939 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2197/4420] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:02 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1265 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:03.846280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:03.846901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:03.860058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:03.861126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:03.861976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:03.862426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:04.132500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:04.147833 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c3596fa-a4e4-4e52-8833-ea5d2ad689ea tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1265 microversion: 2.1 time: 0.309748 Jul 02 21:22:04.148518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2224/4421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:03 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:05.168410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:05.175036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:05.195913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:05.197619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:05.199794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:05.203497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:05.725272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:05.734381 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-511ce3c5-a7b9-4980-bdae-55e6a13a80de tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.572077 Jul 02 21:22:05.735001 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2198/4422] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:05 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:06.761408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:06.762042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:06.784444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:06.784941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:06.785778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:06.786221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:07.510866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:07.527279 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8f48c22-c9aa-490b-b6f5-deca2813f952 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.774104 Jul 02 21:22:07.536694 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2225/4423] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:06 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:07.765057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6521e980-da44-4f4f-8167-2bcc17588e56 req-8447ae00-258b-46f1-9bde-8e916c9dfbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d13e2b0a-de26-41fb-ac2d-1650603b63ef", "tag": "2421e496-bb31-40d3-8be8-422ce36c23e8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:07.783860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6521e980-da44-4f4f-8167-2bcc17588e56 req-8447ae00-258b-46f1-9bde-8e916c9dfbd3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:07.784648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6521e980-da44-4f4f-8167-2bcc17588e56 req-8447ae00-258b-46f1-9bde-8e916c9dfbd3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:07.815003 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6521e980-da44-4f4f-8167-2bcc17588e56 req-8447ae00-258b-46f1-9bde-8e916c9dfbd3 service nova] Creating event network-changed:2421e496-bb31-40d3-8be8-422ce36c23e8 for instance d13e2b0a-de26-41fb-ac2d-1650603b63ef on nch2-master-1 Jul 02 21:22:07.835809 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6521e980-da44-4f4f-8167-2bcc17588e56 req-8447ae00-258b-46f1-9bde-8e916c9dfbd3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074121 Jul 02 21:22:07.837304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2199/4424] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:08.543948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:08.544766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:08.563375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:08.563898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:08.566450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:08.567525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:09.241706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:09.253266 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-85c0089e-4a67-470f-a4eb-e4375326c012 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.713054 Jul 02 21:22:09.253906 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2226/4425] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:08 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:10.273389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:10.274528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:10.295432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:10.298428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:10.316246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:10.319195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:10.321218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:10.819848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:10.831719 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7340edb2-05e5-40cb-963d-964cc8efa71b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.561273 Jul 02 21:22:10.832787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2200/4426] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:10 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:11.357084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:11.357849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:11.841499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1101851269", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:11.849416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:11.850130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:11.863975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:11.866952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:11.870230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:11.872633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:11.954153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:11.962253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] validate_networks() for [('ac866851-1437-4af9-8d9a-d4d3a0ac85af', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:22:12.786165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:12.797145 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f2eb04c-6ffd-417a-bbb6-07ba6186c02e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.950306 Jul 02 21:22:12.798514 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2201/4427] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:11 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:13.814311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:13.815567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:13.827182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:13.829670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:13.830254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:13.830788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:14.494114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:22:14.496909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:22:14.498894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:22:14.499906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:22:14.500599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:22:14.528791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:14.531427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:14.534752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:14.535727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:14.593228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Getting quotas for project 76e7f008cdf342038f77463635293405. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:22:14.627828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Getting quotas for user 8fb8295b4af942d2be5d0cdb0a822868 and project 76e7f008cdf342038f77463635293405. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:22:14.666464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:22:14.682278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:22:14.797839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40fdd7a4-fbc4-47d0-8f9b-ea1ddbce1a40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.446265 Jul 02 21:22:14.800098 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2227/4428] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:22:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:22:14.810561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-603b8988-df24-4075-9c9f-d7c5c94cdade tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:14.811509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-603b8988-df24-4075-9c9f-d7c5c94cdade tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:15.014276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-603b8988-df24-4075-9c9f-d7c5c94cdade tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:15.027174 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-603b8988-df24-4075-9c9f-d7c5c94cdade tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1217 microversion: 2.1 time: 0.222258 Jul 02 21:22:15.027788 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2228/4429] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:14 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1217 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:15.079862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:15.090915 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8bb742b7-bc5c-487c-a796-cab4e2aa59ee tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 1.280435 Jul 02 21:22:15.094531 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2202/4430] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:13 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:16.044670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:16.045510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:16.068522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:16.068991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:16.071540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:16.072135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:16.117336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:16.117961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:16.145066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:16.145887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:16.147388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:16.151178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:16.240268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:16.256339 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00be5563-4106-414a-8e3b-a06dc5b00c6a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1213 microversion: 2.1 time: 0.214561 Jul 02 21:22:16.270990 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2229/4431] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:16 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1213 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:16.421055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:16.430425 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4352274-e4c4-472a-a15c-d7e8b1d3637c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.323126 Jul 02 21:22:16.440712 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2203/4432] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:16 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:16.556740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1195054207", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "f2e36c1c-71ec-4460-9416-4ec0fc9b442f"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:16.572628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-be09d366-2e3f-456e-bc4e-f3796308973a req-0439c8d8-3e67-4084-b4fd-6059e7f73cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13e2b0a-de26-41fb-ac2d-1650603b63ef", "name": "network-vif-plugged", "status": "completed", "tag": "2421e496-bb31-40d3-8be8-422ce36c23e8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:16.593814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-be09d366-2e3f-456e-bc4e-f3796308973a req-0439c8d8-3e67-4084-b4fd-6059e7f73cd5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:16.599592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-be09d366-2e3f-456e-bc4e-f3796308973a req-0439c8d8-3e67-4084-b4fd-6059e7f73cd5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:16.656685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-be09d366-2e3f-456e-bc4e-f3796308973a req-0439c8d8-3e67-4084-b4fd-6059e7f73cd5 service nova] Creating event network-vif-plugged:2421e496-bb31-40d3-8be8-422ce36c23e8 for instance d13e2b0a-de26-41fb-ac2d-1650603b63ef on nch2-master-1 Jul 02 21:22:16.689431 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-be09d366-2e3f-456e-bc4e-f3796308973a req-0439c8d8-3e67-4084-b4fd-6059e7f73cd5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.247035 Jul 02 21:22:16.690063 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2204/4433] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:16.734522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] validate_networks() for [('f2e36c1c-71ec-4460-9416-4ec0fc9b442f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:22:17.279462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:17.280426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:17.333452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:17.333834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:17.335910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:17.336968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:17.500920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:17.515253 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-132d096f-e0fe-42bf-8d7e-3661bf17432d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1275 microversion: 2.1 time: 0.239024 Jul 02 21:22:17.517513 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2205/4434] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:17 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:17.529944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:17.540211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:17.563437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:17.564543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:17.565583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:17.566180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:17.891622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:22:17.891622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:22:17.892257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:22:17.892525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:22:17.892942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:22:17.912716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:17.914138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:17.916186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:17.922907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07297e72-1fa6-4e06-a741-253df749f087 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1307 microversion: 2.1 time: 0.402662 Jul 02 21:22:17.923628 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2206/4435] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:17 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1307 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:17.933523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:17.934150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:17.991684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Getting quotas for project 8a5bdceeafbb40a6be33371a3ad1b0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:22:18.006711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Getting quotas for user 5261fd648c584842937fbd1c53fb53e0 and project 8a5bdceeafbb40a6be33371a3ad1b0aa. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:22:18.050181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:22:18.053988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:22:18.144827 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e3a5ead-c989-4c80-a22b-38f5ec23d646 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846676 Jul 02 21:22:18.146182 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2230/4436] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:22:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:22:18.156754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9a5fdb49-d6f3-40c3-ae20-a7eddd0d1411 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:18.157383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9a5fdb49-d6f3-40c3-ae20-a7eddd0d1411 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:18.248989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9a5fdb49-d6f3-40c3-ae20-a7eddd0d1411 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:18.256841 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9a5fdb49-d6f3-40c3-ae20-a7eddd0d1411 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1225 microversion: 2.1 time: 0.104470 Jul 02 21:22:18.260125 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2207/4437] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:18 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:18.533282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:18.533914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:18.549341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:18.549702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:18.550505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:18.550929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:18.898657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:18.908502 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c9f4210-26d6-49ef-8c6b-35f5b2b797f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.379233 Jul 02 21:22:18.911306 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2231/4438] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:18 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:18.939939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:18.941196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:18.962692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:18.963585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:18.964670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:18.965263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:19.265939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:19.277913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:19.278519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:19.290139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-39ae0c25-c991-48c8-954e-5fb375089861 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1485 microversion: 2.1 time: 0.354411 Jul 02 21:22:19.296588 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2208/4439] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:18 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1485 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:19.300723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:19.304482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:19.305348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:19.305731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:19.310151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ba6cfdb-8365-4bb8-9094-b11a1a538029 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:19.342387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ba6cfdb-8365-4bb8-9094-b11a1a538029 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:19.343923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ba6cfdb-8365-4bb8-9094-b11a1a538029 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:19.429557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ba6cfdb-8365-4bb8-9094-b11a1a538029 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Going to try to stop instance {{(pid=131045) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:22:19.573994 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ba6cfdb-8365-4bb8-9094-b11a1a538029 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef/action" status: 202 len: 0 microversion: 2.1 time: 0.269665 Jul 02 21:22:19.576594 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2209/4440] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:22:19 2022] POST /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:22:19.593719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:19.599040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:19.602068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:19.611168 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad9d28c2-4cd9-40a0-90af-6345600adde8 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1229 microversion: 2.1 time: 0.335876 Jul 02 21:22:19.612098 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2232/4441] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:19 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1229 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:19.634168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:19.634903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:19.635874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:19.637593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:19.930156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:19.930768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:19.989842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:19.994229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:20.002556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:20.005028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:20.164570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:20.174235 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7dcbeb7b-dd53-4cb0-8640-5d2ffc3a763e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.592252 Jul 02 21:22:20.197277 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2210/4442] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:19 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:20.629627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:20.630471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:20.646169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:20.648223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:20.652744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:20.653415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:20.694737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:20.706438 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29608dc3-0e16-4b91-94ba-c9704a067d4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.779943 Jul 02 21:22:20.707658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2233/4443] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:19 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:20.864478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:20.879034 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-319c3eea-d081-427a-b0c3-1a449e16df3a tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1283 microversion: 2.1 time: 0.253024 Jul 02 21:22:20.890152 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2211/4444] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:20 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1283 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:21.216159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:21.217047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:21.230679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:21.232149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:21.234748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:21.236657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:21.743203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7255c0ec-9cc3-4e30-a53f-0aaafb9ec92d req-7dd05d2e-c71f-40cf-8bff-31968843a7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a26c01b1-585c-4366-95f1-2e2388a7fda2", "tag": "e27718a1-3c8b-4441-982a-cf26ff8c5baf"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:21.774201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7255c0ec-9cc3-4e30-a53f-0aaafb9ec92d req-7dd05d2e-c71f-40cf-8bff-31968843a7ea service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:21.776687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7255c0ec-9cc3-4e30-a53f-0aaafb9ec92d req-7dd05d2e-c71f-40cf-8bff-31968843a7ea service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:21.832019 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7255c0ec-9cc3-4e30-a53f-0aaafb9ec92d req-7dd05d2e-c71f-40cf-8bff-31968843a7ea service nova] Creating event network-changed:e27718a1-3c8b-4441-982a-cf26ff8c5baf for instance a26c01b1-585c-4366-95f1-2e2388a7fda2 on nch1-master-1 Jul 02 21:22:21.849587 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7255c0ec-9cc3-4e30-a53f-0aaafb9ec92d req-7dd05d2e-c71f-40cf-8bff-31968843a7ea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.463562 Jul 02 21:22:21.851418 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2212/4445] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:21.864849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:21.865745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:21.887649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:21.888157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:21.888974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:21.889419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:22.210552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:22.233214 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3481728-cbac-4839-b1f4-d50ef92a7709 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 1.023919 Jul 02 21:22:22.245117 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2234/4446] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:21 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:22.250296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:22.251116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:22.268067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:22.272787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:22.274687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:22.275145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:23.559515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:23.568586 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3a9b33f4-743b-4769-b96f-10ec9062be1e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 1.715162 Jul 02 21:22:23.569581 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2213/4447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:21 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:23.578137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:23.579186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:23.587157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:23.587975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:23.590110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:23.590767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:23.803322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:23.820024 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ea4e9a6-138b-4d64-837d-40f1ae16511b tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 1.573464 Jul 02 21:22:23.820818 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2235/4448] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:22 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:24.390947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:24.402446 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-824170d2-d66d-4ea8-87b7-e4b1f99d2d1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.831545 Jul 02 21:22:24.403812 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2214/4449] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:23 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:24.587940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:24.588602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:24.599393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:24.599848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:24.600656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:24.601283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:24.838211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:24.839613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:24.846423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:24.847135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:24.848105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:24.848699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:24.972857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:24.992014 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8c5727e-bfc2-43ea-ba54-307cd67c4130 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.404929 Jul 02 21:22:24.993348 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2236/4450] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:24 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:25.082173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:25.096707 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de9ad4aa-6dd8-4c28-9cb9-dbc87dea5487 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 0.262909 Jul 02 21:22:25.107886 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2215/4451] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:24 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:25.422646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:25.423903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:25.426101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4e5151cd-d5d9-4122-ba44-6415b9a610a4 req-dda9fa37-819a-4c45-9a03-09cbdd4d194a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72c118df-3731-42c7-97e6-191bf53908e1", "tag": "1eaff9f8-2341-4e06-b4ff-e4a838d370d9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:25.434035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:25.435241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:25.437498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:25.438013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:25.466083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4e5151cd-d5d9-4122-ba44-6415b9a610a4 req-dda9fa37-819a-4c45-9a03-09cbdd4d194a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:25.466987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4e5151cd-d5d9-4122-ba44-6415b9a610a4 req-dda9fa37-819a-4c45-9a03-09cbdd4d194a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:25.480731 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4e5151cd-d5d9-4122-ba44-6415b9a610a4 req-dda9fa37-819a-4c45-9a03-09cbdd4d194a service nova] Creating event network-changed:1eaff9f8-2341-4e06-b4ff-e4a838d370d9 for instance 72c118df-3731-42c7-97e6-191bf53908e1 on nch1-master-1 Jul 02 21:22:25.497185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4e5151cd-d5d9-4122-ba44-6415b9a610a4 req-dda9fa37-819a-4c45-9a03-09cbdd4d194a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076683 Jul 02 21:22:25.498964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2216/4452] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:25.693092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:25.708253 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00722103-7f93-4dce-876b-e60b4f6fb366 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.289576 Jul 02 21:22:25.716388 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2237/4453] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:25 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:26.011912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:26.012735 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:26.020257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:26.020959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:26.022058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:26.022698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:26.113999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:26.114769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:26.128397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:26.129235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:26.130706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:26.131563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:26.478514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:26.494460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:26.497427 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b73e768e-4ffc-43be-ba5c-064f49e6df68 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.483944 Jul 02 21:22:26.501627 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2217/4454] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:26 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:26.513666 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fa08e6c-18a7-479d-bdf5-6fd4926dca4d tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 0.401128 Jul 02 21:22:26.516956 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2238/4455] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:26 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:26.732528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:26.733846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:26.745457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:26.745931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:26.746720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:26.747179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:27.384112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:27.406352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d995edf5-ce66-421f-bbe7-f7abc18b0adc tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.677503 Jul 02 21:22:27.408354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2218/4456] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:26 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:27.518153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:27.518773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:27.533817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:27.534441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:27.540486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=9 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:27.542160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:27.543114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:27.543399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:27.543837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:27.549471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:27.556792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:27.557662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:27.558110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:27.629112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=85 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:27.966710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:28.020410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:28.257460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:28.457346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:28.498328 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3f3a1108-7782-4e1e-a1e0-90d21ba4bfb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.984056 Jul 02 21:22:28.499202 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2239/4457] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:27 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:28.504100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:28.504706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:28.510855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:28.511304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:28.512092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:28.512694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:29.352914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:29.356101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:29.370163 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a690aa71-37c4-4b41-9535-83eda7ea0d1f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 1.837044 Jul 02 21:22:29.370816 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2219/4458] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:27 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:29.516728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:29.517897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:29.534259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:29.536999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:29.539206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:29.541302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:29.749559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:29.758511 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c314e693-308b-4840-b420-27edefcd4973 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 1.258102 Jul 02 21:22:29.762937 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2240/4459] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:28 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:30.211961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:30.231377 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f751a888-1874-48e8-b67c-83af0d0bf887 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.718181 Jul 02 21:22:30.236736 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2220/4460] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:29 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:30.387277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:30.387898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:30.399726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:30.400215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:30.400999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:30.407595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:30.768143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:30.778748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:30.779975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:30.786190 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae92be9b-1deb-4b6f-a154-29210d001237 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 0.402937 Jul 02 21:22:30.788915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=56 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:30.792210 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2241/4461] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:30 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:30.794016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:30.794642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:30.795576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:30.796227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:31.135705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:31.150372 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-af3b0a53-5374-49af-9aaf-0045aae606e0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.374792 Jul 02 21:22:31.152783 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2221/4462] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:30 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:31.253408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:31.254456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:31.262743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:31.263563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:31.265402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:31.266348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:31.757392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:31.771156 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76e309a8-3b75-4094-9fcc-f70a6e674d02 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.521446 Jul 02 21:22:31.776350 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2242/4463] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:31 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:31.809552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:31.810403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:31.819710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:31.820538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:31.821562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:31.822223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:32.093877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:32.111223 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1650696a-b234-4282-9c9c-cfb783af30b9 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 0.304496 Jul 02 21:22:32.114721 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2222/4464] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:31 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:32.170165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:32.171259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:32.180796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:32.181887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:32.182662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:32.183107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:32.555306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:32.570137 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8dcb6d4c-3c78-4a79-99d8-aadedd915c1e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.403322 Jul 02 21:22:32.583410 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2243/4465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:32 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:32.789925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:32.791483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:32.799548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:32.799945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:32.800708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:32.801106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:32.924679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-71e8bda4-286b-4037-a96a-bc36400d418d req-8771dff6-793f-41a4-8f51-dbf38bb9bf33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c01b1-585c-4366-95f1-2e2388a7fda2", "name": "network-vif-plugged", "status": "completed", "tag": "e27718a1-3c8b-4441-982a-cf26ff8c5baf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:32.938653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-71e8bda4-286b-4037-a96a-bc36400d418d req-8771dff6-793f-41a4-8f51-dbf38bb9bf33 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:32.939415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-71e8bda4-286b-4037-a96a-bc36400d418d req-8771dff6-793f-41a4-8f51-dbf38bb9bf33 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:32.971527 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-71e8bda4-286b-4037-a96a-bc36400d418d req-8771dff6-793f-41a4-8f51-dbf38bb9bf33 service nova] Creating event network-vif-plugged:e27718a1-3c8b-4441-982a-cf26ff8c5baf for instance a26c01b1-585c-4366-95f1-2e2388a7fda2 on nch1-master-1 Jul 02 21:22:32.981379 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-71e8bda4-286b-4037-a96a-bc36400d418d req-8771dff6-793f-41a4-8f51-dbf38bb9bf33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063422 Jul 02 21:22:32.983088 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2244/4466] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:33.125469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:33.146088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:33.146846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:33.168010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c589ade-925d-4d26-8232-82cdc44b1f2d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.381911 Jul 02 21:22:33.168652 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2223/4467] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:32 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:33.188304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:33.189024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:33.189965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:33.196613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:33.592381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:33.593341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:33.607885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:33.608803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:33.609819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:33.610476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:34.189701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:34.209467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21692a8f-6931-4f27-99f4-0789ba721b42 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 1.078340 Jul 02 21:22:34.216006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:34.217991 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2245/4468] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:33 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:34.240957 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2cbfb4d5-290a-4e3b-8949-8546765fb7c1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.653252 Jul 02 21:22:34.254839 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2224/4469] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:33 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:34.268650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:34.269699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:34.287448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:34.288259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:34.289293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:34.304834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:34.585790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:34.595067 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d0ac494d-308b-4ac0-ae25-6140568a5ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1317 microversion: 2.1 time: 0.338764 Jul 02 21:22:34.597037 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2225/4470] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:34 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:34.682716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-640b069b-2627-42ca-bfe5-e88d6519e8e6 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Action: 'create', calling method: .version_select at 0x7fabd78b0af0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1110865017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqovc0vXC1sGkLlBAmPuY+8ORWHq/7J20D/m1xdz7dQWXo7VjVxqoDzH6iexvjpkrAIWLxnl7aRCtg8Uutvidm6hh+94jdGfFgRFacgOdGiyJGfmkbKAl34SupuPSjmXw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:34.703535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-640b069b-2627-42ca-bfe5-e88d6519e8e6 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Getting quotas for project 04e1d850f7e34fc7997bbea3a4a4777f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:22:34.710969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-640b069b-2627-42ca-bfe5-e88d6519e8e6 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Getting quotas for user 8659f358b57b4574a0703b39e4cb0004 and project 04e1d850f7e34fc7997bbea3a4a4777f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:22:34.743543 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-640b069b-2627-42ca-bfe5-e88d6519e8e6 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.521926 Jul 02 21:22:34.745452 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2246/4471] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:22:34 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:35.237837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:35.239293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:35.261842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:35.263006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:35.265844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:35.266949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:35.270357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:35.271015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:35.276797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:35.279380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:35.280527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:35.283395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:35.774786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:35.785338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-804163c5-ffe0-476e-a2a7-fa8eaa741308 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 0.551980 Jul 02 21:22:35.785956 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2226/4472] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:35 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:35.793012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:35.800208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:35.810908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:35.814698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:35.818203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:35.819206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:35.819837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:35.822752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ac7e0613-b228-4c1a-a040-12b68caadcb2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.567402 Jul 02 21:22:35.840294 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2247/4473] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:35 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:36.091597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:36.106987 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ab43541-439b-40d8-b877-6a1149da0ec7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.317633 Jul 02 21:22:36.107616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2227/4474] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:35 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:36.311876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1216970829", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:36.423107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] validate_networks() for [('ac866851-1437-4af9-8d9a-d4d3a0ac85af', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:22:36.612220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bda650e0-c5f4-4e36-890c-20239b0600c7 req-37606f07-3765-4127-87ba-4ab22c2be9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c118df-3731-42c7-97e6-191bf53908e1", "name": "network-vif-plugged", "status": "completed", "tag": "1eaff9f8-2341-4e06-b4ff-e4a838d370d9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:36.630566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bda650e0-c5f4-4e36-890c-20239b0600c7 req-37606f07-3765-4127-87ba-4ab22c2be9c4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:36.631042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bda650e0-c5f4-4e36-890c-20239b0600c7 req-37606f07-3765-4127-87ba-4ab22c2be9c4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:36.653734 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bda650e0-c5f4-4e36-890c-20239b0600c7 req-37606f07-3765-4127-87ba-4ab22c2be9c4 service nova] Creating event network-vif-plugged:1eaff9f8-2341-4e06-b4ff-e4a838d370d9 for instance 72c118df-3731-42c7-97e6-191bf53908e1 on nch1-master-1 Jul 02 21:22:36.659366 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bda650e0-c5f4-4e36-890c-20239b0600c7 req-37606f07-3765-4127-87ba-4ab22c2be9c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052662 Jul 02 21:22:36.660381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2228/4475] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:36.668657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1119967992", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1110865017", "security_groups": [{"name": "tempest-secgroup-smoke-1946530646"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "c5e1323f-3e40-4311-9b00-081666336f38"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:36.984427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] validate_networks() for [('c5e1323f-3e40-4311-9b00-081666336f38', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:22:37.551406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:22:37.551888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:22:37.552366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:22:37.552792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:22:37.553426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:22:37.596141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:37.596613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:37.597497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:37.597940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:37.646659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Getting quotas for project 76e7f008cdf342038f77463635293405. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:22:37.655235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Getting quotas for user 8fb8295b4af942d2be5d0cdb0a822868 and project 76e7f008cdf342038f77463635293405. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:22:37.673714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:22:37.677008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:22:37.767436 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-580a65ff-a544-4fc3-834e-2baf111794f6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.459539 Jul 02 21:22:37.773053 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2248/4476] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:22:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:22:37.779012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:37.779642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:37.801345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:37.801860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:37.802704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:37.803146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:38.603324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Getting quotas for project 04e1d850f7e34fc7997bbea3a4a4777f. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:22:38.618571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Getting quotas for user 8659f358b57b4574a0703b39e4cb0004 and project 04e1d850f7e34fc7997bbea3a4a4777f. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:22:38.662082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:38.691417 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc1b714c-3b24-460a-9d04-42f1108a5503 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1325 microversion: 2.1 time: 0.921506 Jul 02 21:22:38.693881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2249/4477] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:37 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1325 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:38.694324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:22:38.694851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:22:38.695430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:22:38.696884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:22:38.698669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:22:38.707313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:38.708250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:38.717638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:38.718368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:38.719672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:38.720403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:38.732000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:38.733909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:38.736203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:38.738873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:38.800964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Getting quotas for project 04e1d850f7e34fc7997bbea3a4a4777f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:22:38.834478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Getting quotas for user 8659f358b57b4574a0703b39e4cb0004 and project 04e1d850f7e34fc7997bbea3a4a4777f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:22:38.881201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:22:38.896242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:22:39.019559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78fd25aa-0fc8-49e9-ace9-ccf6440e36fc tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.355375 Jul 02 21:22:39.020318 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2229/4478] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:22:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:22:39.054477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:39.057949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:39.069044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:39.069724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:39.070700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:39.071303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:39.095118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:39.112594 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b041adf-1fcb-4c45-8bc4-b8a80690539e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.414452 Jul 02 21:22:39.114121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2250/4479] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:38 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:39.126217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5c79ee9-f939-4980-b6f3-66cdfc0b4003 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:39.129541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5c79ee9-f939-4980-b6f3-66cdfc0b4003 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:39.179144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:39.190899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d906e4b7-e58f-435a-8992-8365c10aef1c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1269 microversion: 2.1 time: 0.161776 Jul 02 21:22:39.194474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2230/4480] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:39 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:39.281291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5c79ee9-f939-4980-b6f3-66cdfc0b4003 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:39.292667 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5c79ee9-f939-4980-b6f3-66cdfc0b4003 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1303 microversion: 2.1 time: 0.176304 Jul 02 21:22:39.293666 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2251/4481] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:39 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1303 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:39.711482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:39.712173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:39.728995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:39.732576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:39.734045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:39.737656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.075145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:40.083272 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-329d6f61-b7f6-4ec4-a4b8-42aa6d24a17f tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1522 microversion: 2.1 time: 0.376620 Jul 02 21:22:40.083871 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2231/4482] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:39 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:40.101629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.103212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:40.131712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.132640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:40.146529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.147457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.148386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.148903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.149743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.150188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.150619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.153136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.215584 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] HTTP exception thrown: Instance is not a member of specified network Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Request method failure captured: Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1/ips/invalid HTTP/1.1 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcH-YsUTlUugbKuCceWDQgngb7wwL9NVYzp0v-e_zAXGSIm25tdUNXLAZjEC7U6dAhAEPnF2CApj1AX5yTqnpIf8fQ2Z5FsrQVyepxpGVY7XqBCsCuI0dy4IcADJsBKW-OQ18YaNBN8IbWPtga5un36-Xv4ZeLDkJbvcxjxk_fnDd0 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8a5bdceeafbb40a6be33371a3ad1b0aa Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a5bdceeafbb40a6be33371a3ad1b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}] Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8a5bdceeafbb40a6be33371a3ad1b0aa Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerAddressesNegativeTestJSON-1106577031-project Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 5261fd648c584842937fbd1c53fb53e0 Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1106577031-project Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance is not a member of specified network Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'server_id': '72c118df-3731-42c7-97e6-191bf53908e1', 'id': 'invalid'} Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 02 21:22:40.224711 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.230283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:22:40.231355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4fb72139-a028-4966-b7ec-0f3e051b55ad tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.133769 Jul 02 21:22:40.237012 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2252/4483] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:22:40 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1/ips/invalid => generated 91 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:22:40.242602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.243550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:40.250366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.251174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.252297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.252971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.428612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:40.441180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17731483-13c8-4fbb-9109-cd5eff196e2c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1275 microversion: 2.1 time: 0.201772 Jul 02 21:22:40.452113 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2253/4484] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:40 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:40.465133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77d0b648-5fb4-4cd5-94bf-1fd6c7cfa00e tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.466319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77d0b648-5fb4-4cd5-94bf-1fd6c7cfa00e tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Failed to fetch instance by id 999 {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:22:40.467102 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-77d0b648-5fb4-4cd5-94bf-1fd6c7cfa00e tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] HTTP exception thrown: Instance 999 could not be found. Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77d0b648-5fb4-4cd5-94bf-1fd6c7cfa00e tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Request method failure captured: Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcH-YsUTlUugbKuCceWDQgngb7wwL9NVYzp0v-e_zAXGSIm25tdUNXLAZjEC7U6dAhAEPnF2CApj1AX5yTqnpIf8fQ2Z5FsrQVyepxpGVY7XqBCsCuI0dy4IcADJsBKW-OQ18YaNBN8IbWPtga5un36-Xv4ZeLDkJbvcxjxk_fnDd0 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 8a5bdceeafbb40a6be33371a3ad1b0aa Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a5bdceeafbb40a6be33371a3ad1b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}] Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 8a5bdceeafbb40a6be33371a3ad1b0aa Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerAddressesNegativeTestJSON-1106577031-project Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 5261fd648c584842937fbd1c53fb53e0 Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1106577031-project Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 999 could not be found. Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'server_id': '999'} Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 02 21:22:40.468923 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:40.476487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77d0b648-5fb4-4cd5-94bf-1fd6c7cfa00e tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:22:40.477664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77d0b648-5fb4-4cd5-94bf-1fd6c7cfa00e tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.023468 Jul 02 21:22:40.479302 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2254/4485] 10.222.0.43 () {58 vars in 1148 bytes} [Sat Jul 2 21:22:40 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:22:40.490767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.491831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:40.500026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.501016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.502773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.503703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.630023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:40.643604 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1799510c-307f-4756-8756-85d103db2434 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1355 microversion: 2.1 time: 0.154275 Jul 02 21:22:40.644688 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2255/4486] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:40 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1355 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:40.655571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:40.666297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.668959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:40.676086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75253130-7475-4e92-8da8-bf39631def46 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.544658 Jul 02 21:22:40.677322 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2232/4487] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:40 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:40.689882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.690576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.691549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.692262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.760015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:22:40.915998 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8cb17ac-014a-452a-9564-0fef21841712 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "DELETE /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 204 len: 0 microversion: 2.1 time: 0.258618 Jul 02 21:22:40.916973 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2256/4488] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:22:40 2022] DELETE /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:22:40.929012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:40.931231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:40.942732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.943827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:40.945880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:40.946370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:41.387918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:41.398415 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b5e3f5f5-2c0c-4fb7-8171-e7df9ff9f247 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1528 microversion: 2.1 time: 0.476492 Jul 02 21:22:41.399158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2233/4489] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:40 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1528 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:41.459690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:41.471026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:41.492928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:41.497144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:41.497984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:41.498433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:41.662834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:41.668391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:41.675213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:41.675707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:41.677882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:41.678478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:41.970648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:41.980714 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-121a34c8-a594-4df6-9885-88b00cb74c73 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1361 microversion: 2.1 time: 0.322712 Jul 02 21:22:41.981776 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2234/4490] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:41 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:41.986411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:41.987128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:41.998466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:41.998984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:42.000024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:42.002618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:42.136688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:42.147394 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c17b5d9e-5a8b-4938-b785-3857dc2f645f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 0.692428 Jul 02 21:22:42.150876 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2257/4491] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:41 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:42.343995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:42.357711 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-315c6d36-915b-46ef-9f08-40c259ea7d37 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.374549 Jul 02 21:22:42.358022 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2235/4492] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:41 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:42.416156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:42.417159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:42.424131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:42.425355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:42.426398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:42.427091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:42.850297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:42.858017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:42.861599 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef68c328-8024-4b9a-9502-665470d232b1 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1528 microversion: 2.1 time: 0.449138 Jul 02 21:22:42.866164 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2258/4493] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:42 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1528 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:43.000166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:43.000166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:43.007610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:43.008152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:43.009147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:43.009763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:43.151994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:43.152949 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5774122f-96eb-47dd-b2d0-5aa6c15af6ad tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1361 microversion: 2.1 time: 0.157600 Jul 02 21:22:43.153348 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2236/4494] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:42 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:43.167574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:43.168222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:43.181779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:43.182567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:43.183640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:43.184294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:43.375061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:43.376012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:43.404330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:43.408543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:43.410461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:43.411229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:44.193875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:44.202947 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf4607b3-76fc-4036-a4b3-6d24904bde0e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 1.039593 Jul 02 21:22:44.204142 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2259/4495] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:43 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:44.209222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:44.210055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:44.216473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:44.217152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:44.218839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:44.219282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:44.232025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:44.236372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:44.246937 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f78ee36-864a-46db-81df-bce531b09e3b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.875767 Jul 02 21:22:44.249171 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2237/4496] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:43 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:44.260709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:44.261421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:44.278397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:44.279045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:44.280100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:44.280768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:44.413501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5261fd648c584842937fbd1c53fb53e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5bdceeafbb40a6be33371a3ad1b0aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:44.434298 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cb147a6-e7ae-4ace-91a1-6d64f8c1f5af tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 200 len: 1486 microversion: 2.1 time: 0.227530 Jul 02 21:22:44.435640 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2260/4497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:44 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 1486 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:44.448595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:44.462498 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a57c24cc-157c-41b9-93be-102d2fff5b29 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1361 microversion: 2.1 time: 0.212166 Jul 02 21:22:44.463100 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2238/4498] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:44 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:44.660328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-aeda0821-dd2b-4766-8f17-8e499bacd668 req-ee11e631-1d49-4160-95fa-53ff95dd329d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72c118df-3731-42c7-97e6-191bf53908e1", "name": "network-vif-deleted", "tag": "1eaff9f8-2341-4e06-b4ff-e4a838d370d9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:44.698671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aeda0821-dd2b-4766-8f17-8e499bacd668 req-ee11e631-1d49-4160-95fa-53ff95dd329d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:44.699235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-aeda0821-dd2b-4766-8f17-8e499bacd668 req-ee11e631-1d49-4160-95fa-53ff95dd329d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:44.749221 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-aeda0821-dd2b-4766-8f17-8e499bacd668 req-ee11e631-1d49-4160-95fa-53ff95dd329d service nova] Creating event network-vif-deleted:1eaff9f8-2341-4e06-b4ff-e4a838d370d9 for instance 72c118df-3731-42c7-97e6-191bf53908e1 on nch1-master-1 Jul 02 21:22:44.769641 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-aeda0821-dd2b-4766-8f17-8e499bacd668 req-ee11e631-1d49-4160-95fa-53ff95dd329d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116940 Jul 02 21:22:44.772191 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2261/4499] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:45.220487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:45.221213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:45.228484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.228949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.229741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.230489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.267404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:45.268484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:45.279192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.279649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.282941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.283481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.668292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:45.680698 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ddcd15e-376b-43dd-a400-a57f9be1f1d6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 0.463452 Jul 02 21:22:45.682043 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2239/4500] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:45 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:45.689547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:45.690830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] [instance: 72c118df-3731-42c7-97e6-191bf53908e1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:45.701688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.703477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.705430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.706327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.711669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:45.724260 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-164d56dd-99d6-4075-9ab3-82991070e228 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.462390 Jul 02 21:22:45.734713 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2262/4501] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:45 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:45.740571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:45.741490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:45.749480 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] HTTP exception thrown: Instance 72c118df-3731-42c7-97e6-191bf53908e1 could not be found. Jul 02 21:22:45.752379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.753081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Request method failure captured: Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 HTTP/1.1 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcH-YsUTlUugbKuCceWDQgngb7wwL9NVYzp0v-e_zAXGSIm25tdUNXLAZjEC7U6dAhAEPnF2CApj1AX5yTqnpIf8fQ2Z5FsrQVyepxpGVY7XqBCsCuI0dy4IcADJsBKW-OQ18YaNBN8IbWPtga5un36-Xv4ZeLDkJbvcxjxk_fnDd0 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 8a5bdceeafbb40a6be33371a3ad1b0aa Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_8a5bdceeafbb40a6be33371a3ad1b0aa", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/8a5bdceeafbb40a6be33371a3ad1b0aa"}]}] Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 8a5bdceeafbb40a6be33371a3ad1b0aa Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1106577031 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerAddressesNegativeTestJSON-1106577031-project Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 5261fd648c584842937fbd1c53fb53e0 Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1106577031-project Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 72c118df-3731-42c7-97e6-191bf53908e1 could not be found. Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '72c118df-3731-42c7-97e6-191bf53908e1'} Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72c118df-3731-42c7-97e6-191bf53908e1 could not be found. Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72c118df-3731-42c7-97e6-191bf53908e1 could not be found. Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:45.753353 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72c118df-3731-42c7-97e6-191bf53908e1 could not be found. Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] Returning 404 to user: Instance 72c118df-3731-42c7-97e6-191bf53908e1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:22:45.758709 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bb4e8b1f-afa3-4431-9b7d-1e65d029d127 tempest-ServerAddressesNegativeTestJSON-1106577031 tempest-ServerAddressesNegativeTestJSON-1106577031-project] 10.222.0.43 "GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1" status: 404 len: 111 microversion: 2.1 time: 0.072217 Jul 02 21:22:45.760705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:45.760876 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2240/4502] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:45 2022] GET /compute/v2.1/servers/72c118df-3731-42c7-97e6-191bf53908e1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:22:45.762109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:46.044814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:46.067372 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8973dbf-4bcf-49dd-8e97-00e1d57ce920 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.329459 Jul 02 21:22:46.071640 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2263/4503] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:45 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:46.699579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:46.700425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:46.710946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:46.712916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:46.717706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:46.718640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:46.744318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:46.745499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:46.762744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:46.764896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:46.769703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:46.773317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:47.229116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:47.238603 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-294f9e9f-bc4e-4b74-aac4-6697b148023e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 0.543871 Jul 02 21:22:47.239164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:47.249656 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2241/4504] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:46 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:47.257059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-244dce11-cea8-486e-918f-372c8df584a5 req-c9e2c928-3655-470a-a9c7-c5cc235156b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872b5feb-08a2-4738-81eb-0593d065197e", "tag": "bae544b5-0ba4-4436-be18-bd8870ec9835"}, {"name": "network-changed", "server_uuid": "437883a3-6dc4-4818-8739-a52096e8709e", "tag": "31536cde-fbd7-4df4-955e-ab5a641d06e4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:47.259024 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca125bb7-efc5-4766-8a0a-daa7ff4b9ba4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.520440 Jul 02 21:22:47.260204 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2264/4505] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:46 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:47.265531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:47.266420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:47.268293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-244dce11-cea8-486e-918f-372c8df584a5 req-c9e2c928-3655-470a-a9c7-c5cc235156b0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:47.268750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-244dce11-cea8-486e-918f-372c8df584a5 req-c9e2c928-3655-470a-a9c7-c5cc235156b0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:47.275610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:47.276334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:47.277850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:47.279145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:47.283109 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-244dce11-cea8-486e-918f-372c8df584a5 req-c9e2c928-3655-470a-a9c7-c5cc235156b0 service nova] Creating event network-changed:bae544b5-0ba4-4436-be18-bd8870ec9835 for instance 872b5feb-08a2-4738-81eb-0593d065197e on nch2-master-1 Jul 02 21:22:47.283821 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-244dce11-cea8-486e-918f-372c8df584a5 req-c9e2c928-3655-470a-a9c7-c5cc235156b0 service nova] Creating event network-changed:31536cde-fbd7-4df4-955e-ab5a641d06e4 for instance 437883a3-6dc4-4818-8739-a52096e8709e on nch1-master-1 Jul 02 21:22:47.295900 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-244dce11-cea8-486e-918f-372c8df584a5 req-c9e2c928-3655-470a-a9c7-c5cc235156b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044419 Jul 02 21:22:47.297111 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2242/4506] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:47.629083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:47.711772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:47.725538 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3556fc8-1e93-44b2-ba2e-b0c46664538b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.461518 Jul 02 21:22:47.727589 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2265/4507] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:47 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:48.258338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:48.259774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:48.266796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:48.267620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:48.268606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:48.269198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:48.278909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:48.279521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:48.290280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:48.294794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:48.298211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:48.300116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:48.656694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:48.675150 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db2595a0-997c-41f8-b1a3-cd831712f8ed tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 0.421973 Jul 02 21:22:48.677627 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2243/4508] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:48 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:48.704441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:48.718752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1796cf93-f036-44de-81a4-58abda477fbe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.445057 Jul 02 21:22:48.719358 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2266/4509] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:48 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:48.744142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:48.744766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:48.753135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:48.753595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:48.754359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:48.757574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:48.788660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:48.860136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:49.385629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:49.393493 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3a49891e-aee3-451c-a062-13079db11ed5 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.653958 Jul 02 21:22:49.403578 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2244/4510] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:48 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:49.694183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:49.695050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:49.698596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:49.706781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:49.707486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:49.708671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:49.709502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:49.735519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:49.736405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:49.743195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:49.743942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:49.744975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:49.745621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:50.220655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:50.229292 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59510935-ed23-4e33-9e81-456a500bfd79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 0.539105 Jul 02 21:22:50.235797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:50.239873 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2267/4511] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:49 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:50.244335 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-36e8c759-534a-41ee-a707-b1681d191c7a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1495 microversion: 2.1 time: 0.512588 Jul 02 21:22:50.246202 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2245/4512] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:49 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1495 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:50.410985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:50.411611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:50.427904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:50.428300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:50.429298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:50.429893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:50.957499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:50.977397 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c740ba58-cc61-49a3-9d7a-731914517ad1 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.570314 Jul 02 21:22:50.981043 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2268/4513] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:50 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:51.225104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6a3b9064-6c0e-444e-a171-fa82ea3cebee req-c9c1358d-02aa-4c11-ba8d-6bc9c252081c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b5feb-08a2-4738-81eb-0593d065197e", "name": "network-vif-plugged", "status": "completed", "tag": "bae544b5-0ba4-4436-be18-bd8870ec9835"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:51.244893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6a3b9064-6c0e-444e-a171-fa82ea3cebee req-c9c1358d-02aa-4c11-ba8d-6bc9c252081c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.245604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6a3b9064-6c0e-444e-a171-fa82ea3cebee req-c9c1358d-02aa-4c11-ba8d-6bc9c252081c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:51.258540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:51.259167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:51.264785 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6a3b9064-6c0e-444e-a171-fa82ea3cebee req-c9c1358d-02aa-4c11-ba8d-6bc9c252081c service nova] Creating event network-vif-plugged:bae544b5-0ba4-4436-be18-bd8870ec9835 for instance 872b5feb-08a2-4738-81eb-0593d065197e on nch2-master-1 Jul 02 21:22:51.270148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.270611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:51.271406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.271857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:51.281991 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6a3b9064-6c0e-444e-a171-fa82ea3cebee req-c9c1358d-02aa-4c11-ba8d-6bc9c252081c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060615 Jul 02 21:22:51.283443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2246/4514] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:22:51.294707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:51.295421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:51.310387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.310860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:51.311653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.320314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:51.928539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:51.932705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:51.940549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25bc201d-9d7d-4557-ac4c-91b2437dd313 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1317 microversion: 2.1 time: 0.687272 Jul 02 21:22:51.941596 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2269/4515] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:51 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:51.942923 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ac0f453-7179-4ecc-a6c4-52ed8ec803a2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 200 len: 1472 microversion: 2.1 time: 0.657896 Jul 02 21:22:51.944355 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2247/4516] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:51 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 1472 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:51.960627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1608433363"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:51.963743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:51.971391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.972174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:51.973312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:51.974002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:52.006859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:52.007855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:52.014675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:52.019667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:52.021125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:52.024256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:52.278534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:52.289866 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18804762-c1ac-495a-96eb-efbc95071cd2 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.286834 Jul 02 21:22:52.296497 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2248/4517] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:52 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:52.398881 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f1a3e64-8c0c-4471-96a0-8156a4ef37d0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef/action" status: 202 len: 0 microversion: 2.1 time: 0.442397 Jul 02 21:22:52.404155 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2270/4518] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:22:51 2022] POST /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 02 21:22:52.413932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c9d20855-9083-4561-9c7e-7897a9f5a742 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76b0430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:52.515444 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c9d20855-9083-4561-9c7e-7897a9f5a742 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.105810 Jul 02 21:22:52.516090 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2249/4519] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:52 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:52.961312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:52.962538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:52.970103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:52.971063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:52.972439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:52.973333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.133341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:53.142752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63ffab9e-fbb9-4183-9d8e-6fb5369295d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1507 microversion: 2.1 time: 0.187714 Jul 02 21:22:53.143572 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2271/4520] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:52 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:53.159743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:53.160723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:53.168358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.168807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.169563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.170166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.202463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:22:53.287282 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-010b983c-155a-43f2-b353-c839e66bcee0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 204 len: 0 microversion: 2.1 time: 0.130587 Jul 02 21:22:53.289075 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2250/4521] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:22:53 2022] DELETE /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:22:53.299607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:53.301026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:53.305829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-05775ebd-3b7a-400f-b6fe-08137afe0c0f req-d3c0f5ed-8354-42dc-bf13-1518ef6201a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437883a3-6dc4-4818-8739-a52096e8709e", "name": "network-vif-plugged", "status": "completed", "tag": "31536cde-fbd7-4df4-955e-ab5a641d06e4"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:53.310263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.315631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.315838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-05775ebd-3b7a-400f-b6fe-08137afe0c0f req-d3c0f5ed-8354-42dc-bf13-1518ef6201a9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.316114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-05775ebd-3b7a-400f-b6fe-08137afe0c0f req-d3c0f5ed-8354-42dc-bf13-1518ef6201a9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.317093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.317706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.327679 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-05775ebd-3b7a-400f-b6fe-08137afe0c0f req-d3c0f5ed-8354-42dc-bf13-1518ef6201a9 service nova] Creating event network-vif-plugged:31536cde-fbd7-4df4-955e-ab5a641d06e4 for instance 437883a3-6dc4-4818-8739-a52096e8709e on nch1-master-1 Jul 02 21:22:53.332959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-05775ebd-3b7a-400f-b6fe-08137afe0c0f req-d3c0f5ed-8354-42dc-bf13-1518ef6201a9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032572 Jul 02 21:22:53.333578 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2251/4522] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:53.338911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:53.339993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:53.346555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.347022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:53.347966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:53.348435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:54.016858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:54.034371 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d5185c0f-d7c8-4892-a6e5-fb203cda4ce2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1513 microversion: 2.1 time: 0.740433 Jul 02 21:22:54.039872 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2272/4523] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:53 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1513 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:54.055546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:54.060434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-89b81bb4-0e73-4eb6-8594-bc6f5cd5ea7f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd774a310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:54.063237 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce0806e0-375a-423f-a3db-ab6476f00182 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.728374 Jul 02 21:22:54.072598 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2252/4524] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:53 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:54.132724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-89b81bb4-0e73-4eb6-8594-bc6f5cd5ea7f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.089892 Jul 02 21:22:54.136401 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2273/4525] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:54 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:55.056276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:55.056878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:55.064762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:55.065214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:55.065982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:55.074881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:55.103800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:55.105112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:55.115570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:55.116294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:55.118095 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:55.118707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:55.588352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:55.598807 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b55597e4-08f2-4ade-8aea-31fb0b50634c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1429 microversion: 2.1 time: 0.513306 Jul 02 21:22:55.617671 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2274/4526] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:55 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1429 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:55.617671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a2937484-868c-4b25-8c16-26e95dd5308d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77a70d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:55.634831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:55.645731 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e68bd94-3862-4d0a-8612-56c6540602a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1513 microversion: 2.1 time: 0.594093 Jul 02 21:22:55.651342 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2253/4527] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:55 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1513 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:55.711525 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a2937484-868c-4b25-8c16-26e95dd5308d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.101216 Jul 02 21:22:55.712146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2275/4528] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:55 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:56.433197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ca477e4f-227a-4c82-a791-5752267b2ffb req-9b6d9346-d615-4fe3-89a5-e7cdf31ba084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b5feb-08a2-4738-81eb-0593d065197e", "name": "network-vif-deleted", "tag": "bae544b5-0ba4-4436-be18-bd8870ec9835"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:56.451268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ca477e4f-227a-4c82-a791-5752267b2ffb req-9b6d9346-d615-4fe3-89a5-e7cdf31ba084 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:56.451722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ca477e4f-227a-4c82-a791-5752267b2ffb req-9b6d9346-d615-4fe3-89a5-e7cdf31ba084 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:56.495799 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ca477e4f-227a-4c82-a791-5752267b2ffb req-9b6d9346-d615-4fe3-89a5-e7cdf31ba084 service nova] Creating event network-vif-deleted:bae544b5-0ba4-4436-be18-bd8870ec9835 for instance 872b5feb-08a2-4738-81eb-0593d065197e on nch2-master-1 Jul 02 21:22:56.514669 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ca477e4f-227a-4c82-a791-5752267b2ffb req-9b6d9346-d615-4fe3-89a5-e7cdf31ba084 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084985 Jul 02 21:22:56.517994 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2254/4529] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:56.627973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:56.628887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:56.640613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:56.645564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:56.647551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:56.649522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:56.649979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:56.667459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:56.668399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:56.683836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:56.684415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:56.704632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:56.705292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:56.776540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:56.778146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:56.778857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lazy-loading 'fault' on Instance uuid 872b5feb-08a2-4738-81eb-0593d065197e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:22:57.027886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:57.035988 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0480b349-612e-400d-9670-0943ed420f97 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 200 len: 1307 microversion: 2.1 time: 0.373447 Jul 02 21:22:57.038758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2255/4530] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:56 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 1307 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:57.058121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e5c7a18-357c-4315-b5e4-8f7554a8165c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72c6940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:57.150983 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e5c7a18-357c-4315-b5e4-8f7554a8165c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.110199 Jul 02 21:22:57.153324 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2256/4531] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:57 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:57.240761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:57.244138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:57.280200 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d326e80-31b2-401e-962a-2df8d860d73b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1609 microversion: 2.1 time: 0.655308 Jul 02 21:22:57.294457 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2276/4532] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:56 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1609 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:57.319940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:57.320628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:57.363749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:57.366920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:57.368070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:57.368619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:57.662152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Calling method '.version_select at 0x7fabd772c670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:57.663066 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:22:57.663066 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:22:57.664311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:57.664776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:57.685630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:57.705649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:57.706140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:57.734327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:57.735066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:57.745349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:22:57.756014 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d1080a6-52ca-42d5-94ee-226b152058ec tempest-PortsAdminExtendedAttrsTestJSON-806025909 tempest-PortsAdminExtendedAttrsTestJSON-806025909-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.506186 Jul 02 21:22:57.758747 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2257/4533] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:22:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:57.774032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-133bee67-a5d0-40cc-9d64-7ad40982ef17 req-ed51a508-8f44-4ef1-a71f-5a99b8251cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13e2b0a-de26-41fb-ac2d-1650603b63ef", "name": "network-vif-plugged", "status": "completed", "tag": "2421e496-bb31-40d3-8be8-422ce36c23e8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:57.797949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-133bee67-a5d0-40cc-9d64-7ad40982ef17 req-ed51a508-8f44-4ef1-a71f-5a99b8251cbc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:57.799015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-133bee67-a5d0-40cc-9d64-7ad40982ef17 req-ed51a508-8f44-4ef1-a71f-5a99b8251cbc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:57.820891 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-133bee67-a5d0-40cc-9d64-7ad40982ef17 req-ed51a508-8f44-4ef1-a71f-5a99b8251cbc service nova] Creating event network-vif-plugged:2421e496-bb31-40d3-8be8-422ce36c23e8 for instance d13e2b0a-de26-41fb-ac2d-1650603b63ef on nch2-master-1 Jul 02 21:22:57.832456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-133bee67-a5d0-40cc-9d64-7ad40982ef17 req-ed51a508-8f44-4ef1-a71f-5a99b8251cbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072066 Jul 02 21:22:57.833618 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2258/4534] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:22:57.917396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:57.964701 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adcde22d-00b5-4ec7-9d7a-79bb9944ee7a tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1609 microversion: 2.1 time: 0.663024 Jul 02 21:22:57.979106 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2277/4535] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:57 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1609 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:57.997279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:57.998598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:58.013277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:58.014770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:58.019079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:58.019560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:58.055159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:58.058278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:58.076688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:58.077206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:58.081752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:58.084827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:58.140179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e HTTP/1.1 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '872b5feb-08a2-4738-81eb-0593d065197e'} Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:22:58.142390 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:22:58.147874 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:22:58.150178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:22:58.152106 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e240b0e6-2df2-4b0c-bdb4-c6acd69d6df8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 404 len: 111 microversion: 2.1 time: 0.102626 Jul 02 21:22:58.153444 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2278/4536] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:58 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:22:58.172149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:58.173461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:58.181738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:58.182399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:58.184379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:58.185213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:58.610284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:58.625853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9c598976-3df4-4235-abd8-07b60d46d085 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1609 microversion: 2.1 time: 0.634379 Jul 02 21:22:58.628710 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2259/4537] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:57 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1609 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:58.638292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e7d1255-252e-4336-b59e-6afdd23da113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd772cca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:58.747353 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e7d1255-252e-4336-b59e-6afdd23da113 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.115210 Jul 02 21:22:58.748015 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2260/4538] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:58 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:58.792421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:58.805350 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ffe8e95-13d0-412c-95c0-b9def09f02a2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.647177 Jul 02 21:22:58.806239 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2279/4539] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:58 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:22:59.025826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01dc0956-1d58-4c13-9a0a-3caeb5160d0a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01dc0956-1d58-4c13-9a0a-3caeb5160d0a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 163 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": 12345, "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 12345 Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:22:59.029439 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01dc0956-1d58-4c13-9a0a-3caeb5160d0a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:22:59.034429 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-01dc0956-1d58-4c13-9a0a-3caeb5160d0a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.010819 Jul 02 21:22:59.042467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:59.043142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:59.046143 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2261/4540] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:22:59 2022] POST /compute/v2.1/servers => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:22:59.068393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:59.068857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:59.073643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:59.074297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:59.645306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:22:59.664579 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bc7ab66-ba87-4d26-8791-a3a4effa924b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.622106 Jul 02 21:22:59.665913 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2280/4541] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:59 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:22:59.687068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:59.688388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:22:59.701201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:59.702114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:59.703358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:22:59.706744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:22:59.761221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36234233-fcf3-4da7-8080-f20900a0bbb5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd779edc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:22:59.833751 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36234233-fcf3-4da7-8080-f20900a0bbb5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.076683 Jul 02 21:22:59.839560 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2281/4542] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:22:59 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:00.211287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:00.222682 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fe5e207f-a211-405b-ae3e-be577ac6c471 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.541585 Jul 02 21:23:00.236354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2262/4543] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:22:59 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:00.849439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53fb7e64-2664-4109-be81-394a6c3a47ca tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77408b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:00.929020 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53fb7e64-2664-4109-be81-394a6c3a47ca tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.085576 Jul 02 21:23:00.929618 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2282/4544] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:00 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:01.943491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2113d3bb-3767-432f-9b36-bc663d8def78 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76ca160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:02.035338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2113d3bb-3767-432f-9b36-bc663d8def78 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.096987 Jul 02 21:23:02.042173 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2263/4545] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:01 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:02.078675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:02.079350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:02.093834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:02.097465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:02.098403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:02.098854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:02.517250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:02.529470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48c032ee-f0c7-4c69-9f4e-5d527b5241db tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.456553 Jul 02 21:23:02.544442 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2283/4546] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:02 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:02.574140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:02.577599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:02.593181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:02.593612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:02.594518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:02.595135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:03.016059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:03.029752 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4bdd7d8f-3f9f-49ba-ac57-b213af90e157 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.460850 Jul 02 21:23:03.031279 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2264/4547] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:02 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:03.052998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ee60cf5-eaa4-4c52-9920-1ac626ef3241 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77a7670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:03.155454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ee60cf5-eaa4-4c52-9920-1ac626ef3241 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.109844 Jul 02 21:23:03.161398 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2284/4548] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:03 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:03.803936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1505524481", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:03.933660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] validate_networks() for [('5879f9a5-02b6-475e-bf53-8107e8a03fab', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:23:04.170206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c90b1408-611f-4b5c-a86f-3165a768789c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd78b0430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:04.253117 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c90b1408-611f-4b5c-a86f-3165a768789c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.087267 Jul 02 21:23:04.259303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2285/4549] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:04 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:04.702433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e93866bc-d401-47f0-b9fd-f016bc013719 req-daa867fd-0662-400a-9609-6e70be5b5c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "437883a3-6dc4-4818-8739-a52096e8709e", "tag": "31536cde-fbd7-4df4-955e-ab5a641d06e4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:04.724204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e93866bc-d401-47f0-b9fd-f016bc013719 req-daa867fd-0662-400a-9609-6e70be5b5c7c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:04.724798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e93866bc-d401-47f0-b9fd-f016bc013719 req-daa867fd-0662-400a-9609-6e70be5b5c7c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:04.756496 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e93866bc-d401-47f0-b9fd-f016bc013719 req-daa867fd-0662-400a-9609-6e70be5b5c7c service nova] Creating event network-changed:31536cde-fbd7-4df4-955e-ab5a641d06e4 for instance 437883a3-6dc4-4818-8739-a52096e8709e on nch1-master-1 Jul 02 21:23:04.766754 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e93866bc-d401-47f0-b9fd-f016bc013719 req-daa867fd-0662-400a-9609-6e70be5b5c7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228366 Jul 02 21:23:04.771658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2286/4550] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:23:04.779265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:04.784450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:04.801120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:04.801893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:04.806078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:04.806798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:05.407806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:05.419319 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4d5f015-0ecf-4269-a84a-ff7d8b798ad0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.645889 Jul 02 21:23:05.435498 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2287/4551] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:04 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:05.454699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bcefd934-d4b4-41b0-ad11-a34a898a7154 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77a7280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:05.540882 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bcefd934-d4b4-41b0-ad11-a34a898a7154 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.101901 Jul 02 21:23:05.541731 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2288/4552] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:05 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:05.555166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:05.556329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:05.563805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:05.564337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:05.565336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:05.565774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:05.727698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:23:05.739254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:23:05.739922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:23:05.741602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:23:05.742055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:23:05.762933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:05.763701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:05.764728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:05.766476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:05.813684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Getting quotas for project a0c14d320e154cedb7b37f38873f241e. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:23:05.824514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Getting quotas for user 23d7253b721f409ab148368d84b87963 and project a0c14d320e154cedb7b37f38873f241e. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:23:05.875761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:23:05.878870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:23:06.010285 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac4469aa-f774-4b74-b85b-2f6b6160f943 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.333096 Jul 02 21:23:06.012995 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2265/4553] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:23:06.057087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38ea1f96-a349-4031-bbbe-fd31ea683285 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:06.060505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38ea1f96-a349-4031-bbbe-fd31ea683285 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:06.434825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38ea1f96-a349-4031-bbbe-fd31ea683285 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:06.445679 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38ea1f96-a349-4031-bbbe-fd31ea683285 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1214 microversion: 2.1 time: 0.395371 Jul 02 21:23:06.455975 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2266/4554] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:06 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:06.555976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-09e519af-cddd-4141-984d-5fc317b91e77 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72d04c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:06.591954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:06.608239 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-57fd6d86-5812-4130-93ca-4f0995b48670 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 1.051023 Jul 02 21:23:06.613821 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2289/4555] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:05 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:06.663084 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-09e519af-cddd-4141-984d-5fc317b91e77 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.111512 Jul 02 21:23:06.665299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2267/4556] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:06 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:06.713438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8f4db31-bc96-4aa6-8495-f5a970e7a796 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1994747838", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8f4db31-bc96-4aa6-8495-f5a970e7a796 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 492 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1994747838", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1994747838', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.717337 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 02 21:23:06.721308 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:06.723665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8f4db31-bc96-4aa6-8495-f5a970e7a796 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:06.726130 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8f4db31-bc96-4aa6-8495-f5a970e7a796 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.016888 Jul 02 21:23:06.730894 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2290/4557] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:06 2022] POST /compute/v2.1/servers => generated 624 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:06.736971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:06.737599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:06.755196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:06.755647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:06.756457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:06.759325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:07.329006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:07.348823 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f0a36a6-6bcb-41cc-9ec9-b2cb3458569a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.615605 Jul 02 21:23:07.349674 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2268/4558] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:06 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:07.370943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:07.374789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:07.400649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:07.402467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:07.409749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:07.412131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:07.464830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:07.465516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:07.476288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:07.478108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:07.480181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:07.482276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:07.730419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:07.757273 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-10454c74-d15a-4f20-a7cf-390e9e891f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1266 microversion: 2.1 time: 0.292851 Jul 02 21:23:07.759732 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2269/4559] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:07 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:07.777417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3474079c-810c-455a-ba0c-d6d434ea7954 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76ca5e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:07.897924 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3474079c-810c-455a-ba0c-d6d434ea7954 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.136969 Jul 02 21:23:07.898752 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2270/4560] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:07 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:07.898909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:07.911115 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e77cd755-af8f-4bfb-8434-3042d123a161 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.545156 Jul 02 21:23:07.913484 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2291/4561] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:07 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5e72884-6f7e-4277-9295-d7a2edce286e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5e72884-6f7e-4277-9295-d7a2edce286e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 416 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:23:08.029132 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5e72884-6f7e-4277-9295-d7a2edce286e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:08.035625 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5e72884-6f7e-4277-9295-d7a2edce286e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.035335 Jul 02 21:23:08.038611 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2271/4562] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:07 2022] POST /compute/v2.1/servers => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:08.038904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:08.039530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:08.051300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:08.051761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:08.052600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:08.053047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:08.629431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:08.644448 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14a155d3-41bf-4d61-a885-5d1cbfdcb0fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.605527 Jul 02 21:23:08.645370 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2292/4563] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:08 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:08.663407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:08.664945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:08.677729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:08.678576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:08.680555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:08.682575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:08.776962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:08.777682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:08.789807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:08.790663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:08.793164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:08.793830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:08.991983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:09.005172 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d7f1c22-8d96-4881-bd97-764e01c8f495 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1272 microversion: 2.1 time: 0.232306 Jul 02 21:23:09.008898 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2293/4564] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:08 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:09.014961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca212d2e-0f06-4c52-93f1-1f5d9d922c6e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7995550>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:09.104924 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca212d2e-0f06-4c52-93f1-1f5d9d922c6e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.091639 Jul 02 21:23:09.107184 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2294/4565] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:09 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:09.277193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:09.290670 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c7f6b0f-0759-48d8-83e7-e27c1959fa18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.632364 Jul 02 21:23:09.307109 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2272/4566] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:08 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:09.432290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6683337-96f0-4edd-8021-edd8de07f90b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290954346", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": -1, "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:09.468665 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b6683337-96f0-4edd-8021-edd8de07f90b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Flavor -1 could not be found. Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6683337-96f0-4edd-8021-edd8de07f90b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 205 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290954346", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": -1, "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: exception: Flavor -1 could not be found. Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-290954346', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': -1, 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:09.483283 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 02 21:23:09.488924 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:09.490378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6683337-96f0-4edd-8021-edd8de07f90b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:09.490517 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6683337-96f0-4edd-8021-edd8de07f90b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.064575 Jul 02 21:23:09.491361 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2295/4567] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:09 2022] POST /compute/v2.1/servers => generated 73 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 02 21:23:09.508218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:09.508867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:09.519851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:09.529511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:09.531424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:09.531879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:09.895119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:09.905749 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-57c99a7e-e973-4e50-852d-b1addb267a2a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.402184 Jul 02 21:23:09.906353 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2273/4568] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:09 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:09.928711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:09.930263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:09.939828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:09.940694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:09.941734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:09.942394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:10.026225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:10.027589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:10.048658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:10.050719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:10.052952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:10.054819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:10.612427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:10.628836 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccf6bdd1-46f1-4732-ac37-740918da96fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1272 microversion: 2.1 time: 0.601718 Jul 02 21:23:10.629757 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2274/4569] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:10 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1272 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:10.645532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-72926097-a604-456c-b7b6-cffcf694662d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd728b0d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:10.725283 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-72926097-a604-456c-b7b6-cffcf694662d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.094225 Jul 02 21:23:10.725872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2275/4570] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:10 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:10.758606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:10.774193 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03a686db-54b1-498a-9bc6-987fc55b9d0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.854444 Jul 02 21:23:10.774826 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2296/4571] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:09 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:10.842300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb888caa-6c9f-4c3c-8e65-29bef99fd263 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1765754428", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb888caa-6c9f-4c3c-8e65-29bef99fd263 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 173 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1765754428", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1765754428', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi -1 Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:23:10.845925 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 02 21:23:10.850176 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:10.860263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb888caa-6c9f-4c3c-8e65-29bef99fd263 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:10.861426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fb888caa-6c9f-4c3c-8e65-29bef99fd263 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.025003 Jul 02 21:23:10.862568 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2276/4572] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:10 2022] POST /compute/v2.1/servers => generated 145 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:10.870580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:10.872240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:10.885751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:10.886402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:10.887305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:10.887774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:11.247847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:11.265566 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0f4771b-e7ae-4f4e-a35d-fb53cda71c0b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.398048 Jul 02 21:23:11.267169 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2297/4573] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:10 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:11.284869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:11.285813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:11.294603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:11.295428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:11.297155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:11.297767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:11.646458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:11.647185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:11.656437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:11.659850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:11.665643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:11.666328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:11.702337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:11.721114 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-05b4f8e7-1988-491d-8f4c-7023910138a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.440098 Jul 02 21:23:11.724854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2277/4574] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:11 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:11.741585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac213dbc-717d-4bba-a55c-25ca21d0e5b2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7282b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:11.839201 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac213dbc-717d-4bba-a55c-25ca21d0e5b2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.101614 Jul 02 21:23:11.840065 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2278/4575] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:11 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:11.854609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2dbb820-794b-4e0d-8e93-62b7764206c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1169759416", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:11.863582 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-b2dbb820-794b-4e0d-8e93-62b7764206c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2dbb820-794b-4e0d-8e93-62b7764206c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 216 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1169759416", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1169759416', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 02 21:23:11.878256 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2dbb820-794b-4e0d-8e93-62b7764206c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:11.882282 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b2dbb820-794b-4e0d-8e93-62b7764206c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.038547 Jul 02 21:23:11.886299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2279/4576] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:11 2022] POST /compute/v2.1/servers => generated 123 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:11.899579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:11.900184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:11.916844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:11.917286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:11.918256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:11.919044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:12.539873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:12.555457 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7754077d-e5f3-4e21-8ab7-475b8a6b83c7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.907160 Jul 02 21:23:12.556755 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2298/4577] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:11 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:12.776744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:12.790128 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5b796f5-e430-4e72-8cef-84befe690571 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.904067 Jul 02 21:23:12.790715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2280/4578] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:11 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:12.809299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:12.810169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:12.821242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:12.823357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:12.824356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:12.826733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:12.853575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e6dcd9b4-e1c0-47e4-b72a-384d01de2ff1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72feb80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:12.921719 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e6dcd9b4-e1c0-47e4-b72a-384d01de2ff1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.072119 Jul 02 21:23:12.922938 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2281/4579] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:12 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:13.214094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:13.254513 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-039dbc74-3f37-46b5-8b90-799a7627d11a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.448884 Jul 02 21:23:13.258877 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2299/4580] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:12 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:13.334189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-14ab55e0-fbd9-4e00-9bb4-1b0b24dc3614 req-f6308cc9-f80d-4d41-834d-b34a6cfa7a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49932e4c-c9f4-4846-806a-6f26765484c8", "tag": "2eae8e0f-748a-472f-b663-d620ddd7d063"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:13.345508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d5def31-74da-43c3-85fd-a2c5928c050f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1298843606", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "key_name": "tempest-key-1331311371", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:13.371160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-14ab55e0-fbd9-4e00-9bb4-1b0b24dc3614 req-f6308cc9-f80d-4d41-834d-b34a6cfa7a97 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:13.371884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-14ab55e0-fbd9-4e00-9bb4-1b0b24dc3614 req-f6308cc9-f80d-4d41-834d-b34a6cfa7a97 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:13.392216 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-14ab55e0-fbd9-4e00-9bb4-1b0b24dc3614 req-f6308cc9-f80d-4d41-834d-b34a6cfa7a97 service nova] Creating event network-changed:2eae8e0f-748a-472f-b663-d620ddd7d063 for instance 49932e4c-c9f4-4846-806a-6f26765484c8 on nch2-master-1 Jul 02 21:23:13.405751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-14ab55e0-fbd9-4e00-9bb4-1b0b24dc3614 req-f6308cc9-f80d-4d41-834d-b34a6cfa7a97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075312 Jul 02 21:23:13.407174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2282/4581] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:23:13.462575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-5d5def31-74da-43c3-85fd-a2c5928c050f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] validate_networks() for [('ac866851-1437-4af9-8d9a-d4d3a0ac85af', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:23:13.573739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:13.574435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:13.586468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:13.586925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:13.587730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:13.588197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:14.220850 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5d5def31-74da-43c3-85fd-a2c5928c050f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Invalid key_name provided. Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d5def31-74da-43c3-85fd-a2c5928c050f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 247 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1298843606", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "key_name": "tempest-key-1331311371", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid key_name provided. Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1298843606', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'key_name': 'tempest-key-1331311371', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1331311371 not found for user 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:14.223643 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d5def31-74da-43c3-85fd-a2c5928c050f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid key_name provided. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d5def31-74da-43c3-85fd-a2c5928c050f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.883662 Jul 02 21:23:14.227816 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2300/4582] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:13 2022] POST /compute/v2.1/servers => generated 70 bytes in 885 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jul 02 21:23:14.248859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:14.249408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-631ffc35-4617-4500-8a2b-12acb9085c30 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd775edc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:14.260831 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f20b0061-bf9b-44d1-a4f7-a2abb00f0807 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.691289 Jul 02 21:23:14.261711 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2283/4583] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:13 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:14.266284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:14.266881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:14.287472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:14.287932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:14.288780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:14.289218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:14.336600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-631ffc35-4617-4500-8a2b-12acb9085c30 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.109741 Jul 02 21:23:14.337542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2301/4584] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:14 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:14.759292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:14.767909 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8a719dab-37b0-45ad-abb3-5f85e81b26fa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.505033 Jul 02 21:23:14.772338 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2284/4585] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:14 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:14.794308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:14.795052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:14.840946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:14.841408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:14.844760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:14.849454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:15.121561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:15.134581 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-121ad5a1-c122-447b-ae09-40cd31fbc928 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.344522 Jul 02 21:23:15.135910 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2302/4586] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:14 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:15.217165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a46245db-3cb2-4394-8202-852c59c8a17c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-349358574", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:15.290389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:15.290996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:15.309548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:15.312422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:15.313440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:15.314989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:15.519964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.security_group_api [None req-a46245db-3cb2-4394-8202-852c59c8a17c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Neutron security group does_not_exist not found {{(pid=131045) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 02 21:23:15.521246 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a46245db-3cb2-4394-8202-852c59c8a17c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a46245db-3cb2-4394-8202-852c59c8a17c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 257 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-349358574", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-349358574', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:15.543891 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 02 21:23:15.549053 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:15.560007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a46245db-3cb2-4394-8202-852c59c8a17c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:15.560007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a46245db-3cb2-4394-8202-852c59c8a17c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.342219 Jul 02 21:23:15.560753 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2285/4587] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:15 2022] POST /compute/v2.1/servers => generated 106 bytes in 349 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:15.568297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4362e2d2-cd49-418c-87bd-eb5d25c4a5e7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72c6160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:15.631108 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4362e2d2-cd49-418c-87bd-eb5d25c4a5e7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1412 microversion: 2.1 time: 0.068654 Jul 02 21:23:15.632172 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2286/4588] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:15 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:15.638159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:15.639398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:15.646239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:15.647692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:15.648635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:15.649304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:15.792785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:15.802682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:15.815576 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c35a18ba-b99a-40b8-be67-afe517cb1040 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.529624 Jul 02 21:23:15.821052 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2303/4589] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:15 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:15.990367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:16.000500 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b4d608f2-2dd1-4cde-a0a2-73bda363f967 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.366815 Jul 02 21:23:16.001366 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2287/4590] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:15 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:16.020493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.023485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:16.039288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.039654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.040536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.041573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.248794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:16.253703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:16.267658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8be2f5aa-f055-459e-a6c7-54166ced137e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.250979 Jul 02 21:23:16.270218 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2304/4591] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:16 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:16.285120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acef3c12-7c9a-4d4a-93c2-b1cb0dd1b594 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.285619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acef3c12-7c9a-4d4a-93c2-b1cb0dd1b594 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: e8380896-6d0a-450a-95c8-be163c25edfe] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:16.291620 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-acef3c12-7c9a-4d4a-93c2-b1cb0dd1b594 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance e8380896-6d0a-450a-95c8-be163c25edfe could not be found. Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acef3c12-7c9a-4d4a-93c2-b1cb0dd1b594 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/e8380896-6d0a-450a-95c8-be163c25edfe HTTP/1.1 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance e8380896-6d0a-450a-95c8-be163c25edfe could not be found. Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'e8380896-6d0a-450a-95c8-be163c25edfe'} Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8380896-6d0a-450a-95c8-be163c25edfe could not be found. Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8380896-6d0a-450a-95c8-be163c25edfe could not be found. Jul 02 21:23:16.293376 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8380896-6d0a-450a-95c8-be163c25edfe could not be found. Jul 02 21:23:16.297449 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:16.298028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acef3c12-7c9a-4d4a-93c2-b1cb0dd1b594 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance e8380896-6d0a-450a-95c8-be163c25edfe could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:16.298967 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acef3c12-7c9a-4d4a-93c2-b1cb0dd1b594 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e8380896-6d0a-450a-95c8-be163c25edfe" status: 404 len: 111 microversion: 2.1 time: 0.017864 Jul 02 21:23:16.299729 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2288/4592] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:23:16 2022] DELETE /compute/v2.1/servers/e8380896-6d0a-450a-95c8-be163c25edfe => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:16.308707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.309994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:16.321163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.321622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.322412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.322846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.586583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:16.607002 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1fec80d-ffa8-4400-81b6-d8dfcb3cfda3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.302874 Jul 02 21:23:16.607615 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2305/4593] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:16 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:16.627248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.628611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:16.633997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:16.638364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.644926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-587248b1-403e-4f55-91c7-cfaaff6ab8ec tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7995ca0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.647200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.650347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.652243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.723351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-587248b1-403e-4f55-91c7-cfaaff6ab8ec tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1421 microversion: 2.1 time: 0.075476 Jul 02 21:23:16.724287 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2306/4594] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:16 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:16.735262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea538fd1-07f3-4ad3-860c-6da016bdf106 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe405c4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.827319 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea538fd1-07f3-4ad3-860c-6da016bdf106 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 200 len: 1421 microversion: 2.1 time: 0.095668 Jul 02 21:23:16.828494 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2307/4595] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:16 2022] GET /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:16.844697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:16.845507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:16.854730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.855399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.856793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:16.857405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:16.920183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:16.931648 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2b42f0b-5d18-4c6f-9d12-fe5d2473ee12 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.309762 Jul 02 21:23:16.932280 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2289/4596] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:16 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:16.951691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-210c6598-0301-4826-aa37-d012c2181ff0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72c60d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.070141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:17.080008 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e972a78-deec-4a9b-9dcc-ab39d40c4439 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.247027 Jul 02 21:23:17.081649 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2308/4597] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:16 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:17.091137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10503829-24da-4f6a-81cb-aff51504f219 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.093264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10503829-24da-4f6a-81cb-aff51504f219 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:23:17.093805 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-10503829-24da-4f6a-81cb-aff51504f219 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10503829-24da-4f6a-81cb-aff51504f219 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9223372036854775808 could not be found. Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9223372036854775808'} Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.095335 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10503829-24da-4f6a-81cb-aff51504f219 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10503829-24da-4f6a-81cb-aff51504f219 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.014517 Jul 02 21:23:17.099473 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2309/4598] 10.222.0.43 () {58 vars in 1187 bytes} [Sat Jul 2 21:23:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:23:17.123755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.124417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:17.143574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.144006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.144927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.145379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.391965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:17.406179 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9e7d8e5-cb29-44ee-919d-c820ea0e50ff tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.297211 Jul 02 21:23:17.407393 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2310/4599] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:17 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:17.426736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.427510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:17.457332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.458670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.459710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.463722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.650710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:17.667148 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a8c5035-9470-4022-a0c1-f2072cd93a89 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.246293 Jul 02 21:23:17.668380 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2311/4600] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:17 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:17.686518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-166be1a2-756b-4bbe-ab84-968b69047a16 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.687011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-166be1a2-756b-4bbe-ab84-968b69047a16 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Failed to fetch instance by id -1 {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 02 21:23:17.687851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-166be1a2-756b-4bbe-ab84-968b69047a16 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance -1 could not be found. Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-166be1a2-756b-4bbe-ab84-968b69047a16 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance -1 could not be found. Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '-1'} Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:17.689420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-166be1a2-756b-4bbe-ab84-968b69047a16 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-166be1a2-756b-4bbe-ab84-968b69047a16 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.009626 Jul 02 21:23:17.694814 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2312/4601] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:23:17 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:23:17.701949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.702655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:17.711717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.712757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.714371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.715178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.818437 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-210c6598-0301-4826-aa37-d012c2181ff0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 204 len: 0 microversion: 2.1 time: 0.871212 Jul 02 21:23:17.819110 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2290/4602] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:16 2022] DELETE /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 0 bytes in 874 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:23:17.828847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:17.829852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:17.837470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.838443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.839572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:17.840343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:17.874470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:23:17.906562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:17.970638 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9ae199ad-091f-49a2-9766-72b4328e91fe tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 204 len: 0 microversion: 2.1 time: 0.145794 Jul 02 21:23:17.971785 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2291/4603] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:23:17 2022] DELETE /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:23:17.972218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:17.992580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-abbea4fb-b3bf-4960-87ea-a51bb17d531b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.295488 Jul 02 21:23:17.993572 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2313/4604] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:17 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:18.016312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:18.017098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:18.029008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.029470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.030272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.030718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.099204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:18.100411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:18.108795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.121545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.122975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.123764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.293172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:18.308537 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9134da9-e819-4036-b77a-f83a34b957f3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.298235 Jul 02 21:23:18.309771 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2292/4605] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:18 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:18.323965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1824129380", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "5354096e-b039-4010-8707-3aebf48750f0"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:18.387439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:18.396546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e115fdb-ffb1-4c08-96d3-c4c61acf8c19 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.302080 Jul 02 21:23:18.398017 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2314/4606] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:18 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:18.404294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] validate_networks() for [('5354096e-b039-4010-8707-3aebf48750f0', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:23:18.415934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46559624-a055-4656-a480-b7267d8c776e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:18.416801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46559624-a055-4656-a480-b7267d8c776e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 0f8fc83d-f769-4389-8917-7c8608b86255] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:18.424678 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-46559624-a055-4656-a480-b7267d8c776e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 0f8fc83d-f769-4389-8917-7c8608b86255 could not be found. Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46559624-a055-4656-a480-b7267d8c776e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/0f8fc83d-f769-4389-8917-7c8608b86255/action HTTP/1.1 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 19 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: {"forceDelete": {}} Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 0f8fc83d-f769-4389-8917-7c8608b86255 could not be found. Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '0f8fc83d-f769-4389-8917-7c8608b86255', 'body': {'forceDelete': {}}} Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f8fc83d-f769-4389-8917-7c8608b86255 could not be found. Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f8fc83d-f769-4389-8917-7c8608b86255 could not be found. Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:18.430750 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:18.434917 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:18.434917 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:18.434917 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:18.434917 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f8fc83d-f769-4389-8917-7c8608b86255 could not be found. Jul 02 21:23:18.434917 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:18.436303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46559624-a055-4656-a480-b7267d8c776e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 0f8fc83d-f769-4389-8917-7c8608b86255 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:18.437232 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46559624-a055-4656-a480-b7267d8c776e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/0f8fc83d-f769-4389-8917-7c8608b86255/action" status: 404 len: 111 microversion: 2.1 time: 0.027519 Jul 02 21:23:18.438343 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2315/4607] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:18 2022] POST /compute/v2.1/servers/0f8fc83d-f769-4389-8917-7c8608b86255/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:18.447277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:18.448251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:18.457597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.458159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.459022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.459546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.681028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:18.695063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ee1cc57-5e29-4e6a-abc8-6f473d9df174 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.252663 Jul 02 21:23:18.697845 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2316/4608] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:18 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:18.716844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:18.717839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:18.726843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.727459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:18.728320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:18.728858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.379423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:23:19.379903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:23:19.380357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:23:19.380772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:23:19.381189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:23:19.402915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.403381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.404261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.404703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.426315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:19.441043 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99c68652-7fe4-43f2-b415-2212c29af6cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.731446 Jul 02 21:23:19.441825 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2317/4609] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:18 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:19.446940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a0ef51ed-3678-44de-892f-20137ceffdb2 req-0e432b58-d2c8-4acf-ab94-231cbe1354f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49932e4c-c9f4-4846-806a-6f26765484c8", "name": "network-vif-plugged", "status": "completed", "tag": "2eae8e0f-748a-472f-b663-d620ddd7d063"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:19.453121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:23:19.457999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a0ef51ed-3678-44de-892f-20137ceffdb2 req-0e432b58-d2c8-4acf-ab94-231cbe1354f7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.458732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a0ef51ed-3678-44de-892f-20137ceffdb2 req-0e432b58-d2c8-4acf-ab94-231cbe1354f7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.464109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for user fa780176ae5f4a618e42a47531b0d4a5 and project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:23:19.472777 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a0ef51ed-3678-44de-892f-20137ceffdb2 req-0e432b58-d2c8-4acf-ab94-231cbe1354f7 service nova] Creating event network-vif-plugged:2eae8e0f-748a-472f-b663-d620ddd7d063 for instance 49932e4c-c9f4-4846-806a-6f26765484c8 on nch2-master-1 Jul 02 21:23:19.484640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a0ef51ed-3678-44de-892f-20137ceffdb2 req-0e432b58-d2c8-4acf-ab94-231cbe1354f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041138 Jul 02 21:23:19.486740 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2318/4610] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:23:19.493086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:23:19.495760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:23:19.497116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:19.497830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:19.517483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.518021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.518811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.524832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.600153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-84ec9cad-931b-452d-b11a-c88121a1094e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.288966 Jul 02 21:23:19.602742 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2293/4611] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:23:19.608651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-413185a4-a77c-4467-b46d-4fa3ab8b35e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:19.610185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-413185a4-a77c-4467-b46d-4fa3ab8b35e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 7a26e773-0849-42f4-a605-50c2eea804de] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:19.617527 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-413185a4-a77c-4467-b46d-4fa3ab8b35e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 7a26e773-0849-42f4-a605-50c2eea804de could not be found. Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-413185a4-a77c-4467-b46d-4fa3ab8b35e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/7a26e773-0849-42f4-a605-50c2eea804de/action HTTP/1.1 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 39 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: {"os-getConsoleOutput": {"length": 10}} Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7a26e773-0849-42f4-a605-50c2eea804de could not be found. Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7a26e773-0849-42f4-a605-50c2eea804de', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a26e773-0849-42f4-a605-50c2eea804de could not be found. Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a26e773-0849-42f4-a605-50c2eea804de could not be found. Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:19.626931 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a26e773-0849-42f4-a605-50c2eea804de could not be found. Jul 02 21:23:19.632349 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:19.640624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-413185a4-a77c-4467-b46d-4fa3ab8b35e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 7a26e773-0849-42f4-a605-50c2eea804de could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:19.643019 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-413185a4-a77c-4467-b46d-4fa3ab8b35e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/7a26e773-0849-42f4-a605-50c2eea804de/action" status: 404 len: 111 microversion: 2.1 time: 0.037571 Jul 02 21:23:19.644699 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2294/4612] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:19 2022] POST /compute/v2.1/servers/7a26e773-0849-42f4-a605-50c2eea804de/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:19.659244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1efab9c-2185-410a-a21a-6f6723beae23 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:19.660249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e1efab9c-2185-410a-a21a-6f6723beae23 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:19.743756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1efab9c-2185-410a-a21a-6f6723beae23 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:19.753997 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1efab9c-2185-410a-a21a-6f6723beae23 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1208 microversion: 2.1 time: 0.108036 Jul 02 21:23:19.754588 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2295/4613] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:19 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1208 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:19.767883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:19.768785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:19.786240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.787247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.789909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:19.790580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:19.843253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:19.854889 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9bd117ab-5cb5-4edb-9438-969fb2bad086 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.364098 Jul 02 21:23:19.856571 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2319/4614] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:19 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:20.005317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:20.013901 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b6b5099-966c-407a-9786-409689b691e1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.257964 Jul 02 21:23:20.015794 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2296/4615] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:19 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:20.033450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:20.036703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:20.059925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.060421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.061308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.067297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.281670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:20.289917 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa373ef6-2c50-4c96-9cd3-fc23b8e2a8cd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.261220 Jul 02 21:23:20.292268 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2320/4616] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:20 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:20.311164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccce5253-e5fe-4e6b-a6d9-21f2509d2010 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:20.312939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccce5253-e5fe-4e6b-a6d9-21f2509d2010 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 22bc380c-1453-444d-8dc9-9cd585d8b036] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:20.328481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ccce5253-e5fe-4e6b-a6d9-21f2509d2010 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 22bc380c-1453-444d-8dc9-9cd585d8b036 could not be found. Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccce5253-e5fe-4e6b-a6d9-21f2509d2010 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/22bc380c-1453-444d-8dc9-9cd585d8b036 HTTP/1.1 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 22bc380c-1453-444d-8dc9-9cd585d8b036 could not be found. Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '22bc380c-1453-444d-8dc9-9cd585d8b036'} Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bc380c-1453-444d-8dc9-9cd585d8b036 could not be found. Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bc380c-1453-444d-8dc9-9cd585d8b036 could not be found. Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:20.332295 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bc380c-1453-444d-8dc9-9cd585d8b036 could not be found. Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccce5253-e5fe-4e6b-a6d9-21f2509d2010 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 22bc380c-1453-444d-8dc9-9cd585d8b036 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:20.336400 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccce5253-e5fe-4e6b-a6d9-21f2509d2010 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/22bc380c-1453-444d-8dc9-9cd585d8b036" status: 404 len: 111 microversion: 2.1 time: 0.029946 Jul 02 21:23:20.341105 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2297/4617] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:20 2022] GET /compute/v2.1/servers/22bc380c-1453-444d-8dc9-9cd585d8b036 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:20.345137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:20.345800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:20.357733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.359570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.360747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.363297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.637476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:20.649814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33261f57-378f-41fd-aa8c-5108b05312f1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.308333 Jul 02 21:23:20.650527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2321/4618] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:20 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:20.672628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:20.673659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:20.683126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.683618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.684493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.684936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.773117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:20.774082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:20.785295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.786065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.799794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:20.804237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:20.971510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:20.985308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0366d7e4-62af-4627-a91a-4c4601e0a4f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1260 microversion: 2.1 time: 0.217797 Jul 02 21:23:20.995147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2322/4619] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:20 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1260 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:20.998862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:20.999468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:21.017190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.022712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.023860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.029067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.236699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:21.244405 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93ab2328-797a-49ad-9548-82f28f705a8f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.578439 Jul 02 21:23:21.247709 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2298/4620] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:20 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:21.252569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bf79e857-582a-4058-b6d0-13c47c6f9784 req-8b0ece6b-e94c-475c-885a-f521c04c9c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13e2b0a-de26-41fb-ac2d-1650603b63ef", "name": "network-vif-deleted", "tag": "2421e496-bb31-40d3-8be8-422ce36c23e8"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:21.273141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bf79e857-582a-4058-b6d0-13c47c6f9784 req-8b0ece6b-e94c-475c-885a-f521c04c9c40 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.273591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bf79e857-582a-4058-b6d0-13c47c6f9784 req-8b0ece6b-e94c-475c-885a-f521c04c9c40 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.301838 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bf79e857-582a-4058-b6d0-13c47c6f9784 req-8b0ece6b-e94c-475c-885a-f521c04c9c40 service nova] Creating event network-vif-deleted:2421e496-bb31-40d3-8be8-422ce36c23e8 for instance d13e2b0a-de26-41fb-ac2d-1650603b63ef on nch2-master-1 Jul 02 21:23:21.309282 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bf79e857-582a-4058-b6d0-13c47c6f9784 req-8b0ece6b-e94c-475c-885a-f521c04c9c40 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060105 Jul 02 21:23:21.310489 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2299/4621] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:23:21.396113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7994bdd1-e850-4996-bccf-9e0cda7684ee tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737573585", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7994bdd1-e850-4996-bccf-9e0cda7684ee tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 238 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737573585", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1737573585', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:23:21.400858 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7994bdd1-e850-4996-bccf-9e0cda7684ee tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7994bdd1-e850-4996-bccf-9e0cda7684ee tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015819 Jul 02 21:23:21.409369 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2300/4622] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:21 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:21.415509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:21.416795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:21.421333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:21.427991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.429227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.430337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.430958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.476625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:21.485775 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb00316c-f609-4913-8d0c-2e2b212330e6 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1314 microversion: 2.1 time: 0.498122 Jul 02 21:23:21.497628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2323/4623] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:20 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:21.524165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dbc11fe1-9193-4d53-a5a6-af6b9023c149 req-fddf9c7a-64ad-42a7-917e-e28cef66c21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d13e2b0a-de26-41fb-ac2d-1650603b63ef", "name": "network-vif-unplugged", "status": "completed", "tag": "2421e496-bb31-40d3-8be8-422ce36c23e8"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:21.535200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dbc11fe1-9193-4d53-a5a6-af6b9023c149 req-fddf9c7a-64ad-42a7-917e-e28cef66c21e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.536020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dbc11fe1-9193-4d53-a5a6-af6b9023c149 req-fddf9c7a-64ad-42a7-917e-e28cef66c21e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.557428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dbc11fe1-9193-4d53-a5a6-af6b9023c149 req-fddf9c7a-64ad-42a7-917e-e28cef66c21e service nova] Creating event network-vif-unplugged:2421e496-bb31-40d3-8be8-422ce36c23e8 for instance d13e2b0a-de26-41fb-ac2d-1650603b63ef on nch2-master-1 Jul 02 21:23:21.589486 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dbc11fe1-9193-4d53-a5a6-af6b9023c149 req-fddf9c7a-64ad-42a7-917e-e28cef66c21e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047623 Jul 02 21:23:21.592934 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2324/4624] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:23:21.809811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:21.821014 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e16857b1-b4a2-417b-b9d3-77fd974773fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.411004 Jul 02 21:23:21.822620 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2301/4625] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:21 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:21.840685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:21.841402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:21.849327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.849780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:21.850596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:21.851014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.004298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:22.005017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:22.014042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.014594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.015473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.016142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.134196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:22.145934 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c324a1d5-1101-47a8-b2be-d83a228a34bf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1266 microversion: 2.1 time: 0.145942 Jul 02 21:23:22.147170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2302/4626] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:21 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:22.206691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:22.221719 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e0f2aaf-80e1-462e-b7d3-4db53bf414a9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.382639 Jul 02 21:23:22.228872 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2325/4627] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:21 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:22.295774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de528176-c4df-45f7-9ec7-da1535d09f4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-185446909", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de528176-c4df-45f7-9ec7-da1535d09f4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 234 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-185446909", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-185446909', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:22.303717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de528176-c4df-45f7-9ec7-da1535d09f4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:22.308894 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de528176-c4df-45f7-9ec7-da1535d09f4e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.015826 Jul 02 21:23:22.315415 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2303/4628] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:22 2022] POST /compute/v2.1/servers => generated 133 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:22.331023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:22.332766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:22.340966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.341652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.342681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.344174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.503048 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:22.503925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:22.511131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.511907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.512757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.513398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.664724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:22.674544 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b902d7be-7ac5-46eb-8f31-14ee8a06a582 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.357123 Jul 02 21:23:22.675676 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2326/4629] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:22 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:22.692463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:22.693097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:22.699274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.699963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.700789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:22.701226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:22.988221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:22.997505 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-963e5f1c-48dd-4f16-b53a-2692df305790 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1499 microversion: 2.1 time: 0.498351 Jul 02 21:23:22.999843 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2304/4630] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:22 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1499 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:23.016340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:23.017304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.023928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.025147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.026279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.026883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.058648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lazy-loading 'flavor' on Instance uuid 49932e4c-c9f4-4846-806a-6f26765484c8 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:23:23.069511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:23.072618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:23.085116 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d52f1f9-17b7-4db6-b6da-741d522e04f2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.396547 Jul 02 21:23:23.085641 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2327/4631] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:22 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:23.110083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d071c932-41ad-49e0-9316-e747f95379b7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:23.110623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d071c932-41ad-49e0-9316-e747f95379b7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: d4d74df5-0d7f-4bee-9f33-51a9b798d177] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.117247 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-d071c932-41ad-49e0-9316-e747f95379b7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance d4d74df5-0d7f-4bee-9f33-51a9b798d177 could not be found. Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d071c932-41ad-49e0-9316-e747f95379b7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/d4d74df5-0d7f-4bee-9f33-51a9b798d177/action HTTP/1.1 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 13 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: {"pause": {}} Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance d4d74df5-0d7f-4bee-9f33-51a9b798d177 could not be found. Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'd4d74df5-0d7f-4bee-9f33-51a9b798d177', 'body': {'pause': {}}} Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d74df5-0d7f-4bee-9f33-51a9b798d177 could not be found. Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d74df5-0d7f-4bee-9f33-51a9b798d177 could not be found. Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:23.121783 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:23.126665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:23.126665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:23.126665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:23.126665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d74df5-0d7f-4bee-9f33-51a9b798d177 could not be found. Jul 02 21:23:23.126665 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:23.129228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d071c932-41ad-49e0-9316-e747f95379b7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance d4d74df5-0d7f-4bee-9f33-51a9b798d177 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:23.130727 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d071c932-41ad-49e0-9316-e747f95379b7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/d4d74df5-0d7f-4bee-9f33-51a9b798d177/action" status: 404 len: 111 microversion: 2.1 time: 0.025277 Jul 02 21:23:23.132390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2328/4632] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:23 2022] POST /compute/v2.1/servers/d4d74df5-0d7f-4bee-9f33-51a9b798d177/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:23.145063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:23.146084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.158429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.158697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.162578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.169168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.226744 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-af7499fa-e5cd-4e28-953b-ee76434608d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "POST /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8/action" status: 200 len: 32 microversion: 2.1 time: 0.214148 Jul 02 21:23:23.231885 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2305/4633] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:23 2022] POST /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:23:23.238950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:23.239822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.248469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.248943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.252844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.253307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.516562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:23.527152 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d4c6080-3a94-498a-99af-917385f60b2b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.389897 Jul 02 21:23:23.534142 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2329/4634] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:23 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:23.555286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:23.556718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.567465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.569533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.570616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.571291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.583683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:23.593598 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a8c4a2fa-e0a0-4361-bfc9-a2dd5d1e3b5f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.364884 Jul 02 21:23:23.603870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2306/4635] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:23 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:23.603870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:23.603870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.615134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.617969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.619141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.619534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.882804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:23.900810 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aebb8f62-0b18-4a6e-8f0a-dbc5df3cf9c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.350417 Jul 02 21:23:23.902244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:23.910471 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-67010073-c57e-4b5c-a0bc-1a6c547c6fec tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.314832 Jul 02 21:23:23.914043 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2307/4636] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:23 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:23.930290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:23.930829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:23.932137 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2330/4637] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:23 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:23.942703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.943164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:23.943951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:23.944410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.031166 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1ab226c0-9e55-479c-a65b-ed55a76f1958 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 202 len: 0 microversion: 2.1 time: 0.104527 Jul 02 21:23:24.033127 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2308/4638] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:23 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:23:24.041862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:24.042474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:24.058097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.059014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.060146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.060740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.236993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-9d9915fb-651f-4706-a703-2a43015d2ae2 req-77720a21-db2a-482b-9b46-ff2ab54613a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f3693a2-c2f4-4960-9b06-a3f95524bc4f", "tag": "ca20c01f-f855-4f66-a806-179bea7e5c92"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:24.255101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-9d9915fb-651f-4706-a703-2a43015d2ae2 req-77720a21-db2a-482b-9b46-ff2ab54613a7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.255777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-9d9915fb-651f-4706-a703-2a43015d2ae2 req-77720a21-db2a-482b-9b46-ff2ab54613a7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.286728 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-9d9915fb-651f-4706-a703-2a43015d2ae2 req-77720a21-db2a-482b-9b46-ff2ab54613a7 service nova] Creating event network-changed:ca20c01f-f855-4f66-a806-179bea7e5c92 for instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f on nch1-master-1 Jul 02 21:23:24.291876 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-9d9915fb-651f-4706-a703-2a43015d2ae2 req-77720a21-db2a-482b-9b46-ff2ab54613a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059803 Jul 02 21:23:24.292577 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2309/4639] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:23:24.421913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:24.436347 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ddea21d-f90c-41c7-86d2-a4f5e22d543f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1511 microversion: 2.1 time: 0.398878 Jul 02 21:23:24.439286 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2331/4640] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:24 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:24.611215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:24.612127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:24.620337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.620892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.621749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.622253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.870425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:24.882323 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dbdf46f3-0a0c-4205-89f7-bff075d4031d tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.275206 Jul 02 21:23:24.882927 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2310/4641] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:24 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:24.919116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:24.919734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:24.926714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.927172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:24.928253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:24.928865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.111188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:25.119137 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-31182442-e3cb-478d-bd53-d4f5b6e16c4e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.204349 Jul 02 21:23:25.119824 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2332/4642] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:24 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:25.454381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:25.454999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:25.461677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.462331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.463108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.463547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.479101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:25.635521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:25.643971 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dcf314b9-b780-4910-a189-23989d6ac0f5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1491 microversion: 2.1 time: 0.193667 Jul 02 21:23:25.644949 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2311/4643] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:25 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1491 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:25.661659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:25.662848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:25.671080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.671799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.672830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.673814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.701220 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'pause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state paused Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 13 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: {"pause": {}} Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot 'pause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state paused Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'pause': {}}} Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state paused. Cannot pause while the instance is in this state. Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state paused Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:25.703412 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:25.707597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:25.707597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:25.707597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:25.707597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:25.707597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state paused Jul 02 21:23:25.707597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:25.709544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'pause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state paused {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:25.710492 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c766d6c7-5f50-4d73-be27-9897ad59fa86 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 143 microversion: 2.1 time: 0.053445 Jul 02 21:23:25.711243 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2333/4644] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:25 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 143 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:23:25.719716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:25.720290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:25.727790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.728356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.729313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.729767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.803513 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-abca3b6d-00b8-4f0b-9df7-1b67617f6bb0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 202 len: 0 microversion: 2.1 time: 0.087802 Jul 02 21:23:25.804602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2312/4645] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:25 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:23:25.813384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:25.814199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:25.820879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.821339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.822365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.823468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.900110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:25.901071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:25.909248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.911140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:25.912462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:25.913170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:26.006741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:26.014611 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9cd9b543-147d-40dd-bb68-70750fd5672b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1498 microversion: 2.1 time: 0.205889 Jul 02 21:23:26.025733 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2334/4646] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:25 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1498 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:26.107226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:26.117417 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-892d3522-5595-4389-ae46-59aca258135a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.221998 Jul 02 21:23:26.117996 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2313/4647] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:25 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:26.136892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:26.137567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:26.144363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:26.145108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:26.146139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:26.146779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:26.281356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:26.290836 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa8a69f0-b817-45ec-8e8b-8006ad4b015d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.157561 Jul 02 21:23:26.291435 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2335/4648] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:26 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:27.036352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:27.038572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:27.046744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:27.047185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:27.048878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:27.049649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:27.134822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:27.136229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:27.143541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=98 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:27.145553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:27.146262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:27.147304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:27.148372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:27.702997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:27.712324 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78f803c0-e6b2-4efd-a96f-74cdb80eb2f8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.581448 Jul 02 21:23:27.713029 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2336/4649] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:27 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:27.721827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:27.722545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:27.743181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:27.743779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:27.744734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:27.745430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:27.787317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:27.801829 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-563884a7-92fb-4662-9940-8a74262b90a8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1498 microversion: 2.1 time: 0.772367 Jul 02 21:23:27.812009 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2314/4650] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:27 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1498 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:28.104885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:28.120901 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-72e3ee29-1784-4102-9ea2-e4b2ab813954 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.406389 Jul 02 21:23:28.122335 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2337/4651] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:27 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:28.729939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:28.731294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:28.738746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:28.739422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:28.748784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:28.750240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:28.830231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:28.833479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:28.842675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:28.843537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:28.845180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:28.845855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:28.996649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:29.009065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd86407e-8deb-4b13-b211-94f70b8cfc96 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.282372 Jul 02 21:23:29.012990 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2315/4652] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:28 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:29.129827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:29.139332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:29.140116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.148091 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca4d780b-2a7d-49bd-8fc9-ede178035e7b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.322120 Jul 02 21:23:29.150207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.150723 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2338/4653] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:28 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:29.152690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.153524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.153976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.168990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:29.171668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.180591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.181839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.184920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.185701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.427810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:29.445100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:29.448372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:29.453628 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7171cbf2-8ba7-41bc-bd99-f28683388347 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.288836 Jul 02 21:23:29.454301 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2339/4654] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:29 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:29.456409 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9afa2853-2d3f-4981-ad5e-890017150b8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.321518 Jul 02 21:23:29.456978 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2316/4655] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:29 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:29.469887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:29.471072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.477540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.478065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.478904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.479427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.493574 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e/action HTTP/1.1 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 28 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: {"reboot": {"type": "SOFT"}} Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '872b5feb-08a2-4738-81eb-0593d065197e', 'body': {'reboot': {'type': 'SOFT'}}} Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:29.495182 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-59f57b2a-e375-463a-9081-7b0addca12ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e/action" status: 404 len: 111 microversion: 2.1 time: 0.030640 Jul 02 21:23:29.500622 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2340/4656] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:29 2022] POST /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:29.506694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:29.507471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.513788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.514467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.515287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.515727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.662324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:29.674621 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e180c163-9e0a-46db-a846-ff24d70444ef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.172507 Jul 02 21:23:29.675436 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2317/4657] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:29 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:29.693163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:29.693787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.701873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.702339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.703161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.703765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.871076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:29.880192 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a17983bc-c087-48cd-8329-b1e46824cdc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.190936 Jul 02 21:23:29.881486 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2341/4658] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:29 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:29.898194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83d75b72-ffd8-4975-8fb3-5b8bd7a1e87e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:29.899238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-83d75b72-ffd8-4975-8fb3-5b8bd7a1e87e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.902211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:29.907533 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-83d75b72-ffd8-4975-8fb3-5b8bd7a1e87e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0 could not be found. Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83d75b72-ffd8-4975-8fb3-5b8bd7a1e87e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/287a5e84-e4e1-4b8f-a724-a0c851d4d4d0/action HTTP/1.1 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 28 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: {"reboot": {"type": "SOFT"}} Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0 could not be found. Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '287a5e84-e4e1-4b8f-a724-a0c851d4d4d0', 'body': {'reboot': {'type': 'SOFT'}}} Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0 could not be found. Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:29.909523 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0 could not be found. Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0 could not be found. Jul 02 21:23:29.914332 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:29.915908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83d75b72-ffd8-4975-8fb3-5b8bd7a1e87e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 287a5e84-e4e1-4b8f-a724-a0c851d4d4d0 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:29.916981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83d75b72-ffd8-4975-8fb3-5b8bd7a1e87e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/287a5e84-e4e1-4b8f-a724-a0c851d4d4d0/action" status: 404 len: 111 microversion: 2.1 time: 0.023377 Jul 02 21:23:29.918048 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2318/4659] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:29 2022] POST /compute/v2.1/servers/287a5e84-e4e1-4b8f-a724-a0c851d4d4d0/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:29.930298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:29.932148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:29.940398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.941671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:29.942539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:29.943198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.030552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:30.033168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:30.041823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.042788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.043846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.044378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.317660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:30.332914 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ce6c73a-5ccf-4128-930a-edf207cf2339 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.409877 Jul 02 21:23:30.333658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2342/4660] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:29 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:30.339832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:30.363494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8819fae0-9097-4b25-bc40-1b21969421dd tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.335214 Jul 02 21:23:30.364534 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2319/4661] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:30 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:30.367386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:30.369146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:30.379894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.380991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.382394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.384015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.475682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:30.476754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:30.485186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.486010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.487056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.489726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.830781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:30.851259 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d814790c-a11c-4cc0-8cbe-fce327603ac9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.495803 Jul 02 21:23:30.851860 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2343/4662] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:30 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:30.870462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:30.872260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:30.885226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.885819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.887780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.888530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.917096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e/action HTTP/1.1 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 65 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '872b5feb-08a2-4738-81eb-0593d065197e', 'body': {'rebuild': {'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541'}}} Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:30.922122 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:23:30.927524 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:30.928943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:30.930384 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74064196-d631-4b73-9dde-fdf8a7ad456b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e/action" status: 404 len: 111 microversion: 2.1 time: 0.066462 Jul 02 21:23:30.934214 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2344/4663] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:30 2022] POST /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:30.941127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:30.941855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:30.957890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.958648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.960664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:30.961622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:30.994501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:31.028886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6916c4b8-f9e6-4440-a46c-de122d67cbcd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.558824 Jul 02 21:23:31.034340 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2320/4664] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:30 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:31.051737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5ebb0d41-f7fb-477d-a01e-00c26154bb33 req-631eabd5-156d-4573-a99a-31c589792381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3693a2-c2f4-4960-9b06-a3f95524bc4f", "name": "network-vif-plugged", "status": "completed", "tag": "ca20c01f-f855-4f66-a806-179bea7e5c92"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:31.078506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5ebb0d41-f7fb-477d-a01e-00c26154bb33 req-631eabd5-156d-4573-a99a-31c589792381 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.080548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5ebb0d41-f7fb-477d-a01e-00c26154bb33 req-631eabd5-156d-4573-a99a-31c589792381 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:31.111200 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5ebb0d41-f7fb-477d-a01e-00c26154bb33 req-631eabd5-156d-4573-a99a-31c589792381 service nova] Creating event network-vif-plugged:ca20c01f-f855-4f66-a806-179bea7e5c92 for instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f on nch1-master-1 Jul 02 21:23:31.123742 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5ebb0d41-f7fb-477d-a01e-00c26154bb33 req-631eabd5-156d-4573-a99a-31c589792381 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087231 Jul 02 21:23:31.128898 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2321/4665] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:23:31.382434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:31.383412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:31.392366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.393240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:31.394276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.395071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:31.417479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:31.439323 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a036251-dfce-46d1-87e7-f5af94ebb598 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.503802 Jul 02 21:23:31.443452 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2345/4666] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:30 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:31.460906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:31.463084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:31.470753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.471763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:31.474131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.474820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:31.757647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:31.768182 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f896835a-9b32-4fd1-b2bc-566415970036 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.311183 Jul 02 21:23:31.770072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:31.778066 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ecc16f08-3055-466f-b207-98fe883813a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.400533 Jul 02 21:23:31.787483 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2346/4667] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:31 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:31.787483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d14a7a3-24ce-4945-9745-1173f0658801 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:31.788392 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2322/4668] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:31 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:31.789135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d14a7a3-24ce-4945-9745-1173f0658801 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a1b2c618-66f4-4367-a167-5fcdad763ecb] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:31.795275 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6d14a7a3-24ce-4945-9745-1173f0658801 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance a1b2c618-66f4-4367-a167-5fcdad763ecb could not be found. Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d14a7a3-24ce-4945-9745-1173f0658801 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a1b2c618-66f4-4367-a167-5fcdad763ecb/action HTTP/1.1 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 65 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance a1b2c618-66f4-4367-a167-5fcdad763ecb could not be found. Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a1b2c618-66f4-4367-a167-5fcdad763ecb', 'body': {'rebuild': {'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541'}}} Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1b2c618-66f4-4367-a167-5fcdad763ecb could not be found. Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 02 21:23:31.797052 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1b2c618-66f4-4367-a167-5fcdad763ecb could not be found. Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1b2c618-66f4-4367-a167-5fcdad763ecb could not be found. Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:31.802405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d14a7a3-24ce-4945-9745-1173f0658801 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance a1b2c618-66f4-4367-a167-5fcdad763ecb could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:31.803968 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d14a7a3-24ce-4945-9745-1173f0658801 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a1b2c618-66f4-4367-a167-5fcdad763ecb/action" status: 404 len: 111 microversion: 2.1 time: 0.021687 Jul 02 21:23:31.808327 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2347/4669] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:31 2022] POST /compute/v2.1/servers/a1b2c618-66f4-4367-a167-5fcdad763ecb/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:31.815765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:31.817174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:31.824936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.825626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:31.826525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:31.827421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.029871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:32.038148 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6a69eac-542a-4ac2-92f1-f258aac4660d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.228718 Jul 02 21:23:32.038777 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2323/4670] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:31 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:32.060570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:32.061558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:32.063485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:32.064324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:32.078344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.078986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.079856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.080503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.112476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.112967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.114054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.114539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.121029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:32.498146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:32.500630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:32.513075 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a2412d0-50ee-4eee-8b4a-c3607e791800 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.456787 Jul 02 21:23:32.513867 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2348/4671] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:32 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:32.526915 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fcb01b40-d187-46a7-a3ff-c53d44b49408 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.470206 Jul 02 21:23:32.527790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2324/4672] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:32 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:32.544304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c611ac8-0278-4648-b643-588dd12518b4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:32.545166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c611ac8-0278-4648-b643-588dd12518b4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 12b71168-3114-4ddb-9717-603d73ba256a] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:32.552410 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-4c611ac8-0278-4648-b643-588dd12518b4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 12b71168-3114-4ddb-9717-603d73ba256a could not be found. Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c611ac8-0278-4648-b643-588dd12518b4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/12b71168-3114-4ddb-9717-603d73ba256a/action HTTP/1.1 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 15 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: {"restore": {}} Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 12b71168-3114-4ddb-9717-603d73ba256a could not be found. Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '12b71168-3114-4ddb-9717-603d73ba256a', 'body': {'restore': {}}} Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12b71168-3114-4ddb-9717-603d73ba256a could not be found. Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12b71168-3114-4ddb-9717-603d73ba256a could not be found. Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:32.554258 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12b71168-3114-4ddb-9717-603d73ba256a could not be found. Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c611ac8-0278-4648-b643-588dd12518b4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 12b71168-3114-4ddb-9717-603d73ba256a could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c611ac8-0278-4648-b643-588dd12518b4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/12b71168-3114-4ddb-9717-603d73ba256a/action" status: 404 len: 111 microversion: 2.1 time: 0.016448 Jul 02 21:23:32.559051 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2349/4673] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:32 2022] POST /compute/v2.1/servers/12b71168-3114-4ddb-9717-603d73ba256a/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:23:32.565877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:32.566641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:32.573445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.574059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.580244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.581298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.800327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:32.801162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:32.813245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.813707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.814514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.815006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.829354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:32.838525 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33e4176b-7ce5-4629-ab6e-54e2065d1826 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.276820 Jul 02 21:23:32.839550 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2325/4674] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:32 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:32.859138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:32.860998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:32.870995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.871935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:32.883908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:32.884412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.189444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:33.211539 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc54a621-a13d-4a46-b0e0-37c7b48aaaf7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1308 microversion: 2.1 time: 0.420411 Jul 02 21:23:33.214089 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2350/4675] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:32 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1308 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:33.251640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:33.266029 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-30f42cfb-7ded-46da-ab73-f087e1fdd6fb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.412395 Jul 02 21:23:33.267757 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2326/4676] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:32 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:33.283754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:33.284794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:33.294149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.299569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.300443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.300890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.337288 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'restore' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 15 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: {"restore": {}} Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot 'restore' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'restore': {}}} Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state active. Cannot restore while the instance is in this state. Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:33.339073 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:33.343398 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:33.343398 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:33.343398 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:33.343398 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:33.343398 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:33.343398 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:33.345740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'restore' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:33.347061 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-857e959f-8c51-422c-8705-9aa171a79178 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 145 microversion: 2.1 time: 0.067379 Jul 02 21:23:33.347860 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2351/4677] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:33 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:23:33.356329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:33.356975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:33.365128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.365582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.369200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.371896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.532119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:33.534186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:33.541576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.542229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.543183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.543677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.599663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:33.610060 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-53b01541-b903-4815-b264-88847122922e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.257594 Jul 02 21:23:33.610668 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2327/4678] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:33 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:33.630678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:33.631535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:33.638444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.639841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.640959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:33.641842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:33.852443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:33.862963 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9563d05c-4db6-43b0-9532-6e43af48a08c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.335720 Jul 02 21:23:33.864581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2352/4679] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:33 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:33.955594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:33.965302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:33.969074 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0603d23a-23ac-4611-994c-70a894c18cc1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.343878 Jul 02 21:23:33.983038 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2328/4680] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:33 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:33.987620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30536ca4-22a6-476f-a456-a409dad352ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:33.988188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-30536ca4-22a6-476f-a456-a409dad352ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: b8b9608d-6b32-4797-9ebf-098766947861] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:33.994364 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-30536ca4-22a6-476f-a456-a409dad352ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance b8b9608d-6b32-4797-9ebf-098766947861 could not be found. Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30536ca4-22a6-476f-a456-a409dad352ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/b8b9608d-6b32-4797-9ebf-098766947861/action HTTP/1.1 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 14 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: {"resume": {}} Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b8b9608d-6b32-4797-9ebf-098766947861 could not be found. Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b8b9608d-6b32-4797-9ebf-098766947861', 'body': {'resume': {}}} Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8b9608d-6b32-4797-9ebf-098766947861 could not be found. Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8b9608d-6b32-4797-9ebf-098766947861 could not be found. Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:34.006064 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:34.010522 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:34.010522 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:34.010522 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:34.010522 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8b9608d-6b32-4797-9ebf-098766947861 could not be found. Jul 02 21:23:34.010522 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.013803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30536ca4-22a6-476f-a456-a409dad352ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance b8b9608d-6b32-4797-9ebf-098766947861 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:34.014932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30536ca4-22a6-476f-a456-a409dad352ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/b8b9608d-6b32-4797-9ebf-098766947861/action" status: 404 len: 111 microversion: 2.1 time: 0.031473 Jul 02 21:23:34.016269 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2353/4681] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:33 2022] POST /compute/v2.1/servers/b8b9608d-6b32-4797-9ebf-098766947861/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:23:34.025866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:34.026797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.036128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.037355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.038400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.039009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.231399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:34.232024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.239707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.244568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.248737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.249440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.279721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:34.293019 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c260c1e1-5af4-4136-ae57-4614eefd6e8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.272512 Jul 02 21:23:34.307370 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2329/4682] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:34 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:34.317384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:34.318340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.328650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.329367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.330715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.331285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.587582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:34.600375 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d74cbd36-d7e5-4f32-afaf-1008411de456 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1486 microversion: 2.1 time: 0.372503 Jul 02 21:23:34.604632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:34.609761 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2354/4683] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:34 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1486 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:34.613452 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-272018be-7415-4223-af25-945315dd7d8c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.303647 Jul 02 21:23:34.624195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2330/4684] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:34 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:34.630132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:34.630492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:34.630838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.631354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.637223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.637686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.638484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.638924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.639437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.640187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.641396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.642087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.666634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'resume' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 14 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: {"resume": {}} Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'resume' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'resume': {}}} Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state active. Cannot resume while the instance is in this state. Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.669317 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'resume' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:34.674717 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1ecb33ab-9134-47b6-93f8-2c681d027f25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 144 microversion: 2.1 time: 0.044793 Jul 02 21:23:34.675410 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2331/4685] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:34 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 144 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:23:34.679131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lazy-loading 'flavor' on Instance uuid 8f3693a2-c2f4-4960-9b06-a3f95524bc4f {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:23:34.680365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:34.681000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.687420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.688801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.689485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.689973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.814447 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d54d9ce4-5a9a-4efe-ba86-5d05f95735a4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f/action" status: 202 len: 0 microversion: 2.1 time: 0.193067 Jul 02 21:23:34.815531 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2355/4686] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:34 2022] POST /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:23:34.827308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:34.828295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:34.840735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.842025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:34.843740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:34.844946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:35.318373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:35.328551 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b61cf0db-e21a-489c-8a86-a5040780f496 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.651790 Jul 02 21:23:35.329982 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2332/4687] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:34 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:35.337071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:35.337962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:35.354963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:35.355791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:35.356825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:35.357461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:35.365286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:35.384204 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5618e368-a0e6-44d0-bd50-ef5e73777533 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1494 microversion: 2.1 time: 0.557283 Jul 02 21:23:35.385704 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2356/4688] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:34 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1494 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:35.402427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:35.403307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:35.415972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:35.417125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:35.418281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:35.418726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:35.712875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:35.723394 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9b3283b7-4909-432a-ab62-b454da3d58bd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.391625 Jul 02 21:23:35.736179 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2333/4689] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:35 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:35.767102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:35.789772 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ba75d7f-1b0b-4008-a911-f2a101f925b0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.391749 Jul 02 21:23:35.804070 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2357/4690] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:35 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:35.860300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3354801-6e98-4905-b80f-c973e5aac97b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3354801-6e98-4905-b80f-c973e5aac97b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 160 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ac866851-1437-4af9-8d9a-d4d3a0ac85af"}]}} Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541', 'flavorRef': '452', 'networks': [{'uuid': 'ac866851-1437-4af9-8d9a-d4d3a0ac85af'}]}}} Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi '' Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:23:35.865445 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3354801-6e98-4905-b80f-c973e5aac97b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f3354801-6e98-4905-b80f-c973e5aac97b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.014365 Jul 02 21:23:35.872589 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2334/4691] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:35 2022] POST /compute/v2.1/servers => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:23:35.879880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:35.880523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:35.886909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:35.887369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:35.888198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:35.888647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.069548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:36.082837 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75d8a3b7-272e-4e89-ad74-23850c817266 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.207005 Jul 02 21:23:36.083696 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2358/4692] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:35 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:36.101845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:36.102481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:36.116525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.116989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.121724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.122203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.368886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:36.383546 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c220a9ab-035f-425d-a3b0-3c8318e43cab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.286675 Jul 02 21:23:36.387921 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2335/4693] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:36 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:36.403472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55d8aebc-4c71-4c1d-b637-4c2292a4e66d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:36.404007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55d8aebc-4c71-4c1d-b637-4c2292a4e66d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 29cda14a-b6bb-4048-9d90-bdb25f376dd0] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:36.407281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:36.409319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:36.416304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-55d8aebc-4c71-4c1d-b637-4c2292a4e66d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 29cda14a-b6bb-4048-9d90-bdb25f376dd0 could not be found. Jul 02 21:23:36.423192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55d8aebc-4c71-4c1d-b637-4c2292a4e66d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/29cda14a-b6bb-4048-9d90-bdb25f376dd0/action HTTP/1.1 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 14 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: {"shelve": {}} Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 29cda14a-b6bb-4048-9d90-bdb25f376dd0 could not be found. Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '29cda14a-b6bb-4048-9d90-bdb25f376dd0', 'body': {'shelve': {}}} Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cda14a-b6bb-4048-9d90-bdb25f376dd0 could not be found. Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cda14a-b6bb-4048-9d90-bdb25f376dd0 could not be found. Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:23:36.423421 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cda14a-b6bb-4048-9d90-bdb25f376dd0 could not be found. Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55d8aebc-4c71-4c1d-b637-4c2292a4e66d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 29cda14a-b6bb-4048-9d90-bdb25f376dd0 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55d8aebc-4c71-4c1d-b637-4c2292a4e66d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/29cda14a-b6bb-4048-9d90-bdb25f376dd0/action" status: 404 len: 111 microversion: 2.1 time: 0.025768 Jul 02 21:23:36.429605 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2336/4694] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:36 2022] POST /compute/v2.1/servers/29cda14a-b6bb-4048-9d90-bdb25f376dd0/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:23:36.431439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.432861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.433317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.433944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:36.434558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:36.446566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.447018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.447801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.448274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.887724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:36.896458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:36.919184 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1e1000b0-21d9-46ab-97bf-28264c44dfca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.488842 Jul 02 21:23:36.925671 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2337/4695] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:36 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:36.927842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc13e006-3611-4c1a-be61-8a2df2fdae2f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 200 len: 1477 microversion: 2.1 time: 0.528787 Jul 02 21:23:36.931143 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2359/4696] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:36 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 1477 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:36.948554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:36.949393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:36.949963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:36.951246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:36.956478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.957220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.958176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.958779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.965803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.968681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:36.970309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:36.971539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:37.313082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:37.322299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:37.323622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e965ffb4-34dc-4914-b81a-01a0037b5c2a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.394521 Jul 02 21:23:37.333931 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2338/4697] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:36 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:37.340264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-730781263"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:37.341869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:37.349578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:37.350025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:37.350814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:37.351243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:37.352344 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e039fb69-2f07-4b3d-992a-07768e0b3db3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.407443 Jul 02 21:23:37.353726 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2360/4698] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:36 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:37.381920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:37.382469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:37.389414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:37.389865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:37.390705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:37.391627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:37.426079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lazy-loading 'flavor' on Instance uuid a26c01b1-585c-4366-95f1-2e2388a7fda2 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:23:37.748599 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6de382c0-97be-4900-955e-a00ee8861214 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f/action" status: 202 len: 0 microversion: 2.1 time: 0.412290 Jul 02 21:23:37.749771 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2339/4699] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:37 2022] POST /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:23:37.764632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f7318d8f-dbff-4c6d-9117-55f8d2736537 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72c6dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:37.836444 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f7318d8f-dbff-4c6d-9117-55f8d2736537 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.077028 Jul 02 21:23:37.838704 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2340/4700] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:37 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:37.855488 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f46a418-d1c9-4ed7-96b3-c0ea549f8a62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 202 len: 0 microversion: 2.1 time: 0.482177 Jul 02 21:23:37.859936 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2361/4701] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:23:37 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:23:37.865248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:37.865994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:37.873558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:37.874007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:37.874784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:37.875240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:38.066577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:38.074890 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f0cdaf3d-1158-4219-8f0e-5477377a0f14 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.213578 Jul 02 21:23:38.075475 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2341/4702] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:37 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:38.341838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:38.342706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:38.350170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:38.350737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:38.351613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:38.352194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:38.496674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:38.504615 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-863341b5-3eaa-4e15-aa49-984accae8ecf tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.167561 Jul 02 21:23:38.505189 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2362/4703] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:38 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:38.855321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46485539-2e7b-499c-a3e5-39a32f7700b6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd720a310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:38.907491 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-46485539-2e7b-499c-a3e5-39a32f7700b6 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.058491 Jul 02 21:23:38.908716 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2342/4704] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:38 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:39.092077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:39.093222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:39.105170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:39.106395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:39.107352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:39.107791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:39.133906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:39.299434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:39.310505 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcb804f7-fe22-4843-8222-45931411712d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.222801 Jul 02 21:23:39.323405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2363/4705] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:39 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:39.523791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:39.524605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:39.536840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:39.537429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:39.538289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:39.538734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:39.743484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:39.752920 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2d8ff02-b816-42f1-9129-156423db1d9a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.234437 Jul 02 21:23:39.756225 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2343/4706] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:39 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:39.921008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f020deb-e39a-4409-826f-d8f4f64d00d8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77a7940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:39.976946 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f020deb-e39a-4409-826f-d8f4f64d00d8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.059761 Jul 02 21:23:39.979573 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2364/4707] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:39 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:40.330296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:40.331614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:40.339548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:40.340000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:40.340817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:40.341259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:40.532148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:40.545470 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-048931eb-fb3d-440b-ace8-c3c892c2079e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.220308 Jul 02 21:23:40.558975 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2344/4708] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:40 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:40.770612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:40.770983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:40.778378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:40.779204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:40.780253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:40.780909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:40.998118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86490c68-6c0b-4519-8b22-3675c576f3bb tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd720aaf0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:41.060838 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86490c68-6c0b-4519-8b22-3675c576f3bb tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.073208 Jul 02 21:23:41.062949 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2345/4709] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:40 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:41.081920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:41.093141 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94929146-65a1-4418-80d1-8658dfe5a23a tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.326625 Jul 02 21:23:41.094711 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2365/4710] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:40 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:41.567004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:41.567625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:41.574611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:41.575070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:41.575856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:41.576339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:41.741984 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:41.751809 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5260a24f-f5c4-4f46-9dbc-b64af7c54be8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.191459 Jul 02 21:23:41.762098 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2346/4711] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:41 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:42.074626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-348b257a-5a97-4f30-a234-302d041cb9a1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd79a3700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:42.116904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:42.117592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:42.125849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:42.126302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:42.127097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:42.127584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:42.129471 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-348b257a-5a97-4f30-a234-302d041cb9a1 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.058614 Jul 02 21:23:42.130621 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2366/4712] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:42 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:42.384009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:42.392598 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b331f96a-492f-4d19-91f4-eef98f1cf56e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.285399 Jul 02 21:23:42.397076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2347/4713] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:42 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:42.771929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:42.773177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:42.790437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:42.792464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:42.793327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:42.793771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:43.134019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:43.142962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e35726e8-1a37-4345-8fb2-c47cff6095d5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7203040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:43.144210 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9fa5d949-f39b-4878-9ce6-e45f27b51736 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.378081 Jul 02 21:23:43.145365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2367/4714] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:42 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:43.211635 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e35726e8-1a37-4345-8fb2-c47cff6095d5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.072575 Jul 02 21:23:43.212942 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2348/4715] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:43 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:43.414719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:43.415582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:43.423175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:43.424536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:43.425442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:43.425982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:43.690507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:43.703764 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8883e69-4bea-4eef-a511-b5232a9e61fd tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.293984 Jul 02 21:23:43.713744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2368/4716] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:43 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:44.161867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:44.162673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:44.183870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:44.184582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:44.185902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:44.187089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:44.226716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b5fbb9a-8a32-4950-884b-baff8e612282 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd771e5e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:44.312728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b5fbb9a-8a32-4950-884b-baff8e612282 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.091844 Jul 02 21:23:44.316679 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2369/4717] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:44 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:44.379994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:44.388525 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db148628-658e-4cc8-b7f5-697fdbe11d20 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.230815 Jul 02 21:23:44.389353 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2349/4718] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:44 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:44.578183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4ca8a380-a8a2-4f40-a2f3-48caa00f8f8a req-0cf7015d-1684-466d-bb57-fb155acb780b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3693a2-c2f4-4960-9b06-a3f95524bc4f", "name": "network-vif-plugged", "status": "completed", "tag": "ca20c01f-f855-4f66-a806-179bea7e5c92"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:44.595224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ca8a380-a8a2-4f40-a2f3-48caa00f8f8a req-0cf7015d-1684-466d-bb57-fb155acb780b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:44.595735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4ca8a380-a8a2-4f40-a2f3-48caa00f8f8a req-0cf7015d-1684-466d-bb57-fb155acb780b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:44.610345 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4ca8a380-a8a2-4f40-a2f3-48caa00f8f8a req-0cf7015d-1684-466d-bb57-fb155acb780b service nova] Creating event network-vif-plugged:ca20c01f-f855-4f66-a806-179bea7e5c92 for instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f on nch1-master-1 Jul 02 21:23:44.617533 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4ca8a380-a8a2-4f40-a2f3-48caa00f8f8a req-0cf7015d-1684-466d-bb57-fb155acb780b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044919 Jul 02 21:23:44.618525 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2370/4719] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:23:44.721687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:44.722454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:44.731464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:44.732097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:44.733580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:44.734129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:44.752200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:44.903193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:44.915347 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-db6544a0-3320-46aa-a6c7-5a31a46517c0 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.197684 Jul 02 21:23:44.927269 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2350/4720] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:44 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:45.329037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a928d526-37a1-490d-8947-8a10c1308ddb tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76d88b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:45.411378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a928d526-37a1-490d-8947-8a10c1308ddb tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.088221 Jul 02 21:23:45.412086 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2371/4721] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:45 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:45.416426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:45.417103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:45.424696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:45.425145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:45.436323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:45.437973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:45.713614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:45.723857 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb58493e-cb08-49ba-901f-58dcb338976b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.320779 Jul 02 21:23:45.725318 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2351/4722] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:45 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:45.933376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:45.934535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:45.946481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:45.953227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:45.954729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:45.960955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:46.425788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-703df4f1-c782-40cc-ab5f-56aba00ba12a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72824c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:46.508003 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-703df4f1-c782-40cc-ab5f-56aba00ba12a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.086707 Jul 02 21:23:46.510082 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2352/4723] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:46 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:46.548676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:46.557546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18b0d197-0a8c-4b76-a0c2-b09f727de7c3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.628059 Jul 02 21:23:46.560796 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2372/4724] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:45 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:46.743139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:46.743770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:46.754624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:46.755090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:46.755892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:46.756358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:47.041080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:47.053738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6c6b74f9-f2b7-4834-b600-5f5e0d11e3ac tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.314647 Jul 02 21:23:47.054358 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2353/4725] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:46 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:47.523224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c616f2f8-70aa-47cf-b6f0-70015abbe4be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76d73a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:47.579207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:47.580920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:47.602857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:47.603921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:47.605185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:47.606015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:47.624709 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c616f2f8-70aa-47cf-b6f0-70015abbe4be tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.105336 Jul 02 21:23:47.625798 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2373/4726] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:47 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:48.070751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:48.072459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:48.079326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:48.095052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:48.096782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:48.097978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:48.369982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:48.383377 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b799a4e2-ce6e-4e0e-a53b-f64d7dd629d9 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.808601 Jul 02 21:23:48.401441 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2354/4727] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:47 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:48.466331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:48.476813 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45c22999-fdd1-4ebd-a9b0-314b2f870167 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.409710 Jul 02 21:23:48.477533 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2374/4728] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:48 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:48.637910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9137cd8b-24cf-4bc5-87ac-e67b27e5179b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72c6ca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:48.722209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9137cd8b-24cf-4bc5-87ac-e67b27e5179b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.088373 Jul 02 21:23:48.725312 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2355/4729] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:48 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:49.403254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:49.404644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:49.428013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:49.429037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:49.431595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:49.433648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:49.495819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:49.496809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:49.521328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:49.521801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:49.522640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:49.523500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:50.077713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:50.113371 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d94068e3-2838-4e74-bc60-e0093fa0499c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.622269 Jul 02 21:23:50.114374 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2356/4730] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:49 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:50.122030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fddd08e6-b0f8-4db8-b765-4fa4fe1a3891 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76b0040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:50.165969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:50.174725 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23e14a25-d5f0-4663-9f9a-efc337faf9f8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.777568 Jul 02 21:23:50.180651 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2375/4731] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:49 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:50.221108 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fddd08e6-b0f8-4db8-b765-4fa4fe1a3891 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.104655 Jul 02 21:23:50.237471 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2357/4732] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:50 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:51.131533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:51.132997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:51.146120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:51.146571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:51.147451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:51.148530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:51.198050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:51.199235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:51.226929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:51.229369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:51.231476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:51.234139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:51.497325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:51.506337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ebe755b0-9b00-4fc0-884b-87ab28631299 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.379055 Jul 02 21:23:51.511884 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2376/4733] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:51 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:51.516775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30003fe0-5302-4dec-a988-916f9d20d7b7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd79955e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:51.557692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:51.566654 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a8ba4461-f888-4f44-84a2-a91b06a92c7d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1505 microversion: 2.1 time: 0.372785 Jul 02 21:23:51.569742 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2358/4734] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:51 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:51.616822 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30003fe0-5302-4dec-a988-916f9d20d7b7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.103642 Jul 02 21:23:51.618237 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2377/4735] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:51 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:52.529971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:52.532074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:52.538090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=98 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:52.555104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:52.555845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:52.556904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:52.557961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:52.589061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:52.591244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:52.615078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:52.616777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:52.619295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:52.619952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:53.049641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:53.058626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70fa07fa-2df1-4665-8a98-abf13428d2b4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1485 microversion: 2.1 time: 0.475681 Jul 02 21:23:53.060209 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2378/4736] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:52 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1485 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:53.065523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3588dec1-5f8a-4845-b593-433c62f734b9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7758700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:53.135160 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3588dec1-5f8a-4845-b593-433c62f734b9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.073456 Jul 02 21:23:53.142187 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2379/4737] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:53 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:53.148367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:53.162044 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ea21514-de3a-42a0-98d4-4e47d7f9ace7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.634988 Jul 02 21:23:53.163928 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2359/4738] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:52 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:53.289177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1678433072", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:23:53.409616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] validate_networks() for [('5879f9a5-02b6-475e-bf53-8107e8a03fab', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:23:54.159486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8c22ce6-d34c-4786-917c-cc99dbd95509 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd71c4310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:54.247695 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8c22ce6-d34c-4786-917c-cc99dbd95509 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.102233 Jul 02 21:23:54.248481 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2360/4739] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:54 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:54.259183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:54.271172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:54.298610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:54.300083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:54.305023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:54.305616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:54.805074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:23:54.805767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:23:54.806576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:54.808495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:23:54.809264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:23:54.810400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:23:54.843263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12157023-c256-406b-a685-f69572721dd2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.581722 Jul 02 21:23:54.844525 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2361/4740] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:54 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:54.853193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:54.855900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:54.856829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:54.857279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:54.903156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Getting quotas for project a0c14d320e154cedb7b37f38873f241e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:23:54.913154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Getting quotas for user 23d7253b721f409ab148368d84b87963 and project a0c14d320e154cedb7b37f38873f241e. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:23:54.952979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:23:54.959818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:23:55.089820 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dc2c99ee-1df4-46c5-937e-98ee86bb8999 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.807041 Jul 02 21:23:55.092585 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2380/4741] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:23:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:23:55.116680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03bc4188-e950-4879-a19a-bd1a2a35ba69 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:55.117331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03bc4188-e950-4879-a19a-bd1a2a35ba69 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:55.230195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-03bc4188-e950-4879-a19a-bd1a2a35ba69 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:55.237921 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03bc4188-e950-4879-a19a-bd1a2a35ba69 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1214 microversion: 2.1 time: 0.136403 Jul 02 21:23:55.253091 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2362/4742] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:55 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:55.265347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfae0bc4-9af3-44e2-86c5-20f557d069cf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76d7b80>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:55.408687 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfae0bc4-9af3-44e2-86c5-20f557d069cf tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.146224 Jul 02 21:23:55.409332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2381/4743] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:55 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:55.870451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:55.874412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:55.920221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:55.921274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:55.925378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:55.927329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:56.266157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:56.268384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:56.287999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:56.293419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:56.294274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:56.294722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:56.420086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:56.439369 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed48325a-4f84-42e7-82da-1fe630213b5f tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1533 microversion: 2.1 time: 0.574488 Jul 02 21:23:56.440103 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2363/4744] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:55 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1533 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:56.464784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8994eb4b-0dc2-4688-9fe8-41fe6f5c0880 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd71c4d30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:56.522157 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8994eb4b-0dc2-4688-9fe8-41fe6f5c0880 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.080697 Jul 02 21:23:56.522754 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2364/4745] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:56 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:56.642649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:56.656022 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce2f283f-5658-4f36-bea5-a54056be3c93 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1210 microversion: 2.1 time: 0.403244 Jul 02 21:23:56.657651 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2382/4746] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:56 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1210 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:23:57.464355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:57.464988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:57.481689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:57.484152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:57.484993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:57.485439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:57.535361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e222869-85d7-4bcd-85d9-78c60d8c4ce0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabe47c5ee0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:57.669805 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e222869-85d7-4bcd-85d9-78c60d8c4ce0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.138561 Jul 02 21:23:57.678352 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2383/4747] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:57 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:57.691097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:57.692812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:57.697255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:23:57.728987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:57.730343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:57.731785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:57.732480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:58.145360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:58.165152 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-659aa3fc-9ef9-4d5b-9252-ed03384b049d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1272 microversion: 2.1 time: 0.485214 Jul 02 21:23:58.165764 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2384/4748] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:57 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1272 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:58.315865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:23:58.336963 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-91dda379-a6e1-4c3c-8efc-239f9ed72a59 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1533 microversion: 2.1 time: 0.879031 Jul 02 21:23:58.337631 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2365/4749] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:57 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1533 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:58.684180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f93ba740-5d4a-4230-a9bc-0d43d4ea9d5b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7995790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:58.776027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f93ba740-5d4a-4230-a9bc-0d43d4ea9d5b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.095545 Jul 02 21:23:58.779731 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2385/4750] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:23:58 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:23:59.185062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:59.186858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:59.203017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:59.203475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:59.204309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:59.204748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:59.354155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:23:59.354788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:23:59.368925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:59.369374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:23:59.370162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:23:59.370594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:00.372495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:00.385853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-afec2a8a-8995-4428-9bba-ddd47add7966 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 1.205306 Jul 02 21:24:00.385853 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2366/4751] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:59 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:00.398404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ed263a7-99cf-44e9-a4fe-d4fe87099d70 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd728b310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:00.465004 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ed263a7-99cf-44e9-a4fe-d4fe87099d70 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1437 microversion: 2.1 time: 0.078115 Jul 02 21:24:00.469106 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2367/4752] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:00 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1437 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:00.474206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-32a23f89-3f0c-4811-a626-8c77354b4779 req-de7ecfab-afd2-4966-a180-935ffcf6241d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c01b1-585c-4366-95f1-2e2388a7fda2", "name": "network-vif-plugged", "status": "completed", "tag": "e27718a1-3c8b-4441-982a-cf26ff8c5baf"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:00.491404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:00.501238 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cb1bee1-7fbc-49f8-bd8d-8dc98bc469ea tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1533 microversion: 2.1 time: 1.150963 Jul 02 21:24:00.506196 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2386/4753] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:23:59 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1533 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:00.517493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-32a23f89-3f0c-4811-a626-8c77354b4779 req-de7ecfab-afd2-4966-a180-935ffcf6241d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:00.518004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-32a23f89-3f0c-4811-a626-8c77354b4779 req-de7ecfab-afd2-4966-a180-935ffcf6241d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:00.555997 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-32a23f89-3f0c-4811-a626-8c77354b4779 req-de7ecfab-afd2-4966-a180-935ffcf6241d service nova] Creating event network-vif-plugged:e27718a1-3c8b-4441-982a-cf26ff8c5baf for instance a26c01b1-585c-4366-95f1-2e2388a7fda2 on nch1-master-1 Jul 02 21:24:00.593648 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-32a23f89-3f0c-4811-a626-8c77354b4779 req-de7ecfab-afd2-4966-a180-935ffcf6241d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122895 Jul 02 21:24:00.594267 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2368/4754] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:01.403336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:01.404434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:01.425228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:01.427897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:01.429955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:01.430904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:01.495700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3fb8a13-98d0-4c6d-8cc9-ab7aa453c72c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd72c60d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:02.033170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:02.044242 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3324f73c-6b01-4d47-99d3-a986fabfe599 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.645281 Jul 02 21:24:02.044848 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2387/4755] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:01 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:02.059461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:02.060147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:02.092710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:02.095998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:02.096924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:02.097435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:02.425924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:02.441329 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48f0fb1c-d8be-4f33-988b-738f72d3ecc5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.392610 Jul 02 21:24:02.442583 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2388/4756] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:02 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:02.455368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-53433a7d-d0ed-44fd-b4dc-57c966854cac req-36092744-ce1e-42d1-adac-1b280f88eca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c56689cd-e15f-465f-aa22-8477e9c19f71", "tag": "4ab4f888-e498-4201-906c-7fd02e831494"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:02.470270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-53433a7d-d0ed-44fd-b4dc-57c966854cac req-36092744-ce1e-42d1-adac-1b280f88eca6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:02.471826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-53433a7d-d0ed-44fd-b4dc-57c966854cac req-36092744-ce1e-42d1-adac-1b280f88eca6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:02.501210 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-53433a7d-d0ed-44fd-b4dc-57c966854cac req-36092744-ce1e-42d1-adac-1b280f88eca6 service nova] Creating event network-changed:4ab4f888-e498-4201-906c-7fd02e831494 for instance c56689cd-e15f-465f-aa22-8477e9c19f71 on nch2-master-1 Jul 02 21:24:02.509591 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-53433a7d-d0ed-44fd-b4dc-57c966854cac req-36092744-ce1e-42d1-adac-1b280f88eca6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057805 Jul 02 21:24:02.510635 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2389/4757] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:03.062839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:03.065614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:03.106258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:03.124016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:03.130762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:03.131333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:03.617148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:03.631180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-475a2664-2a1d-4e9f-8474-97e4a0fcf0e2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.572155 Jul 02 21:24:03.641029 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2390/4758] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:03 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:03.651578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:03.655387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:03.685713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:03.686169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:03.686961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:03.687393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:04.375575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:04.406529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4a5f89c-b2f6-4bde-b690-16d6fba57bc9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.764263 Jul 02 21:24:04.418772 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2391/4759] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:03 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:04.659459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:04.663518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:04.694587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:04.704365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:04.705690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:04.709694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:04.782592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:04.878154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:04.938533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:05.237672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:05.606706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:05.619690 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36739667-2578-4741-8797-00992c737cbe tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.972631 Jul 02 21:24:05.624646 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2392/4760] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:04 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:05.643206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:05.650534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:05.693048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:05.693507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:05.701656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:05.705800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:06.036500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:06.049318 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d35bace-b649-4a5f-a912-ab2ec02c39d1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.422303 Jul 02 21:24:06.050638 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2393/4761] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:05 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:06.641892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:06.642494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:06.654929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:06.655618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:06.656719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:06.657346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:06.910250 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f3fb8a13-98d0-4c6d-8cc9-ab7aa453c72c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1446 microversion: 2.1 time: 5.432217 Jul 02 21:24:06.912604 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2369/4762] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:01 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1446 bytes in 5436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:06.927007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-190ec48d-a0a8-4bf6-8e66-b0b7761fb151 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd71de790>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:06.941053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:06.955299 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43f22612-47e5-4c4c-a073-9d93addbf706 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.315724 Jul 02 21:24:06.956612 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2394/4763] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:06 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:06.996981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-190ec48d-a0a8-4bf6-8e66-b0b7761fb151 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 200 len: 1446 microversion: 2.1 time: 0.076788 Jul 02 21:24:07.005665 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2370/4764] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:06 2022] GET /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 1446 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:07.012461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0c7af08-1ac0-45e9-ad00-31891e47040f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76d8160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:07.068730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:07.069972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:07.098771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:07.098986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:07.099897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:07.100444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:07.600379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:07.611366 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d797119-76ab-4879-9fea-53356f5773b1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.548032 Jul 02 21:24:07.616797 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2371/4765] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:07 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:07.975648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:07.977294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:07.993204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:08.000156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:08.003928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:08.004720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:08.284374 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0c7af08-1ac0-45e9-ad00-31891e47040f tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 204 len: 0 microversion: 2.1 time: 1.277496 Jul 02 21:24:08.286364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2395/4766] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:07 2022] DELETE /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 0 bytes in 1280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:24:08.294853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:08.295978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:08.309332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:08.310317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:08.311400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:08.316028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:08.381473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:24:08.520545 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7ea2d38e-2cd3-49c8-8a40-710b73568d33 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 204 len: 0 microversion: 2.1 time: 0.229499 Jul 02 21:24:08.526433 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2396/4767] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:08 2022] DELETE /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:24:08.569964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:08.581377 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2686ba6a-4afa-4f8c-a29c-b4b454567106 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.611790 Jul 02 21:24:08.583232 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2372/4768] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:07 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:08.633231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:08.634197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:08.660475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:08.661105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:08.663649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:08.664943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:08.790465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-469857443", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "5354096e-b039-4010-8707-3aebf48750f0"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:08.912121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] validate_networks() for [('5354096e-b039-4010-8707-3aebf48750f0', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:24:09.217747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:09.242132 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-25334859-2aa0-4a72-a2b9-77e257a6425d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.613745 Jul 02 21:24:09.243233 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2397/4769] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:08 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:09.615804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:09.618474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:09.680914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:09.681552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:09.682412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:09.694059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:10.285216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:10.309286 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11eb5e13-8a87-4890-910c-694e0d9acca8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.711859 Jul 02 21:24:10.310863 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2398/4770] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:09 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:10.315604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4d8eba2d-e9aa-49bf-ad9d-2e4f39494a57 req-f6ad97ab-5b42-4feb-a307-5f52ade0b197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56689cd-e15f-465f-aa22-8477e9c19f71", "name": "network-vif-plugged", "status": "completed", "tag": "4ab4f888-e498-4201-906c-7fd02e831494"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:10.363042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d8eba2d-e9aa-49bf-ad9d-2e4f39494a57 req-f6ad97ab-5b42-4feb-a307-5f52ade0b197 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:10.363406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4d8eba2d-e9aa-49bf-ad9d-2e4f39494a57 req-f6ad97ab-5b42-4feb-a307-5f52ade0b197 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:10.390386 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4d8eba2d-e9aa-49bf-ad9d-2e4f39494a57 req-f6ad97ab-5b42-4feb-a307-5f52ade0b197 service nova] Creating event network-vif-plugged:4ab4f888-e498-4201-906c-7fd02e831494 for instance c56689cd-e15f-465f-aa22-8477e9c19f71 on nch2-master-1 Jul 02 21:24:10.397898 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4d8eba2d-e9aa-49bf-ad9d-2e4f39494a57 req-f6ad97ab-5b42-4feb-a307-5f52ade0b197 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085358 Jul 02 21:24:10.398720 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2399/4771] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:10.418580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:10.419335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:10.433716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:10.434163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:10.434949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:10.435388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:10.824021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:24:10.824536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:24:10.825452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:24:10.826411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:24:10.827447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:24:10.874533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:10.886270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:10.887347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:10.891170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:11.042852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:24:11.060342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Getting quotas for user fa780176ae5f4a618e42a47531b0d4a5 and project ada57eeadbb9443c9f42dc99310ef8de. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:24:11.124324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:24:11.134268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:24:11.276768 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-898294af-c7cf-4624-8a3c-82bc8a8e7069 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.497309 Jul 02 21:24:11.277781 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2373/4772] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:24:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:24:11.291194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-116f06a9-ed9c-4928-92e9-e9305441a1e5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:11.305756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-116f06a9-ed9c-4928-92e9-e9305441a1e5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:11.814015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-116f06a9-ed9c-4928-92e9-e9305441a1e5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:11.821835 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-116f06a9-ed9c-4928-92e9-e9305441a1e5 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1207 microversion: 2.1 time: 0.534569 Jul 02 21:24:11.831773 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2374/4773] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:11 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1207 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:11.834078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:11.834706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:11.851763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:11.852394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:11.853189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:11.853630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:12.012399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:12.022001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca97400f-c584-472c-89b3-92cb877806e8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 1.621677 Jul 02 21:24:12.027727 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2400/4774] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:10 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:12.295901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:12.305347 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f32d2c39-6f2c-46b9-839e-1ba02507face tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1314 microversion: 2.1 time: 0.474195 Jul 02 21:24:12.307678 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2375/4775] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:11 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:12.433468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-97d73aab-4808-404f-83d7-656f04a6a01c req-277ed455-7044-4f3d-bbd8-01486524314e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3693a2-c2f4-4960-9b06-a3f95524bc4f", "name": "network-vif-unplugged", "status": "completed", "tag": "ca20c01f-f855-4f66-a806-179bea7e5c92"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:12.456014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-97d73aab-4808-404f-83d7-656f04a6a01c req-277ed455-7044-4f3d-bbd8-01486524314e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:12.456805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-97d73aab-4808-404f-83d7-656f04a6a01c req-277ed455-7044-4f3d-bbd8-01486524314e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:12.477886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-97d73aab-4808-404f-83d7-656f04a6a01c req-277ed455-7044-4f3d-bbd8-01486524314e service nova] Creating event network-vif-unplugged:ca20c01f-f855-4f66-a806-179bea7e5c92 for instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f on nch1-master-1 Jul 02 21:24:12.497957 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-97d73aab-4808-404f-83d7-656f04a6a01c req-277ed455-7044-4f3d-bbd8-01486524314e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068269 Jul 02 21:24:12.499261 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2401/4776] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:12.843092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:12.844293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:12.873761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:12.875338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:12.893894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:12.894581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:13.040257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:13.041701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:13.061826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:13.065100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:13.066196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:13.068703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:13.164819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:13.175358 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc8f513c-fb06-43a6-9b1e-3f5c6caa6066 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1259 microversion: 2.1 time: 0.339744 Jul 02 21:24:13.185258 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2376/4777] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:12 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1259 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:13.328243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:13.328893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:13.355317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:13.355784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:13.359388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:13.359845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.073845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:14.081819 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ab8b270-41ac-4cc0-98c1-a88a38e1bf25 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 1.046305 Jul 02 21:24:14.086370 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2402/4778] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:13 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:14.101550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-41271226-81e6-4129-95e8-3a7b2b6ea1c6 req-5d224970-4d8f-46a8-9e7e-45b0c3e75d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f3693a2-c2f4-4960-9b06-a3f95524bc4f", "name": "network-vif-deleted", "tag": "ca20c01f-f855-4f66-a806-179bea7e5c92"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:14.110251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-41271226-81e6-4129-95e8-3a7b2b6ea1c6 req-5d224970-4d8f-46a8-9e7e-45b0c3e75d75 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.110630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-41271226-81e6-4129-95e8-3a7b2b6ea1c6 req-5d224970-4d8f-46a8-9e7e-45b0c3e75d75 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.129591 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-41271226-81e6-4129-95e8-3a7b2b6ea1c6 req-5d224970-4d8f-46a8-9e7e-45b0c3e75d75 service nova] Creating event network-vif-deleted:ca20c01f-f855-4f66-a806-179bea7e5c92 for instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f on nch1-master-1 Jul 02 21:24:14.135479 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-41271226-81e6-4129-95e8-3a7b2b6ea1c6 req-5d224970-4d8f-46a8-9e7e-45b0c3e75d75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047627 Jul 02 21:24:14.136923 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2403/4779] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:14.225159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:14.226339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:14.238532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.240074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.241483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.242465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.445491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:14.458839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78ca9a03-cd74-44f0-a1ed-e7781e73def9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1265 microversion: 2.1 time: 0.235597 Jul 02 21:24:14.482613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:14.483485 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2404/4780] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:14 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:14.491440 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f5e34f7-0f46-47fb-9f79-3893bc3ff025 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1499 microversion: 2.1 time: 1.171034 Jul 02 21:24:14.508497 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2377/4781] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:13 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1499 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:14.570880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:14.581373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:14.608973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.609452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.610260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.616809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.665962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lazy-loading 'flavor' on Instance uuid c56689cd-e15f-465f-aa22-8477e9c19f71 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:24:14.898122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23ea2093-a71c-4955-9127-32174692fe5c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "POST /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71/action" status: 200 len: 32 microversion: 2.1 time: 0.368050 Jul 02 21:24:14.899626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2405/4782] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:14 2022] POST /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71/action => generated 32 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:24:14.908757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:14.911144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:14.939137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.940000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.941063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:14.941693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:14.947829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:15.104190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:15.105988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:15.118678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:15.129960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:15.131180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:15.140798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:15.965489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:15.989597 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3274a4e7-dad3-4539-a469-55d338c518c8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 1.083441 Jul 02 21:24:16.004566 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2378/4783] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:14 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:16.017337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:16.020922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:16.042805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:16.044283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:16.049153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:16.049669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:16.055154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:16.068440 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-734675c6-4076-4337-bdd2-8501b94733c8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.968513 Jul 02 21:24:16.077724 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2406/4784] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:15 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:16.585038 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:16.611084 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-74c0f24b-4b19-4184-9fce-e88522567c85 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.605226 Jul 02 21:24:16.611782 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2379/4785] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:16 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:17.018060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:17.019942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:17.029762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.030521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.031840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.032463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.094593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:17.096050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:17.107820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.110919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.112764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.113445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.713245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:17.725096 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00f29eba-f7ee-4f90-8abe-05d64ac98c3e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.712370 Jul 02 21:24:17.730308 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2407/4786] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:17 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:17.739930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-82a16356-d2e0-4032-b99a-ad468baec628 req-ebe9106c-4a12-49f0-ac87-0c516b8a160a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed8727d-68ba-4aef-971c-55876c2856b4", "tag": "5ab41a84-5959-40f7-9ad8-8db9b1a049a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:17.762598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82a16356-d2e0-4032-b99a-ad468baec628 req-ebe9106c-4a12-49f0-ac87-0c516b8a160a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.763257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-82a16356-d2e0-4032-b99a-ad468baec628 req-ebe9106c-4a12-49f0-ac87-0c516b8a160a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.769741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:17.794497 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-82a16356-d2e0-4032-b99a-ad468baec628 req-ebe9106c-4a12-49f0-ac87-0c516b8a160a service nova] Creating event network-changed:5ab41a84-5959-40f7-9ad8-8db9b1a049a2 for instance bed8727d-68ba-4aef-971c-55876c2856b4 on nch1-master-1 Jul 02 21:24:17.801044 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-82a16356-d2e0-4032-b99a-ad468baec628 req-ebe9106c-4a12-49f0-ac87-0c516b8a160a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069181 Jul 02 21:24:17.801908 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2408/4787] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:17.807080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:17.808582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:17.821309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.822162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.823147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:17.823737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:17.893228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:17.902084 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f3c2f8e8-e726-4ab5-8750-ef2af72cc5e3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.814887 Jul 02 21:24:17.906676 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2380/4788] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:17 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:18.223125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:18.231601 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0847e670-48cd-4bd8-8bb7-59bffe7b2c34 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.427820 Jul 02 21:24:18.237152 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2409/4789] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:17 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:18.746512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:18.747924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:18.768989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:18.771779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:18.772853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:18.774460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:18.923199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:18.923923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:18.933352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:18.936771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:18.937721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:18.939339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:19.277410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:19.286156 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aa8b2221-d453-4b89-ad7d-434964be7711 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.543753 Jul 02 21:24:19.286739 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2381/4790] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:18 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:19.290708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:19.301992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:19.302817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:19.304611 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2aa53d4f-60ad-4f30-b13a-998fa4584d79 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.385284 Jul 02 21:24:19.306613 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2410/4791] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:18 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:19.318738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:19.319171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:19.320233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:19.320932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:19.741928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:19.773184 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6c5b3708-6bba-4b73-81a6-22dcc8a0a179 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.475741 Jul 02 21:24:19.778654 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2382/4792] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:19 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:20.014234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:20.014751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:20.021562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:20.022016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:20.022818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:20.023259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:20.056632 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca0584cf-4873-4e3a-9538-99d0abce262b tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.046250 Jul 02 21:24:20.059081 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2411/4793] 10.222.0.43 () {58 vars in 1292 bytes} [Sat Jul 2 21:24:20 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e/os-server-password => generated 116 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:20.309334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:20.310838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:20.320224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:20.321020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:20.322161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:20.323998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:20.325298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:20.325604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:20.335904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:20.337646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:20.338662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:20.346206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:20.958246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:20.966697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:20.969571 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f8197b4-434f-4fac-9bcb-e6ea79dcc205 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.669507 Jul 02 21:24:20.979225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:20.981747 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2383/4794] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:20 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:20.988632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:20.989962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:20.992325 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c667400-b1f2-4584-a65c-a9d56506d5cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.673221 Jul 02 21:24:20.993042 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2412/4795] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:20 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:21.000169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:21.000915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:21.002511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:21.003205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:21.291529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:21.319779 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-85d03038-a6ac-4f7d-8f2f-aaec57e0f9c8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.336482 Jul 02 21:24:21.322455 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2384/4796] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:20 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:21.987477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:21.988361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:21.995714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:21.996438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:21.997459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:21.998112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:22.009501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:22.010093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:22.013250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:22.026087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:22.028830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:22.029674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:22.030116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:22.493019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:22.511338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:22.512130 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1936faa6-3578-4a6b-8d3d-7724183e9ac8 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.528537 Jul 02 21:24:22.513945 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2413/4797] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:21 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:22.519920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:22.520243 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c11200d-729f-42e1-89d5-70995de6c9ca tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1528 microversion: 2.1 time: 0.514552 Jul 02 21:24:22.520807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:22.528613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:22.529369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:22.530691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:22.530950 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2385/4798] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:22 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1528 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:22.531660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:22.839005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:22.849225 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4620391e-b4cf-4366-bf49-215ce7c69f3c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.333737 Jul 02 21:24:22.850511 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2414/4799] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:22 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:23.530564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:23.534702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:23.538200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:23.538930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:23.540131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:23.549503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:23.550983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:23.552834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:23.553451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:23.553913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:23.554706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:23.556577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:23.557221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:23.970747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:23.999262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:24.005257 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-97383dbe-2cd7-403a-84e9-26aef0a0f8ae tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.478650 Jul 02 21:24:24.008170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2386/4800] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:23 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:24.010131 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a831563b-f124-4e38-a04e-be8a36a591dd tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1510 microversion: 2.1 time: 0.476166 Jul 02 21:24:24.020157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2415/4801] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:23 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1510 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:24.029952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:24.031591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:24.043943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:24.044828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:24.045796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:24.046407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:24.325036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:24.335622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1b20544a-7ded-44e7-80a1-81c6c4980bae tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.325854 Jul 02 21:24:24.337404 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2387/4802] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:24 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:25.025864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:25.027081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:25.027619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:25.028285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:25.035539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.035989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.036772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.037560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.050856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.057000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.058540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.059067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.375496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:25.390571 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4078a91-e2bd-4c80-9ae2-e8c76127e26d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.369768 Jul 02 21:24:25.393655 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2416/4803] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:25 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:25.395321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:25.408833 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-09255caf-1387-438f-9781-f1f6bf3da2c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1510 microversion: 2.1 time: 0.384820 Jul 02 21:24:25.409685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e0823b05-6ff8-4b1b-8d07-62342eaeaf90 req-b3658de5-1171-4561-bda4-40ba4083db60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c01b1-585c-4366-95f1-2e2388a7fda2", "name": "network-vif-unplugged", "status": "completed", "tag": "e27718a1-3c8b-4441-982a-cf26ff8c5baf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:25.419086 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2388/4804] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:25 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1510 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:25.431508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e0823b05-6ff8-4b1b-8d07-62342eaeaf90 req-b3658de5-1171-4561-bda4-40ba4083db60 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.432368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:25.433003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:25.434190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e0823b05-6ff8-4b1b-8d07-62342eaeaf90 req-b3658de5-1171-4561-bda4-40ba4083db60 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.456365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.457005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.458084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:25.458571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:25.463058 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e0823b05-6ff8-4b1b-8d07-62342eaeaf90 req-b3658de5-1171-4561-bda4-40ba4083db60 service nova] Creating event network-vif-unplugged:e27718a1-3c8b-4441-982a-cf26ff8c5baf for instance a26c01b1-585c-4366-95f1-2e2388a7fda2 on nch1-master-1 Jul 02 21:24:25.474139 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e0823b05-6ff8-4b1b-8d07-62342eaeaf90 req-b3658de5-1171-4561-bda4-40ba4083db60 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078178 Jul 02 21:24:25.476727 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2417/4805] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:25.711179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:25.720025 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5fc7c10-1d47-45f3-af19-f2ed358ddff8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.299720 Jul 02 21:24:25.721617 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2389/4806] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:25 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:26.411850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:26.412499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:26.437723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:26.438357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:26.443982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.444628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.447134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.448418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.454911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.456073 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.459017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.460362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.716370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:26.725791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9b118c9-4897-4c18-8fc9-cc7d0f736e98 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.319067 Jul 02 21:24:26.726380 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2418/4807] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:26 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:26.736280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:26.738459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:26.739017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:26.744228 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ed58e8e-e7c1-48b6-ae09-4bb743efe0a3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1453 microversion: 2.1 time: 0.321488 Jul 02 21:24:26.744811 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2390/4808] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:26 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1453 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:26.752385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.752385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.752385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.752385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.765273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:26.766169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:26.774211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.774982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:26.775957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:26.777232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.132178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:27.141009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:27.141305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3cc5d2b-a9d5-48ed-b5c5-b2b074a6a97e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.407935 Jul 02 21:24:27.146886 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2419/4809] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:26 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:27.172685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-05b75f7f-a5c1-4322-a730-572a32a6a8c4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1453 microversion: 2.1 time: 0.406116 Jul 02 21:24:27.173651 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2391/4810] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:26 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1453 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:27.222570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:27.223118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:27.232738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.233190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.233980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.234410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.293460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lazy-loading 'flavor' on Instance uuid a26c01b1-585c-4366-95f1-2e2388a7fda2 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:24:27.308547 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'shelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state shelved_offloaded Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 14 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: {"shelve": {}} Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot 'shelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state shelved_offloaded Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'shelve': {}}} Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:27.310842 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state shelved_offloaded Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state shelved_offloaded Jul 02 21:24:27.316322 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:27.319006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'shelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state shelved_offloaded {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:27.320138 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-245e57e3-f705-407d-98a6-3ef9abbddad1 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 155 microversion: 2.1 time: 0.101777 Jul 02 21:24:27.321278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2420/4811] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:27 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 155 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:24:27.330796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:27.331707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:27.356397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.356867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.358313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.358791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.537076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4876632f-3f60-44ec-a241-ed4f051c2f3e req-d8789a28-ac54-46e1-a7fc-89dbe9af1ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed8727d-68ba-4aef-971c-55876c2856b4", "name": "network-vif-plugged", "status": "completed", "tag": "5ab41a84-5959-40f7-9ad8-8db9b1a049a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:27.544681 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1ecd1bec-768e-4b46-b77a-d77d4c98ad46 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 202 len: 0 microversion: 2.1 time: 0.218772 Jul 02 21:24:27.551444 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2392/4812] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:27 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:24:27.563937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:27.567366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:27.578632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4876632f-3f60-44ec-a241-ed4f051c2f3e req-d8789a28-ac54-46e1-a7fc-89dbe9af1ff5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.581011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.583151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.584397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4876632f-3f60-44ec-a241-ed4f051c2f3e req-d8789a28-ac54-46e1-a7fc-89dbe9af1ff5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.586454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.587188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.621671 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4876632f-3f60-44ec-a241-ed4f051c2f3e req-d8789a28-ac54-46e1-a7fc-89dbe9af1ff5 service nova] Creating event network-vif-plugged:5ab41a84-5959-40f7-9ad8-8db9b1a049a2 for instance bed8727d-68ba-4aef-971c-55876c2856b4 on nch1-master-1 Jul 02 21:24:27.638132 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4876632f-3f60-44ec-a241-ed4f051c2f3e req-d8789a28-ac54-46e1-a7fc-89dbe9af1ff5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105608 Jul 02 21:24:27.640434 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2421/4813] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:24:27.744265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:27.745132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:27.756816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:27.760330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.761092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:27.762173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:27.762838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:28.199260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:28.201790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:28.209042 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef969560-6632-4295-9771-f1fc0e243492 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1461 microversion: 2.1 time: 0.655714 Jul 02 21:24:28.224378 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2393/4814] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:27 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1461 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:28.241027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:28.241648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:28.249861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:28.250923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:28.251917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:28.252603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:28.273937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:28.289063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78ab3213-9d73-4ae6-9914-83bab2da0393 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.549798 Jul 02 21:24:28.299235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2422/4815] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:27 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:28.664002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:28.676919 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac32aeb8-020f-42b4-9109-0fc724be6504 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1307 microversion: 2.1 time: 0.451279 Jul 02 21:24:28.687112 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2394/4816] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:28 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1307 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:29.230300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:29.231084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:29.238079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:29.238563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:29.240963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:29.241495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:29.306405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:29.307092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:29.313646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:29.314218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:29.315975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:29.316800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:29.652379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:29.670328 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7729db3-adfa-4146-ab5d-c5810410cd18 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1463 microversion: 2.1 time: 0.443978 Jul 02 21:24:29.673396 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2423/4817] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:29 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1463 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:29.696409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:29.697121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:29.703988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:29.704481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:29.705298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:29.716819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:29.732723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:29.742945 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-55a27c8d-83a5-4381-a621-e6058d159ed3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.440598 Jul 02 21:24:29.753489 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2395/4818] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:29 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:29.963013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:29.982530 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b779de1-251f-463e-8f54-3fd5e40afe44 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1485 microversion: 2.1 time: 0.291074 Jul 02 21:24:29.983844 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2424/4819] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:29 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1485 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:30.000133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-21805965"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:30.001272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:30.016676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:30.017407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:30.019447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:30.020172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:30.412208 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-21245d7a-d38e-429c-b896-2a659f9822f2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "POST /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4/action" status: 202 len: 0 microversion: 2.1 time: 0.415868 Jul 02 21:24:30.413835 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2396/4820] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:29 2022] POST /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 02 21:24:30.427885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a1ec7fa-b3c0-499d-83fa-c73d46a33aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd768faf0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.505774 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a1ec7fa-b3c0-499d-83fa-c73d46a33aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5" status: 200 len: 1410 microversion: 2.1 time: 0.085830 Jul 02 21:24:30.506355 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2425/4821] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:30 2022] GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 => generated 1410 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:30.523258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-16018bd5-5e89-442d-aefb-3ab185a8ce8c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76b0310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.608715 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-16018bd5-5e89-442d-aefb-3ab185a8ce8c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5" status: 200 len: 1410 microversion: 2.1 time: 0.093637 Jul 02 21:24:30.609758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2397/4822] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:30 2022] GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 => generated 1410 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:30.622548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-288716c9-c236-4f33-95f1-d4a85726ba4c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd76fb700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.691614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.692671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:30.700273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:30.701018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:30.701950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:30.702544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:30.790393 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-288716c9-c236-4f33-95f1-d4a85726ba4c tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5" status: 204 len: 0 microversion: 2.1 time: 0.171596 Jul 02 21:24:30.791007 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2426/4823] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:30 2022] DELETE /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:24:30.801669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.803175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:30.891579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:30.909289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fadef62d-7edd-4d48-895a-6945d885c16c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.222447 Jul 02 21:24:30.919395 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2398/4824] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:30 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:30.919395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a760a801-29e1-44e5-ad19-b31242487f4e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7203f70>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.936560 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-a760a801-29e1-44e5-ad19-b31242487f4e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Image not found. Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a760a801-29e1-44e5-ad19-b31242487f4e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 HTTP/1.1 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'f44ae780-1426-4359-8d27-9415ce7fd0e5'} Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f44ae780-1426-4359-8d27-9415ce7fd0e5 Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:24:30.939396 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f44ae780-1426-4359-8d27-9415ce7fd0e5 could not be found. Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:24:30.943981 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:30.953153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a760a801-29e1-44e5-ad19-b31242487f4e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:30.953153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a760a801-29e1-44e5-ad19-b31242487f4e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5" status: 404 len: 62 microversion: 2.1 time: 0.040287 Jul 02 21:24:30.955913 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2399/4825] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:24:30 2022] GET /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:24:30.961629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:30.962676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:30.970476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:30.971422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:30.972653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:30.973319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:31.159923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:31.173012 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ee5df63-e8ce-4511-9845-e00b1eedb1c9 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1497 microversion: 2.1 time: 0.213372 Jul 02 21:24:31.174457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2400/4826] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:30 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:31.185217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:31.186251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:31.188009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:31.188746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:31.757640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:31.769223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb2d2e2c-1e53-4a28-ac4a-b23d144d371c tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.973611 Jul 02 21:24:31.769812 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2427/4827] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:30 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:31.926621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:31.927813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:31.938691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:31.939360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:31.941097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:31.941728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:32.193869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:32.194767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:32.232929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:32.243421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:32.245047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:32.256999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:32.361384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:32.372455 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0289b8fb-6145-4f0e-9510-0897777c4dfa tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.448697 Jul 02 21:24:32.376644 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2401/4828] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:31 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:32.622410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:32.638805 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad6bbceb-a830-4481-8ee2-0276b2f30490 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1497 microversion: 2.1 time: 0.449361 Jul 02 21:24:32.643090 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2428/4829] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:32 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1497 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:32.787782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:32.788439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:32.805940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:32.807045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:32.813054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:32.813702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:33.394239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:33.395522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:33.405917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:33.406717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:33.409024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:33.417837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:33.422928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:33.492685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:33.508251 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-15ce4859-e893-45ab-afd0-57e5c6748b29 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.724065 Jul 02 21:24:33.510498 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2402/4830] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:32 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:33.660651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:33.661775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:33.673807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:33.683208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:33.687954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:33.689431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:33.973051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:33.987022 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ce67a16-d118-42c2-ad85-e6f610db204c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.597204 Jul 02 21:24:33.996983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2429/4831] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:33 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:34.079930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:34.089392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-77f227a8-cb21-4381-9528-c723039946e4 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1503 microversion: 2.1 time: 0.434045 Jul 02 21:24:34.092762 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2403/4832] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:33 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:34.528546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:34.529199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:34.548450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:34.550941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:34.564133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:34.570497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:35.009454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:35.010808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:35.023782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:35.024545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:35.027476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:35.028142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:35.169100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:35.187208 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98779edc-7f02-4128-adc0-376a7fcf67fa tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.662862 Jul 02 21:24:35.191781 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2430/4833] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:34 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:35.203691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:35.204351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:35.221920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:35.224597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:35.226945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:35.228768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:35.610382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:35.623648 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7fa2de0a-7117-42d3-896c-954bb2338ecb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.618726 Jul 02 21:24:35.624883 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2404/4834] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:35 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:35.792670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:35.807881 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45e92b8f-5252-48a8-898a-c21709752893 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1503 microversion: 2.1 time: 0.613816 Jul 02 21:24:35.832428 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2431/4835] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:35 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1503 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:36.211898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:36.213773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:36.228674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:36.229503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:36.230525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:36.231160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:36.649591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:36.653037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:36.672214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:36.673129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:36.674262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:36.675015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:36.675846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:36.690115 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-99701f99-71cb-4143-a5f0-cc929d027416 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.483400 Jul 02 21:24:36.690759 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2405/4836] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:36 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:36.830147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:36.831263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:36.846589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:36.848076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:36.850897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:36.851581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:37.036969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:37.055303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5b5cfaf-729b-4ea7-917e-158140a90d70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.415231 Jul 02 21:24:37.057320 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2432/4837] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:36 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:37.328402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:37.338889 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e36fcb3c-0dea-479b-97b3-175d263af607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1503 microversion: 2.1 time: 0.513169 Jul 02 21:24:37.354405 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2406/4838] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:36 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1503 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:37.711011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:37.712270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:37.722965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:37.724235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:37.728271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:37.729642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:38.074562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:38.086760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:38.106033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:38.126442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:38.127568 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dcd860c5-c1d2-4715-81bf-80c2e8352ff5 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.413365 Jul 02 21:24:38.128740 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2433/4839] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:37 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:38.129712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:38.130870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:38.131552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:38.361819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:38.363189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:38.377831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:38.380666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:38.384459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:38.385230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:38.573245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:38.590267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-13d55472-267e-4211-b878-ec3be64e9e7a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.520969 Jul 02 21:24:38.606739 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2407/4840] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:38 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:38.798776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:38.823932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b576668-3310-4730-8c3c-570f1ca24fad tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1498 microversion: 2.1 time: 0.463688 Jul 02 21:24:38.842345 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2434/4841] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:38 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1498 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:38.895437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-37bd6fa9-71a5-4085-ad17-e67c34d2956e req-2eee4012-dd04-41a0-a7fd-5c389cbc556e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed8727d-68ba-4aef-971c-55876c2856b4", "name": "network-vif-plugged", "status": "completed", "tag": "5ab41a84-5959-40f7-9ad8-8db9b1a049a2"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:38.916268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-37bd6fa9-71a5-4085-ad17-e67c34d2956e req-2eee4012-dd04-41a0-a7fd-5c389cbc556e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:38.918737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-37bd6fa9-71a5-4085-ad17-e67c34d2956e req-2eee4012-dd04-41a0-a7fd-5c389cbc556e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:38.966854 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-37bd6fa9-71a5-4085-ad17-e67c34d2956e req-2eee4012-dd04-41a0-a7fd-5c389cbc556e service nova] Creating event network-vif-plugged:5ab41a84-5959-40f7-9ad8-8db9b1a049a2 for instance bed8727d-68ba-4aef-971c-55876c2856b4 on nch1-master-1 Jul 02 21:24:38.981255 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-37bd6fa9-71a5-4085-ad17-e67c34d2956e req-2eee4012-dd04-41a0-a7fd-5c389cbc556e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097931 Jul 02 21:24:38.982313 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2408/4842] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:24:39.146273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:39.147777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:39.162450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:39.163332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:39.164444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:39.165093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:39.487403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:39.495463 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-893fc786-4841-407a-8cbf-441cd4858702 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.353622 Jul 02 21:24:39.501697 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2435/4843] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:39 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:39.623463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:39.624495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:39.647574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:39.649039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:39.651474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:39.652018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:39.846429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:39.847047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:39.865740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:39.866646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:39.873707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:39.874452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:39.994373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:40.009243 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3747ed88-d99c-48a7-8612-1c0686d0f4c6 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.388028 Jul 02 21:24:40.010351 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2409/4844] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:39 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:40.199591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:40.213001 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d6bec70-2a8e-44ad-ae04-d14b2cdc799b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1485 microversion: 2.1 time: 0.366914 Jul 02 21:24:40.214393 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2436/4845] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:39 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1485 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:40.230350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:40.231297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:40.242795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.244604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.245457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.245892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.280819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:24:40.347240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:40.453881 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8c5972f-9abd-40dc-bb69-28cc0a2f3eb3 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 204 len: 0 microversion: 2.1 time: 0.227384 Jul 02 21:24:40.455472 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2410/4846] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:40 2022] DELETE /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:24:40.467694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f2ce8b9-2e4f-4c2d-b951-5219782cb028 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77124c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:40.506461 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7f2ce8b9-2e4f-4c2d-b951-5219782cb028 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Image not found. Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f2ce8b9-2e4f-4c2d-b951-5219782cb028 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 HTTP/1.1 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'f44ae780-1426-4359-8d27-9415ce7fd0e5'} Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f44ae780-1426-4359-8d27-9415ce7fd0e5 to delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f44ae780-1426-4359-8d27-9415ce7fd0e5 could not be found. Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.508680 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:24:40.514600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:40.517015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:40.517734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:40.518225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f2ce8b9-2e4f-4c2d-b951-5219782cb028 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:40.519485 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f2ce8b9-2e4f-4c2d-b951-5219782cb028 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5" status: 404 len: 62 microversion: 2.1 time: 0.056491 Jul 02 21:24:40.520628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2437/4847] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:40 2022] DELETE /compute/v2.1/images/f44ae780-1426-4359-8d27-9415ce7fd0e5 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:24:40.531145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.531595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:40.531744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.532437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:40.532591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.532878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.541534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.542306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.543301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.544395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.586895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:24:40.662594 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Instance is already in deleting state, ignoring this request Jul 02 21:24:40.663798 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-936185bd-938b-4c1e-8a05-d423ec6f195a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 204 len: 0 microversion: 2.1 time: 0.139424 Jul 02 21:24:40.667778 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2438/4848] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:40 2022] DELETE /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:24:40.683815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:40.684806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:40.692441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.693357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.694311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:40.694913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:40.985017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:40.994852 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1a6516c-1275-4823-abd3-50d0a4e88d8d tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.485234 Jul 02 21:24:40.995650 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2411/4849] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:40 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:41.022491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:41.030121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:41.030976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:41.040020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:41.041272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:41.042265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:41.043249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:41.064836 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3d2f462-4430-48ee-8e9e-ef6e839a3772 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1491 microversion: 2.1 time: 0.386678 Jul 02 21:24:41.068746 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2439/4850] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:40 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1491 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:41.357247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:41.368117 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b984d719-d31a-44c7-96c6-a7fe880ad950 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.344112 Jul 02 21:24:41.369673 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2412/4851] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:41 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:41.499514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a7299678-49e8-4d44-997a-98b021cfaaa0 req-4598784a-d24a-485e-b054-c685bb4723fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed8727d-68ba-4aef-971c-55876c2856b4", "name": "network-vif-unplugged", "status": "completed", "tag": "5ab41a84-5959-40f7-9ad8-8db9b1a049a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:41.513872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a7299678-49e8-4d44-997a-98b021cfaaa0 req-4598784a-d24a-485e-b054-c685bb4723fd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:41.517581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a7299678-49e8-4d44-997a-98b021cfaaa0 req-4598784a-d24a-485e-b054-c685bb4723fd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:41.567885 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a7299678-49e8-4d44-997a-98b021cfaaa0 req-4598784a-d24a-485e-b054-c685bb4723fd service nova] Creating event network-vif-unplugged:5ab41a84-5959-40f7-9ad8-8db9b1a049a2 for instance bed8727d-68ba-4aef-971c-55876c2856b4 on nch1-master-1 Jul 02 21:24:41.584140 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a7299678-49e8-4d44-997a-98b021cfaaa0 req-4598784a-d24a-485e-b054-c685bb4723fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086827 Jul 02 21:24:41.585358 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2440/4852] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:42.015591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:42.016397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:42.038037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:42.038459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:42.040612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:42.041066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:42.091522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:42.095174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:42.121785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:42.122610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:42.127327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:42.128980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:42.633648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:42.645608 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0e1076e4-1d6f-4c15-ac98-0cc16432c63f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.636691 Jul 02 21:24:42.653093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2413/4853] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:42 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:42.663685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:42.667377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:42.701267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:42.708263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:42.716361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:42.718950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:42.882306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:42.896370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b0378ad-862e-4e7f-bc97-b63c84f90cd2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1491 microversion: 2.1 time: 0.815429 Jul 02 21:24:42.897625 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2441/4854] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:42 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1491 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:43.018205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:43.030648 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf36555e-2502-40e7-967e-49c4a00faa24 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.376024 Jul 02 21:24:43.031264 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2414/4855] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:42 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:43.672918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:43.673701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:43.689788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:43.691023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:43.692059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:43.695863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:43.919307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:43.920359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:43.927943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:43.934637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:43.937163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:43.938704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:44.613743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:44.622722 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5d659038-1bbd-4bae-a0c7-71355d114607 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1449 microversion: 2.1 time: 0.712379 Jul 02 21:24:44.632263 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2415/4856] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:43 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1449 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:44.637295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:44.655219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:44.688129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:44.689155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:44.690340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:44.690992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:44.912337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:44.939123 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0abb263e-e4f2-4f0c-a6d3-a7ddbff345dc tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 1.272240 Jul 02 21:24:44.940139 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2442/4857] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:43 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:44.971147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4cc4fb58-7bb3-45ff-9ed2-85dac7e0d0b8 req-bb7ed20c-50e9-42e8-8679-8ff2d7d67cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed8727d-68ba-4aef-971c-55876c2856b4", "name": "network-vif-deleted", "tag": "5ab41a84-5959-40f7-9ad8-8db9b1a049a2"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:44.991611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4cc4fb58-7bb3-45ff-9ed2-85dac7e0d0b8 req-bb7ed20c-50e9-42e8-8679-8ff2d7d67cf8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:44.995630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4cc4fb58-7bb3-45ff-9ed2-85dac7e0d0b8 req-bb7ed20c-50e9-42e8-8679-8ff2d7d67cf8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:45.028652 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4cc4fb58-7bb3-45ff-9ed2-85dac7e0d0b8 req-bb7ed20c-50e9-42e8-8679-8ff2d7d67cf8 service nova] Creating event network-vif-deleted:5ab41a84-5959-40f7-9ad8-8db9b1a049a2 for instance bed8727d-68ba-4aef-971c-55876c2856b4 on nch1-master-1 Jul 02 21:24:45.032818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:45.038890 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4cc4fb58-7bb3-45ff-9ed2-85dac7e0d0b8 req-bb7ed20c-50e9-42e8-8679-8ff2d7d67cf8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079798 Jul 02 21:24:45.043079 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2443/4858] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:45.046332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a2e3cba8-8218-4595-acbd-45423814dcef tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.408653 Jul 02 21:24:45.046971 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2416/4859] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:44 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:45.652508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:45.653687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:45.661252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:45.662037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:45.663015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:45.663690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:45.762390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:45.763128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:45.763776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lazy-loading 'fault' on Instance uuid bed8727d-68ba-4aef-971c-55876c2856b4 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:24:45.883870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:45.899081 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-674efd1e-0b56-44ce-896e-20e07703657b tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1297 microversion: 2.1 time: 0.255706 Jul 02 21:24:45.900179 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2444/4860] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:45 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1297 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:45.957688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:45.958306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:45.967042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:45.968864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:45.971382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:45.972108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.066780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:46.067415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:46.077713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.085635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.086762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.087390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.285320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:46.300202 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e52ac3a4-efde-4ca5-a09d-0b8c9541ee02 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1485 microversion: 2.1 time: 0.346432 Jul 02 21:24:46.301845 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2417/4861] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:45 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1485 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:46.319203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:46.319993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:46.343932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.344604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.345429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.345875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.441142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:46.451825 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-854f07d4-9320-4ddc-9344-ee01210ba50a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.389857 Jul 02 21:24:46.452849 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2445/4862] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:46 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:46.495237 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2954066a-c5aa-40ad-addf-7e786b532529 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "POST /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71/action" status: 202 len: 0 microversion: 2.1 time: 0.178973 Jul 02 21:24:46.496605 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2418/4863] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:46 2022] POST /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:24:46.506637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:46.507590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:46.515755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.516500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.518159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.518654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.552504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:46.782841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:46.791618 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c48653bb-dabd-451f-9ac7-d57d27143ec1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1493 microversion: 2.1 time: 0.291025 Jul 02 21:24:46.792989 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2446/4864] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:46 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1493 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:46.917535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:46.918338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:46.926840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.927616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.928726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.929487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.969946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:46.971881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:46.973434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lazy-loading 'fault' on Instance uuid bed8727d-68ba-4aef-971c-55876c2856b4 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:24:47.081418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa780176ae5f4a618e42a47531b0d4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ada57eeadbb9443c9f42dc99310ef8de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:47.085596 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3e894fc-0df2-49b0-a3c3-808312ec1bc8 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 200 len: 1297 microversion: 2.1 time: 0.172256 Jul 02 21:24:47.094548 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2419/4865] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:46 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 1297 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:47.470611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:47.471963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:47.483954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:47.486167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:47.487210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:47.487852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:47.812215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:47.813151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:47.831465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:47.835711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:47.839454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:47.850252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.026172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:48.041468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3140455f-a294-4440-b989-4f2fa44233e7 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.571039 Jul 02 21:24:48.042373 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2447/4866] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:47 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:48.102383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.103320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: bed8727d-68ba-4aef-971c-55876c2856b4] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.114174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.116121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.117257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.122649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.143136 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance bed8727d-68ba-4aef-971c-55876c2856b4 could not be found. Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 HTTP/1.1 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance bed8727d-68ba-4aef-971c-55876c2856b4 could not be found. Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'bed8727d-68ba-4aef-971c-55876c2856b4'} Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed8727d-68ba-4aef-971c-55876c2856b4 could not be found. Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed8727d-68ba-4aef-971c-55876c2856b4 could not be found. Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.145951 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.151649 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.151649 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.151649 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.151649 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.151649 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed8727d-68ba-4aef-971c-55876c2856b4 could not be found. Jul 02 21:24:48.151649 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.154601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance bed8727d-68ba-4aef-971c-55876c2856b4 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.157880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42b6c3ab-a8af-40f2-8543-88802c4be962 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4" status: 404 len: 111 microversion: 2.1 time: 0.059686 Jul 02 21:24:48.163066 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2448/4867] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] GET /compute/v2.1/servers/bed8727d-68ba-4aef-971c-55876c2856b4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:24:48.176621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09a2166e-ff9f-4c66-b7bf-6bf1a582806e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7740790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.209463 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-09a2166e-ff9f-4c66-b7bf-6bf1a582806e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Image not found. Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09a2166e-ff9f-4c66-b7bf-6bf1a582806e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 HTTP/1.1 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '6a6c8609-54b6-4232-a6f2-09afdedb9e33'} Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a6c8609-54b6-4232-a6f2-09afdedb9e33 to delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a6c8609-54b6-4232-a6f2-09afdedb9e33 could not be found. Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.211600 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:24:48.218433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.223430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09a2166e-ff9f-4c66-b7bf-6bf1a582806e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.224631 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09a2166e-ff9f-4c66-b7bf-6bf1a582806e tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33" status: 404 len: 62 microversion: 2.1 time: 0.059358 Jul 02 21:24:48.232333 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2449/4868] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] DELETE /compute/v2.1/images/6a6c8609-54b6-4232-a6f2-09afdedb9e33 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:24:48.255434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.255942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.265121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.265845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.266886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.267556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.294871 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f HTTP/1.1 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8f3693a2-c2f4-4960-9b06-a3f95524bc4f'} Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:48.296509 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96871c0f-4df5-423c-ac63-7511c02c4fc0 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 404 len: 111 microversion: 2.1 time: 0.064663 Jul 02 21:24:48.301385 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2450/4869] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:48 2022] DELETE /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:48.307431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.308079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: 8f3693a2-c2f4-4960-9b06-a3f95524bc4f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.314608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.315190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.315994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.316484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.324027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:48.336698 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c7defe1c-ba1c-400e-b355-2c061c3361ca tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1493 microversion: 2.1 time: 0.530580 Jul 02 21:24:48.336901 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.337292 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2420/4870] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:47 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1493 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f HTTP/1.1 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8f3693a2-c2f4-4960-9b06-a3f95524bc4f'} Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.348954 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.354436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance 8f3693a2-c2f4-4960-9b06-a3f95524bc4f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.355948 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c1b93c1-565b-4c57-9e5c-1240d4fe1b04 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f" status: 404 len: 111 microversion: 2.1 time: 0.052427 Jul 02 21:24:48.359924 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2451/4871] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] GET /compute/v2.1/servers/8f3693a2-c2f4-4960-9b06-a3f95524bc4f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:24:48.366680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-482be399-3621-448f-a4fb-168f087bffc2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd7203790>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.394140 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-482be399-3621-448f-a4fb-168f087bffc2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Image not found. Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-482be399-3621-448f-a4fb-168f087bffc2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd HTTP/1.1 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: method: Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: exception: Image not found. Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'f9cbc195-54ca-4300-9078-7a207f8aebfd'} Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f9cbc195-54ca-4300-9078-7a207f8aebfd to delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f9cbc195-54ca-4300-9078-7a207f8aebfd could not be found. Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.396410 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-482be399-3621-448f-a4fb-168f087bffc2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Image not found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.401023 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-482be399-3621-448f-a4fb-168f087bffc2 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd" status: 404 len: 62 microversion: 2.1 time: 0.036645 Jul 02 21:24:48.407984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.408856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.411972 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2421/4872] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] DELETE /compute/v2.1/images/f9cbc195-54ca-4300-9078-7a207f8aebfd => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:24:48.415264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.415728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.416622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.417067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.432436 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef HTTP/1.1 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'd13e2b0a-de26-41fb-ac2d-1650603b63ef'} Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:48.434179 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.438843 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c616e2f-2978-4945-b132-4a8903c036a7 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 404 len: 111 microversion: 2.1 time: 0.032810 Jul 02 21:24:48.444602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.445241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: d13e2b0a-de26-41fb-ac2d-1650603b63ef] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.449225 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2452/4873] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:48 2022] DELETE /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:48.453360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.453826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.454661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.455111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.483558 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef HTTP/1.1 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd13e2b0a-de26-41fb-ac2d-1650603b63ef'} Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.485186 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance d13e2b0a-de26-41fb-ac2d-1650603b63ef could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-691359e2-3ab9-413e-9f7f-49daab0e5e26 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef" status: 404 len: 111 microversion: 2.1 time: 0.046002 Jul 02 21:24:48.492108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2422/4874] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] GET /compute/v2.1/servers/d13e2b0a-de26-41fb-ac2d-1650603b63ef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:48.495262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3df057bd-ba09-4751-9413-dd8318023aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '.version_select at 0x7fabd77401f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.531765 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-3df057bd-ba09-4751-9413-dd8318023aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Image not found. Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3df057bd-ba09-4751-9413-dd8318023aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 HTTP/1.1 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '19afd4bf-562c-490e-a7f1-5ff7710fc6f6'} Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 19afd4bf-562c-490e-a7f1-5ff7710fc6f6 to delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 19afd4bf-562c-490e-a7f1-5ff7710fc6f6 could not be found. Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.533785 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3df057bd-ba09-4751-9413-dd8318023aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3df057bd-ba09-4751-9413-dd8318023aff tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6" status: 404 len: 62 microversion: 2.1 time: 0.043849 Jul 02 21:24:48.540375 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2453/4875] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] DELETE /compute/v2.1/images/19afd4bf-562c-490e-a7f1-5ff7710fc6f6 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:24:48.552066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.552066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.552066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.552066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.552931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.560089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.952331 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b HTTP/1.1 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'db16f871-de37-42d1-8bba-2920d24d495b'} Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:48.960457 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:48.966125 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8d20e9f8-2571-4d64-8308-e83194dd6b54 tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "DELETE /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 404 len: 111 microversion: 2.1 time: 0.421880 Jul 02 21:24:48.972749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:48.973383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] [instance: db16f871-de37-42d1-8bba-2920d24d495b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:48.980033 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2423/4876] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:48 2022] DELETE /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 111 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:48.990357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.990823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:48.991632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:48.992101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:49.021920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] HTTP exception thrown: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Request method failure captured: Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b HTTP/1.1 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa1z-AwJtN9zu5htgUzCdeidn4Mi9OsJUui9dSwYYoz2JF4MNxQpzfUAP5w4JOthxRpL74xbc1asjYGHy9mP9_XPXH-vLSn4kZ61XEup_xKqUqJHs8iJiuXJlSXxrxHptIhOoLQ4r3eQRs8FbKDdH3kC242VNu0_O5dETTmxlVc4Ms Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ada57eeadbb9443c9f42dc99310ef8de", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ada57eeadbb9443c9f42dc99310ef8de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ada57eeadbb9443c9f42dc99310ef8de"}]}] Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesTestJSON-425963404 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: ada57eeadbb9443c9f42dc99310ef8de Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesTestJSON-425963404 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: fa780176ae5f4a618e42a47531b0d4a5 Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesTestJSON-425963404-project Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'db16f871-de37-42d1-8bba-2920d24d495b'} Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:49.025408 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] Returning 404 to user: Instance db16f871-de37-42d1-8bba-2920d24d495b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c17bf23c-f76d-4dd7-9d66-73c1fcaff21a tempest-ImagesTestJSON-425963404 tempest-ImagesTestJSON-425963404-project] 10.222.0.43 "GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b" status: 404 len: 111 microversion: 2.1 time: 0.059678 Jul 02 21:24:49.030967 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2454/4877] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:48 2022] GET /compute/v2.1/servers/db16f871-de37-42d1-8bba-2920d24d495b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:49.059197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:49.059746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:49.082696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:49.083379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:49.084399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:49.085011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:49.354195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:49.354410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:49.364877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:49.365344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:49.366141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:49.366584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:49.409568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:49.420714 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-934fb982-a3b3-46e6-92b3-edebee5cb3fc tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.365462 Jul 02 21:24:49.431965 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2424/4878] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:49 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:49.609964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:49.624432 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6829fc3-28bb-484a-aac0-de288244c4e1 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1493 microversion: 2.1 time: 0.274364 Jul 02 21:24:49.634577 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2455/4879] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:49 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1493 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:50.440027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:50.440838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:50.451863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:50.454860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:50.459822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:50.460619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:50.642693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:50.643356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:50.650659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:50.651131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:50.651902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:50.652376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:50.750855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:50.762737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38e026e7-9214-4111-a6a4-b3c68e215a70 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.327495 Jul 02 21:24:50.774332 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2425/4880] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:50 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:50.953979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:50.965369 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-140e1077-4589-44e4-a111-47ff13b4e9d2 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1499 microversion: 2.1 time: 0.326569 Jul 02 21:24:50.981997 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2456/4881] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:50 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1499 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:50.991596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:50.992538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:51.002189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:51.003121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:51.004225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:51.004953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:51.052193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:24:51.112607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:51.189668 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3513abc-02f2-45a7-af35-7050f2e9f05f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 204 len: 0 microversion: 2.1 time: 0.202863 Jul 02 21:24:51.190662 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2426/4882] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:50 2022] DELETE /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:24:51.198945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:51.199575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:51.218806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:51.219590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:51.220583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:51.221079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:51.567162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:51.583635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-263e5b3f-19df-4a82-8474-e6d867ad1f0f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.388742 Jul 02 21:24:51.585865 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2457/4883] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:51 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:51.790951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:51.792345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:51.801564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:51.802019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:51.802802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:51.803540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:52.206325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:52.218292 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eae4fec7-5ca8-475d-9ff4-fd25236ed782 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.429155 Jul 02 21:24:52.227600 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2427/4884] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:51 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:52.607150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:52.608482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:52.634077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:52.636470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:52.637528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:52.640696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:53.236010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:53.237202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:53.263469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:53.264030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:53.265028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:53.265881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:53.469024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:53.480355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ac6c971-22a1-4db7-8982-a2e0d5be5eb4 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.877076 Jul 02 21:24:53.493537 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2458/4885] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:52 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:53.598603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:53.612992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d413618a-40ad-4f4a-a4ab-6ec9eb8a968d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.379288 Jul 02 21:24:53.613724 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2428/4886] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:53 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:53.821120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2e0d9c3a-b53f-4561-bfa7-f45c95d453c7 req-6eca62f9-43c6-4eb8-abb5-3bd8663f6108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c01b1-585c-4366-95f1-2e2388a7fda2", "name": "network-vif-plugged", "status": "completed", "tag": "e27718a1-3c8b-4441-982a-cf26ff8c5baf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:53.835358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2e0d9c3a-b53f-4561-bfa7-f45c95d453c7 req-6eca62f9-43c6-4eb8-abb5-3bd8663f6108 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:53.836117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2e0d9c3a-b53f-4561-bfa7-f45c95d453c7 req-6eca62f9-43c6-4eb8-abb5-3bd8663f6108 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:53.851168 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2e0d9c3a-b53f-4561-bfa7-f45c95d453c7 req-6eca62f9-43c6-4eb8-abb5-3bd8663f6108 service nova] Creating event network-vif-plugged:e27718a1-3c8b-4441-982a-cf26ff8c5baf for instance a26c01b1-585c-4366-95f1-2e2388a7fda2 on nch1-master-1 Jul 02 21:24:53.860026 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2e0d9c3a-b53f-4561-bfa7-f45c95d453c7 req-6eca62f9-43c6-4eb8-abb5-3bd8663f6108 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042295 Jul 02 21:24:53.861705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2459/4887] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:24:54.500291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:54.500865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:54.503977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:54.512197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:54.512658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:54.513488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:54.516908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:54.631016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:54.632056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:54.645418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:54.648250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:54.652019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:54.652764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:54.843411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:54.852545 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2579e79e-c26b-449e-9798-eb5ec1ce1fcb tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1505 microversion: 2.1 time: 0.356903 Jul 02 21:24:54.865616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2429/4888] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:54 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:55.129745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:55.145050 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c554ec63-eebd-487f-91c0-5647de4064ab tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.512653 Jul 02 21:24:55.145050 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2460/4889] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:54 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:55.675454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b45bae8d-7795-4a7a-aed6-1da01ca4e529 req-583c35d3-4260-4774-9372-02bfddb5c6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c56689cd-e15f-465f-aa22-8477e9c19f71", "name": "network-vif-deleted", "tag": "4ab4f888-e498-4201-906c-7fd02e831494"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:55.695013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b45bae8d-7795-4a7a-aed6-1da01ca4e529 req-583c35d3-4260-4774-9372-02bfddb5c6de service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:55.696029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b45bae8d-7795-4a7a-aed6-1da01ca4e529 req-583c35d3-4260-4774-9372-02bfddb5c6de service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:55.723795 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b45bae8d-7795-4a7a-aed6-1da01ca4e529 req-583c35d3-4260-4774-9372-02bfddb5c6de service nova] Creating event network-vif-deleted:4ab4f888-e498-4201-906c-7fd02e831494 for instance c56689cd-e15f-465f-aa22-8477e9c19f71 on nch2-master-1 Jul 02 21:24:55.735751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b45bae8d-7795-4a7a-aed6-1da01ca4e529 req-583c35d3-4260-4774-9372-02bfddb5c6de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065835 Jul 02 21:24:55.742612 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2430/4890] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:24:55.880169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:55.880929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:55.912350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:55.918273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:55.920001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:55.920865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:55.993658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:55.994567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:55.995678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lazy-loading 'fault' on Instance uuid c56689cd-e15f-465f-aa22-8477e9c19f71 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:24:56.076066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:56.090425 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-03b65bf4-2fb4-4d10-acb8-abb6e1290b03 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 200 len: 1304 microversion: 2.1 time: 0.225570 Jul 02 21:24:56.091872 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2461/4891] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:55 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 1304 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:56.163793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:56.165783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:56.175253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:56.176463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:56.177457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:56.177689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:56.454642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:56.466958 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5929faa3-7f0d-4c4b-af94-da1c091334c3 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1519 microversion: 2.1 time: 0.309871 Jul 02 21:24:56.468174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2431/4892] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:56 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1519 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:57.109730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:57.110512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: c56689cd-e15f-465f-aa22-8477e9c19f71] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:57.118484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.118904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.119715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.120669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.138303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] HTTP exception thrown: Instance c56689cd-e15f-465f-aa22-8477e9c19f71 could not be found. Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Request method failure captured: Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 HTTP/1.1 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLc3-HxVlp3PUVT3oHHIPXJCHYNTngE-tU8yLFGsOAD_gxj5Jyvm-HJZMluU8gMME_IDjMByJRWtD6WY9lQ0CXe2QSBmE_oin0Zn_rotKDag01KjK8bg81YNvmiWUSOHqFc_2hl7-DraheL6ebpGeEZB4COwfkyYC6HWag-Ou0evni4 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a0c14d320e154cedb7b37f38873f241e Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueTestJSON-1935583305 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c14d320e154cedb7b37f38873f241e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c14d320e154cedb7b37f38873f241e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c14d320e154cedb7b37f38873f241e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c14d320e154cedb7b37f38873f241e"}]}] Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueTestJSON-1935583305 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a0c14d320e154cedb7b37f38873f241e Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueTestJSON-1935583305 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerRescueTestJSON-1935583305-project Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 23d7253b721f409ab148368d84b87963 Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueTestJSON-1935583305-project Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance c56689cd-e15f-465f-aa22-8477e9c19f71 could not be found. Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c56689cd-e15f-465f-aa22-8477e9c19f71'} Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c56689cd-e15f-465f-aa22-8477e9c19f71 could not be found. Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c56689cd-e15f-465f-aa22-8477e9c19f71 could not be found. Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:57.140298 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c56689cd-e15f-465f-aa22-8477e9c19f71 could not be found. Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Returning 404 to user: Instance c56689cd-e15f-465f-aa22-8477e9c19f71 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:57.146800 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d1e6111-73de-4c7b-9a22-3bb0d4cf1ae3 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71" status: 404 len: 111 microversion: 2.1 time: 0.036639 Jul 02 21:24:57.151339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:57.151874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:57.155745 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2462/4893] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:57 2022] GET /compute/v2.1/servers/c56689cd-e15f-465f-aa22-8477e9c19f71 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:57.159195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.159659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.161164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.161625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.191062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:24:57.312451 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e01d0d5c-62a1-498c-b5ba-20a5d645100f tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "DELETE /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 204 len: 0 microversion: 2.1 time: 0.164137 Jul 02 21:24:57.313389 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2432/4894] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:24:57 2022] DELETE /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:24:57.322065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:57.322994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:57.341704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.342275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.343357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.344885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.488602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:57.490007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:57.498426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.500419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.501437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.502049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.580791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:57.591099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26ca3f1c-6f1c-4f0a-b14e-727f8f63866e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1491 microversion: 2.1 time: 0.273201 Jul 02 21:24:57.591778 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2463/4895] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:57 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1491 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:57.681790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:57.691506 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c04f8acf-f13c-4eb4-9534-87c92142f699 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.210197 Jul 02 21:24:57.692474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2433/4896] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:57 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:57.709488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:57.710784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:57.719939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.722228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.724982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.725677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.868667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-658563790", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:57.879003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=78 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:57.934253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] validate_networks() for None {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:24:57.942995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:57.952142 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ecdf38f0-83cc-4bc5-94c7-288c4c6f46e0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.247581 Jul 02 21:24:57.953273 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2434/4897] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:57 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:57.980500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:57.981130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:57.991278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.991278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:57.991278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:57.991278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.313896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:58.334962 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9cc9da9b-dc7c-4f30-a95c-21e3b717ed4c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.361077 Jul 02 21:24:58.335643 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2435/4898] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:57 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:58.354348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c061909d-3196-4964-8ec3-0108afe9d622 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:58.362791 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c061909d-3196-4964-8ec3-0108afe9d622 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance febfdeef-085d-4e22-9705-fc764fa53eac has no mapping to a cell. Jul 02 21:24:58.372740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:24:58.373274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:24:58.374334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:24:58.374754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:24:58.375176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c061909d-3196-4964-8ec3-0108afe9d622 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/febfdeef-085d-4e22-9705-fc764fa53eac/action HTTP/1.1 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 15 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: {"os-stop": {}} Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance febfdeef-085d-4e22-9705-fc764fa53eac has no mapping to a cell. Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'febfdeef-085d-4e22-9705-fc764fa53eac', 'body': {'os-stop': {}}} Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance febfdeef-085d-4e22-9705-fc764fa53eac has no mapping to a cell. Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 02 21:24:58.381064 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance febfdeef-085d-4e22-9705-fc764fa53eac has no mapping to a cell. Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance febfdeef-085d-4e22-9705-fc764fa53eac has no mapping to a cell. Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c061909d-3196-4964-8ec3-0108afe9d622 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance febfdeef-085d-4e22-9705-fc764fa53eac has no mapping to a cell. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c061909d-3196-4964-8ec3-0108afe9d622 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/febfdeef-085d-4e22-9705-fc764fa53eac/action" status: 404 len: 117 microversion: 2.1 time: 0.034341 Jul 02 21:24:58.389923 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2436/4899] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:58 2022] POST /compute/v2.1/servers/febfdeef-085d-4e22-9705-fc764fa53eac/action => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:24:58.397197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.397670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.398493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.398637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:58.399354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:58.401777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.419272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.419745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.420884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.422844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.430892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Getting quotas for project af5057879953477fa6557bbd78b77763. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:24:58.437806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Getting quotas for user 8be0d1bce21149af900fccfc92b64f29 and project af5057879953477fa6557bbd78b77763. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:24:58.455616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:24:58.458297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:24:58.506032 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15ee60dd-2f4b-443b-b57a-5ecaf0cf8337 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912760 Jul 02 21:24:58.507165 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2464/4900] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:24:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:24:58.517787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4788f694-5dd5-4563-8fd7-2d23bad3ec69 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:58.518763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4788f694-5dd5-4563-8fd7-2d23bad3ec69 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:58.591523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4788f694-5dd5-4563-8fd7-2d23bad3ec69 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:58.602981 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4788f694-5dd5-4563-8fd7-2d23bad3ec69 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1216 microversion: 2.1 time: 0.088924 Jul 02 21:24:58.605103 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2465/4901] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:58 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:58.607200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:58.621190 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef548cf2-995a-4766-af0e-76442cd6264a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.227938 Jul 02 21:24:58.622482 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2437/4902] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:58 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:58.623790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:58.624564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:58.639763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.640279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.641088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.641537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.645512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:58.646411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:58.657865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.659004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.659918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:58.660488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:58.949438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:58.958284 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8e56cde-8a53-4015-a9d7-b9b4d702449e tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1491 microversion: 2.1 time: 0.351734 Jul 02 21:24:58.959162 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2466/4903] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:58 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1491 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:58.965906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:58.982202 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-73f4835b-05ce-4a77-a7de-768c49d9fa03 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.347154 Jul 02 21:24:58.983153 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2438/4904] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:58 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:58.999524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42d2a100-460a-4640-802c-9d2f8d2374cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:59.000229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42d2a100-460a-4640-802c-9d2f8d2374cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 7a75bb2e-fded-490e-ae2f-eeee3a26397d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.006844 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-42d2a100-460a-4640-802c-9d2f8d2374cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 7a75bb2e-fded-490e-ae2f-eeee3a26397d could not be found. Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42d2a100-460a-4640-802c-9d2f8d2374cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/7a75bb2e-fded-490e-ae2f-eeee3a26397d/action HTTP/1.1 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 15 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: {"suspend": {}} Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 7a75bb2e-fded-490e-ae2f-eeee3a26397d could not be found. Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7a75bb2e-fded-490e-ae2f-eeee3a26397d', 'body': {'suspend': {}}} Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a75bb2e-fded-490e-ae2f-eeee3a26397d could not be found. Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a75bb2e-fded-490e-ae2f-eeee3a26397d could not be found. Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:24:59.009083 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:24:59.014533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:24:59.014533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:24:59.014533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:24:59.014533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a75bb2e-fded-490e-ae2f-eeee3a26397d could not be found. Jul 02 21:24:59.014533 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:24:59.016838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42d2a100-460a-4640-802c-9d2f8d2374cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 7a75bb2e-fded-490e-ae2f-eeee3a26397d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:24:59.018159 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42d2a100-460a-4640-802c-9d2f8d2374cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/7a75bb2e-fded-490e-ae2f-eeee3a26397d/action" status: 404 len: 111 microversion: 2.1 time: 0.022719 Jul 02 21:24:59.019592 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2467/4905] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:58 2022] POST /compute/v2.1/servers/7a75bb2e-fded-490e-ae2f-eeee3a26397d/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:24:59.028548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:59.029253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.038350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.038811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.041078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.042307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.274946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:59.295923 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f1776be-4bce-450a-82c4-deab4967c396 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.269430 Jul 02 21:24:59.296986 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2439/4906] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:59 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:59.316309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:59.317043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.330251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.331202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.332901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.334032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.512970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:59.521273 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2b53fce-0f4e-45cf-80a1-fedb44207a04 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.210022 Jul 02 21:24:59.521856 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2468/4907] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:59 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:59.538982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:24:59.540182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.547961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.548799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.549815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.551217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.577322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lazy-loading 'flavor' on Instance uuid a26c01b1-585c-4366-95f1-2e2388a7fda2 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:24:59.621028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:59.621649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.630567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.630861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.631630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.632085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.664499 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f829bc8-033e-45c4-8a8f-38b8b06d24c2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 202 len: 0 microversion: 2.1 time: 0.130469 Jul 02 21:24:59.665425 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2440/4908] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:24:59 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:24:59.685903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:59.686898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.694977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.695970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.697397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.698061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.702061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:24:59.735897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:59.752682 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f9e407a-07a3-4ba1-9dcf-33063d1ef061 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1268 microversion: 2.1 time: 0.135153 Jul 02 21:24:59.754752 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2469/4909] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:59 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1268 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:24:59.951082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:24:59.969521 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb694928-92e0-424b-b4ae-2f7c46bfee62 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1514 microversion: 2.1 time: 0.298556 Jul 02 21:24:59.975552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:24:59.976207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:24:59.992987 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2441/4910] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:59 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:24:59.995537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.996220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:24:59.997199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:24:59.997841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:00.176662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:00.187967 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42d40286-6c46-4340-b4f8-2600aa1d9fc7 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1491 microversion: 2.1 time: 0.217019 Jul 02 21:25:00.190157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2470/4911] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:24:59 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1491 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:00.769629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:00.770290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:00.779405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:00.779867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:00.780675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:00.781367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:00.873519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:00.885155 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9df3ba5c-7606-48c4-afc5-14fb813c4a7c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1274 microversion: 2.1 time: 0.119601 Jul 02 21:25:00.886414 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2442/4912] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:00 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:01.003094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:01.003094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:01.026936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.027407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.028294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.028741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.217008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:01.219077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:01.240759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.242245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.261274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.261974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.591309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:01.604648 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca34d524-e1fa-4b94-8e81-8416a5e153e2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1497 microversion: 2.1 time: 0.606672 Jul 02 21:25:01.605617 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2471/4913] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:00 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1497 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:01.621849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23d7253b721f409ab148368d84b87963', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c14d320e154cedb7b37f38873f241e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:01.629356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9b56dbd9-ee94-4873-aae3-5bff08057710 req-bb6fec75-f590-46bc-93ba-f8e0009094fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49932e4c-c9f4-4846-806a-6f26765484c8", "name": "network-vif-deleted", "tag": "2eae8e0f-748a-472f-b663-d620ddd7d063"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:01.637575 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33cb328a-eb58-4ab0-bb53-91d4bfd4a823 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 200 len: 1449 microversion: 2.1 time: 0.434216 Jul 02 21:25:01.638514 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2443/4914] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:01 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 1449 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:01.641063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9b56dbd9-ee94-4873-aae3-5bff08057710 req-bb6fec75-f590-46bc-93ba-f8e0009094fc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.641697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9b56dbd9-ee94-4873-aae3-5bff08057710 req-bb6fec75-f590-46bc-93ba-f8e0009094fc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.652371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:01.653062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:01.655090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:01.657544 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9b56dbd9-ee94-4873-aae3-5bff08057710 req-bb6fec75-f590-46bc-93ba-f8e0009094fc service nova] Creating event network-vif-deleted:2eae8e0f-748a-472f-b663-d620ddd7d063 for instance 49932e4c-c9f4-4846-806a-6f26765484c8 on nch2-master-1 Jul 02 21:25:01.663670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9b56dbd9-ee94-4873-aae3-5bff08057710 req-bb6fec75-f590-46bc-93ba-f8e0009094fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051417 Jul 02 21:25:01.664693 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2472/4915] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:01.667203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.668550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.669648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.670257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.706647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lazy-loading 'flavor' on Instance uuid a26c01b1-585c-4366-95f1-2e2388a7fda2 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:25:01.721693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'suspend' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state suspended Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 15 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: {"suspend": {}} Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'suspend' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state suspended Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'suspend': {}}} Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:01.724230 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state suspended Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state suspended Jul 02 21:25:01.729644 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:01.733587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'suspend' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state suspended {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:01.734038 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-348b4546-a985-4694-a1e4-9274dc578b5b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 148 microversion: 2.1 time: 0.091749 Jul 02 21:25:01.735186 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2444/4916] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:01 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 148 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:25:01.744223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:01.745245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:01.759166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.760629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.761847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.762526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.905001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:01.907153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:01.919977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.920486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.921521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.922778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.938419 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-916538cc-76a4-4737-9803-e69d7b991c06 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 202 len: 0 microversion: 2.1 time: 0.196284 Jul 02 21:25:01.940919 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2473/4917] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:01 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:25:01.955164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:01.956810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:01.970402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.971675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:01.973597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:01.974279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:02.426220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:02.449521 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac098071-1eb7-437c-8e08-bb6daaa84f77 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.549319 Jul 02 21:25:02.450872 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2445/4918] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:01 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:02.472486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:02.484190 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f82b0a40-cffc-4e66-a33c-933eeb617d28 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1503 microversion: 2.1 time: 0.533908 Jul 02 21:25:02.484818 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2474/4919] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:01 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1503 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:02.661053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:02.662111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] [instance: 49932e4c-c9f4-4846-806a-6f26765484c8] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:02.677234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:02.680604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:02.681751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:02.682209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:02.726206 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] HTTP exception thrown: Instance 49932e4c-c9f4-4846-806a-6f26765484c8 could not be found. Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Request method failure captured: Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 HTTP/1.1 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLc3-HxVlp3PUVT3oHHIPXJCHYNTngE-tU8yLFGsOAD_gxj5Jyvm-HJZMluU8gMME_IDjMByJRWtD6WY9lQ0CXe2QSBmE_oin0Zn_rotKDag01KjK8bg81YNvmiWUSOHqFc_2hl7-DraheL6ebpGeEZB4COwfkyYC6HWag-Ou0evni4 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a0c14d320e154cedb7b37f38873f241e Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerRescueTestJSON-1935583305 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c14d320e154cedb7b37f38873f241e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a0c14d320e154cedb7b37f38873f241e", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a0c14d320e154cedb7b37f38873f241e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a0c14d320e154cedb7b37f38873f241e"}]}] Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerRescueTestJSON-1935583305 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a0c14d320e154cedb7b37f38873f241e Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerRescueTestJSON-1935583305 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerRescueTestJSON-1935583305-project Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 23d7253b721f409ab148368d84b87963 Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerRescueTestJSON-1935583305-project Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 49932e4c-c9f4-4846-806a-6f26765484c8 could not be found. Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '49932e4c-c9f4-4846-806a-6f26765484c8'} Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49932e4c-c9f4-4846-806a-6f26765484c8 could not be found. Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49932e4c-c9f4-4846-806a-6f26765484c8 could not be found. Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:02.728564 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49932e4c-c9f4-4846-806a-6f26765484c8 could not be found. Jul 02 21:25:02.735442 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:02.739236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] Returning 404 to user: Instance 49932e4c-c9f4-4846-806a-6f26765484c8 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:02.744335 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-84148e24-ac92-4bd7-9e41-5ad45567de85 tempest-ServerRescueTestJSON-1935583305 tempest-ServerRescueTestJSON-1935583305-project] 10.222.0.43 "GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8" status: 404 len: 111 microversion: 2.1 time: 0.089380 Jul 02 21:25:02.745505 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2446/4920] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:02 2022] GET /compute/v2.1/servers/49932e4c-c9f4-4846-806a-6f26765484c8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:03.467204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:03.468129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:03.477241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:03.478408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:03.479821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:03.480520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:03.501712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:03.503121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:03.518962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:03.519664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:03.521172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:03.521827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:03.754664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:03.775122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6388cfa-688d-4498-b7ac-486a6f3afebe tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.311539 Jul 02 21:25:03.775743 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2475/4921] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:03 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:03.782346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:03.786303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-76fc8063-87f7-4770-8343-141c6ab8a4c4 req-be379a50-e14d-4a06-8850-a50c5952efc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:03.791338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4cd0175f-45a5-4432-ad45-40d700ceec29 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1503 microversion: 2.1 time: 0.292405 Jul 02 21:25:03.808751 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2447/4922] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:03 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:03.810578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-76fc8063-87f7-4770-8343-141c6ab8a4c4 req-be379a50-e14d-4a06-8850-a50c5952efc8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:03.814562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-76fc8063-87f7-4770-8343-141c6ab8a4c4 req-be379a50-e14d-4a06-8850-a50c5952efc8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:03.830403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-76fc8063-87f7-4770-8343-141c6ab8a4c4 req-be379a50-e14d-4a06-8850-a50c5952efc8 service nova] Creating event network-changed:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:25:03.844833 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-76fc8063-87f7-4770-8343-141c6ab8a4c4 req-be379a50-e14d-4a06-8850-a50c5952efc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065550 Jul 02 21:25:03.845816 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2476/4923] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:04.792733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:04.793376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:04.800628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:04.801764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:04.802929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:04.803367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:04.823252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:04.825532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:04.840583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:04.841150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:04.842302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:04.842996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.096122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:05.109360 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9065b13b-602e-4e26-bd75-8efbc26f3eb5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.318906 Jul 02 21:25:05.110108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:05.110387 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2448/4924] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:04 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:05.128610 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd640f5b-7ed1-4e6f-951c-1a24d6baee8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.312280 Jul 02 21:25:05.129512 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2477/4925] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:04 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:05.147889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:05.149082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:05.158169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.159391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.161159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.163555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.373747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:05.397474 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f63b9d7-fdf9-4b80-b0b7-b088a82bda6b tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.253903 Jul 02 21:25:05.409232 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2449/4926] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:05 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:05.422936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-926a7b39-94a6-4cea-8e92-244448637a01 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:05.425096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-926a7b39-94a6-4cea-8e92-244448637a01 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 461a0c94-40b0-43a0-a851-1d41676d1252] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:05.440689 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-926a7b39-94a6-4cea-8e92-244448637a01 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 461a0c94-40b0-43a0-a851-1d41676d1252 could not be found. Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-926a7b39-94a6-4cea-8e92-244448637a01 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/461a0c94-40b0-43a0-a851-1d41676d1252/action HTTP/1.1 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 15 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: {"unpause": {}} Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 461a0c94-40b0-43a0-a851-1d41676d1252 could not be found. Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '461a0c94-40b0-43a0-a851-1d41676d1252', 'body': {'unpause': {}}} Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461a0c94-40b0-43a0-a851-1d41676d1252 could not be found. Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461a0c94-40b0-43a0-a851-1d41676d1252 could not be found. Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:05.442662 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:05.448051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:05.448051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:05.448051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:05.448051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461a0c94-40b0-43a0-a851-1d41676d1252 could not be found. Jul 02 21:25:05.448051 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:05.448051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-926a7b39-94a6-4cea-8e92-244448637a01 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 461a0c94-40b0-43a0-a851-1d41676d1252 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:05.449466 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-926a7b39-94a6-4cea-8e92-244448637a01 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/461a0c94-40b0-43a0-a851-1d41676d1252/action" status: 404 len: 111 microversion: 2.1 time: 0.036872 Jul 02 21:25:05.455421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2478/4927] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:05 2022] POST /compute/v2.1/servers/461a0c94-40b0-43a0-a851-1d41676d1252/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:05.466351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:05.467282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:05.475941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.476852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.479931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.480603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.685665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:05.698750 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6019cfe1-e6c9-4984-9609-c568a60c818e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.235911 Jul 02 21:25:05.699680 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2450/4928] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:05 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:05.717456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:05.718076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:05.731520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.732882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.735482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.736245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.923963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:05.942061 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e77b512-5cc3-4e92-802d-6c3300c87409 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.228614 Jul 02 21:25:05.942663 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2479/4929] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:05 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:05.959200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:05.959856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:05.972500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.973201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:05.974116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:05.975473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.005827 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'unpause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 15 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: {"unpause": {}} Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'unpause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'unpause': {}}} Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state active. Cannot unpause while the instance is in this state. Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.008943 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:06.014279 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:06.014279 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:06.014279 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:06.014279 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:06.014279 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:06.014279 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.015972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'unpause' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:06.017096 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3dfe3ba4-fb81-4317-8fe8-0d3156444a13 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 145 microversion: 2.1 time: 0.062523 Jul 02 21:25:06.018064 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2451/4930] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:05 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 145 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:25:06.026242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:06.026877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.033627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.034088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.035148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.035598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.127661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:06.128493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.135971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.136449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.137472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.138094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.235171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:06.245727 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3d34f78-fbac-4ee7-ba81-494f6636ebd4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.223574 Jul 02 21:25:06.246308 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2480/4931] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:06 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:06.263482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:06.264836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.271128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.271659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.272670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.273347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.299977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:06.308220 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba92ebb7-646d-4f9a-a2e3-f2737e1d4c0d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.184871 Jul 02 21:25:06.308801 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2452/4932] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:06 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:06.433241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:06.442765 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9d4f79c-dea4-46d6-b2d6-dbc5cbba6beb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.183622 Jul 02 21:25:06.443360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2481/4933] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:06 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:06.459948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b29f88c-07b3-4e2a-a87d-f2b251ff1835 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:06.460695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3b29f88c-07b3-4e2a-a87d-f2b251ff1835 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 01a8091f-e19b-44a9-a006-badeb2623616] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.466686 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-3b29f88c-07b3-4e2a-a87d-f2b251ff1835 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 01a8091f-e19b-44a9-a006-badeb2623616 could not be found. Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b29f88c-07b3-4e2a-a87d-f2b251ff1835 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/01a8091f-e19b-44a9-a006-badeb2623616/action HTTP/1.1 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 18 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: {"unshelve": null} Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 01a8091f-e19b-44a9-a006-badeb2623616 could not be found. Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '01a8091f-e19b-44a9-a006-badeb2623616', 'body': {'unshelve': None}} Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a8091f-e19b-44a9-a006-badeb2623616 could not be found. Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a8091f-e19b-44a9-a006-badeb2623616 could not be found. Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.468511 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:06.474124 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:06.474124 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:06.474124 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:06.474124 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:06.474124 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a8091f-e19b-44a9-a006-badeb2623616 could not be found. Jul 02 21:25:06.474124 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:06.475817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3b29f88c-07b3-4e2a-a87d-f2b251ff1835 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 01a8091f-e19b-44a9-a006-badeb2623616 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:06.476678 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3b29f88c-07b3-4e2a-a87d-f2b251ff1835 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/01a8091f-e19b-44a9-a006-badeb2623616/action" status: 404 len: 111 microversion: 2.1 time: 0.021217 Jul 02 21:25:06.480116 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2453/4934] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:06 2022] POST /compute/v2.1/servers/01a8091f-e19b-44a9-a006-badeb2623616/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:06.486352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:06.487026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.494156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.494653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.496166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.497820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.679816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:06.696747 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-83c7af1d-1ebd-4865-937e-5c3cc709ec40 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.214400 Jul 02 21:25:06.697917 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2482/4935] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:06 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:06.713997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:06.714962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.722807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.723747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.724895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.725579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.919366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:06.932553 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ebbf1bc-9a6b-4da1-845c-99f00f920fb4 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.222218 Jul 02 21:25:06.933153 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2454/4936] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:06 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:06.951507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:06.952451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:06.966555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.967724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:06.970960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:06.974090 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.030722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Cannot 'unshelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action HTTP/1.1 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 18 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: {"unshelve": null} Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot 'unshelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'unshelve': None}} Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 in vm_state active. Cannot unshelve while the instance is in this state. Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:25:07.033655 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 409 to user: Cannot 'unshelve' instance a26c01b1-585c-4366-95f1-2e2388a7fda2 while it is in vm_state active {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:07.040092 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3729d54-2975-440b-a40e-0061b7e3950e tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action" status: 409 len: 146 microversion: 2.1 time: 0.090244 Jul 02 21:25:07.043317 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2483/4937] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:06 2022] POST /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2/action => generated 146 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:25:07.045460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:07.046093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:07.062485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.062485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.062485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.062989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.326954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:07.328088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:07.335846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:07.341272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.341808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.354858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.356780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.358355 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5a0faa0-16ed-42d4-b17a-c7f2a19f8b99 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.317232 Jul 02 21:25:07.359267 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2455/4938] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:07 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:07.379921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:07.380932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:07.401868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.409666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.411219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.413037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.787332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:07.797575 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c1e4bd5-01e8-4fc8-8881-11b831f9d35e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.476682 Jul 02 21:25:07.798394 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2484/4939] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:07 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:07.881805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:07.889584 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-825e7bff-01d0-4737-a14b-8b7aabeec7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.513670 Jul 02 21:25:07.892678 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2456/4940] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:07 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:07.907875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bee6b4e8-b62e-43a7-a39d-62002a11b936 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166532756_updated"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:07.910373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bee6b4e8-b62e-43a7-a39d-62002a11b936 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:07.917510 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bee6b4e8-b62e-43a7-a39d-62002a11b936 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 could not be found. Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bee6b4e8-b62e-43a7-a39d-62002a11b936 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: request: PUT /compute/v2.1/servers/7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 HTTP/1.1 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 80 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-166532756_updated"}} Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 could not be found. Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-166532756_updated'}}} Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 could not be found. Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 02 21:25:07.920285 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 could not be found. Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 could not be found. Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bee6b4e8-b62e-43a7-a39d-62002a11b936 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bee6b4e8-b62e-43a7-a39d-62002a11b936 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "PUT /compute/v2.1/servers/7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0" status: 404 len: 111 microversion: 2.1 time: 0.018613 Jul 02 21:25:07.930972 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2485/4941] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:25:07 2022] PUT /compute/v2.1/servers/7dfcee37-3b7c-4b1f-97b6-1bf284fc54b0 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:07.934435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:07.934435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:07.964669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.965244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:07.966161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:07.966608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.214725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:08.222500 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d64d1549-3e8d-4417-9bfb-c3441fb6df93 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.294123 Jul 02 21:25:08.223951 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2457/4942] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:07 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:08.248334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:08.249823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:08.262469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.263958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.265194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.265816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.418242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:08.532103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:08.541424 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c21a8c68-49e2-4a93-8e0b-04a2cac24504 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.304470 Jul 02 21:25:08.542270 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2486/4943] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:08 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:08.558907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c8a98c-9152-458e-91ac-dd6dfe930b51 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c8a98c-9152-458e-91ac-dd6dfe930b51 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 HTTP/1.1 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 280 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:08.561423 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c8a98c-9152-458e-91ac-dd6dfe930b51 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11c8a98c-9152-458e-91ac-dd6dfe930b51 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "PUT /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 400 len: 619 microversion: 2.1 time: 0.008157 Jul 02 21:25:08.568412 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2458/4944] 10.222.0.43 () {60 vars in 1256 bytes} [Sat Jul 2 21:25:08 2022] PUT /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:25:08.574356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:08.575104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:08.582738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.583641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.584655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.585558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.610886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:08.823125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:08.824488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:08.836318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.836966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.837343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:08.838133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.840706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.852412 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7d8db6a-d2ee-401e-af7b-ffc4a4059d77 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.284270 Jul 02 21:25:08.853421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2487/4945] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:08 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:08.876934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:08.878230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:08.886627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.887491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:08.888721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:08.894918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:09.141609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:09.157332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-329708ba-36f5-4823-a8cc-0691ee8e4f54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.340479 Jul 02 21:25:09.158726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2459/4946] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:08 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:09.188404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:09.199868 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d25c48e4-ca5a-4733-9d56-745f6fc2353c tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.328590 Jul 02 21:25:09.202094 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2488/4947] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:08 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:09.223674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-573db725-9cd1-402a-b165-5fdaa48f504d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-573db725-9cd1-402a-b165-5fdaa48f504d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: request: PUT /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 HTTP/1.1 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 24 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: {"server": {"name": ""}} Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2', 'body': {'server': {'name': ''}}} Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi '' Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:25:09.229538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-573db725-9cd1-402a-b165-5fdaa48f504d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-573db725-9cd1-402a-b165-5fdaa48f504d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "PUT /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 400 len: 108 microversion: 2.1 time: 0.014859 Jul 02 21:25:09.238964 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2460/4948] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:25:09 2022] PUT /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:25:09.241622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:09.241775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:09.253137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:09.256263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:09.257278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:09.257613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:09.518767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:09.532663 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-806aace4-bf67-428d-8cf9-2adf97c60ddb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1506 microversion: 2.1 time: 0.296417 Jul 02 21:25:09.546121 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2489/4949] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:09 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1506 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:09.554337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-09806e0f-12c7-4e41-98c1-f36d14b31fa6 req-d7a51fc7-b341-4111-814b-2cddfd6010e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "name": "network-vif-plugged", "status": "completed", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:09.566084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-09806e0f-12c7-4e41-98c1-f36d14b31fa6 req-d7a51fc7-b341-4111-814b-2cddfd6010e0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:09.566838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-09806e0f-12c7-4e41-98c1-f36d14b31fa6 req-d7a51fc7-b341-4111-814b-2cddfd6010e0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:09.602155 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-09806e0f-12c7-4e41-98c1-f36d14b31fa6 req-d7a51fc7-b341-4111-814b-2cddfd6010e0 service nova] Creating event network-vif-plugged:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:25:09.612346 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-09806e0f-12c7-4e41-98c1-f36d14b31fa6 req-d7a51fc7-b341-4111-814b-2cddfd6010e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063020 Jul 02 21:25:09.615524 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2461/4950] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:10.054992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:10.055793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:10.063198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.063880 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.064928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.065572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.080187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e HTTP/1.1 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '872b5feb-08a2-4738-81eb-0593d065197e'} Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:25:10.081895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.087276 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.089184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:10.090178 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6c469ad-3448-41f3-8b39-749a68b397cb tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 404 len: 111 microversion: 2.1 time: 0.040863 Jul 02 21:25:10.090761 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2490/4951] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:25:10 2022] DELETE /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:10.101488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:10.102463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: 872b5feb-08a2-4738-81eb-0593d065197e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:10.110364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.110831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.111680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.112150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.126760 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e HTTP/1.1 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '872b5feb-08a2-4738-81eb-0593d065197e'} Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.128690 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance 872b5feb-08a2-4738-81eb-0593d065197e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-22080c62-d54f-4453-8a80-b1768019f7e9 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e" status: 404 len: 111 microversion: 2.1 time: 0.034476 Jul 02 21:25:10.134426 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2462/4952] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:10 2022] GET /compute/v2.1/servers/872b5feb-08a2-4738-81eb-0593d065197e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:10.140318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:10.142381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:10.151329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.151796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.153120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.153588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.180572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:10.181388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:10.189907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.190511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.191897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.192684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.198125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:25:10.199071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=100 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:10.216658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:10.360730 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87cd5abd-1105-4065-8340-ac9d5710693a tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 204 len: 0 microversion: 2.1 time: 0.225229 Jul 02 21:25:10.361778 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2491/4953] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:25:10 2022] DELETE /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:25:10.373213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:10.374501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:10.383136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.384025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.385118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:10.385768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:10.413423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:10.422384 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-38b17e80-064c-4523-85fb-f1a8a3b4fa00 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.251280 Jul 02 21:25:10.423862 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2463/4954] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:10 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:10.600961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:10.612267 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74ebd3ba-7487-4792-971e-e0cb2680f8f0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.246349 Jul 02 21:25:10.613087 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2492/4955] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:10 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:11.448025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:11.448025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:11.457515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:11.457970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:11.458786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:11.467360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:11.630548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:11.631185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:11.671180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:11.671632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:11.686252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:11.689819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:11.710787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:11.724139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-56d6f554-0ac6-480a-89b5-772610a1f22c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1316 microversion: 2.1 time: 0.287707 Jul 02 21:25:11.725175 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2464/4956] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:11 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:11.886741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:11.895234 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-905d3a44-7466-4961-b1c2-ab3ba6663bc8 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.268993 Jul 02 21:25:11.901542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2493/4957] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:11 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:12.741290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:12.741917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:12.764477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:12.765064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:12.765928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:12.766372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:12.914679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:12.916491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:12.937781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:12.940195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:12.941965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:12.943425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:12.962428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:12.971757 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f9f331e-76ca-4351-a69d-03127ec1c658 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1466 microversion: 2.1 time: 0.234664 Jul 02 21:25:12.972795 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2465/4958] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:12 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1466 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:12.995288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1157371554", "metadata": {"image_type": "test"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:12.996461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:13.016697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:13.017171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:13.018341 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:13.018792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:13.087350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Getting quotas for project af5057879953477fa6557bbd78b77763. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:25:13.107437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Getting quotas for user 8be0d1bce21149af900fccfc92b64f29 and project af5057879953477fa6557bbd78b77763. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:25:13.245207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:13.256997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-715c2c5a-e38f-40da-929b-d811370a17c5 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1512 microversion: 2.1 time: 0.346849 Jul 02 21:25:13.261074 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2494/4959] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:12 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1512 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:13.570824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9edaf2d7-eee0-42fb-b511-1be9d39f92f5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "POST /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f/action" status: 202 len: 0 microversion: 2.1 time: 0.581595 Jul 02 21:25:13.581936 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2466/4960] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:12 2022] POST /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:25:13.592573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9936959-7c24-48de-bce0-ef7e3d786869 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd785e790>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:13.684657 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9936959-7c24-48de-bce0-ef7e3d786869 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.095726 Jul 02 21:25:13.685245 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2495/4961] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:13 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:14.280384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:14.281130 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:14.296285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:14.296756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:14.297614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:14.298087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:14.539622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-706c5102-8dcd-4421-9ad0-c0c96f3c7777 req-1a6b92ea-1bda-4a50-a432-cd9aec8e40d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a26c01b1-585c-4366-95f1-2e2388a7fda2", "name": "network-vif-deleted", "tag": "e27718a1-3c8b-4441-982a-cf26ff8c5baf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:14.540383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:14.553268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-706c5102-8dcd-4421-9ad0-c0c96f3c7777 req-1a6b92ea-1bda-4a50-a432-cd9aec8e40d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:14.555085 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-644f4fe8-c33c-4cf0-8c37-d4b66b43cf8d tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1470 microversion: 2.1 time: 0.280876 Jul 02 21:25:14.556692 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2467/4962] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:14 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1470 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:14.561616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-706c5102-8dcd-4421-9ad0-c0c96f3c7777 req-1a6b92ea-1bda-4a50-a432-cd9aec8e40d0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:14.583691 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-706c5102-8dcd-4421-9ad0-c0c96f3c7777 req-1a6b92ea-1bda-4a50-a432-cd9aec8e40d0 service nova] Creating event network-vif-deleted:e27718a1-3c8b-4441-982a-cf26ff8c5baf for instance a26c01b1-585c-4366-95f1-2e2388a7fda2 on nch1-master-1 Jul 02 21:25:14.592937 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-706c5102-8dcd-4421-9ad0-c0c96f3c7777 req-1a6b92ea-1bda-4a50-a432-cd9aec8e40d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056456 Jul 02 21:25:14.594225 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2496/4963] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:25:14.699538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5140b4b2-8636-45ff-9f75-e6a4293f0c42 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71c4310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:14.797437 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5140b4b2-8636-45ff-9f75-e6a4293f0c42 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.101784 Jul 02 21:25:14.798283 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2468/4964] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:14 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:15.575615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:15.577250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:15.592851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:15.595755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:15.596846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:15.597451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:15.664067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:15.664662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:15.665557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lazy-loading 'fault' on Instance uuid a26c01b1-585c-4366-95f1-2e2388a7fda2 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:25:15.784852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fb8295b4af942d2be5d0cdb0a822868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e7f008cdf342038f77463635293405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:15.800649 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0d550592-ad04-4212-ad41-f1351f10c4b2 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 200 len: 1307 microversion: 2.1 time: 0.225394 Jul 02 21:25:15.813869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46295f28-c9b0-4114-8d51-5ff1b0a64244 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77a6670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:15.815328 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2497/4965] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:15 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 1307 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:15.912736 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-46295f28-c9b0-4114-8d51-5ff1b0a64244 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.105501 Jul 02 21:25:15.913538 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2469/4966] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:15 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:16.825192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:16.825939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] [instance: a26c01b1-585c-4366-95f1-2e2388a7fda2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:16.839307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:16.840732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:16.841804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:16.842551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:16.871067 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] HTTP exception thrown: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 could not be found. Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Request method failure captured: Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 HTTP/1.1 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcDJhZcmiCGBKcZnTDLiLLaPNAD-Jx2Q7lM4gNmy1mbVObsco097WUf_ol7UjwQM7NQ7I1UM-aTn2BlBkm82J4XfkAPAHxe1WIKODfP5_Jso-SRKliLGlpi4QgW2xzCQeYZph9eszerGIFZUad1oaMv4j0mZhQB2ze6C1QCNSVf4iw Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "tempest-ServicesTestJSON-Type-975445932", "name": "tempest-ServicesTestJSON-Service-778550394", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_76e7f008cdf342038f77463635293405", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/76e7f008cdf342038f77463635293405"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/76e7f008cdf342038f77463635293405"}]}] Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 76e7f008cdf342038f77463635293405 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-113123989 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8fb8295b4af942d2be5d0cdb0a822868 Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-113123989-project Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 could not be found. Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a26c01b1-585c-4366-95f1-2e2388a7fda2'} Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 could not be found. Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 could not be found. Jul 02 21:25:16.872986 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 could not be found. Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] Returning 404 to user: Instance a26c01b1-585c-4366-95f1-2e2388a7fda2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9deb355d-8402-4f93-8a77-abed475f01d0 tempest-ServersNegativeTestJSON-113123989 tempest-ServersNegativeTestJSON-113123989-project] 10.222.0.43 "GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2" status: 404 len: 111 microversion: 2.1 time: 0.056150 Jul 02 21:25:16.878301 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2498/4967] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:16 2022] GET /compute/v2.1/servers/a26c01b1-585c-4366-95f1-2e2388a7fda2 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:25:16.931144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20083e01-0bf5-4dd9-95ad-e31684b746b5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71d3700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:16.999790 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20083e01-0bf5-4dd9-95ad-e31684b746b5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.076067 Jul 02 21:25:17.009629 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2470/4968] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:16 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:17.383814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-651782201", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:17.488828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] validate_networks() for [('4a78432e-957a-4481-a59d-20aaa33c4261', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:25:18.017508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad6925c2-a875-4f7e-9288-ed0b3c4e846a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd76ea5e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:18.075127 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad6925c2-a875-4f7e-9288-ed0b3c4e846a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.061354 Jul 02 21:25:18.085767 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2471/4969] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:18 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:18.520758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:25:18.521446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:25:18.522331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:25:18.522579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:25:18.523122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:25:18.547770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:18.550747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:18.552490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:18.553812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:18.577782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Getting quotas for project 481f91eba9c14f728a473c0b03f1709f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:25:18.585109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Getting quotas for user e594a743b6424809abe3d22f930afd8b and project 481f91eba9c14f728a473c0b03f1709f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:25:18.588249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:18.602944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:25:18.605718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:25:18.686178 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f577fdbe-bd4e-4f3a-a853-d2a9754eddf2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.566050 Jul 02 21:25:18.690968 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2499/4970] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:25:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:25:18.708435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d252309-6d7f-427d-9e6b-95c8c7d653bd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:18.709148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7d252309-6d7f-427d-9e6b-95c8c7d653bd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:18.803828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7d252309-6d7f-427d-9e6b-95c8c7d653bd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:18.824105 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d252309-6d7f-427d-9e6b-95c8c7d653bd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1221 microversion: 2.1 time: 0.126651 Jul 02 21:25:18.824889 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2472/4971] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:18 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:19.086532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-357891957", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:19.098326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32efbdac-7834-4ab6-800b-8f5c9df87668 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd7686430>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:19.187905 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32efbdac-7834-4ab6-800b-8f5c9df87668 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.094180 Jul 02 21:25:19.194643 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2473/4972] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:19 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:19.228545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] validate_networks() for [('4a78432e-957a-4481-a59d-20aaa33c4261', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:25:20.215795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-351c8b29-fa1b-42af-adc3-2581b144c44d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea130f70>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:20.308578 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-351c8b29-fa1b-42af-adc3-2581b144c44d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.110542 Jul 02 21:25:20.312378 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2474/4973] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:20 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:20.682855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:25:20.686543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:25:20.688731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:25:20.689410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:25:20.690674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:25:20.715523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:20.718879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:20.724229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:20.725230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:20.824211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Getting quotas for project 481f91eba9c14f728a473c0b03f1709f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:25:20.855558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Getting quotas for user e594a743b6424809abe3d22f930afd8b and project 481f91eba9c14f728a473c0b03f1709f. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:25:20.901573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:25:20.904183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:25:21.042568 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44eafa37-3473-45d4-8a91-0434d552d021 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.963075 Jul 02 21:25:21.049183 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2500/4974] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:25:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:25:21.059811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9f7658d-6d1e-4595-90a0-eb232618f324 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:21.061475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a9f7658d-6d1e-4595-90a0-eb232618f324 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:21.306482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a9f7658d-6d1e-4595-90a0-eb232618f324 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:21.325432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-410bbb5b-e438-4a34-9a95-24b2f06d6dd9 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd76fbaf0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:21.329869 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9f7658d-6d1e-4595-90a0-eb232618f324 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1221 microversion: 2.1 time: 0.274287 Jul 02 21:25:21.333597 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2475/4975] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:21 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1221 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:21.420687 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-410bbb5b-e438-4a34-9a95-24b2f06d6dd9 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.099273 Jul 02 21:25:21.422580 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2501/4976] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:21 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:22.358572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:22.365660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:22.408071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:22.409959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:22.410844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:22.411299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:22.435852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd5ac9dd-3b4c-493c-94a0-0c14c5fe1a91 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd799d430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:22.532397 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd5ac9dd-3b4c-493c-94a0-0c14c5fe1a91 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.101419 Jul 02 21:25:22.533004 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2502/4977] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:22 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:23.003404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:23.015200 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4dbe6924-53a5-43ca-85a6-c9e0c0fa6eb2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1217 microversion: 2.1 time: 0.665939 Jul 02 21:25:23.022622 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2476/4978] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:22 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1217 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:23.240796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b897140e-6601-44a8-a049-099fae023af7 req-99c31a3c-eeb9-4c5a-a93e-a114570229fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "name": "network-vif-plugged", "status": "completed", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:23.273044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b897140e-6601-44a8-a049-099fae023af7 req-99c31a3c-eeb9-4c5a-a93e-a114570229fa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:23.273611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b897140e-6601-44a8-a049-099fae023af7 req-99c31a3c-eeb9-4c5a-a93e-a114570229fa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:23.315303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b897140e-6601-44a8-a049-099fae023af7 req-99c31a3c-eeb9-4c5a-a93e-a114570229fa service nova] Creating event network-vif-plugged:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:25:23.331111 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b897140e-6601-44a8-a049-099fae023af7 req-99c31a3c-eeb9-4c5a-a93e-a114570229fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092964 Jul 02 21:25:23.331771 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2503/4979] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:23.545929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3aebf1b3-8ce3-414e-baca-d3d74dc214fc tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9f70>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:23.646431 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3aebf1b3-8ce3-414e-baca-d3d74dc214fc tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.104318 Jul 02 21:25:23.647373 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2477/4980] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:23 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:24.040375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:24.041270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:24.048684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:24.049256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:24.050084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:24.051009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:24.541762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:24.557760 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dea93c28-9b0c-4c8a-b774-d477832c117e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1279 microversion: 2.1 time: 0.522515 Jul 02 21:25:24.561223 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2504/4981] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:24 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1279 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:24.674795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b8f44e2a-19d8-4980-9bcd-dd01a6ddf3ea tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77b84c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:24.775218 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b8f44e2a-19d8-4980-9bcd-dd01a6ddf3ea tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.117288 Jul 02 21:25:24.776528 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2478/4982] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:24 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:25.516722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-bb971252-f458-4da5-9444-19d62572ad60 req-bd57484c-7090-45ad-bba9-d5edbb24a7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f7c66a-56e5-4d36-bde6-03325e5fb665", "tag": "eb832cf9-f536-48b0-b1d3-2635b4481149"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:25.559543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bb971252-f458-4da5-9444-19d62572ad60 req-bd57484c-7090-45ad-bba9-d5edbb24a7d3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:25.560395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-bb971252-f458-4da5-9444-19d62572ad60 req-bd57484c-7090-45ad-bba9-d5edbb24a7d3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:25.578682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:25.579380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:25.588779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:25.593855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:25.596215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:25.600814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:25.602207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:25.651874 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-bb971252-f458-4da5-9444-19d62572ad60 req-bd57484c-7090-45ad-bba9-d5edbb24a7d3 service nova] Creating event network-changed:eb832cf9-f536-48b0-b1d3-2635b4481149 for instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 on nch2-master-1 Jul 02 21:25:25.682161 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-bb971252-f458-4da5-9444-19d62572ad60 req-bd57484c-7090-45ad-bba9-d5edbb24a7d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169103 Jul 02 21:25:25.691579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2505/4983] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:25.792872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3ca6197-5402-4262-8d05-ad8edc333c69 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd76d5820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:25.887728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:25.901199 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-30ce275d-a1e1-4123-9143-9cd073af4b42 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1279 microversion: 2.1 time: 0.327303 Jul 02 21:25:25.902443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2479/4984] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:25 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1279 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:25.913927 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3ca6197-5402-4262-8d05-ad8edc333c69 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.128655 Jul 02 21:25:25.914880 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2506/4985] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:25 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:26.919901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:26.920689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:26.930646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1ac19a6-4a0e-40c2-8085-ebc42799ab68 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea0b1700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:26.933939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:26.934440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:26.935510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:26.936234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:27.027731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1ac19a6-4a0e-40c2-8085-ebc42799ab68 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.104085 Jul 02 21:25:27.032196 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2507/4986] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:26 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:27.298278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:27.328462 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4cf90bb7-2bac-4c38-9845-01c76a9176c6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.411905 Jul 02 21:25:27.333195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2480/4987] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:26 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:28.046396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f01983e6-2a73-43b2-95e7-5b557997b84e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd79c7820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:28.169339 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f01983e6-2a73-43b2-95e7-5b557997b84e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.128073 Jul 02 21:25:28.169956 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2508/4988] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:28 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:28.347819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:28.348313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:28.359852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:28.360907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:28.369139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:28.369650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:28.791214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:28.818084 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4d18cb2-02a5-484a-8aa4-9ef03d4fcc58 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.468455 Jul 02 21:25:28.818749 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2481/4989] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:28 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:29.185311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-852a006e-04ca-44d7-bd7c-261446df1840 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea1dcc10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:29.326073 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-852a006e-04ca-44d7-bd7c-261446df1840 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.146440 Jul 02 21:25:29.331812 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2509/4990] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:29 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:29.416019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4c230ad2-abb2-48cf-9672-ecfb269c2933 req-509afae3-f1d6-4079-b43b-65828d1227f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280e9a70-044a-4ae2-8609-3504c505420e", "tag": "03834a04-c98b-46d2-b6a5-03402e2929f9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:29.442106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4c230ad2-abb2-48cf-9672-ecfb269c2933 req-509afae3-f1d6-4079-b43b-65828d1227f3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:29.442556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4c230ad2-abb2-48cf-9672-ecfb269c2933 req-509afae3-f1d6-4079-b43b-65828d1227f3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:29.481093 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4c230ad2-abb2-48cf-9672-ecfb269c2933 req-509afae3-f1d6-4079-b43b-65828d1227f3 service nova] Creating event network-changed:03834a04-c98b-46d2-b6a5-03402e2929f9 for instance 280e9a70-044a-4ae2-8609-3504c505420e on nch2-master-1 Jul 02 21:25:29.498249 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4c230ad2-abb2-48cf-9672-ecfb269c2933 req-509afae3-f1d6-4079-b43b-65828d1227f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084604 Jul 02 21:25:29.501041 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2482/4991] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:29.836973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:29.837789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:29.857646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:29.860656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:29.867968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:29.868777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:30.339594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e74a160-7d8a-49c0-8f73-e8febd013bd3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9af0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:30.414069 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e74a160-7d8a-49c0-8f73-e8febd013bd3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.078634 Jul 02 21:25:30.420332 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2483/4992] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:30 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:30.746806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:30.833314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:30.842766 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bee6c762-c728-47e1-8818-dc668130e098 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 1.011189 Jul 02 21:25:30.850276 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2510/4993] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:29 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:31.429623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6cb653cc-52f6-452f-967d-c7c56431c442 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea12f040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:31.445141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:31.523510 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6cb653cc-52f6-452f-967d-c7c56431c442 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.100230 Jul 02 21:25:31.526297 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2484/4994] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:31 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:31.862825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:31.863984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:31.867228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:31.878457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:31.882131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:31.884861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:31.885568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:31.983234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-71d3ef3b-e1f2-4049-bbbb-d743cfccc3ff req-78201c5d-bf50-43ca-adb3-f9f652147ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f7c66a-56e5-4d36-bde6-03325e5fb665", "name": "network-vif-plugged", "status": "completed", "tag": "eb832cf9-f536-48b0-b1d3-2635b4481149"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:32.000227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-71d3ef3b-e1f2-4049-bbbb-d743cfccc3ff req-78201c5d-bf50-43ca-adb3-f9f652147ecb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:32.002319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-71d3ef3b-e1f2-4049-bbbb-d743cfccc3ff req-78201c5d-bf50-43ca-adb3-f9f652147ecb service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:32.044841 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-71d3ef3b-e1f2-4049-bbbb-d743cfccc3ff req-78201c5d-bf50-43ca-adb3-f9f652147ecb service nova] Creating event network-vif-plugged:eb832cf9-f536-48b0-b1d3-2635b4481149 for instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 on nch2-master-1 Jul 02 21:25:32.070522 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-71d3ef3b-e1f2-4049-bbbb-d743cfccc3ff req-78201c5d-bf50-43ca-adb3-f9f652147ecb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089097 Jul 02 21:25:32.072566 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2485/4995] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:25:32.306606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:32.315279 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17ac95c1-4f77-46ea-9f43-c999c048287f tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.460388 Jul 02 21:25:32.328205 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2511/4996] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:31 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:32.537651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8ee60cdf-cad8-445a-85f6-9261d0a5e6e6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:32.604973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8ee60cdf-cad8-445a-85f6-9261d0a5e6e6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.071098 Jul 02 21:25:32.611919 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2486/4997] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:32 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:33.344578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:33.345837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:33.360948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:33.366959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:33.369866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:33.370328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:33.576104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:33.592309 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c4a0078-d8ad-4267-804b-dde8385e5dc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.256546 Jul 02 21:25:33.598435 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2512/4998] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:33 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:33.619261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6d6f556-a282-4998-9a37-62223666a83d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77b8670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:33.703311 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6d6f556-a282-4998-9a37-62223666a83d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.088859 Jul 02 21:25:33.714469 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2487/4999] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:33 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:34.616853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:34.624851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:34.645932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:34.647536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:34.648564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:34.649716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:34.739684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ea2cf00-8062-41a4-ab59-d8885b57e46c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd780e8b0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:34.812559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ea2cf00-8062-41a4-ab59-d8885b57e46c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.080873 Jul 02 21:25:34.819272 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2488/5000] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:34 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:34.908021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:34.929845 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b129d32f-4b0d-4973-8f4a-fc4b1b801203 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.307518 Jul 02 21:25:34.933003 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2513/5001] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:34 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:35.832897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f69d41b-4887-49ee-b765-b07e2953d409 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd78a1940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:35.919565 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f69d41b-4887-49ee-b765-b07e2953d409 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.095131 Jul 02 21:25:35.920434 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2489/5002] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:35 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:35.957826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:35.961110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:35.975074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6fbc2316-189e-4d06-83f0-0d478581bb92 req-debc3e39-58c3-4278-936a-855eb470f494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280e9a70-044a-4ae2-8609-3504c505420e", "name": "network-vif-plugged", "status": "completed", "tag": "03834a04-c98b-46d2-b6a5-03402e2929f9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:35.994781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:35.995549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:35.996931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:35.997807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:36.023979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6fbc2316-189e-4d06-83f0-0d478581bb92 req-debc3e39-58c3-4278-936a-855eb470f494 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:36.024459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6fbc2316-189e-4d06-83f0-0d478581bb92 req-debc3e39-58c3-4278-936a-855eb470f494 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:36.076534 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6fbc2316-189e-4d06-83f0-0d478581bb92 req-debc3e39-58c3-4278-936a-855eb470f494 service nova] Creating event network-vif-plugged:03834a04-c98b-46d2-b6a5-03402e2929f9 for instance 280e9a70-044a-4ae2-8609-3504c505420e on nch2-master-1 Jul 02 21:25:36.082249 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6fbc2316-189e-4d06-83f0-0d478581bb92 req-debc3e39-58c3-4278-936a-855eb470f494 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111328 Jul 02 21:25:36.083506 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2490/5003] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:25:36.314571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:36.344180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4fe7579f-4d71-4c26-819f-37f86661706a tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.398540 Jul 02 21:25:36.349642 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2514/5004] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:35 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:36.940225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f733239c-85f5-4011-ac2a-7c3bc3b322e9 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabe4ad60d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:37.045660 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f733239c-85f5-4011-ac2a-7c3bc3b322e9 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.111575 Jul 02 21:25:37.047705 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2491/5005] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:36 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:37.366893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:37.367596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:37.375616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:37.376343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:37.377653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:37.378966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:37.722832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:37.742659 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69f8bb19-53ba-4cf6-90b4-025159bb4fd0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1321 microversion: 2.1 time: 0.378017 Jul 02 21:25:37.743889 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2515/5006] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:37 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:38.061436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-15755bf5-3167-42d9-aa78-c480af3d7282 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd7242d30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:38.161496 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-15755bf5-3167-42d9-aa78-c480af3d7282 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.106927 Jul 02 21:25:38.162724 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2492/5007] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:38 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:38.761370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:38.762044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:38.778192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:38.779083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:38.779947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:38.781416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:39.146029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:39.161847 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70d3f4f3-9bf6-47f9-802f-8932d6793df3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1515 microversion: 2.1 time: 0.404431 Jul 02 21:25:39.164059 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2516/5008] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:38 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:39.182114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a172c67-4fa5-4af3-a3ef-c939a0204c2c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:39.198776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:39.199741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:39.213911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:39.214565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:39.215373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:39.215821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:39.241800 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a172c67-4fa5-4af3-a3ef-c939a0204c2c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.065628 Jul 02 21:25:39.242787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2493/5009] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:39 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:39.269812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lazy-loading 'flavor' on Instance uuid 280e9a70-044a-4ae2-8609-3504c505420e {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:25:39.279588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:39.460686 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e1a4ef01-61bb-448b-b4f3-b035276857c2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action" status: 200 len: 32 microversion: 2.1 time: 0.275094 Jul 02 21:25:39.466009 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2517/5010] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:39 2022] POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 02 21:25:39.472385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:39.473930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:39.488970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:39.489837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:39.491953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:39.493557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:39.914358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:39.929834 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fa70a776-fb4a-4cae-8ca4-c2c7ba0415b6 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.459676 Jul 02 21:25:39.931562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2494/5011] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:39 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:40.260451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cbd10b03-c601-4951-9d90-c10183faf52c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd785ee50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:40.325155 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cbd10b03-c601-4951-9d90-c10183faf52c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1424 microversion: 2.1 time: 0.073725 Jul 02 21:25:40.326153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2518/5012] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:40 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:40.948804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:40.950097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:40.958671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:40.959641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:40.960824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:40.961555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:40.967155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:41.144131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:41.154720 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e495ebf-108e-4c64-abcc-369c0c22d59b tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.210108 Jul 02 21:25:41.155799 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2495/5013] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:40 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:41.340279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6da144fd-a4e7-43f1-9e11-ba030fdde5d3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd79aff70>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:41.389475 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6da144fd-a4e7-43f1-9e11-ba030fdde5d3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1433 microversion: 2.1 time: 0.054609 Jul 02 21:25:41.390360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2519/5014] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:41 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1433 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:41.402872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80e2b4df-8f80-4fdd-aa74-c25d39224acb tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:41.454338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80e2b4df-8f80-4fdd-aa74-c25d39224acb tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 200 len: 1433 microversion: 2.1 time: 0.055473 Jul 02 21:25:41.455497 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2496/5015] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:41 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 1433 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:41.469010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:41.469824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:41.478328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:41.478951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:41.480535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:41.481078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:41.631328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:41.640003 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3dfa7e8-a314-4c79-a54b-565f606c4449 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1466 microversion: 2.1 time: 0.176429 Jul 02 21:25:41.640674 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2520/5016] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:41 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1466 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:41.657258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93033518-df72-4e88-9862-affa7fa6ee13 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77a69d0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:41.702889 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93033518-df72-4e88-9862-affa7fa6ee13 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/e482b755-1c1a-4758-a7c0-b3edf1610541" status: 200 len: 784 microversion: 2.1 time: 0.050582 Jul 02 21:25:41.703466 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2497/5017] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:41 2022] GET /compute/v2.1/images/e482b755-1c1a-4758-a7c0-b3edf1610541 => generated 784 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:41.715426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44682d3c-78e5-4a9b-bab8-8cb616d58c2a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:41.727392 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44682d3c-78e5-4a9b-bab8-8cb616d58c2a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015915 Jul 02 21:25:41.728011 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2521/5018] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:25:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:25:41.740360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e842a9ef-83ca-4c36-9b7c-eb00e70eb6e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:42.172156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:42.172789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:42.185465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:42.186199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:42.187290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:42.188082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:42.372839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:42.388282 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-164c070d-f46f-4c84-a5ef-2d0aed661438 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.220344 Jul 02 21:25:42.389742 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2522/5019] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:42 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:42.628278 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e842a9ef-83ca-4c36-9b7c-eb00e70eb6e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "DELETE /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 204 len: 0 microversion: 2.1 time: 0.893458 Jul 02 21:25:42.628880 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2498/5020] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:41 2022] DELETE /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:25:42.637231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5465039d-6c74-444f-9a45-a60c3a4c41f4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd771e4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:42.659340 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5465039d-6c74-444f-9a45-a60c3a4c41f4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] HTTP exception thrown: Image not found. Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5465039d-6c74-444f-9a45-a60c3a4c41f4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Request method failure captured: Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 HTTP/1.1 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLep5mlnOT8aL_44nlQvLWwdbo2C_bh7HQ_E8eCiJBkyblnosxidedaPJb-d1dhD1xLqEGjEJN1EHZiGeGRWfaiEah_E3JzoXb7_D0QWs22udIo-QKYtbo_aIbq446ztROA6keeINi-D1GJLNw2-cZ4OxXaJYAKaQkwk91DNR5UJxlQ Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: af5057879953477fa6557bbd78b77763 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af5057879953477fa6557bbd78b77763"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_af5057879953477fa6557bbd78b77763", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af5057879953477fa6557bbd78b77763"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/af5057879953477fa6557bbd78b77763"}]}] Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: af5057879953477fa6557bbd78b77763 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerTestJSON-1957829880-project Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8be0d1bce21149af900fccfc92b64f29 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerTestJSON-1957829880-project Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a6051d59-a556-40c0-9ffa-a421d6ab7224'} Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a6051d59-a556-40c0-9ffa-a421d6ab7224 Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 02 21:25:42.662318 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6051d59-a556-40c0-9ffa-a421d6ab7224 could not be found. Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:25:42.667685 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:25:42.672469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5465039d-6c74-444f-9a45-a60c3a4c41f4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:25:42.673631 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5465039d-6c74-444f-9a45-a60c3a4c41f4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 404 len: 62 microversion: 2.1 time: 0.040653 Jul 02 21:25:42.674735 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2523/5021] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:42 2022] GET /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:25:42.686329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1365097817"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:42.687827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:42.695356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:42.695828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:42.696850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:42.697309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:43.005760 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e48598af-17d4-4ed6-ba8d-82924476d39a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "POST /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f/action" status: 202 len: 0 microversion: 2.1 time: 0.323407 Jul 02 21:25:43.006953 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2499/5022] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:25:42 2022] POST /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 21:25:43.016843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79661cbe-e799-4659-8d58-017ca8fc1d54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd785e310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:43.090639 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79661cbe-e799-4659-8d58-017ca8fc1d54 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.078267 Jul 02 21:25:43.095248 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2524/5023] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:43 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:43.420358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:43.422867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:43.440952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:43.441419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:43.445931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:43.447222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:43.647237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:43.657528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-43c0de98-1981-48ba-aa34-7c3d5cca14f0 req-d145ecbd-269c-4c95-bca7-3fcf735d078b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "name": "network-vif-unplugged", "status": "completed", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:43.670501 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9031792d-bd40-4af3-842f-fe8e86aea1ee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.265212 Jul 02 21:25:43.672100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c0de98-1981-48ba-aa34-7c3d5cca14f0 req-d145ecbd-269c-4c95-bca7-3fcf735d078b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:43.672556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c0de98-1981-48ba-aa34-7c3d5cca14f0 req-d145ecbd-269c-4c95-bca7-3fcf735d078b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:43.684388 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2500/5024] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:43 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:43.694857 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-43c0de98-1981-48ba-aa34-7c3d5cca14f0 req-d145ecbd-269c-4c95-bca7-3fcf735d078b service nova] Creating event network-vif-unplugged:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:25:43.710113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-43c0de98-1981-48ba-aa34-7c3d5cca14f0 req-d145ecbd-269c-4c95-bca7-3fcf735d078b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057939 Jul 02 21:25:43.712372 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2525/5025] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:25:44.106741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-716f0b18-63d1-48b1-888c-7a6e3321bc7f tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71c41f0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:44.159324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-716f0b18-63d1-48b1-888c-7a6e3321bc7f tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.057563 Jul 02 21:25:44.159914 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2501/5026] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:44 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:44.691001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:44.692337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:44.700017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:44.700589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:44.701575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:44.701947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:44.868658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:44.877495 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4dc1b17-9118-409a-927d-bd54b4ee6646 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.191930 Jul 02 21:25:44.878441 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2526/5027] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:44 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:45.174389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0a34f15-c0f9-41e6-90d1-be3cefd37194 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd771fa60>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:45.223141 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0a34f15-c0f9-41e6-90d1-be3cefd37194 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.053875 Jul 02 21:25:45.223740 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2502/5028] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:45 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:45.894542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:45.895173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:45.903714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:45.904434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:45.905251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:45.906005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:46.049704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:46.059090 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e96de453-db61-4abc-98f0-9d8164acd303 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.168599 Jul 02 21:25:46.060153 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2527/5029] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:45 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:46.237810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5e54b24-32ad-47ed-bec2-59df23042dc7 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd7686ee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:46.286365 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5e54b24-32ad-47ed-bec2-59df23042dc7 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.053477 Jul 02 21:25:46.292417 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2503/5030] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:46 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:47.079991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:47.079991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:47.085857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:47.086617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:47.088208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:47.088904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:47.255865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:47.264513 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b727f3c-5149-45a8-afb4-2c46081e2b74 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.191624 Jul 02 21:25:47.265799 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2528/5031] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:47 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:47.299322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-67074f11-4cb4-470b-bf3e-58bf6e79fae1 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd771fd30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:47.356494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-67074f11-4cb4-470b-bf3e-58bf6e79fae1 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.061415 Jul 02 21:25:47.357071 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2504/5032] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:47 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:48.283140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:48.284700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:48.294258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:48.295072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:48.296074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:48.296710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:48.372090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-755fed4c-cb5c-4712-b206-00d4f7649362 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd7686310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:48.422349 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-755fed4c-cb5c-4712-b206-00d4f7649362 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.054296 Jul 02 21:25:48.423248 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2505/5033] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:48 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:48.456341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:48.464558 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf37721a-5c76-4079-8a06-e1eb71ffbb86 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.186996 Jul 02 21:25:48.474043 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2529/5034] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:48 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:49.438095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-616198d4-b61f-4fa7-bf33-cf0edbbd96f8 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea130dc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:49.481666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:49.482297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:49.485280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:49.489289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-616198d4-b61f-4fa7-bf33-cf0edbbd96f8 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.055609 Jul 02 21:25:49.490039 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2506/5035] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:49 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:49.491736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:49.492426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:49.493223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:49.493654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:49.631234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:49.640492 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18172934-5e5b-4213-83cf-6c5827d28640 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.163238 Jul 02 21:25:49.641237 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2530/5036] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:49 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:50.504569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5f89c21-586b-4501-aa63-1bcc4acfb0ec tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea187ee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:50.559573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5f89c21-586b-4501-aa63-1bcc4acfb0ec tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.060090 Jul 02 21:25:50.566849 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2507/5037] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:50 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:50.588757 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:25:50.589010 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:25:50.658094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:50.660002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:50.672006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:50.673324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:50.674976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:50.675664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:50.747148 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:25:50.747524 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e (ip 10.222.0.43) !!! Jul 02 21:25:50.902784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:50.912898 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9e5302b-7c17-4c2f-92d9-52879f45cc55 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.259131 Jul 02 21:25:50.916610 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2531/5038] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:50 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:51.574976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4da7bd36-dd01-494e-86cd-fea71ee1c0cd tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77b8310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:51.635682 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4da7bd36-dd01-494e-86cd-fea71ee1c0cd tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.065403 Jul 02 21:25:51.642379 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2508/5039] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:51 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:51.766670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1d4b32d4-3592-4f2d-91af-f90db2e7d131 req-fc52af23-6adb-4a36-af28-8fa2f26296c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "name": "network-vif-plugged", "status": "completed", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:25:51.777582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1d4b32d4-3592-4f2d-91af-f90db2e7d131 req-fc52af23-6adb-4a36-af28-8fa2f26296c8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:51.778147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1d4b32d4-3592-4f2d-91af-f90db2e7d131 req-fc52af23-6adb-4a36-af28-8fa2f26296c8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:51.802378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1d4b32d4-3592-4f2d-91af-f90db2e7d131 req-fc52af23-6adb-4a36-af28-8fa2f26296c8 service nova] Creating event network-vif-plugged:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:25:51.816577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1d4b32d4-3592-4f2d-91af-f90db2e7d131 req-fc52af23-6adb-4a36-af28-8fa2f26296c8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054647 Jul 02 21:25:51.819644 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2532/5040] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:25:51.933032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:51.933650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:51.940794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:51.941396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:51.942461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:51.943074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:52.087620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:52.102571 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f2a870bc-2719-45bf-9511-d3c77e2dceff tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.173611 Jul 02 21:25:52.103158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2509/5041] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:51 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:52.654551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b40f421f-2745-4075-89cd-1c9db901997a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd777c4c0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:52.748991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b40f421f-2745-4075-89cd-1c9db901997a tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.103468 Jul 02 21:25:52.749971 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2533/5042] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:52 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:53.122962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:53.123669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:53.136207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:53.136670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:53.137471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:53.137955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:53.395282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:53.409186 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-43cdeab8-d477-4a2c-b50e-7c1fe8cb9d01 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.290812 Jul 02 21:25:53.410814 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2510/5043] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:53 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:53.781767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e01b153-0473-4639-8c1a-beea2b21f8c2 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea0c13a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:53.861986 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e01b153-0473-4639-8c1a-beea2b21f8c2 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.091224 Jul 02 21:25:53.867523 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2534/5044] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:53 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:54.430552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:54.431190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:54.457368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:54.459192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:54.462610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:54.464817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:54.795264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:54.806443 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1e7c7beb-a1d3-45da-9412-aebabeeb6bee tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.381053 Jul 02 21:25:54.807352 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2511/5045] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:54 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:54.879020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77fe5c3f-c0f2-430b-8b91-72c47aa6e77e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd78d8280>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:55.007560 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77fe5c3f-c0f2-430b-8b91-72c47aa6e77e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.136572 Jul 02 21:25:55.016163 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2535/5046] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:54 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:55.826487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:55.830431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:55.846664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=26 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:25:55.850654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:55.851677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:55.853010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:55.853843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:56.021650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9a70a6b-e8b3-4c66-bc56-f772f5295ab2 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd79c7160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:56.094396 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9a70a6b-e8b3-4c66-bc56-f772f5295ab2 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.076891 Jul 02 21:25:56.095051 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2536/5047] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:56 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:25:56.307260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:56.321447 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ca07271-0897-459b-bb29-327fc71d2e75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.500601 Jul 02 21:25:56.325410 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2512/5048] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:55 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:57.107801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b05a67f6-507b-49a2-bee1-125ad18378a1 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea0b15e0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:57.209991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b05a67f6-507b-49a2-bee1-125ad18378a1 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.106967 Jul 02 21:25:57.210726 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2537/5049] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:57 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:57.340906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:57.342258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:57.358467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:57.359229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:57.363210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:57.365331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:58.205269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:58.214283 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-686e935b-3afd-4189-8e65-11b6bcb5ed98 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.879112 Jul 02 21:25:58.214870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2513/5050] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:57 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:58.223766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-75be203a-754a-4577-a76f-ab851bd43534 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabe4075d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:59.030211 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-75be203a-754a-4577-a76f-ab851bd43534 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.811251 Jul 02 21:25:59.030814 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2538/5051] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:25:58 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:25:59.233362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:25:59.234597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:25:59.246935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:59.247403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:59.248251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:25:59.248706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:25:59.654083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:25:59.671320 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f716f721-bdd8-4631-a998-1f317ceb2d2d tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.443768 Jul 02 21:25:59.685564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2514/5052] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:25:59 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:00.044947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4f577ca6-ae17-47a5-b2c6-59adf6139297 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea0c11f0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:00.146949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4f577ca6-ae17-47a5-b2c6-59adf6139297 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.107476 Jul 02 21:26:00.149629 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2539/5053] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:00 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:00.705134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:00.705833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:00.732711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:00.733080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:00.734283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:00.734877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:00.978719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:00.989800 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8434701-bd4f-43fd-a778-dc531c82933c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.289386 Jul 02 21:26:00.991057 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2515/5054] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:00 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:01.164153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be54cf85-87cd-4095-841d-1ac67812d0fd tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabe4075160>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:01.774395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:01.785479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:02.008545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:02.010082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:02.038016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:02.038740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:02.044851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:02.048587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:02.730916 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be54cf85-87cd-4095-841d-1ac67812d0fd tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 1.573391 Jul 02 21:26:02.737692 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2540/5055] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:01 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:03.050068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:03.069804 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14079a9d-2ddc-44e4-9884-688fd76f5257 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 1.065516 Jul 02 21:26:03.070403 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2516/5056] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:02 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:26:03.745288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-baf9ac1b-ed20-4d6d-bd99-3def576db179 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd78b7700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:03.959403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-baf9ac1b-ed20-4d6d-bd99-3def576db179 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.218298 Jul 02 21:26:03.965587 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2541/5057] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:03 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:04.089212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:04.090269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:04.109777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:04.110308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:04.111174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:04.119682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:04.703353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:04.712687 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-267446b6-cdc1-479a-81f7-9339e083ecb0 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.628413 Jul 02 21:26:04.713880 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2517/5058] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:04 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:04.974273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bc4c190-f516-4f4e-b9bc-331804ee68d8 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabe409d9d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:05.315831 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bc4c190-f516-4f4e-b9bc-331804ee68d8 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.346490 Jul 02 21:26:05.316750 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2542/5059] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:04 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:05.731912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:05.733983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:05.760698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:05.762638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:05.766167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:05.768535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:06.330433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a939dcf0-727c-4e88-b1d2-9e82a4044b92 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea1f2dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:06.440189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:06.447381 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a939dcf0-727c-4e88-b1d2-9e82a4044b92 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.121711 Jul 02 21:26:06.447992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a8bbae2-6988-4536-aba4-e9dd01ba3fa3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.721297 Jul 02 21:26:06.448606 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2518/5060] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:05 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:06.453757 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2543/5061] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:06 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:07.462287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8edb3575-6888-4c9b-9b63-05618fe06f0c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea1304c0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:07.464705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:07.466108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:07.497150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:07.498125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:07.500082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:07.502139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:07.585139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8edb3575-6888-4c9b-9b63-05618fe06f0c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.126734 Jul 02 21:26:07.586324 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2519/5062] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:07 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:08.194740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:08.204278 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8052ebd-f743-4308-8480-36e89b443806 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1521 microversion: 2.1 time: 0.743390 Jul 02 21:26:08.204881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2544/5063] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:07 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1521 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:26:08.600624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ac90151-2773-4531-bd29-898600453e48 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd771f310>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:08.741726 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ac90151-2773-4531-bd29-898600453e48 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.146532 Jul 02 21:26:08.742905 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2520/5064] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:08 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:09.222983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:09.223604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:09.267878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:09.269952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:09.272764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:09.288181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:09.756198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f820e8c-0930-494b-8214-de3e925eec9f tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea187b80>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:09.874626 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f820e8c-0930-494b-8214-de3e925eec9f tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.123260 Jul 02 21:26:09.889873 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2521/5065] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:09 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:09.958631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:09.968274 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-aa0a381d-3165-40fe-a997-d3ab0eb84837 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1501 microversion: 2.1 time: 0.750189 Jul 02 21:26:09.971179 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2545/5066] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:09 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1501 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:26:09.990198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:09.991265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:10.007490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:10.011005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:10.013702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:10.017925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:10.749963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:10.773956 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d4580d31-84db-44df-bc00-9c9e28fda243 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1514 microversion: 2.1 time: 0.788092 Jul 02 21:26:10.798233 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2522/5067] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:09 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1514 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:10.798471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3ba8080-c39e-4f47-be03-54a223212c54 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:10.800506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3ba8080-c39e-4f47-be03-54a223212c54 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 2a05cbdb-005a-4888-bb0d-10f0e2007cda] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:10.829571 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c3ba8080-c39e-4f47-be03-54a223212c54 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] HTTP exception thrown: Instance 2a05cbdb-005a-4888-bb0d-10f0e2007cda could not be found. Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3ba8080-c39e-4f47-be03-54a223212c54 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Request method failure captured: Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/2a05cbdb-005a-4888-bb0d-10f0e2007cda/action HTTP/1.1 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 14 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLe8g1nnwZk_BsDmBBbFRQZK3TvymJBUxjjxnaWMVRxK8pX8B5AVkVqjUfieFtgBpgKxxuJ-DdJRJNea5lyvOc1e89Rks_HULNW8tHcLgWFdKiYbEiVwuJS3i30Qi8xQemvdFphYKbykFDOCKkCxOAYZMKWlHdjBF8ieRx6d0xQXI14 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_481f91eba9c14f728a473c0b03f1709f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/481f91eba9c14f728a473c0b03f1709f"}]}] Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e594a743b6424809abe3d22f930afd8b Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: {"rescue": {}} Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 2a05cbdb-005a-4888-bb0d-10f0e2007cda could not be found. Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2a05cbdb-005a-4888-bb0d-10f0e2007cda', 'body': {'rescue': {}}} Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a05cbdb-005a-4888-bb0d-10f0e2007cda could not be found. Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a05cbdb-005a-4888-bb0d-10f0e2007cda could not be found. Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:10.844953 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a05cbdb-005a-4888-bb0d-10f0e2007cda could not be found. Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3ba8080-c39e-4f47-be03-54a223212c54 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Returning 404 to user: Instance 2a05cbdb-005a-4888-bb0d-10f0e2007cda could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:10.850184 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3ba8080-c39e-4f47-be03-54a223212c54 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/2a05cbdb-005a-4888-bb0d-10f0e2007cda/action" status: 404 len: 111 microversion: 2.1 time: 0.055192 Jul 02 21:26:10.856284 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2546/5068] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:26:10 2022] POST /compute/v2.1/servers/2a05cbdb-005a-4888-bb0d-10f0e2007cda/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:10.865851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:10.867197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:10.877318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:10.878104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:10.879139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:10.880410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:10.894788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08cfc008-36ab-4b2d-9c9b-4ca61640a46c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd78d8af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:11.012351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08cfc008-36ab-4b2d-9c9b-4ca61640a46c tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.121842 Jul 02 21:26:11.013425 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2547/5069] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:10 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:11.040101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:11.115897 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5859c88-60f5-4168-8231-3e13e4e08346 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action" status: 202 len: 0 microversion: 2.1 time: 0.257838 Jul 02 21:26:11.117695 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2523/5070] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:26:10 2022] POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:26:11.137086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:11.139250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:11.159267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:11.160845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:11.163363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:11.165890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:12.033513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b22b8b00-bede-4c1e-868a-d6c673b2a61e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd771f040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:12.269926 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b22b8b00-bede-4c1e-868a-d6c673b2a61e tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.247272 Jul 02 21:26:12.270922 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2524/5071] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:12 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:12.492603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:12.509745 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2391920e-0ed0-4c0f-bee7-faa0f7ce41d3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1519 microversion: 2.1 time: 1.383798 Jul 02 21:26:12.540874 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2548/5072] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:11 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1519 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:13.288476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a48754a5-538c-4045-8e52-166be869d590 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77b8d30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:13.422405 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a48754a5-538c-4045-8e52-166be869d590 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.140506 Jul 02 21:26:13.423462 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2525/5073] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:13 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:13.542752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:13.544102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:13.577185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:13.582511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:13.584732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:13.589585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:14.311274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:14.324281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db1c2ffd-d519-44e0-a6b3-0fb95cf1a1b7 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1499 microversion: 2.1 time: 0.794547 Jul 02 21:26:14.341161 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2549/5074] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:13 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1499 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:14.356908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:14.360814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:14.377402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:14.379124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:14.382484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:14.383171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:14.457104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lazy-loading 'flavor' on Instance uuid e6f7c66a-56e5-4d36-bde6-03325e5fb665 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:26:14.486274 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] HTTP exception thrown: Cannot 'rescue' instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 while it is in vm_state paused Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Request method failure captured: Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action HTTP/1.1 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 14 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLe8g1nnwZk_BsDmBBbFRQZK3TvymJBUxjjxnaWMVRxK8pX8B5AVkVqjUfieFtgBpgKxxuJ-DdJRJNea5lyvOc1e89Rks_HULNW8tHcLgWFdKiYbEiVwuJS3i30Qi8xQemvdFphYKbykFDOCKkCxOAYZMKWlHdjBF8ieRx6d0xQXI14 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_481f91eba9c14f728a473c0b03f1709f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/481f91eba9c14f728a473c0b03f1709f"}]}] Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e594a743b6424809abe3d22f930afd8b Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: {"rescue": {}} Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: exception: Cannot 'rescue' instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 while it is in vm_state paused Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'e6f7c66a-56e5-4d36-bde6-03325e5fb665', 'body': {'rescue': {}}} Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 in vm_state paused. Cannot rescue while the instance is in this state. Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 while it is in vm_state paused Jul 02 21:26:14.494158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 while it is in vm_state paused Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Returning 409 to user: Cannot 'rescue' instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 while it is in vm_state paused {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:14.502186 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fa22b89-f4c0-4edc-bc75-967c3192e266 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action" status: 409 len: 144 microversion: 2.1 time: 0.154431 Jul 02 21:26:14.508282 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2550/5075] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:26:14 2022] POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action => generated 144 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:26:14.513946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9151641b-19a4-4dba-b2df-6d246df1b1b5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd77a7e50>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:14.635048 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9151641b-19a4-4dba-b2df-6d246df1b1b5 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.130610 Jul 02 21:26:14.638861 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2551/5076] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:14 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:14.650913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:14.652489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:14.667723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:14.669919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:14.671327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:14.673868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:14.910758 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2f17e54-30d0-41e5-b4eb-9f350c939542 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action" status: 202 len: 0 microversion: 2.1 time: 0.270028 Jul 02 21:26:14.912312 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2552/5077] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:26:14 2022] POST /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:26:14.921810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:14.931171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:14.955555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11234afd-956d-4ccb-8986-8682eb5598d8 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-74327198", "availability_zone": "foo_zone"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:14.987292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:14.995219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:14.999157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:15.000952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:15.029484 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:15.029484 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:15.039621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.aggregate [None req-11234afd-956d-4ccb-8986-8682eb5598d8 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Generated uuid a47f626d-a24d-4878-9644-e2bc89d4436d for aggregate {{(pid=131045) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 02 21:26:15.140707 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11234afd-956d-4ccb-8986-8682eb5598d8 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 1.057419 Jul 02 21:26:15.150917 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2526/5078] 10.222.0.43 () {60 vars in 1163 bytes} [Sat Jul 2 21:26:14 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:15.167973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2251f1ef-84b5-4e51-8db5-183ae0eede70 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:15.169299 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:15.169299 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:15.233456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2251f1ef-84b5-4e51-8db5-183ae0eede70 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.079772 Jul 02 21:26:15.234359 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2527/5079] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:26:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:15.263671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ae5b168-ccaa-4a92-ad3d-2a6f4b4fb0db tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:15.272619 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:15.272619 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:15.277726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ae5b168-ccaa-4a92-ad3d-2a6f4b4fb0db tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:15.282203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ae5b168-ccaa-4a92-ad3d-2a6f4b4fb0db tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:15.287606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ae5b168-ccaa-4a92-ad3d-2a6f4b4fb0db tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:15.289446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ae5b168-ccaa-4a92-ad3d-2a6f4b4fb0db tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:15.435049 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ae5b168-ccaa-4a92-ad3d-2a6f4b4fb0db tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.190905 Jul 02 21:26:15.450797 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2528/5080] 10.222.0.43 () {58 vars in 1175 bytes} [Sat Jul 2 21:26:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:15.473757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-220f9dc6-d40a-40ee-bd09-3fe7e69c5392 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:15.476775 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:15.476775 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:15.497400 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-220f9dc6-d40a-40ee-bd09-3fe7e69c5392 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.042382 Jul 02 21:26:15.502309 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2529/5081] 10.222.0.43 () {58 vars in 1142 bytes} [Sat Jul 2 21:26:15 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:15.513589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5e26bd1-e9c7-4ed6-b15a-4d989f7a0de4 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:15.514506 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:15.514506 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:15.530330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5e26bd1-e9c7-4ed6-b15a-4d989f7a0de4 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:15.531334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5e26bd1-e9c7-4ed6-b15a-4d989f7a0de4 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:16.072323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:16.081004 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-24c0cdc5-3e39-4f45-ad6b-51b7955b5153 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1506 microversion: 2.1 time: 1.164337 Jul 02 21:26:16.088997 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2553/5082] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:14 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1506 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:26:16.110255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79d9d500-fb24-4ed1-813e-408a468b60db tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd79a3d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:16.218167 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79d9d500-fb24-4ed1-813e-408a468b60db tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.127399 Jul 02 21:26:16.220309 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2554/5083] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:16 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:16.359952 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5e26bd1-e9c7-4ed6-b15a-4d989f7a0de4 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 0.848743 Jul 02 21:26:16.363526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2530/5084] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:26:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:26:16.375644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12eb53fe-95fd-4352-b477-80a1dd95ecb5 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:16.379229 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:16.379229 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:26:16.401853 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12eb53fe-95fd-4352-b477-80a1dd95ecb5 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.029890 Jul 02 21:26:16.407924 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2555/5085] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:26:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:16.418740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8e7bf7d-1e0e-4b9e-8a0e-081bd119d4b6 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-920055594", "availability_zone": "foo_zone"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:16.560529 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:16.560529 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:16.714480 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8e7bf7d-1e0e-4b9e-8a0e-081bd119d4b6 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.298174 Jul 02 21:26:16.715144 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2531/5086] 10.222.0.43 () {60 vars in 1172 bytes} [Sat Jul 2 21:26:16 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:16.725570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e4080cc-8a80-4a7b-96c7-a9403cc3edd4 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:16.728304 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:16.728304 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:26:16.792428 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e4080cc-8a80-4a7b-96c7-a9403cc3edd4 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.070632 Jul 02 21:26:16.794763 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2556/5087] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:26:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:16.809378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3aeae7e4-9139-4441-b93f-90f063075596 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:16.811332 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:16.811332 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:26:16.826101 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3aeae7e4-9139-4441-b93f-90f063075596 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.025045 Jul 02 21:26:16.827683 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2532/5088] 10.222.0.43 () {58 vars in 1151 bytes} [Sat Jul 2 21:26:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:16.838058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-276f233a-2c86-4d30-b048-b192ac112184 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:16.839355 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:16.839355 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:26:16.849802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276f233a-2c86-4d30-b048-b192ac112184 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:16.850632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-276f233a-2c86-4d30-b048-b192ac112184 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:17.120499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:17.121723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:17.138634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:17.141325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:17.147611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:17.148567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:17.490392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:17.536853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-41c6053f-85a4-4770-a407-404812a21074 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1518 microversion: 2.1 time: 0.428960 Jul 02 21:26:17.553865 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2533/5089] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:17 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1518 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:17.576139 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-276f233a-2c86-4d30-b048-b192ac112184 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.740649 Jul 02 21:26:17.577409 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2557/5090] 10.222.0.43 () {60 vars in 1193 bytes} [Sat Jul 2 21:26:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:17.588467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8c64535-7def-4ea0-b345-de0f406255af tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd71a9280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:17.597973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c065117a-1fef-4c32-91fa-40df1d341475 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:17.601478 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:17.601478 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:26:17.667318 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c065117a-1fef-4c32-91fa-40df1d341475 tempest-TestAggregatesBasicOps-2084787840 tempest-TestAggregatesBasicOps-2084787840-project-admin] 10.222.0.43 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.080755 Jul 02 21:26:17.678049 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2558/5091] 10.222.0.43 () {58 vars in 1154 bytes} [Sat Jul 2 21:26:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 02 21:26:17.741392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8c64535-7def-4ea0-b345-de0f406255af tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.183550 Jul 02 21:26:17.747094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2534/5092] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:17 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:18.759231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04bbfe2e-f7ec-4fc9-9eba-f20b5f7157bf tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd79c7c10>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:18.870569 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04bbfe2e-f7ec-4fc9-9eba-f20b5f7157bf tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.116066 Jul 02 21:26:18.871175 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2559/5093] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:18 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:19.889786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b3490bc7-b783-47da-b652-9e69901cb047 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabea130700>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:20.031580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b3490bc7-b783-47da-b652-9e69901cb047 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1429 microversion: 2.1 time: 0.149736 Jul 02 21:26:20.032245 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2535/5094] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:19 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1429 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:21.046895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96177b1e-ac3d-4e0b-b8ac-b3172071b758 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabe4075af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:21.167370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96177b1e-ac3d-4e0b-b8ac-b3172071b758 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1438 microversion: 2.1 time: 0.125700 Jul 02 21:26:21.169558 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2560/5095] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:21 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1438 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:21.185093 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d3a2b89-97e9-43e4-842c-c14e41064100 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd76ca160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:21.292174 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d3a2b89-97e9-43e4-842c-c14e41064100 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 200 len: 1438 microversion: 2.1 time: 0.114281 Jul 02 21:26:21.295438 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2536/5096] 10.222.0.43 () {58 vars in 1232 bytes} [Sat Jul 2 21:26:21 2022] GET /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:21.311573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:21.312946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:21.341614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:21.342057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:21.342851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:21.347575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:21.614606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:21.618704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:21.645472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:21.646285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:21.652932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:21.655785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:21.712115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:21.721320 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0ff6a74-850a-445d-90a5-0c9dfb97a287 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1466 microversion: 2.1 time: 0.417816 Jul 02 21:26:21.721952 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2561/5097] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:21 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1466 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:21.751128 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] HTTP exception thrown: Cannot 'reboot' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.755873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9276e510-705d-4331-96ff-0ea88b3534e2 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabe4075dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Request method failure captured: Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action HTTP/1.1 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 28 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLe8g1nnwZk_BsDmBBbFRQZK3TvymJBUxjjxnaWMVRxK8pX8B5AVkVqjUfieFtgBpgKxxuJ-DdJRJNea5lyvOc1e89Rks_HULNW8tHcLgWFdKiYbEiVwuJS3i30Qi8xQemvdFphYKbykFDOCKkCxOAYZMKWlHdjBF8ieRx6d0xQXI14 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_481f91eba9c14f728a473c0b03f1709f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/481f91eba9c14f728a473c0b03f1709f"}]}] Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: e594a743b6424809abe3d22f930afd8b Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: {"reboot": {"type": "HARD"}} Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'reboot' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '280e9a70-044a-4ae2-8609-3504c505420e', 'body': {'reboot': {'type': 'HARD'}}} Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 280e9a70-044a-4ae2-8609-3504c505420e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:26:21.758947 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Returning 409 to user: Cannot 'reboot' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:21.764619 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2fd0b21d-8ca8-481c-980a-17bec8c56abd tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action" status: 409 len: 145 microversion: 2.1 time: 0.157183 Jul 02 21:26:21.775754 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2537/5098] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:26:21 2022] POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action => generated 145 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:26:21.792133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:21.793691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:21.819531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:21.820100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:21.820766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:21.821216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:21.906255 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] HTTP exception thrown: Cannot 'rebuild' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Request method failure captured: Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action HTTP/1.1 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 65 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLe8g1nnwZk_BsDmBBbFRQZK3TvymJBUxjjxnaWMVRxK8pX8B5AVkVqjUfieFtgBpgKxxuJ-DdJRJNea5lyvOc1e89Rks_HULNW8tHcLgWFdKiYbEiVwuJS3i30Qi8xQemvdFphYKbykFDOCKkCxOAYZMKWlHdjBF8ieRx6d0xQXI14 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_481f91eba9c14f728a473c0b03f1709f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/481f91eba9c14f728a473c0b03f1709f"}]}] Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: e594a743b6424809abe3d22f930afd8b Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: exception: Cannot 'rebuild' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '280e9a70-044a-4ae2-8609-3504c505420e', 'body': {'rebuild': {'imageRef': 'e482b755-1c1a-4758-a7c0-b3edf1610541'}}} Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 280e9a70-044a-4ae2-8609-3504c505420e in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:26:21.914777 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:21.919665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Returning 409 to user: Cannot 'rebuild' instance 280e9a70-044a-4ae2-8609-3504c505420e while it is in vm_state rescued {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:21.924541 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d8e60f6f-ba25-4845-962f-fa85fba89475 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action" status: 409 len: 146 microversion: 2.1 time: 0.133856 Jul 02 21:26:21.925222 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2538/5099] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:26:21 2022] POST /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e/action => generated 146 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 02 21:26:22.628382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:22.629021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:22.646357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:22.647698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:22.648659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:22.651572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:22.724222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:26:22.929661 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3e74b40-9a0b-43ee-8750-2c55f02bbe75 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "DELETE /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 204 len: 0 microversion: 2.1 time: 0.304936 Jul 02 21:26:22.931657 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2539/5100] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:26:22 2022] DELETE /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:26:22.952650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:22.954491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:22.955773 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9276e510-705d-4331-96ff-0ea88b3534e2 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "DELETE /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399" status: 204 len: 0 microversion: 2.1 time: 1.203751 Jul 02 21:26:22.959692 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2562/5101] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:21 2022] DELETE /compute/v2.1/images/cc746a26-0695-43bc-9615-f55aded30399 => generated 0 bytes in 1215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:26:22.964722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fe17da5-8576-49f7-8fa9-51a7bc8a6bd6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '.version_select at 0x7fabd79c7940>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:22.975625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:22.977585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:22.978614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:22.979760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:22.996012 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-0fe17da5-8576-49f7-8fa9-51a7bc8a6bd6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] HTTP exception thrown: Image not found. Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fe17da5-8576-49f7-8fa9-51a7bc8a6bd6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Request method failure captured: Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 HTTP/1.1 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLep5mlnOT8aL_44nlQvLWwdbo2C_bh7HQ_E8eCiJBkyblnosxidedaPJb-d1dhD1xLqEGjEJN1EHZiGeGRWfaiEah_E3JzoXb7_D0QWs22udIo-QKYtbo_aIbq446ztROA6keeINi-D1GJLNw2-cZ4OxXaJYAKaQkwk91DNR5UJxlQ Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: af5057879953477fa6557bbd78b77763 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af5057879953477fa6557bbd78b77763"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_af5057879953477fa6557bbd78b77763", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af5057879953477fa6557bbd78b77763"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/af5057879953477fa6557bbd78b77763"}]}] Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: af5057879953477fa6557bbd78b77763 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerTestJSON-1957829880-project Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8be0d1bce21149af900fccfc92b64f29 Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerTestJSON-1957829880-project Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: method: Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: exception: Image not found. Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a6051d59-a556-40c0-9ffa-a421d6ab7224'} Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a6051d59-a556-40c0-9ffa-a421d6ab7224 to delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a6051d59-a556-40c0-9ffa-a421d6ab7224 could not be found. Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:22.998839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 02 21:26:23.002246 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:23.005504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0fe17da5-8576-49f7-8fa9-51a7bc8a6bd6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Returning 404 to user: Image not found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:23.006565 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0fe17da5-8576-49f7-8fa9-51a7bc8a6bd6 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "DELETE /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224" status: 404 len: 62 microversion: 2.1 time: 0.045571 Jul 02 21:26:23.008634 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2563/5102] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:22 2022] DELETE /compute/v2.1/images/a6051d59-a556-40c0-9ffa-a421d6ab7224 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 02 21:26:23.026949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:23.027637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:23.044917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:23.045637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:23.046632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:23.048940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:23.123379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:26:23.323459 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8646f5b0-fa4d-45ea-8c59-e3c44ca7132d tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 204 len: 0 microversion: 2.1 time: 0.308632 Jul 02 21:26:23.324181 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2564/5103] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:26:23 2022] DELETE /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:26:23.334507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:23.335520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:23.351847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:23.352332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:23.357527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:23.358158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:23.624956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:23.637684 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ee3397df-be64-431b-8e08-e624b8af3cc1 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1507 microversion: 2.1 time: 0.702514 Jul 02 21:26:23.638960 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2540/5104] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:22 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1507 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:23.842830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:23.858770 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7cba299c-61d1-4a50-ba53-24f6f8b5f1e3 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1472 microversion: 2.1 time: 0.528893 Jul 02 21:26:23.859897 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2565/5105] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:23 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1472 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:24.655344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:24.656774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:24.667387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:24.668575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:24.669579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:24.670227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:24.867331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-619220d9-017b-4838-b1a6-d7220157b94a req-012d29b1-e056-4c93-a26d-4c722d31a3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "name": "network-vif-unplugged", "status": "completed", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:24.887730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-619220d9-017b-4838-b1a6-d7220157b94a req-012d29b1-e056-4c93-a26d-4c722d31a3fc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:24.888223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-619220d9-017b-4838-b1a6-d7220157b94a req-012d29b1-e056-4c93-a26d-4c722d31a3fc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:24.949161 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-619220d9-017b-4838-b1a6-d7220157b94a req-012d29b1-e056-4c93-a26d-4c722d31a3fc service nova] Creating event network-vif-unplugged:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:26:24.964854 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-619220d9-017b-4838-b1a6-d7220157b94a req-012d29b1-e056-4c93-a26d-4c722d31a3fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095527 Jul 02 21:26:24.966718 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2566/5106] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:26:24.976954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:24.978045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:24.988488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:24.989353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:24.990423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:24.991082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:25.243523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:25.252230 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c8b91ca-1374-45cd-9d78-31fe19fdf6b3 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1507 microversion: 2.1 time: 0.601030 Jul 02 21:26:25.261496 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2541/5107] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:24 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1507 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:25.343745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:25.354918 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-22d32564-e61f-417b-b904-7a3db73181b4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1472 microversion: 2.1 time: 0.383571 Jul 02 21:26:25.355552 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2567/5108] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:24 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:26.232356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2aa46bb4-a646-4917-a4df-06c33331cc4e req-47c0f129-5359-4607-a532-ad1f788a3d4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280e9a70-044a-4ae2-8609-3504c505420e", "name": "network-vif-deleted", "tag": "03834a04-c98b-46d2-b6a5-03402e2929f9"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:26.267646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:26.275787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:26.282693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:26.283535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:26.285723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2aa46bb4-a646-4917-a4df-06c33331cc4e req-47c0f129-5359-4607-a532-ad1f788a3d4f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:26.290121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2aa46bb4-a646-4917-a4df-06c33331cc4e req-47c0f129-5359-4607-a532-ad1f788a3d4f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:26.315163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:26.315736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:26.316801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:26.318206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:26.327272 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2aa46bb4-a646-4917-a4df-06c33331cc4e req-47c0f129-5359-4607-a532-ad1f788a3d4f service nova] Creating event network-vif-deleted:03834a04-c98b-46d2-b6a5-03402e2929f9 for instance 280e9a70-044a-4ae2-8609-3504c505420e on nch2-master-1 Jul 02 21:26:26.337382 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2aa46bb4-a646-4917-a4df-06c33331cc4e req-47c0f129-5359-4607-a532-ad1f788a3d4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137522 Jul 02 21:26:26.338687 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2542/5109] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:26.379902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:26.381417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:26.404542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:26.405000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:26.405790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:26.406230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:26.713463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:26.722384 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1537c62-7f23-457f-9aeb-81af80187d83 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 200 len: 1465 microversion: 2.1 time: 0.447608 Jul 02 21:26:26.732551 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2568/5110] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:26 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 1465 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:26.993580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8be0d1bce21149af900fccfc92b64f29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af5057879953477fa6557bbd78b77763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:27.003501 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ae0901ae-b98d-4f33-871b-6586ee4196e4 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 200 len: 1472 microversion: 2.1 time: 0.628877 Jul 02 21:26:27.007002 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2543/5111] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:26 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 1472 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:27.195463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b9ec29f0-a8ae-450d-8ca4-7cd3a8433fbd req-24f0dabc-8c30-4738-83ad-6a292223286d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d1fef88-4881-47fb-a3f7-e736797de65f", "name": "network-vif-deleted", "tag": "a5da8ec2-fdf5-47a6-9362-997bc3ab1492"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:27.229122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b9ec29f0-a8ae-450d-8ca4-7cd3a8433fbd req-24f0dabc-8c30-4738-83ad-6a292223286d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.251401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b9ec29f0-a8ae-450d-8ca4-7cd3a8433fbd req-24f0dabc-8c30-4738-83ad-6a292223286d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.283213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b9ec29f0-a8ae-450d-8ca4-7cd3a8433fbd req-24f0dabc-8c30-4738-83ad-6a292223286d service nova] Creating event network-vif-deleted:a5da8ec2-fdf5-47a6-9362-997bc3ab1492 for instance 9d1fef88-4881-47fb-a3f7-e736797de65f on nch1-master-1 Jul 02 21:26:27.310797 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b9ec29f0-a8ae-450d-8ca4-7cd3a8433fbd req-24f0dabc-8c30-4738-83ad-6a292223286d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127238 Jul 02 21:26:27.315643 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2544/5112] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:27.735629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a804e5a-1bfb-43c9-828a-d3313e4e1aff tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:27.737252 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:26:27.737252 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:26:27.738863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a804e5a-1bfb-43c9-828a-d3313e4e1aff tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.739619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:27.739769 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a804e5a-1bfb-43c9-828a-d3313e4e1aff tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.740496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a804e5a-1bfb-43c9-828a-d3313e4e1aff tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.740829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: 280e9a70-044a-4ae2-8609-3504c505420e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:27.740940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a804e5a-1bfb-43c9-828a-d3313e4e1aff tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.756444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.757272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.759317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.761285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.788145 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a804e5a-1bfb-43c9-828a-d3313e4e1aff tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.611242 Jul 02 21:26:27.789095 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2569/5113] 10.222.0.43 () {58 vars in 1184 bytes} [Sat Jul 2 21:26:27 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:27.806860 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] HTTP exception thrown: Instance 280e9a70-044a-4ae2-8609-3504c505420e could not be found. Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Request method failure captured: Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e HTTP/1.1 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLe8g1nnwZk_BsDmBBbFRQZK3TvymJBUxjjxnaWMVRxK8pX8B5AVkVqjUfieFtgBpgKxxuJ-DdJRJNea5lyvOc1e89Rks_HULNW8tHcLgWFdKiYbEiVwuJS3i30Qi8xQemvdFphYKbykFDOCKkCxOAYZMKWlHdjBF8ieRx6d0xQXI14 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_481f91eba9c14f728a473c0b03f1709f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/481f91eba9c14f728a473c0b03f1709f"}]}] Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: e594a743b6424809abe3d22f930afd8b Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 280e9a70-044a-4ae2-8609-3504c505420e could not be found. Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '280e9a70-044a-4ae2-8609-3504c505420e'} Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280e9a70-044a-4ae2-8609-3504c505420e could not be found. Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280e9a70-044a-4ae2-8609-3504c505420e could not be found. Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:27.816600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280e9a70-044a-4ae2-8609-3504c505420e could not be found. Jul 02 21:26:27.820541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:26:27.823325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Returning 404 to user: Instance 280e9a70-044a-4ae2-8609-3504c505420e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:27.827512 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9aa1907d-71e1-4b7d-87c9-1cd2b940083c tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e" status: 404 len: 111 microversion: 2.1 time: 0.091600 Jul 02 21:26:27.828721 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2545/5114] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:27 2022] GET /compute/v2.1/servers/280e9a70-044a-4ae2-8609-3504c505420e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:27.836713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:27.837214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:27.847551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.847734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.848413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:27.848848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:27.896631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:27.912468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:26:28.004018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-701884922", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "0ce93dda-673c-4092-81ee-51c5b9ef59d6"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:28.110752 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e0b4bad-17d2-45bb-a22f-5f6920c4d919 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 204 len: 0 microversion: 2.1 time: 0.277493 Jul 02 21:26:28.112347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2570/5115] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:26:27 2022] DELETE /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:26:28.121984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:28.124180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] [instance: 9d1fef88-4881-47fb-a3f7-e736797de65f] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:28.143407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:28.144396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:28.148742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:28.151285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:28.151941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] validate_networks() for [('0ce93dda-673c-4092-81ee-51c5b9ef59d6', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:26:28.178693 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] HTTP exception thrown: Instance 9d1fef88-4881-47fb-a3f7-e736797de65f could not be found. Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Request method failure captured: Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f HTTP/1.1 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLep5mlnOT8aL_44nlQvLWwdbo2C_bh7HQ_E8eCiJBkyblnosxidedaPJb-d1dhD1xLqEGjEJN1EHZiGeGRWfaiEah_E3JzoXb7_D0QWs22udIo-QKYtbo_aIbq446ztROA6keeINi-D1GJLNw2-cZ4OxXaJYAKaQkwk91DNR5UJxlQ Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: af5057879953477fa6557bbd78b77763 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af5057879953477fa6557bbd78b77763"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_af5057879953477fa6557bbd78b77763", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/af5057879953477fa6557bbd78b77763"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/af5057879953477fa6557bbd78b77763"}]}] Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: af5057879953477fa6557bbd78b77763 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1957829880 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ImagesOneServerTestJSON-1957829880-project Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8be0d1bce21149af900fccfc92b64f29 Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ImagesOneServerTestJSON-1957829880-project Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9d1fef88-4881-47fb-a3f7-e736797de65f could not be found. Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9d1fef88-4881-47fb-a3f7-e736797de65f'} Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d1fef88-4881-47fb-a3f7-e736797de65f could not be found. Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d1fef88-4881-47fb-a3f7-e736797de65f could not be found. Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:28.180768 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d1fef88-4881-47fb-a3f7-e736797de65f could not be found. Jul 02 21:26:28.184661 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:28.186003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] Returning 404 to user: Instance 9d1fef88-4881-47fb-a3f7-e736797de65f could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:28.187214 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-548816af-e5df-4567-9843-b424c544dc79 tempest-ImagesOneServerTestJSON-1957829880 tempest-ImagesOneServerTestJSON-1957829880-project] 10.222.0.43 "GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f" status: 404 len: 111 microversion: 2.1 time: 0.073228 Jul 02 21:26:28.191355 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2571/5116] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:28 2022] GET /compute/v2.1/servers/9d1fef88-4881-47fb-a3f7-e736797de65f => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:28.204620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:28.205939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:28.223977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:28.224463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:28.225269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:28.231020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:28.678190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:28.690505 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef4c1004-cf1f-4034-a01f-baa9a8a16ea4 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1520 microversion: 2.1 time: 0.497571 Jul 02 21:26:28.693039 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2572/5117] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:28 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:29.528793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:26:29.529247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:26:29.529491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:26:29.530170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:26:29.530667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:26:29.553695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:29.554948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:29.555778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:29.558164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:29.601203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Getting quotas for project bd287eaf14654f86aaba0b98ebb2e612. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:26:29.624313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Getting quotas for user 03f48b1e51b24b97acc169f4672af157 and project bd287eaf14654f86aaba0b98ebb2e612. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:26:29.648632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:26:29.651725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:26:29.711360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:29.712108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:29.736852 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e070fb1f-54ca-406f-9821-bd1f4fb2ab28 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.737058 Jul 02 21:26:29.744265 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2546/5118] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:26:29.752163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c8d8f6-5e3a-4dab-844f-b26fa9436d11 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:29.752999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-11c8d8f6-5e3a-4dab-844f-b26fa9436d11 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:29.768094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:29.768557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:29.769874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:29.771626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:30.309455 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11c8d8f6-5e3a-4dab-844f-b26fa9436d11 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1328 microversion: 2.1 time: 0.563370 Jul 02 21:26:30.320913 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2547/5119] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:29 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1328 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:30.702400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:30.715429 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e95ba3a-0471-4fba-a2a7-6f702cec3cc2 tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1520 microversion: 2.1 time: 1.010273 Jul 02 21:26:30.717268 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2573/5120] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:29 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1520 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:26:31.337084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:31.338397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:31.346298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:31.347051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:31.351311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:31.352383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:31.555209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-52356dcb-09c8-4307-be38-ed4b7a21ced1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1337 microversion: 2.1 time: 0.221294 Jul 02 21:26:31.559094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2548/5121] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:31 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1337 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:31.735407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b030c466-f619-4b63-ac1f-ba10c1456efa req-f2478a28-31b3-4ad5-b68a-8d7eece798ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f7c66a-56e5-4d36-bde6-03325e5fb665", "name": "network-vif-deleted", "tag": "eb832cf9-f536-48b0-b1d3-2635b4481149"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:31.735821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:31.736454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:31.753025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b030c466-f619-4b63-ac1f-ba10c1456efa req-f2478a28-31b3-4ad5-b68a-8d7eece798ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:31.759680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:31.759841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b030c466-f619-4b63-ac1f-ba10c1456efa req-f2478a28-31b3-4ad5-b68a-8d7eece798ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:31.764465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:31.767459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:31.770773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:31.794213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b030c466-f619-4b63-ac1f-ba10c1456efa req-f2478a28-31b3-4ad5-b68a-8d7eece798ce service nova] Creating event network-vif-deleted:eb832cf9-f536-48b0-b1d3-2635b4481149 for instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 on nch2-master-1 Jul 02 21:26:31.809958 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b030c466-f619-4b63-ac1f-ba10c1456efa req-f2478a28-31b3-4ad5-b68a-8d7eece798ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077978 Jul 02 21:26:31.810989 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2549/5122] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:26:31.877294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e594a743b6424809abe3d22f930afd8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481f91eba9c14f728a473c0b03f1709f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:26:31.891956 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a18b31b7-eae6-4865-ac4a-e0c9a04df25e tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 200 len: 1478 microversion: 2.1 time: 0.158698 Jul 02 21:26:31.892975 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2574/5123] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:31 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:32.577776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:32.578490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:32.591697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:32.592230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:32.593154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:32.593575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:32.770119 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-86ead2e6-7b39-4d94-8699-250c9e1d2d46 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1421 microversion: 2.1 time: 0.196337 Jul 02 21:26:32.780319 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2550/5124] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:32 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1421 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:32.910247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:32.911483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] [instance: e6f7c66a-56e5-4d36-bde6-03325e5fb665] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:32.919552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:32.922006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:32.922952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:32.924347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:32.925063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:32.950928 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] HTTP exception thrown: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 could not be found. Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Request method failure captured: Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 HTTP/1.1 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLe8g1nnwZk_BsDmBBbFRQZK3TvymJBUxjjxnaWMVRxK8pX8B5AVkVqjUfieFtgBpgKxxuJ-DdJRJNea5lyvOc1e89Rks_HULNW8tHcLgWFdKiYbEiVwuJS3i30Qi8xQemvdFphYKbykFDOCKkCxOAYZMKWlHdjBF8ieRx6d0xQXI14 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_481f91eba9c14f728a473c0b03f1709f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/481f91eba9c14f728a473c0b03f1709f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/481f91eba9c14f728a473c0b03f1709f"}]}] Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 481f91eba9c14f728a473c0b03f1709f Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-247859143 Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e594a743b6424809abe3d22f930afd8b Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerRescueNegativeTestJSON-247859143-project Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 could not be found. Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'e6f7c66a-56e5-4d36-bde6-03325e5fb665'} Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 could not be found. Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 could not be found. Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:26:32.953828 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 could not be found. Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:26:32.957206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] Returning 404 to user: Instance e6f7c66a-56e5-4d36-bde6-03325e5fb665 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:26:32.960974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7248b6d4-8f02-47a4-8868-2651ff7775ed tempest-ServerRescueNegativeTestJSON-247859143 tempest-ServerRescueNegativeTestJSON-247859143-project] 10.222.0.43 "GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665" status: 404 len: 111 microversion: 2.1 time: 0.054900 Jul 02 21:26:32.965624 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2575/5125] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:32 2022] GET /compute/v2.1/servers/e6f7c66a-56e5-4d36-bde6-03325e5fb665 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:26:33.789491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:33.790009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:33.804554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:33.805532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:33.806563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:33.807413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:34.391504 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bec3a175-8281-4ee3-b654-98fb497e0431 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1463 microversion: 2.1 time: 0.605690 Jul 02 21:26:34.392897 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2551/5126] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:33 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1463 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:35.408871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:35.417407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:35.434315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:35.435026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:35.439662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:35.440590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:35.730529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d5a9bbfa-a617-4e8b-8d34-53f22f6aa573 req-8cac230b-3719-4be2-a827-6fe5a81b13dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a3ea90-ecae-4783-a8f5-5e05008f5291", "tag": "af0673c9-dd82-42b3-a697-61e83f04e25a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:35.753544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d5a9bbfa-a617-4e8b-8d34-53f22f6aa573 req-8cac230b-3719-4be2-a827-6fe5a81b13dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:35.754406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d5a9bbfa-a617-4e8b-8d34-53f22f6aa573 req-8cac230b-3719-4be2-a827-6fe5a81b13dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:35.779866 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d5a9bbfa-a617-4e8b-8d34-53f22f6aa573 req-8cac230b-3719-4be2-a827-6fe5a81b13dd service nova] Creating event network-changed:af0673c9-dd82-42b3-a697-61e83f04e25a for instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 on nch2-master-1 Jul 02 21:26:35.787143 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d5a9bbfa-a617-4e8b-8d34-53f22f6aa573 req-8cac230b-3719-4be2-a827-6fe5a81b13dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070528 Jul 02 21:26:35.787994 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2552/5127] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:26:35.936664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f51470f8-bd57-4109-a78e-98e7828f5664 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1463 microversion: 2.1 time: 0.530205 Jul 02 21:26:35.938390 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2576/5128] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:35 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1463 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:36.956395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:36.957108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:36.975733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:36.976233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:36.977025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:36.977462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:37.607778 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ebb56c72-bd60-4af9-83d4-ab38c83b6582 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1463 microversion: 2.1 time: 0.656397 Jul 02 21:26:37.608762 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2553/5129] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:36 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1463 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:38.626631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:38.627272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:38.632649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:38.636968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:38.637667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:38.638762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:38.639403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:39.112376 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7c15f33-cb31-4a2f-8e4e-c17818c6cd0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1463 microversion: 2.1 time: 0.489328 Jul 02 21:26:39.114316 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2577/5130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:38 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1463 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:40.131573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:40.132326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:40.135351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:40.146117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:40.146585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:40.147388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:40.152812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:40.305406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:40.495787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-43ab4f15-ef41-4b7d-ab28-32770bc3b3cc req-de865e16-314e-4054-889c-e1c084866148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a3ea90-ecae-4783-a8f5-5e05008f5291", "name": "network-vif-plugged", "status": "completed", "tag": "af0673c9-dd82-42b3-a697-61e83f04e25a"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:40.510599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43ab4f15-ef41-4b7d-ab28-32770bc3b3cc req-de865e16-314e-4054-889c-e1c084866148 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:40.511046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43ab4f15-ef41-4b7d-ab28-32770bc3b3cc req-de865e16-314e-4054-889c-e1c084866148 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:40.538230 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-43ab4f15-ef41-4b7d-ab28-32770bc3b3cc req-de865e16-314e-4054-889c-e1c084866148 service nova] Creating event network-vif-plugged:af0673c9-dd82-42b3-a697-61e83f04e25a for instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 on nch2-master-1 Jul 02 21:26:40.543937 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-43ab4f15-ef41-4b7d-ab28-32770bc3b3cc req-de865e16-314e-4054-889c-e1c084866148 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052457 Jul 02 21:26:40.546626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2578/5131] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:40.621712 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3c3ac03-9e05-4c54-a006-f1f963ceb958 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1463 microversion: 2.1 time: 0.494213 Jul 02 21:26:40.622962 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2554/5132] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:40 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1463 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:41.641317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:41.642243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:41.664218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:41.664670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:41.665465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:41.665903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:41.988381 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-294d6703-143b-4d9e-9f94-4b4e5865d074 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1463 microversion: 2.1 time: 0.352404 Jul 02 21:26:41.989330 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2579/5133] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:41 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1463 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:42.561551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eec9bc84-6c20-4272-831f-9a6b0e032b6b tempest-ServersTestBootFromVolume-938471560 tempest-ServersTestBootFromVolume-938471560-project] Action: 'create', calling method: .version_select at 0x7fabea327d30>, body: {"keypair": {"name": "tempest-keypair-78466623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKiZMmjbZBQjdTKF/gDgVKXzzClsLgvdlUdsDZgYQNA/T5rgEQKe1PzsPiAx3cyuQRMTNsAQz5TcRkpaPRzajnO5E12Eb039qKNRh/I3kUDoURrNHGB7Efdd9xXSE2GDw=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:42.580840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-eec9bc84-6c20-4272-831f-9a6b0e032b6b tempest-ServersTestBootFromVolume-938471560 tempest-ServersTestBootFromVolume-938471560-project] Getting quotas for project 282d207988644c02869aec5ae667a2d3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:26:42.598603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-eec9bc84-6c20-4272-831f-9a6b0e032b6b tempest-ServersTestBootFromVolume-938471560 tempest-ServersTestBootFromVolume-938471560-project] Getting quotas for user dbf79689e3074d2589296c97b0b16924 and project 282d207988644c02869aec5ae667a2d3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:26:42.667143 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eec9bc84-6c20-4272-831f-9a6b0e032b6b tempest-ServersTestBootFromVolume-938471560 tempest-ServersTestBootFromVolume-938471560-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.252013 Jul 02 21:26:42.668200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2555/5134] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:26:42 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:43.016711 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:43.019154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:43.060852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:43.061521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:43.062823 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:43.063677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:43.356932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-727457d2-c388-4d79-90f9-edb9f99bb317 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1648 microversion: 2.1 time: 0.351138 Jul 02 21:26:43.357614 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2580/5135] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:43 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1648 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:43.378615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:43.379905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:43.404909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:43.406950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:43.408188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:43.409510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:43.418646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:43.721645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e4878bb4-3b9d-4426-9561-cbecc1e70957 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1648 microversion: 2.1 time: 0.351228 Jul 02 21:26:43.723820 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2556/5136] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:43 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1648 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:43.741181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:43.742080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:43.749603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:43.750257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:43.751635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:43.752345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:43.968937 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-82d60378-0d4a-42f7-9619-d4ad3c72ff1b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1648 microversion: 2.1 time: 0.232448 Jul 02 21:26:43.969543 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2581/5137] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:43 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1648 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:44.120546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1292122541", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "0ce93dda-673c-4092-81ee-51c5b9ef59d6"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:44.210911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] validate_networks() for [('0ce93dda-673c-4092-81ee-51c5b9ef59d6', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:26:45.770833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:26:45.771418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:26:45.771878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:26:45.772512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:26:45.773627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:26:45.796330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:45.796959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:45.797974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:45.798509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:45.858742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Getting quotas for project bd287eaf14654f86aaba0b98ebb2e612. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:26:45.871343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Getting quotas for user 03f48b1e51b24b97acc169f4672af157 and project bd287eaf14654f86aaba0b98ebb2e612. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:26:45.892363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:26:45.895067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:26:45.996741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4757b102-9308-4297-bbda-c374817230b9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.879600 Jul 02 21:26:45.998807 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2557/5138] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:26:46.010195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-170955db-1ffb-4103-89d9-c581c6372e0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:46.010832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-170955db-1ffb-4103-89d9-c581c6372e0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:46.156140 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-170955db-1ffb-4103-89d9-c581c6372e0b tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1329 microversion: 2.1 time: 0.150466 Jul 02 21:26:46.156929 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2582/5139] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:46 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1329 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:47.177035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:47.178868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:47.188185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:47.189194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:47.190167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:47.190942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:47.286830 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-902f12cc-d815-4324-af78-f48bb9aa9be9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1416 microversion: 2.1 time: 0.114408 Jul 02 21:26:47.287827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2558/5140] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:47 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1416 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:47.325004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-799e5140-f709-4690-b01b-3f656198f638 tempest-ServersTestBootFromVolume-938471560 tempest-ServersTestBootFromVolume-938471560-project] Calling method '.version_select at 0x7fabe42ad430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:47.351852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-799e5140-f709-4690-b01b-3f656198f638 tempest-ServersTestBootFromVolume-938471560 tempest-ServersTestBootFromVolume-938471560-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78466623" status: 202 len: 0 microversion: 2.1 time: 0.031436 Jul 02 21:26:47.352489 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2583/5141] 10.222.0.43 () {58 vars in 1214 bytes} [Sat Jul 2 21:26:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78466623 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:26:48.309692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:48.310339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:48.329125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:48.330023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:48.338962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:48.339894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:48.669466 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-afb11f42-11a0-4571-b7a5-41ad2b474cef tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.367553 Jul 02 21:26:48.673436 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2559/5142] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:48 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:49.441055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-12d35ab5-bd53-4c5a-a487-f65aae869dec req-100e7082-d4fe-412e-92dd-79f17ccd4e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c99f6b-c7ce-4a45-bca9-de7d8a818e19", "tag": "a9cb18a2-e48a-4f7a-bebd-1ccec03bfd31"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:49.458555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-12d35ab5-bd53-4c5a-a487-f65aae869dec req-100e7082-d4fe-412e-92dd-79f17ccd4e91 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:49.459254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-12d35ab5-bd53-4c5a-a487-f65aae869dec req-100e7082-d4fe-412e-92dd-79f17ccd4e91 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:49.486484 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-12d35ab5-bd53-4c5a-a487-f65aae869dec req-100e7082-d4fe-412e-92dd-79f17ccd4e91 service nova] Creating event network-changed:a9cb18a2-e48a-4f7a-bebd-1ccec03bfd31 for instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 on nch1-master-1 Jul 02 21:26:49.497584 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-12d35ab5-bd53-4c5a-a487-f65aae869dec req-100e7082-d4fe-412e-92dd-79f17ccd4e91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060248 Jul 02 21:26:49.498491 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2584/5143] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:49.690394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:49.691747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:49.706614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:49.708598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:49.709610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:49.716272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:49.990877 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5dbc05bf-96fd-453c-834a-977f6140a0ad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.304482 Jul 02 21:26:49.992119 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2560/5144] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:49 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:51.010589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:51.011304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:51.017894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:51.018668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:51.019596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:51.020208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:51.248958 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7d8cba3-c178-4799-9c5d-1f3baffc56e2 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.244126 Jul 02 21:26:51.249636 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2585/5145] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:51 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:52.265711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:52.266404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:52.274182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:52.275508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:52.276575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:52.277414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:52.649409 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c334419-8613-47a3-9759-fe56d55ffff3 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.387330 Jul 02 21:26:52.650009 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2561/5146] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:52 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:53.666872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:53.667492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:53.676154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:53.676622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:53.677825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:53.678310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:53.841251 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3b026a5a-6955-4d6d-994e-2586a1c312c5 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.178422 Jul 02 21:26:53.842666 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2586/5147] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:53 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:54.860029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:54.860664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:54.872005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:54.872832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:54.874057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:54.874719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:55.119374 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ee113d73-cb2a-455d-a85b-3218201b7155 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.263757 Jul 02 21:26:55.122334 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2562/5148] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:54 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:56.147724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:56.152113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:56.166139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:56.172681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:56.173452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:56.174653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:56.176485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:56.407982 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a7662cb8-af79-4f4a-8055-302dc24abb81 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.272877 Jul 02 21:26:56.417404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2587/5149] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:56 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:57.425083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:57.425700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:57.428498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:57.430052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:57.432391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=7 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:57.441946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:57.443686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:57.446205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:57.447763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:58.097096 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6a71bb83-b32e-42f1-804e-d4af0c79b29c tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.675775 Jul 02 21:26:58.099602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2563/5150] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:57 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:26:58.239266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d7257530-e59f-492b-805a-968233328f3c req-9a046031-8690-4172-8f67-87600a0ae49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c99f6b-c7ce-4a45-bca9-de7d8a818e19", "name": "network-vif-plugged", "status": "completed", "tag": "a9cb18a2-e48a-4f7a-bebd-1ccec03bfd31"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:26:58.259549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7257530-e59f-492b-805a-968233328f3c req-9a046031-8690-4172-8f67-87600a0ae49b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:58.259999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d7257530-e59f-492b-805a-968233328f3c req-9a046031-8690-4172-8f67-87600a0ae49b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:58.303006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:26:58.309970 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d7257530-e59f-492b-805a-968233328f3c req-9a046031-8690-4172-8f67-87600a0ae49b service nova] Creating event network-vif-plugged:a9cb18a2-e48a-4f7a-bebd-1ccec03bfd31 for instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 on nch1-master-1 Jul 02 21:26:58.321138 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d7257530-e59f-492b-805a-968233328f3c req-9a046031-8690-4172-8f67-87600a0ae49b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084505 Jul 02 21:26:58.325655 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2588/5151] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:26:59.115502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:26:59.116126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:26:59.128391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:59.129940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:59.130764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:26:59.131217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:26:59.370193 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b13e6d78-dbd4-4975-873a-65300b7528bd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1464 microversion: 2.1 time: 0.259094 Jul 02 21:26:59.373387 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2564/5152] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:26:59 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1464 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:00.388461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:00.390129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:00.399857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:00.400326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:00.401124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:00.401548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:00.550211 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40431639-a6aa-4fd6-bdf0-c4472226dbf4 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1648 microversion: 2.1 time: 0.166950 Jul 02 21:27:00.550812 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2589/5153] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:00 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1648 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:00.567415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:00.568030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:00.575931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:00.576712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:00.577711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:00.578157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:00.780640 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5beb9e9-ea86-4324-b87b-ceb8e21539c8 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1648 microversion: 2.1 time: 0.208632 Jul 02 21:27:00.783712 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2565/5154] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:00 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1648 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:00.803103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:00.803829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:00.811754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:00.812278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:00.815282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:00.815735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:01.062109 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70b367b1-015b-4a93-a93b-7e8dcf7fcecf tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1648 microversion: 2.1 time: 0.265944 Jul 02 21:27:01.072130 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2590/5155] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:00 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1648 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:01.087549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:01.088378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:01.101119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:01.102072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:01.102899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:01.105172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:01.156323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:27:01.336028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ee6b45d2-4b56-4870-8915-cef6f99e71dd tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 204 len: 0 microversion: 2.1 time: 0.258599 Jul 02 21:27:01.340009 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2566/5156] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:27:01 2022] DELETE /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:27:01.347895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:01.348461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:01.359954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:01.360454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:01.365611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:01.369313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:01.635700 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b35a371-fa1b-49a5-8727-c881c62362c1 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1654 microversion: 2.1 time: 0.293926 Jul 02 21:27:01.637652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2591/5157] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:01 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1654 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:02.653771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:02.654480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:02.668126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:02.668590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:02.669387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:02.669835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:02.827146 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0995495d-23bd-47f1-888a-635da8de3eb9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1654 microversion: 2.1 time: 0.177483 Jul 02 21:27:02.828659 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2567/5158] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:02 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1654 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:03.691308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00198132-1572-4656-a2d2-dda19a3a7bb0 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Action: 'create', calling method: .version_select at 0x7fabe494cca0>, body: {"keypair": {"name": "tempest-keypair-1346829852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrQvLzdvqLRyHjZlpvWKFhuxVkrp4RNyB43sC0dendXvBZSmvqvy5xLCh1uwlDsus7Nh0EhwocsqW+6IaOp1CaiODGBPGB38kvWjneUwWGNWbXoAUXmYWrwLYEbYYComw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:03.739612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-fef26ece-d9c0-4e61-b134-fc1332940d70 req-51208438-e1dd-4f4b-90c1-6f3fda548d93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c99f6b-c7ce-4a45-bca9-de7d8a818e19", "name": "network-vif-deleted", "tag": "a9cb18a2-e48a-4f7a-bebd-1ccec03bfd31"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:03.743887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-00198132-1572-4656-a2d2-dda19a3a7bb0 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Getting quotas for project 18bb6db6102b4d9f87530f9a71b78db0. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:27:03.756443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-00198132-1572-4656-a2d2-dda19a3a7bb0 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Getting quotas for user 9cf49b6497cd4485bee8253300a1ff96 and project 18bb6db6102b4d9f87530f9a71b78db0. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:27:03.759269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fef26ece-d9c0-4e61-b134-fc1332940d70 req-51208438-e1dd-4f4b-90c1-6f3fda548d93 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:03.760775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fef26ece-d9c0-4e61-b134-fc1332940d70 req-51208438-e1dd-4f4b-90c1-6f3fda548d93 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:03.801364 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-fef26ece-d9c0-4e61-b134-fc1332940d70 req-51208438-e1dd-4f4b-90c1-6f3fda548d93 service nova] Creating event network-vif-deleted:a9cb18a2-e48a-4f7a-bebd-1ccec03bfd31 for instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 on nch1-master-1 Jul 02 21:27:03.808500 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-fef26ece-d9c0-4e61-b134-fc1332940d70 req-51208438-e1dd-4f4b-90c1-6f3fda548d93 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074700 Jul 02 21:27:03.809832 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2568/5159] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:27:03.835743 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00198132-1572-4656-a2d2-dda19a3a7bb0 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.594277 Jul 02 21:27:03.836944 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2592/5160] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:27:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:27:03.850029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:03.851339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:03.863369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:03.866376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:03.871788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:03.872772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:04.095519 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8aea5a0-be10-482e-9110-1e8fa2698cc7 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 200 len: 1449 microversion: 2.1 time: 0.253278 Jul 02 21:27:04.098841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2569/5161] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:03 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 1449 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:05.117476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:05.118615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 25c99f6b-c7ce-4a45-bca9-de7d8a818e19] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:05.127607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:05.128314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:05.129341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:05.130048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:05.148924 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] HTTP exception thrown: Instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 could not be found. Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Request method failure captured: Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 HTTP/1.1 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLgDNto4Ng9N2nPgStr4nMZ24q6zwGKM5DKSX-MMxbDdAyRp2BYAqnAVL9o8ufI6Zn-uV5-CWlxXEg5nIZCZ9J6LpdCrw9B6vEWTmptMVPTHEH5OxGpa-MrHg6iEUKGohZyDk_Y9zgwfS7gcXK8ngoYIDtS-l9LCZkSBmn8h2Wufnj8 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: bd287eaf14654f86aaba0b98ebb2e612 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerMultinode-777200118 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd287eaf14654f86aaba0b98ebb2e612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bd287eaf14654f86aaba0b98ebb2e612", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd287eaf14654f86aaba0b98ebb2e612"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bd287eaf14654f86aaba0b98ebb2e612"}]}] Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerMultinode-777200118 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: bd287eaf14654f86aaba0b98ebb2e612 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerMultinode-777200118 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestServerMultinode-777200118-project-admin Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 03f48b1e51b24b97acc169f4672af157 Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerMultinode-777200118-project-admin Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 could not be found. Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '25c99f6b-c7ce-4a45-bca9-de7d8a818e19'} Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 could not be found. Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 could not be found. Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:27:05.152602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 could not be found. Jul 02 21:27:05.156811 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:05.158891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Returning 404 to user: Instance 25c99f6b-c7ce-4a45-bca9-de7d8a818e19 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:27:05.159791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6c687a6a-331a-4108-bf4b-f1972239bf01 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19" status: 404 len: 111 microversion: 2.1 time: 0.050298 Jul 02 21:27:05.174340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:05.174821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:05.183411 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2593/5162] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:05 2022] GET /compute/v2.1/servers/25c99f6b-c7ce-4a45-bca9-de7d8a818e19 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:27:05.185834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:05.186875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:05.188308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:05.189004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:05.239426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:27:05.336759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:05.400530 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4b088587-760d-49ac-8e28-c56d2dfc7aad tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "DELETE /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 204 len: 0 microversion: 2.1 time: 0.231169 Jul 02 21:27:05.401158 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2570/5163] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:27:05 2022] DELETE /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:27:05.412414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:05.413440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:05.430949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:05.433225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:05.434300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:05.436534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:06.011732 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee14eb65-817d-4895-b4df-40a892d3e106 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1654 microversion: 2.1 time: 0.605603 Jul 02 21:27:06.017127 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2594/5164] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:05 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1654 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:06.639206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1878320048", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e4dea945-aa8d-4411-b888-dd5e3aecce51"}], "security_groups": [{"name": "tempest-securitygroup--990746752"}], "key_name": "tempest-keypair-1346829852", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:06.826612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] validate_networks() for [('e4dea945-aa8d-4411-b888-dd5e3aecce51', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:27:07.035154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:07.036433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:07.045750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:07.048124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:07.049016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:07.050162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:07.050668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:07.536031 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d98a8ffd-0dd1-4a25-a473-7911770a86a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1654 microversion: 2.1 time: 0.505561 Jul 02 21:27:07.536830 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2595/5165] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:07 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1654 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:07.841527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Getting quotas for project 18bb6db6102b4d9f87530f9a71b78db0. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:27:07.850013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Getting quotas for user 9cf49b6497cd4485bee8253300a1ff96 and project 18bb6db6102b4d9f87530f9a71b78db0. Resources: dict_keys(['metadata_items']) {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:27:07.864291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:27:07.864716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:27:07.865394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:27:07.865808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:27:07.866390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:27:07.876638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:07.877124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:07.877921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:07.878815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:07.898578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Getting quotas for project 18bb6db6102b4d9f87530f9a71b78db0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:27:07.903991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Getting quotas for user 9cf49b6497cd4485bee8253300a1ff96 and project 18bb6db6102b4d9f87530f9a71b78db0. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:27:07.917628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:27:07.920282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:27:07.990168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5adb80c8-fbc1-4813-adf8-e7c0489c5b13 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.359131 Jul 02 21:27:07.993268 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2571/5166] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:27:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:27:08.003205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-50fb9469-53ff-4719-9bb3-1b6d03aa4c96 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:08.003977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-50fb9469-53ff-4719-9bb3-1b6d03aa4c96 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:08.140370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-50fb9469-53ff-4719-9bb3-1b6d03aa4c96 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:08.156893 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-50fb9469-53ff-4719-9bb3-1b6d03aa4c96 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1270 microversion: 2.1 time: 0.157066 Jul 02 21:27:08.158147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2596/5167] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:07 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:08.180156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7116629f-5521-4047-aced-699d521b152d req-59a7dfe0-7c5d-4b83-a0bf-87c6749e20d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a3ea90-ecae-4783-a8f5-5e05008f5291", "name": "network-vif-deleted", "tag": "af0673c9-dd82-42b3-a697-61e83f04e25a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:08.196178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7116629f-5521-4047-aced-699d521b152d req-59a7dfe0-7c5d-4b83-a0bf-87c6749e20d6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:08.200219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7116629f-5521-4047-aced-699d521b152d req-59a7dfe0-7c5d-4b83-a0bf-87c6749e20d6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:08.223693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7116629f-5521-4047-aced-699d521b152d req-59a7dfe0-7c5d-4b83-a0bf-87c6749e20d6 service nova] Creating event network-vif-deleted:af0673c9-dd82-42b3-a697-61e83f04e25a for instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 on nch2-master-1 Jul 02 21:27:08.229091 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7116629f-5521-4047-aced-699d521b152d req-59a7dfe0-7c5d-4b83-a0bf-87c6749e20d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053124 Jul 02 21:27:08.230186 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2572/5168] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:27:08.559174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:08.561164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:08.572147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:08.572829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:08.573813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:08.574363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:08.617616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:08.618071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:08.618554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lazy-loading 'fault' on Instance uuid 93a3ea90-ecae-4783-a8f5-5e05008f5291 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:27:08.706917 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cf047961-55dc-4738-bdb5-cbcb04dcc1a9 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 200 len: 1453 microversion: 2.1 time: 0.155307 Jul 02 21:27:08.713004 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2597/5169] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:08 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:09.178459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:09.179978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:09.189123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:09.190373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:09.192348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:09.193189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:09.323075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:09.365615 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4bdb8f91-5774-4f42-922c-1351cf4c3dd9 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1322 microversion: 2.1 time: 0.194631 Jul 02 21:27:09.366605 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2573/5170] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:09 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:09.743886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:09.747379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] [instance: 93a3ea90-ecae-4783-a8f5-5e05008f5291] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:09.767353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:09.768896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:09.772430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:09.773477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:09.800653 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] HTTP exception thrown: Instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 could not be found. Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Request method failure captured: Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 HTTP/1.1 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLgDNto4Ng9N2nPgStr4nMZ24q6zwGKM5DKSX-MMxbDdAyRp2BYAqnAVL9o8ufI6Zn-uV5-CWlxXEg5nIZCZ9J6LpdCrw9B6vEWTmptMVPTHEH5OxGpa-MrHg6iEUKGohZyDk_Y9zgwfS7gcXK8ngoYIDtS-l9LCZkSBmn8h2Wufnj8 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: bd287eaf14654f86aaba0b98ebb2e612 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerMultinode-777200118 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd287eaf14654f86aaba0b98ebb2e612"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bd287eaf14654f86aaba0b98ebb2e612", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bd287eaf14654f86aaba0b98ebb2e612"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bd287eaf14654f86aaba0b98ebb2e612"}]}] Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerMultinode-777200118 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: bd287eaf14654f86aaba0b98ebb2e612 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerMultinode-777200118 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestServerMultinode-777200118-project-admin Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 03f48b1e51b24b97acc169f4672af157 Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerMultinode-777200118-project-admin Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 could not be found. Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '93a3ea90-ecae-4783-a8f5-5e05008f5291'} Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 could not be found. Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 could not be found. Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:27:09.803395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 could not be found. Jul 02 21:27:09.807139 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:27:09.808977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] Returning 404 to user: Instance 93a3ea90-ecae-4783-a8f5-5e05008f5291 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:27:09.810071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4eef60a-7e57-4ff7-82b6-63ad22954975 tempest-TestServerMultinode-777200118 tempest-TestServerMultinode-777200118-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291" status: 404 len: 111 microversion: 2.1 time: 0.079280 Jul 02 21:27:09.811305 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2598/5171] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:09 2022] GET /compute/v2.1/servers/93a3ea90-ecae-4783-a8f5-5e05008f5291 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:27:10.386368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:10.387563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:10.405729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:10.409569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:10.412055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:10.412645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:10.758373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:10.767526 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b4067f0e-b7dd-45f3-99a1-a6cbfde5b02a tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.388001 Jul 02 21:27:10.778504 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2574/5172] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:10 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:11.025737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-378655ba-7c14-49c1-b57b-87a620b4983a req-74f658cc-bc64-4381-a802-b2cc1c2dd05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e0a8bf-edf5-4ae8-8385-739e7102a886", "tag": "64576936-9792-4181-9c80-076acd89e1b0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:11.057501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-378655ba-7c14-49c1-b57b-87a620b4983a req-74f658cc-bc64-4381-a802-b2cc1c2dd05c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:11.058877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-378655ba-7c14-49c1-b57b-87a620b4983a req-74f658cc-bc64-4381-a802-b2cc1c2dd05c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:11.091997 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-378655ba-7c14-49c1-b57b-87a620b4983a req-74f658cc-bc64-4381-a802-b2cc1c2dd05c service nova] Creating event network-changed:64576936-9792-4181-9c80-076acd89e1b0 for instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 on nch1-master-1 Jul 02 21:27:11.113026 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-378655ba-7c14-49c1-b57b-87a620b4983a req-74f658cc-bc64-4381-a802-b2cc1c2dd05c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095549 Jul 02 21:27:11.118564 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2599/5173] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:27:11.788141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:11.789706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:11.798434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:11.798902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:11.799945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:11.800583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:12.125143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:12.134853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d56ef936-491c-448a-afaf-c7b264dfe727 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.352132 Jul 02 21:27:12.136110 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2575/5174] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:11 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:13.155233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:13.156140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:13.163555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:13.164016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:13.164886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:13.165275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:13.445515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:13.466571 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3dc09b19-d2bd-41d8-b3b3-d198b4ca2872 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.316755 Jul 02 21:27:13.467506 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2600/5175] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:13 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:14.485115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:14.486676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:14.495925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:14.496672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:14.497713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:14.498485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:14.856596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:14.872233 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb28c2e4-8bb8-4c65-884e-39f3382657ff tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.388088 Jul 02 21:27:14.873086 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2576/5176] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:14 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:27:15.890809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:15.892375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:15.906897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:15.908573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:15.911126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:15.912527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:16.311573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:16.320373 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2111bc81-ebf4-45d2-b3d5-7fa7038d7dbe tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.435085 Jul 02 21:27:16.321389 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2601/5177] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:15 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:17.338681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:17.339418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:17.355656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:17.356488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:17.358058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:17.360480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:17.888480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:17.911453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:17.945559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:17.954688 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34d572d0-bd50-48eb-9c03-dd4bd9ffab15 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.620669 Jul 02 21:27:17.956058 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2577/5178] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:17 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:18.567203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:18.781076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-cb69c8d4-e4cf-46b9-beb6-5f5c1d83726e req-face8e05-53c1-40e9-bc5a-14048e15a0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e0a8bf-edf5-4ae8-8385-739e7102a886", "name": "network-vif-plugged", "status": "completed", "tag": "64576936-9792-4181-9c80-076acd89e1b0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:18.791457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cb69c8d4-e4cf-46b9-beb6-5f5c1d83726e req-face8e05-53c1-40e9-bc5a-14048e15a0e0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:18.792123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-cb69c8d4-e4cf-46b9-beb6-5f5c1d83726e req-face8e05-53c1-40e9-bc5a-14048e15a0e0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:18.806308 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-cb69c8d4-e4cf-46b9-beb6-5f5c1d83726e req-face8e05-53c1-40e9-bc5a-14048e15a0e0 service nova] Creating event network-vif-plugged:64576936-9792-4181-9c80-076acd89e1b0 for instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 on nch1-master-1 Jul 02 21:27:18.813180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-cb69c8d4-e4cf-46b9-beb6-5f5c1d83726e req-face8e05-53c1-40e9-bc5a-14048e15a0e0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255562 Jul 02 21:27:18.814305 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2602/5179] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:27:18.973899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:18.974437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:18.988184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:18.989786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:18.990714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:18.991276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:19.591997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:19.603147 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b22b6fa5-c4cc-43cf-a7d3-aa95be9f01c4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.635844 Jul 02 21:27:19.603790 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2578/5180] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:18 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:20.621855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:20.623165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:20.630674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:20.631956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:20.632807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:20.633309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:21.039772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:21.065739 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08760a82-3884-4c0b-afe0-fa5f93f1b8a4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1395 microversion: 2.1 time: 0.449199 Jul 02 21:27:21.071193 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2603/5181] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:20 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1395 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:22.087308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:22.088555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:22.106164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:22.107360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:22.108209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:22.109677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:22.434928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:22.444660 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-680fb241-2942-438b-9188-d67a9d508cb4 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1575 microversion: 2.1 time: 0.365647 Jul 02 21:27:22.445266 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2579/5182] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:22 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1575 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:22.463213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:22.464442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:22.476659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:22.477717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:22.483068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:22.483844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:22.618617 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7eae3573-96cf-4b58-9a28-edeff9e49805 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158930 Jul 02 21:27:22.619496 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2604/5183] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:27:22 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:27:24.077059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:24.077759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:27:24.092658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:24.096194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:24.097022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:24.097999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:24.340547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2f0ea252-7535-471d-b1ff-540f5c08d5cf req-0c2a8116-4789-4b54-8465-e6fe119c9703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e0a8bf-edf5-4ae8-8385-739e7102a886", "tag": "64576936-9792-4181-9c80-076acd89e1b0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:24.352388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2f0ea252-7535-471d-b1ff-540f5c08d5cf req-0c2a8116-4789-4b54-8465-e6fe119c9703 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:27:24.353066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2f0ea252-7535-471d-b1ff-540f5c08d5cf req-0c2a8116-4789-4b54-8465-e6fe119c9703 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:27:24.371848 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2f0ea252-7535-471d-b1ff-540f5c08d5cf req-0c2a8116-4789-4b54-8465-e6fe119c9703 service nova] Creating event network-changed:64576936-9792-4181-9c80-076acd89e1b0 for instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 on nch1-master-1 Jul 02 21:27:24.381237 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2f0ea252-7535-471d-b1ff-540f5c08d5cf req-0c2a8116-4789-4b54-8465-e6fe119c9703 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.309911 Jul 02 21:27:24.382364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2605/5184] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:27:24.490691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:27:24.498938 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ea5c28f-35e1-40ba-91c1-5155500ec363 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1575 microversion: 2.1 time: 0.432495 Jul 02 21:27:24.511719 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2580/5185] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:27:24 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1575 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:27:45.487724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=25 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:45.488988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=71 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:45.493929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-066d71fc-cfdd-4d0e-b74d-9ee14c85dccd tempest-TestVolumeBootPattern-283262115 tempest-TestVolumeBootPattern-283262115-project] Action: 'create', calling method: .version_select at 0x7fabe456b670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1843502282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHT6UsigPXqgGH8kN9GMTUUGNDzDpn2jppJZUWtsRMVZwX+fBLPCOtuut4bqOeIoBeHS8Cq93p8c1RujHBEubNRCwq2SYAuXMTYEZrUiqhhq7/sAd/qZOnd4CgNCHMegg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:27:45.512339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-066d71fc-cfdd-4d0e-b74d-9ee14c85dccd tempest-TestVolumeBootPattern-283262115 tempest-TestVolumeBootPattern-283262115-project] Getting quotas for project 14611f1a06c7495c934849caf0089f94. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:27:45.522391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-066d71fc-cfdd-4d0e-b74d-9ee14c85dccd tempest-TestVolumeBootPattern-283262115 tempest-TestVolumeBootPattern-283262115-project] Getting quotas for user ef602dcbd0e7441ea0f13a16b393e033 and project 14611f1a06c7495c934849caf0089f94. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:27:45.566848 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-066d71fc-cfdd-4d0e-b74d-9ee14c85dccd tempest-TestVolumeBootPattern-283262115 tempest-TestVolumeBootPattern-283262115-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.081199 Jul 02 21:27:45.569527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2606/5186] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:27:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:27:50.145482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f3aa595-85b1-4658-9291-8a323f162568 tempest-TestVolumeBootPattern-283262115 tempest-TestVolumeBootPattern-283262115-project] Calling method '.version_select at 0x7fabd78a1ca0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:27:50.193603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:50.195469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=52 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:27:50.226364 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f3aa595-85b1-4658-9291-8a323f162568 tempest-TestVolumeBootPattern-283262115 tempest-TestVolumeBootPattern-283262115-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1843502282" status: 202 len: 0 microversion: 2.1 time: 0.091883 Jul 02 21:27:50.229231 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2581/5187] 10.222.0.43 () {58 vars in 1262 bytes} [Sat Jul 2 21:27:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1843502282 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:28:02.981659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:02.982513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:02.987455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:02.988354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:02.996157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:02.996867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:02.997846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:02.998521 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:03.035445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:28:03.226884 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e39fc138-a86b-48ce-aa84-8176ad662d46 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 204 len: 0 microversion: 2.1 time: 0.246522 Jul 02 21:28:03.228160 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2607/5188] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:28:02 2022] DELETE /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:28:03.238715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:03.245002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:03.249720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:03.266983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:03.267757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:03.270817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:03.271451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:03.825089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:03.833069 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-467974e1-6da7-4872-982c-f415ad5888f9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1674 microversion: 2.1 time: 0.600663 Jul 02 21:28:03.833654 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2582/5189] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:03 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1674 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:04.855277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:04.856989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:04.870363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:04.871159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:04.873247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:04.874570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:04.993817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:05.003492 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55163b04-8af5-43f9-ab3c-bb873bd9ec1d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 200 len: 1606 microversion: 2.1 time: 0.154049 Jul 02 21:28:05.006650 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2608/5190] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:04 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 1606 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:05.328239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-21ae1e95-bb75-49a4-92e7-bde026f23bf0 req-9f629f80-b805-43d2-abc7-325ebcd8db81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7695c9ea-dedd-41a5-bbd1-1b9027f019ad", "name": "network-vif-deleted", "tag": "e0a9e6df-73b9-43ae-9f31-6212c2d7755a"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:05.362443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-21ae1e95-bb75-49a4-92e7-bde026f23bf0 req-9f629f80-b805-43d2-abc7-325ebcd8db81 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:05.365399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-21ae1e95-bb75-49a4-92e7-bde026f23bf0 req-9f629f80-b805-43d2-abc7-325ebcd8db81 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:05.391426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-21ae1e95-bb75-49a4-92e7-bde026f23bf0 req-9f629f80-b805-43d2-abc7-325ebcd8db81 service nova] Creating event network-vif-deleted:e0a9e6df-73b9-43ae-9f31-6212c2d7755a for instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad on nch2-master-1 Jul 02 21:28:05.402807 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-21ae1e95-bb75-49a4-92e7-bde026f23bf0 req-9f629f80-b805-43d2-abc7-325ebcd8db81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082141 Jul 02 21:28:05.429656 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2583/5191] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:06.035951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:06.036939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:06.093447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:06.101914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:06.105948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:06.106587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:06.127785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bdc779d-dfa2-4dbf-add9-ec8001574b8b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: .version_select at 0x7fabe46e4670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-804248385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYb2YS75fHrKT7Hutok1RfoUwQUCcpmHLqwXd8a7u9T9Y01VZeIjfuHE98Sq52tGZDJekgYPYYUkjjrbZi2ZrkJUkEBFbFySMfz4vRb2qX51wJhDvl+hD+4pFW3BiUbAA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:06.142456 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] HTTP exception thrown: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Request method failure captured: Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad HTTP/1.1 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa3kF1RbKEycaMXSjM7YhSbgQRkJ_dH_xg2HlbQUtEWyrK5HznoAcacUAwV31eIgz9iUvP6wc6vbw3mgaugf3SLWaom5MtjJJunpBQ-jeNLDxp1Vqt90z62Lgpjg5zT_7erl0H17w89t2Yhfk4BMyOwZ6ks7geq805mjBxGlLcfvwA Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44ceefe86e694dc8a2c9a478eeb1d1c5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}] Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a90caf8a110549e39bbaf7ec50a6207d Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7695c9ea-dedd-41a5-bbd1-1b9027f019ad'} Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:06.146880 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Returning 404 to user: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c6828fef-8667-4d5d-8f4d-2bc683a40a19 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 404 len: 111 microversion: 2.1 time: 0.129471 Jul 02 21:28:06.151283 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2584/5192] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:06 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:28:06.159267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a69daaa7-3d8a-4e89-8de7-5756cde44af6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '.version_select at 0x7fabea2c1ee0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:06.173322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5bdc779d-dfa2-4dbf-add9-ec8001574b8b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:28:06.187301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5bdc779d-dfa2-4dbf-add9-ec8001574b8b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:28:06.199230 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a69daaa7-3d8a-4e89-8de7-5756cde44af6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-432767255" status: 202 len: 0 microversion: 2.1 time: 0.045091 Jul 02 21:28:06.199839 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2585/5193] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:28:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-432767255 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:28:06.237826 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5bdc779d-dfa2-4dbf-add9-ec8001574b8b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.591064 Jul 02 21:28:06.240846 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2609/5194] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:28:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:07.524476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b1dfba4-ce76-4fb5-842b-7a0665cd0b4d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Action: 'create', calling method: .version_select at 0x7fabd7ea6dc0>, body: {"keypair": {"name": "tempest-keypair-476185947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpiEOrMuvrtBNY4m7qW0rebKAS+M0mvRGCYFPVV/E+dLkjlLZG4+48E779DOa8UUbUOlpwGGEqFNnnf+G8jGSZ8WKhIK8j4KOScUrx9Vz81Tu/CtmczANw5MsB5rcy9xw=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:07.569574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9b1dfba4-ce76-4fb5-842b-7a0665cd0b4d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:28:07.585082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9b1dfba4-ce76-4fb5-842b-7a0665cd0b4d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for user a90caf8a110549e39bbaf7ec50a6207d and project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:28:07.643575 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9b1dfba4-ce76-4fb5-842b-7a0665cd0b4d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130283 Jul 02 21:28:07.644542 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2586/5195] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:28:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:11.854302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1342960945", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cc96c2d-fdad-4762-b6c0-6497636d934f"}], "security_groups": [{"name": "tempest-securitygroup--1904037382"}], "key_name": "tempest-keypair-476185947", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:12.051385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] validate_networks() for [('9cc96c2d-fdad-4762-b6c0-6497636d934f', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:28:12.729914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:28:12.730531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:28:12.731281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:28:12.731927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:28:12.732633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:28:12.743453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:12.743906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:12.744915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:12.745612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:12.771666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:28:12.783137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Getting quotas for user a90caf8a110549e39bbaf7ec50a6207d and project 44ceefe86e694dc8a2c9a478eeb1d1c5. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:28:12.803482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:28:12.806167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:28:12.877807 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b42ee53-0409-4895-8abc-61384bf9d52a tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.028152 Jul 02 21:28:12.880476 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2610/5196] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:28:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:28:12.893119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9dc2705e-8e2b-41d4-9d84-c9560ee58317 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:12.894653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9dc2705e-8e2b-41d4-9d84-c9560ee58317 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:13.342607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9dc2705e-8e2b-41d4-9d84-c9560ee58317 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:13.353382 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9dc2705e-8e2b-41d4-9d84-c9560ee58317 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1237 microversion: 2.1 time: 0.466309 Jul 02 21:28:13.353988 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2587/5197] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:12 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1237 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:14.374997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:14.376598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:14.388320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:14.389003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:14.389921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:14.391047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:14.524508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:14.532991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae235888-7243-40f5-935c-030b4d9a0c35 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1295 microversion: 2.1 time: 0.165565 Jul 02 21:28:14.543365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2611/5198] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:14 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1295 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:15.550699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:15.555850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:15.570416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:15.571232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:15.572345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:15.573400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:15.719563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:15.730685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e6c9bbb-2af2-4a91-8733-478065f9594b tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1295 microversion: 2.1 time: 0.183880 Jul 02 21:28:15.733209 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2588/5199] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:15 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1295 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:16.749589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:16.751235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:16.766980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:16.767500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:16.768411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:16.768853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:16.998414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:17.009236 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d707e971-6d45-467c-9fa8-0debed89e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 0.263675 Jul 02 21:28:17.011337 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2612/5200] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:16 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:18.028198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:18.028898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:18.042979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:18.043515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:18.044408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:18.045032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:18.630531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-020bb1e1-3f46-48b4-b8c0-0cc7972a11ad req-31903b1d-efa6-448a-ba42-dd2355c6b5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d29f974-6518-49ed-9bd2-11c33ba78d7c", "tag": "9a73779c-758c-4d24-ab50-bb693ca4ed4f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:18.658579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-020bb1e1-3f46-48b4-b8c0-0cc7972a11ad req-31903b1d-efa6-448a-ba42-dd2355c6b5bd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:18.660207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-020bb1e1-3f46-48b4-b8c0-0cc7972a11ad req-31903b1d-efa6-448a-ba42-dd2355c6b5bd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:18.705633 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-020bb1e1-3f46-48b4-b8c0-0cc7972a11ad req-31903b1d-efa6-448a-ba42-dd2355c6b5bd service nova] Creating event network-changed:9a73779c-758c-4d24-ab50-bb693ca4ed4f for instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c on nch2-master-1 Jul 02 21:28:18.719676 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-020bb1e1-3f46-48b4-b8c0-0cc7972a11ad req-31903b1d-efa6-448a-ba42-dd2355c6b5bd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090980 Jul 02 21:28:18.721254 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2613/5201] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:19.065109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:19.075315 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b047250f-54a4-4c1e-8097-599085711644 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 1.051545 Jul 02 21:28:19.075925 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2589/5202] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:18 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:19.752225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-776048978", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "7bc9da76-6d29-44d4-b493-49c0ba5a4760"}], "key_name": "tempest-TestNetworkAdvancedServerOps-804248385", "security_groups": [{"name": "tempest-secgroup-smoke-571318717"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:19.942344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] validate_networks() for [('7bc9da76-6d29-44d4-b493-49c0ba5a4760', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:28:20.092994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:20.093627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:20.121337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:20.121808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:20.122635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:20.123087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:20.717866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:20.732396 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd9d84fd-93dc-488a-be38-de6378694bd6 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 0.643610 Jul 02 21:28:20.733160 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2590/5203] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:20 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:21.244852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:28:21.245350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:28:21.245821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:28:21.246234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:28:21.246733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:28:21.281646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:21.283707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:21.284783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:21.290169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:21.343237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:28:21.358477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:28:21.419814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:28:21.422634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:28:21.575872 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d8c8e653-be80-458b-8021-c0d7b3d836fa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.831661 Jul 02 21:28:21.587099 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2614/5204] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:28:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:28:21.591861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c64f963b-c943-473f-bee8-2237e4695943 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:21.592884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c64f963b-c943-473f-bee8-2237e4695943 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:21.752604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:21.753562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:21.781898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:21.785470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:21.786481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:21.787076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:21.875796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c64f963b-c943-473f-bee8-2237e4695943 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:21.905799 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c64f963b-c943-473f-bee8-2237e4695943 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1265 microversion: 2.1 time: 0.318189 Jul 02 21:28:21.910265 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2591/5205] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:21 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:22.354270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:22.368708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f793f19-2593-4409-8ef9-acb10f28ff2d tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 0.623051 Jul 02 21:28:22.384250 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2615/5206] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:21 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:22.952236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:22.952952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:22.985274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:22.986589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:22.991335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:22.994030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:23.273060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:23.284939 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34c03317-ed1f-4d6c-9b92-fffcb2843334 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1261 microversion: 2.1 time: 0.357828 Jul 02 21:28:23.285563 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2592/5207] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:22 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1261 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:23.392228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:23.393012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:23.404181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:23.404642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:23.409159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:23.409651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:23.972728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:23.989769 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2a93cb55-5e19-47b9-b466-55873153b8df tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 0.608200 Jul 02 21:28:23.990275 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2616/5208] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:23 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:24.043128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:24.043629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:24.058695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.060805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.063977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.064463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.130168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:28:24.248079 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-537882be-c21d-4e17-a165-9c15a830b216 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "DELETE /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 204 len: 0 microversion: 2.1 time: 0.644881 Jul 02 21:28:24.252858 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2593/5209] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:28:23 2022] DELETE /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:28:24.258289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:24.259137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:24.266179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.266761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.267631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.268402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.305644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:24.307902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:24.316005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.316576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.317441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.317947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.447012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:24.460200 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c992906-d2e9-4907-802e-3169fc1540c3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1323 microversion: 2.1 time: 0.160825 Jul 02 21:28:24.460812 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2594/5210] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:24 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:24.574221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:24.589630 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-570611cb-c78c-4ad5-979c-c8b2379ca7a4 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1734 microversion: 2.1 time: 0.335635 Jul 02 21:28:24.594219 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2617/5211] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:24 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1734 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:24.814045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d986ce5c-277a-443e-bef3-07b8e1c54209 req-a36f39b0-d998-4318-b4e1-37737e3ecd7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d29f974-6518-49ed-9bd2-11c33ba78d7c", "name": "network-vif-plugged", "status": "completed", "tag": "9a73779c-758c-4d24-ab50-bb693ca4ed4f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:24.831349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d986ce5c-277a-443e-bef3-07b8e1c54209 req-a36f39b0-d998-4318-b4e1-37737e3ecd7b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:24.833730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d986ce5c-277a-443e-bef3-07b8e1c54209 req-a36f39b0-d998-4318-b4e1-37737e3ecd7b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:24.878332 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d986ce5c-277a-443e-bef3-07b8e1c54209 req-a36f39b0-d998-4318-b4e1-37737e3ecd7b service nova] Creating event network-vif-plugged:9a73779c-758c-4d24-ab50-bb693ca4ed4f for instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c on nch2-master-1 Jul 02 21:28:24.894002 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d986ce5c-277a-443e-bef3-07b8e1c54209 req-a36f39b0-d998-4318-b4e1-37737e3ecd7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082780 Jul 02 21:28:24.895761 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2595/5212] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:25.007218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:25.007914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:25.022111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:25.026574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:25.028597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:25.034862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:25.478797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:25.480169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:25.502391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:25.503135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:25.504200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:25.504849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:26.138550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:26.149931 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80c1683b-abe8-40d7-aeb5-2dc83db6ddab tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 1.146661 Jul 02 21:28:26.152862 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2618/5213] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:25 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:26.158894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:26.159773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:26.172765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:26.174226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:26.175901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:26.177882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:26.197378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:26.210922 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f38f5958-38d5-4473-b7c8-7d80a495926f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.737775 Jul 02 21:28:26.220625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2596/5214] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:25 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:26.812452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:26.830206 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c72701d-7f24-4bdc-8175-c958ffca76cb tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1734 microversion: 2.1 time: 0.669970 Jul 02 21:28:26.833356 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2619/5215] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:26 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1734 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:26.932015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4ee0613b-b1cd-432e-b78d-b8e9b97880b0 req-14934e21-3210-4a9f-920b-e68d75c36168 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:26.956615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4ee0613b-b1cd-432e-b78d-b8e9b97880b0 req-14934e21-3210-4a9f-920b-e68d75c36168 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:26.957064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4ee0613b-b1cd-432e-b78d-b8e9b97880b0 req-14934e21-3210-4a9f-920b-e68d75c36168 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:26.976943 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4ee0613b-b1cd-432e-b78d-b8e9b97880b0 req-14934e21-3210-4a9f-920b-e68d75c36168 service nova] Creating event network-changed:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch1-master-1 Jul 02 21:28:26.989741 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4ee0613b-b1cd-432e-b78d-b8e9b97880b0 req-14934e21-3210-4a9f-920b-e68d75c36168 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214540 Jul 02 21:28:26.992965 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2597/5216] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:27.167608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:27.168439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:27.196968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:27.197488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:27.204946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:27.205551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:27.229039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:27.229957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:27.245447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:27.246004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:27.257695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:27.258174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:27.890833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:27.913612 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ca0bccca-be17-4ebc-b8e5-55d57fe77acc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1363 microversion: 2.1 time: 0.749123 Jul 02 21:28:27.919095 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2620/5217] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:27 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1363 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:27.935831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9d65857c-c343-47d5-bda4-28e1a85625d9 req-b5ed2331-9bb9-4cbc-abde-c10312236cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "437883a3-6dc4-4818-8739-a52096e8709e", "name": "network-vif-deleted", "tag": "31536cde-fbd7-4df4-955e-ab5a641d06e4"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:27.943129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:27.957676 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b3ee8535-25ee-4376-9696-19fbd5338127 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.732767 Jul 02 21:28:27.960486 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2598/5218] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:27 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:27.973231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d65857c-c343-47d5-bda4-28e1a85625d9 req-b5ed2331-9bb9-4cbc-abde-c10312236cbd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:27.974717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:27.975401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9d65857c-c343-47d5-bda4-28e1a85625d9 req-b5ed2331-9bb9-4cbc-abde-c10312236cbd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:27.976352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:27.997333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:27.997905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:27.998792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:28.003091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:28.012331 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9d65857c-c343-47d5-bda4-28e1a85625d9 req-b5ed2331-9bb9-4cbc-abde-c10312236cbd service nova] Creating event network-vif-deleted:31536cde-fbd7-4df4-955e-ab5a641d06e4 for instance 437883a3-6dc4-4818-8739-a52096e8709e on nch1-master-1 Jul 02 21:28:28.036232 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9d65857c-c343-47d5-bda4-28e1a85625d9 req-b5ed2331-9bb9-4cbc-abde-c10312236cbd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100535 Jul 02 21:28:28.037060 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2621/5219] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:28.094009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:28.100014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:28.102951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lazy-loading 'fault' on Instance uuid 437883a3-6dc4-4818-8739-a52096e8709e {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:28:28.225646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8659f358b57b4574a0703b39e4cb0004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e1d850f7e34fc7997bbea3a4a4777f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:28.248749 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44c80acc-81b9-434c-9972-c5ab3ca76898 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 200 len: 1389 microversion: 2.1 time: 0.285964 Jul 02 21:28:28.258667 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2599/5220] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:27 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 1389 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:28.944069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:28.945356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:28.957973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:28.958361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:28.959127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:28.962632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:28.975588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:28.976233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:28.988215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:28.992472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:28.993499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:29.004638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:29.410504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:29.424276 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9406408a-336f-4234-8172-0d337ca360a1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.450949 Jul 02 21:28:29.425305 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2600/5221] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:28 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:29.433138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:29.434844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:29.450946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:29.451677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:29.453699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:29.454848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:29.480414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:29.489235 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] HTTP exception thrown: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Request method failure captured: Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e HTTP/1.1 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcSwHJlBnZUwwR7u45nbpoQqnpetAYssWE2ckW9xAuSIIKhsQXR3kRkbxmnPEaGiXH8yoVPWApmFr7xI5Mv2TALRRSFWMHENoOBLbSPOuD8pQUwxQ_BrYBrpbjifiR7t4R70TFn9W7wZQva76KU5A6g3q0lbpgVd3A3-16ZFUyGkI0 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 04e1d850f7e34fc7997bbea3a4a4777f Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestServerBasicOps-283991601 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04e1d850f7e34fc7997bbea3a4a4777f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04e1d850f7e34fc7997bbea3a4a4777f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04e1d850f7e34fc7997bbea3a4a4777f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04e1d850f7e34fc7997bbea3a4a4777f"}]}] Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestServerBasicOps-283991601 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 04e1d850f7e34fc7997bbea3a4a4777f Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestServerBasicOps-283991601 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestServerBasicOps-283991601-project Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8659f358b57b4574a0703b39e4cb0004 Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestServerBasicOps-283991601-project Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '437883a3-6dc4-4818-8739-a52096e8709e'} Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:29.493266 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:29.498047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:29.498646 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-249ecc2c-696e-47c6-90f7-e5f95f032ccc tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1549 microversion: 2.1 time: 0.559122 Jul 02 21:28:29.500511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Returning 404 to user: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:28:29.501608 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c2eb222c-7394-47d7-8e46-1cff0f4ef9ce tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 404 len: 111 microversion: 2.1 time: 0.075131 Jul 02 21:28:29.502171 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2601/5222] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:29 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:28:29.505601 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2622/5223] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:28 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1549 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:29.516752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:29.524579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:29.534950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:29.536363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:29.538087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:29.538804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:29.878121 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1319b873-5183-49b9-8212-1dac7336bc5c tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.371366 Jul 02 21:28:29.884299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2602/5224] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:28:29 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c/os-interface => generated 284 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:30.442085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:30.443308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:30.450917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:30.451715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:30.452746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:30.453197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:30.862432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:30.875878 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3febe41a-8346-4d0d-8eb7-23cb31694aaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.437227 Jul 02 21:28:30.880301 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2623/5225] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:30 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:31.356376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:31.356947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:31.368890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:31.384201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:31.386004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:31.386588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:31.411647 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] HTTP exception thrown: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Request method failure captured: Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e HTTP/1.1 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLcSwHJlBnZUwwR7u45nbpoQqnpetAYssWE2ckW9xAuSIIKhsQXR3kRkbxmnPEaGiXH8yoVPWApmFr7xI5Mv2TALRRSFWMHENoOBLbSPOuD8pQUwxQ_BrYBrpbjifiR7t4R70TFn9W7wZQva76KU5A6g3q0lbpgVd3A3-16ZFUyGkI0 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 04e1d850f7e34fc7997bbea3a4a4777f Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestServerBasicOps-283991601 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04e1d850f7e34fc7997bbea3a4a4777f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04e1d850f7e34fc7997bbea3a4a4777f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04e1d850f7e34fc7997bbea3a4a4777f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04e1d850f7e34fc7997bbea3a4a4777f"}]}] Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestServerBasicOps-283991601 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 04e1d850f7e34fc7997bbea3a4a4777f Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestServerBasicOps-283991601 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestServerBasicOps-283991601-project Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 8659f358b57b4574a0703b39e4cb0004 Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestServerBasicOps-283991601-project Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '437883a3-6dc4-4818-8739-a52096e8709e'} Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:28:31.413451 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.417868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Returning 404 to user: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:28:31.418602 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0abf9938-62dc-4cf7-b7d6-13eed68a111c tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "DELETE /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 404 len: 111 microversion: 2.1 time: 0.066357 Jul 02 21:28:31.419431 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2603/5226] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:28:31 2022] DELETE /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:28:31.434013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:31.434647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] [instance: 437883a3-6dc4-4818-8739-a52096e8709e] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:31.436776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:31.437548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:31.444729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:31.445862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:31.446835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:31.447278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:31.463530 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] HTTP exception thrown: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Request method failure captured: Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e HTTP/1.1 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLcSwHJlBnZUwwR7u45nbpoQqnpetAYssWE2ckW9xAuSIIKhsQXR3kRkbxmnPEaGiXH8yoVPWApmFr7xI5Mv2TALRRSFWMHENoOBLbSPOuD8pQUwxQ_BrYBrpbjifiR7t4R70TFn9W7wZQva76KU5A6g3q0lbpgVd3A3-16ZFUyGkI0 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 04e1d850f7e34fc7997bbea3a4a4777f Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerBasicOps-283991601 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04e1d850f7e34fc7997bbea3a4a4777f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_04e1d850f7e34fc7997bbea3a4a4777f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/04e1d850f7e34fc7997bbea3a4a4777f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/04e1d850f7e34fc7997bbea3a4a4777f"}]}] Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerBasicOps-283991601 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 04e1d850f7e34fc7997bbea3a4a4777f Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerBasicOps-283991601 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestServerBasicOps-283991601-project Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 8659f358b57b4574a0703b39e4cb0004 Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerBasicOps-283991601-project Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '437883a3-6dc4-4818-8739-a52096e8709e'} Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:31.465589 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Returning 404 to user: Instance 437883a3-6dc4-4818-8739-a52096e8709e could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:28:31.469310 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbaf9f5e-406b-4da1-9812-7d639460a509 tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e" status: 404 len: 111 microversion: 2.1 time: 0.041783 Jul 02 21:28:31.470886 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2624/5227] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:31 2022] GET /compute/v2.1/servers/437883a3-6dc4-4818-8739-a52096e8709e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:28:31.743056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7bba3b05-c0f8-49fe-bd66-b755bdd7b54e tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] Calling method '.version_select at 0x7fabea31b940>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:31.778467 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7bba3b05-c0f8-49fe-bd66-b755bdd7b54e tempest-TestServerBasicOps-283991601 tempest-TestServerBasicOps-283991601-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1110865017" status: 202 len: 0 microversion: 2.1 time: 0.039670 Jul 02 21:28:31.782358 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2604/5228] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:28:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1110865017 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:28:31.895663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:31.896665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:31.904059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:31.905380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:31.906605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:31.907787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:32.773282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:32.783233 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7072d232-8699-4543-8e42-849d756fb7ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.892316 Jul 02 21:28:32.784260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2625/5229] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:31 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:32.965629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:32.972939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-52015f09-f332-4d38-a2cf-de1f287d1d9e req-6c196a3d-1d5c-44dc-a127-3db8bf95a0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d29f974-6518-49ed-9bd2-11c33ba78d7c", "tag": "9a73779c-758c-4d24-ab50-bb693ca4ed4f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:32.989133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-52015f09-f332-4d38-a2cf-de1f287d1d9e req-6c196a3d-1d5c-44dc-a127-3db8bf95a0a7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:32.991128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-52015f09-f332-4d38-a2cf-de1f287d1d9e req-6c196a3d-1d5c-44dc-a127-3db8bf95a0a7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:33.009377 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-52015f09-f332-4d38-a2cf-de1f287d1d9e req-6c196a3d-1d5c-44dc-a127-3db8bf95a0a7 service nova] Creating event network-changed:9a73779c-758c-4d24-ab50-bb693ca4ed4f for instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c on nch2-master-1 Jul 02 21:28:33.016881 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-52015f09-f332-4d38-a2cf-de1f287d1d9e req-6c196a3d-1d5c-44dc-a127-3db8bf95a0a7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052334 Jul 02 21:28:33.018264 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2605/5230] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:33.806310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:33.807617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:33.813682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:33.824752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:33.825684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:33.827519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:33.829144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:33.851835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:34.188282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:34.205762 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-541a3105-18b4-40e9-916a-7b789972485b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.408630 Jul 02 21:28:34.206383 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2626/5231] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:33 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:34.421213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7341b834-3dbb-4814-b823-831b8dde3e53 req-689a5483-c28a-454c-9e6a-caa283e09432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "name": "network-vif-plugged", "status": "completed", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:34.425075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:34.445738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7341b834-3dbb-4814-b823-831b8dde3e53 req-689a5483-c28a-454c-9e6a-caa283e09432 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:34.446363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7341b834-3dbb-4814-b823-831b8dde3e53 req-689a5483-c28a-454c-9e6a-caa283e09432 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:34.450269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:34.481906 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7341b834-3dbb-4814-b823-831b8dde3e53 req-689a5483-c28a-454c-9e6a-caa283e09432 service nova] Creating event network-vif-plugged:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch1-master-1 Jul 02 21:28:34.491679 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7341b834-3dbb-4814-b823-831b8dde3e53 req-689a5483-c28a-454c-9e6a-caa283e09432 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075467 Jul 02 21:28:34.493710 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2606/5232] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:35.223941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:35.225494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:35.234580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:35.235205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:35.236018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:35.236498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:35.631424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:35.641994 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53ce639b-82bd-465a-a5c3-26cbbe396172 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1390 microversion: 2.1 time: 0.422775 Jul 02 21:28:35.642970 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2627/5233] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:35 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1390 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:36.662742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:36.663449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:36.671201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:36.672218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:36.672997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:36.673555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:37.093994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:37.105265 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3ee3caf-8d3e-422a-988b-06a352e702ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1562 microversion: 2.1 time: 0.449669 Jul 02 21:28:37.107597 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2607/5234] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:36 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1562 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:37.127057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:37.127813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:37.137408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:37.137890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:37.138757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:37.139266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:37.487691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:37.496649 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c5c49945-85d5-4c84-8043-6b6ebdd61b24 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1562 microversion: 2.1 time: 0.375204 Jul 02 21:28:37.497371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2628/5235] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:37 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1562 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:40.119735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3a82e72b-1a95-4d24-99f3-575ac920add7 req-27c3602c-396c-4f5a-b685-af78396d933c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:40.121503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:40.122877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:40.141677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3a82e72b-1a95-4d24-99f3-575ac920add7 req-27c3602c-396c-4f5a-b685-af78396d933c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.142056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.142944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3a82e72b-1a95-4d24-99f3-575ac920add7 req-27c3602c-396c-4f5a-b685-af78396d933c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.143511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.146056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.148832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.176418 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3a82e72b-1a95-4d24-99f3-575ac920add7 req-27c3602c-396c-4f5a-b685-af78396d933c service nova] Creating event network-changed:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch1-master-1 Jul 02 21:28:40.185262 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3a82e72b-1a95-4d24-99f3-575ac920add7 req-27c3602c-396c-4f5a-b685-af78396d933c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067765 Jul 02 21:28:40.186214 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2629/5236] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:28:40.414373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:40.419144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:40.422690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Searching by: {'deleted': False, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:28:40.436465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.437436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.439057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.439504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.508902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:28:40.585370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d905c03d-e613-4ee9-a26b-9b2d8bfa17d2 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.173954 Jul 02 21:28:40.589019 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2630/5237] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:28:40 2022] GET /compute/v2.1/servers => generated 334 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:40.614464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:40.633193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:40.634017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Searching by: {'deleted': False, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:28:40.644762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.645223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.646149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.646446 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:40.697027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:40.706877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:28:40.725351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c44ee61-59bb-4510-a4dc-35d0d412f39a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1562 microversion: 2.1 time: 0.615434 Jul 02 21:28:40.725973 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2608/5238] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:40 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1562 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:40.835641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:40.850226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:40.855821 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:41.316508 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33df95c0-cfc6-45f7-a10f-fa9c3731b0e6 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.717845 Jul 02 21:28:41.316508 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2631/5239] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:28:40 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:41.332764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9724b16-b7f8-4bec-809c-148c160f5c9c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:41.349245 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9724b16-b7f8-4bec-809c-148c160f5c9c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021020 Jul 02 21:28:41.356195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2609/5240] 10.222.0.43 () {58 vars in 1136 bytes} [Sat Jul 2 21:28:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:41.671080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:41.671752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:41.690245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:41.690713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:41.691519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:41.691952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:41.746944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:28:41.958503 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa7cb7f5-34e9-4b81-85d6-691ce56398a3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "DELETE /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 204 len: 0 microversion: 2.1 time: 0.291062 Jul 02 21:28:41.959872 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2632/5241] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:28:41 2022] DELETE /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:28:41.968524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:41.971416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:41.983410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:41.985134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:41.988060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:41.989037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:42.470953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:42.488514 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b2a67fb-4e98-4ba8-9c45-662980f09b23 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1699 microversion: 2.1 time: 0.517318 Jul 02 21:28:42.491474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2610/5242] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:41 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1699 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:43.508355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:43.509327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:43.528227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:43.529441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:43.530358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:43.531054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:44.016930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:44.025932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7edb0c7-0790-4c14-816c-c1bdd5a3f0e3 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1699 microversion: 2.1 time: 0.523586 Jul 02 21:28:44.029777 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2633/5243] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:43 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1699 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:45.047417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:45.048875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:45.063996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:45.064986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:45.077536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:45.078393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:45.779097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:45.790781 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6aec4a6-39ea-47bd-98b9-01dd8483f6bb tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1699 microversion: 2.1 time: 0.747871 Jul 02 21:28:45.791636 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2611/5244] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:45 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1699 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:28:46.820784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:46.823655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:46.835805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:46.836622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:46.837688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:46.838548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:47.002686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cf49b6497cd4485bee8253300a1ff96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18bb6db6102b4d9f87530f9a71b78db0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:28:47.039004 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0f6b4463-9c21-46fb-b848-f3b8cedee195 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 200 len: 1632 microversion: 2.1 time: 0.232276 Jul 02 21:28:47.043103 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2634/5245] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:46 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 1632 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:28:47.196852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6cb7269b-53d4-4633-925b-4223c5d70476 req-da5362b2-0d5b-4936-896b-5d68aa601ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e0a8bf-edf5-4ae8-8385-739e7102a886", "name": "network-vif-deleted", "tag": "64576936-9792-4181-9c80-076acd89e1b0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:47.251083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6cb7269b-53d4-4633-925b-4223c5d70476 req-da5362b2-0d5b-4936-896b-5d68aa601ea8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:47.254507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6cb7269b-53d4-4633-925b-4223c5d70476 req-da5362b2-0d5b-4936-896b-5d68aa601ea8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:47.295458 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6cb7269b-53d4-4633-925b-4223c5d70476 req-da5362b2-0d5b-4936-896b-5d68aa601ea8 service nova] Creating event network-vif-deleted:64576936-9792-4181-9c80-076acd89e1b0 for instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 on nch1-master-1 Jul 02 21:28:47.315702 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6cb7269b-53d4-4633-925b-4223c5d70476 req-da5362b2-0d5b-4936-896b-5d68aa601ea8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131504 Jul 02 21:28:47.319715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2612/5246] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:28:48.062501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:48.063230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] [instance: 11e0a8bf-edf5-4ae8-8385-739e7102a886] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:28:48.087539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:48.097180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:48.098648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:28:48.100407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:28:48.134788 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] HTTP exception thrown: Instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 could not be found. Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Request method failure captured: Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 HTTP/1.1 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLgnlutMGDl1ZxIkkqO9JK8QzswqZKkyBODZI96_N-V8Y1i3w2LgKcfy-aw3Rig4HuEGs2l9PKp-MSfY7tUARkUTTH1QAAeFFQx9kLRen113k2zcrgRh1DM2F3gYcie3j8WV1P9oDqjBuXvOrZDi1JMswrz4zmxogH3zpDGU3XJIkJE Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 18bb6db6102b4d9f87530f9a71b78db0 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersTestJSON-512481110 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18bb6db6102b4d9f87530f9a71b78db0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_18bb6db6102b4d9f87530f9a71b78db0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/18bb6db6102b4d9f87530f9a71b78db0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/18bb6db6102b4d9f87530f9a71b78db0"}]}] Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersTestJSON-512481110 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 18bb6db6102b4d9f87530f9a71b78db0 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersTestJSON-512481110 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersTestJSON-512481110-project Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9cf49b6497cd4485bee8253300a1ff96 Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersTestJSON-512481110-project Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 could not be found. Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '11e0a8bf-edf5-4ae8-8385-739e7102a886'} Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 could not be found. Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 could not be found. Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:48.141916 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 could not be found. Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Returning 404 to user: Instance 11e0a8bf-edf5-4ae8-8385-739e7102a886 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:28:48.145945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17698f07-ca36-4cda-964a-7352402fd53c tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886" status: 404 len: 111 microversion: 2.1 time: 0.085899 Jul 02 21:28:48.147289 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2635/5247] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:28:48 2022] GET /compute/v2.1/servers/11e0a8bf-edf5-4ae8-8385-739e7102a886 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:28:48.157572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0af5a8c5-8e3b-4470-9363-6cca8db6ede0 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] Calling method '.version_select at 0x7fabea2575e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:28:48.187167 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0af5a8c5-8e3b-4470-9363-6cca8db6ede0 tempest-ServersTestJSON-512481110 tempest-ServersTestJSON-512481110-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346829852" status: 202 len: 0 microversion: 2.1 time: 0.035110 Jul 02 21:28:48.188375 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2613/5248] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346829852 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:28:59.650038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:59.653967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:59.655251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:59.656622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:28:59.846385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-367158998", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": "none"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:28:59.960002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:28:59.960375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:28:59.960843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:28:59.961262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:28:59.961678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:28:59.993019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:00.000558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:00.001592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:00.002371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:00.048584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Getting quotas for project c1b4e97dcb6c4d7ba62d67b02cf3bfca. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:29:00.057327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Getting quotas for user e531117f50124183adfa6a09b5f2d0b7 and project c1b4e97dcb6c4d7ba62d67b02cf3bfca. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:29:00.073716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:29:00.082173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:29:00.149119 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9df0c7e9-6d63-4f57-bb87-79e85c38a42d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.508711 Jul 02 21:29:00.150513 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2636/5249] 10.222.0.43 () {62 vars in 1187 bytes} [Sat Jul 2 21:28:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 02 21:29:00.160789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a30f462-0513-480c-b023-05ee687b8252 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:00.161655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7a30f462-0513-480c-b023-05ee687b8252 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:00.198423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=27 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:00.212310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:00.315034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a30f462-0513-480c-b023-05ee687b8252 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:00.326594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a30f462-0513-480c-b023-05ee687b8252 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:00.329571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a30f462-0513-480c-b023-05ee687b8252 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:00.331227 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a30f462-0513-480c-b023-05ee687b8252 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1277 microversion: 2.57 time: 0.174762 Jul 02 21:29:00.345546 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2614/5250] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:00 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:01.350694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:01.351932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:01.361580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:01.362275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:01.363557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:01.364705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:01.443468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:01.452661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:01.454273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:01.455681 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b3de012-e981-4c19-9665-b60724be8f9a tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1329 microversion: 2.57 time: 0.109298 Jul 02 21:29:01.456798 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2637/5251] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:01 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:29:02.474981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:02.475544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:02.483403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:02.483892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:02.484700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:02.492281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:02.673853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:02.687928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:02.694687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:02.698213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f832b285-6957-4a93-98a1-25190d546c1d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1335 microversion: 2.57 time: 0.227218 Jul 02 21:29:02.700116 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2615/5252] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:02 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1335 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:03.720186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:03.721382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:03.732168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:03.733127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:03.734208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:03.734798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:03.875170 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:03.891885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:03.895561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:03.897124 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-173113cd-23dd-4883-97aa-75d8200cdb30 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1335 microversion: 2.57 time: 0.182275 Jul 02 21:29:03.897895 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2638/5253] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:03 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:04.919369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:04.920670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:04.942906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:04.944387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:04.945371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:04.948661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:05.445142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:05.480549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:05.483231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:05.484981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2987e7d0-1050-4d6c-947d-090650b4be32 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1356 microversion: 2.57 time: 0.570542 Jul 02 21:29:05.494264 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2616/5254] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:04 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1356 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:05.505609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:29:05.507179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:05.519809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:05.520303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:05.521104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:05.521546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:05.722633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:29:05.730977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:29:05.740084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:29:05.740688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:29:05.741302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:29:05.898676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:05.909557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:05.910868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:05.913702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:05.914162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:05.993604 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c07fe7ee-f911-4286-9d38-366bcb789524 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "POST /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655/action" status: 202 len: 1137 microversion: 2.57 time: 0.489244 Jul 02 21:29:06.004350 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2639/5255] 10.222.0.43 () {62 vars in 1319 bytes} [Sat Jul 2 21:29:05 2022] POST /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655/action => generated 1137 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 02 21:29:06.013829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:06.015230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:06.029659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:06.038105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:06.059081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:06.069035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:06.220426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:06.233872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:06.238315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:06.240432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e40a450-24e7-4f39-86a1-df626b65ff25 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.231994 Jul 02 21:29:06.249046 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2617/5256] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:06 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:06.567696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:06.569507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:06.580217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:06.580684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:06.582225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:06.582973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:06.610454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f41b36f3-e877-4a94-b593-122d5d2b4d66 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c/ips" status: 200 len: 146 microversion: 2.1 time: 0.048160 Jul 02 21:29:06.611485 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2640/5257] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:29:06 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c/ips => generated 146 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:29:07.266909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:07.267476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:07.281685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:07.282166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:07.282955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:07.283397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:07.386071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:07.398288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:07.399830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:07.401085 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d3b35f1-3d5d-4386-8422-84750c93bc80 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.138273 Jul 02 21:29:07.401783 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2618/5258] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:07 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:08.131759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:08.132391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:08.145337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:08.149066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:08.149896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:08.150336 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:08.185291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:29:08.304018 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-92c8003c-785a-4e1c-9f50-2dfa12cea3b9 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 204 len: 0 microversion: 2.1 time: 0.175834 Jul 02 21:29:08.305503 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2641/5259] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:29:08 2022] DELETE /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:29:08.314709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:08.315327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:08.332854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:08.333786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:08.334985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:08.336085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:08.420840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:08.422011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:08.431608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:08.432324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:08.434135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:08.435058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:08.581282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:08.614151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:08.630065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:08.632572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:08.642337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3c5d1f5-12be-4678-8946-08365738bf4b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.217473 Jul 02 21:29:08.643097 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-946eba0e-193c-4bb4-9ac5-47d1c70b6616 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1674 microversion: 2.1 time: 0.332764 Jul 02 21:29:08.644726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2619/5260] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:08 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1674 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:08.655060 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2642/5261] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:08 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:29:09.661753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:09.662391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:09.676262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:09.677191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:09.678252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:09.679856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:09.681120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:09.681744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:09.691454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:09.692265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:09.693279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:09.693919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:10.011328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:10.068004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:10.308669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:10.321316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:10.325763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:10.327595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:10.329190 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90ebfa1e-0d99-4cdd-9442-fcf61bcd33af tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.653566 Jul 02 21:29:10.341269 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2643/5262] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:09 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:10.492861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:10.505250 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ac07db9-555e-4c7d-9cfb-d6c74bc39010 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1674 microversion: 2.1 time: 0.847468 Jul 02 21:29:10.506221 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2620/5263] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:09 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1674 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:11.350576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:11.351192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:11.361830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:11.363492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:11.365284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:11.365867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:11.470140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:11.486288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:11.489683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:11.492468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b78702fd-4257-48fc-bfab-52b239465d1b tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.145602 Jul 02 21:29:11.493649 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2644/5264] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:11 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:11.526628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:11.527447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:11.542029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:11.544795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:11.546060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:11.546933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:11.657217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:11.688720 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44eee520-00e7-4644-9b0e-b48817f9fb85 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1606 microversion: 2.1 time: 0.168591 Jul 02 21:29:11.689870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2621/5265] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:11 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1606 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:12.042615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-047550aa-c788-49fd-a5af-0f529afa83bd req-272e2788-db09-4a5d-8f8f-2ee383860d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d29f974-6518-49ed-9bd2-11c33ba78d7c", "name": "network-vif-deleted", "tag": "9a73779c-758c-4d24-ab50-bb693ca4ed4f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:29:12.068826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-047550aa-c788-49fd-a5af-0f529afa83bd req-272e2788-db09-4a5d-8f8f-2ee383860d11 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:12.069281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-047550aa-c788-49fd-a5af-0f529afa83bd req-272e2788-db09-4a5d-8f8f-2ee383860d11 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:12.105766 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-047550aa-c788-49fd-a5af-0f529afa83bd req-272e2788-db09-4a5d-8f8f-2ee383860d11 service nova] Creating event network-vif-deleted:9a73779c-758c-4d24-ab50-bb693ca4ed4f for instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c on nch2-master-1 Jul 02 21:29:12.120828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-047550aa-c788-49fd-a5af-0f529afa83bd req-272e2788-db09-4a5d-8f8f-2ee383860d11 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083232 Jul 02 21:29:12.124364 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2645/5266] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:29:12.514309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:12.515779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:12.538475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:12.541994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:12.547586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:12.549905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:12.708965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:12.710281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:12.734019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:12.746471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:12.748534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:12.753198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:12.775820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:12.791916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:12.795306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:12.800654 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7983b26a-3d32-4d13-b732-3db28a4b6437 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.290859 Jul 02 21:29:12.803926 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2622/5267] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:12 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:12.828182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:12.830073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:12.830761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lazy-loading 'fault' on Instance uuid 2d29f974-6518-49ed-9bd2-11c33ba78d7c {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:29:12.886732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a90caf8a110549e39bbaf7ec50a6207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44ceefe86e694dc8a2c9a478eeb1d1c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:12.895669 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43c75552-15b2-4a8a-9368-54a499f94868 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 200 len: 1327 microversion: 2.1 time: 0.192957 Jul 02 21:29:12.896642 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2646/5268] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:12 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 1327 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:29:13.823508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:13.825424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:13.833478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:13.834265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:13.835435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:13.836090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:13.890612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:29:13.899462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:13.910398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:13.911610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:13.912680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:13.913467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:13.973228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:13.997305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-17408639-2630-432e-9401-501671c87d0e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action" status: 200 len: 24561 microversion: 2.1 time: 0.111814 Jul 02 21:29:13.997975 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2647/5269] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:29:13 2022] POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action => generated 24561 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 02 21:29:14.000788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:14.005964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:14.013739 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7b38a4d-d4cd-4140-b69f-a351d8dd705d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.197294 Jul 02 21:29:14.014656 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2623/5270] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:13 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:14.019226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:14.020260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:14.032840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:14.033498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:14.034468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:14.035092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:14.055807 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] HTTP exception thrown: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Request method failure captured: Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c HTTP/1.1 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa3kF1RbKEycaMXSjM7YhSbgQRkJ_dH_xg2HlbQUtEWyrK5HznoAcacUAwV31eIgz9iUvP6wc6vbw3mgaugf3SLWaom5MtjJJunpBQ-jeNLDxp1Vqt90z62Lgpjg5zT_7erl0H17w89t2Yhfk4BMyOwZ6ks7geq805mjBxGlLcfvwA Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44ceefe86e694dc8a2c9a478eeb1d1c5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}] Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: a90caf8a110549e39bbaf7ec50a6207d Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2d29f974-6518-49ed-9bd2-11c33ba78d7c'} Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:14.057463 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Returning 404 to user: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94be3565-0de7-42a6-8c75-1140924d0402 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 404 len: 111 microversion: 2.1 time: 0.056628 Jul 02 21:29:14.061470 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2648/5271] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:14 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:29:14.072188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2ac6759-f46d-4503-9968-f764c873ac94 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '.version_select at 0x7fabea257d30>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:14.094142 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2ac6759-f46d-4503-9968-f764c873ac94 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-476185947" status: 202 len: 0 microversion: 2.1 time: 0.025935 Jul 02 21:29:14.099974 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2624/5272] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-476185947 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:29:15.035251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:15.037239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:15.045297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:15.045791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:15.047043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:15.047975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:15.071447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:15.072574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:15.080323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:15.081351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:15.082834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:15.083492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:15.100834 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] HTTP exception thrown: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Request method failure captured: Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c HTTP/1.1 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa3kF1RbKEycaMXSjM7YhSbgQRkJ_dH_xg2HlbQUtEWyrK5HznoAcacUAwV31eIgz9iUvP6wc6vbw3mgaugf3SLWaom5MtjJJunpBQ-jeNLDxp1Vqt90z62Lgpjg5zT_7erl0H17w89t2Yhfk4BMyOwZ6ks7geq805mjBxGlLcfvwA Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44ceefe86e694dc8a2c9a478eeb1d1c5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}] Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a90caf8a110549e39bbaf7ec50a6207d Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '2d29f974-6518-49ed-9bd2-11c33ba78d7c'} Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:29:15.102664 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Returning 404 to user: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:29:15.107368 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f4717a0-29c5-4a33-93b5-935a0c32c5a8 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 404 len: 111 microversion: 2.1 time: 0.037176 Jul 02 21:29:15.108956 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2625/5273] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:29:15 2022] DELETE /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:29:15.113454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:15.114085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 2d29f974-6518-49ed-9bd2-11c33ba78d7c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:15.121789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:15.122254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:15.123070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:15.123514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:15.131874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:15.143260 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] HTTP exception thrown: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.143397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:15.145071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Request method failure captured: Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c HTTP/1.1 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa3kF1RbKEycaMXSjM7YhSbgQRkJ_dH_xg2HlbQUtEWyrK5HznoAcacUAwV31eIgz9iUvP6wc6vbw3mgaugf3SLWaom5MtjJJunpBQ-jeNLDxp1Vqt90z62Lgpjg5zT_7erl0H17w89t2Yhfk4BMyOwZ6ks7geq805mjBxGlLcfvwA Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44ceefe86e694dc8a2c9a478eeb1d1c5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}] Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a90caf8a110549e39bbaf7ec50a6207d Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '2d29f974-6518-49ed-9bd2-11c33ba78d7c'} Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:15.145505 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. Jul 02 21:29:15.149422 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:29:15.149839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-140afbe7-1763-48f8-a3df-445d60849811 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.116848 Jul 02 21:29:15.149927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Returning 404 to user: Instance 2d29f974-6518-49ed-9bd2-11c33ba78d7c could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:29:15.150011 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2649/5274] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:15 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:15.150087 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b0acf2b-a423-4041-9ce3-69fa49793cb7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c" status: 404 len: 111 microversion: 2.1 time: 0.038388 Jul 02 21:29:15.150087 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2626/5275] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:15 2022] GET /compute/v2.1/servers/2d29f974-6518-49ed-9bd2-11c33ba78d7c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:29:16.170061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:16.171017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:16.178748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:16.179210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:16.180147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:16.180748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:16.275268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:16.289919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:16.291997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:16.293721 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-18c1457d-9bdb-4c55-b3a4-804abc73660c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.127760 Jul 02 21:29:16.294578 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2650/5276] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:16 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:17.315163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:17.316453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:17.325199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:17.327494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:17.327494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:17.327494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:17.415487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:17.424573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:17.426233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:17.427526 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8c4d2741-bffc-4f00-b17a-240531fff764 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.118658 Jul 02 21:29:17.428220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2627/5277] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:17 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:18.447990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:18.448782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:18.457155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:18.457621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:18.458815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:18.459831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:18.465065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:18.540829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:18.549833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:18.551244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:18.552713 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d25e6ad-f186-4f68-9aae-27e5e7a377ab tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.109525 Jul 02 21:29:18.553708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2651/5278] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:18 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:19.571900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:19.573152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:19.581596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:19.582303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:19.583549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:19.584181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:19.669419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:19.680407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:19.681854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:19.683066 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f9971bb-9e4b-426b-8efd-a478ea5468aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.115082 Jul 02 21:29:19.683643 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2628/5279] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:19 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:20.702158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:20.702778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:20.710228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:20.710679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:20.711470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:20.711894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:20.779848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:20.788500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:20.790103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:20.791399 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae0869d1-c513-4499-b8e4-87478671df98 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.093333 Jul 02 21:29:20.792062 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2652/5280] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:20 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:21.810609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:21.811873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:21.819720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:21.820225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:21.821273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:21.821788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:21.887883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:21.896551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:21.898262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:21.899581 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd1099d4-b176-45db-a31e-18ff404168ca tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.093054 Jul 02 21:29:21.900369 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2629/5281] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:21 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:22.921291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:22.923094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:22.931515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:22.932286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:22.933136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:22.933737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:23.004544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:23.012883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:23.014381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:23.015616 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-741e55ba-d7e6-4ee0-a790-84a599b47aa1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.098343 Jul 02 21:29:23.016183 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2653/5282] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:22 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:24.037228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:24.037832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:24.049699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:24.050641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:24.051532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:24.052006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:24.130874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:24.140466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:24.142356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:24.143568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ce0c358-799e-40ce-95d3-f85437719ad1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.112897 Jul 02 21:29:24.153156 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2630/5283] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:24 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:25.163407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:25.164026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:25.171681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:25.172458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:25.173361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:25.173808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:25.241761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:25.250504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:25.252014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:25.253218 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f535ad83-c5dd-429d-9ed5-1db7e1e61383 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.093940 Jul 02 21:29:25.253789 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2654/5284] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:25 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:26.272617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:26.273242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:26.280556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:26.281182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:26.282144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:26.282679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:26.357168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:26.365750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:26.367308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:26.368528 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a90df10-f366-439b-875e-0342fa419601 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.100402 Jul 02 21:29:26.369102 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2631/5285] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:26 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:27.387179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:27.387789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:27.394939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:27.395421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:27.396183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:27.396790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:27.473239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:27.482494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:27.484137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:27.485280 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd8dbd99-d51f-49ba-a297-f634d4224a8c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.102475 Jul 02 21:29:27.486024 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2655/5286] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:27 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:28.505694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:28.507143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:28.519307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:28.523241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:28.524108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:28.524843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:28.604103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:28.612702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:28.614413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:28.615670 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a341f0e-6a0d-477d-baa7-ce051f139e37 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.114464 Jul 02 21:29:28.616281 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2632/5287] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:28 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:29.638125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:29.638830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:29.646341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:29.646945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:29.648232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:29.648893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:29.736312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:29.745513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:29.747126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:29.748764 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b26f48f4-bee8-40af-adbb-cc43ead441dc tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.115913 Jul 02 21:29:29.749174 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2656/5288] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:29 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:30.769607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:30.770242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:30.773252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:30.779151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:30.779610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:30.780423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:30.781013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:30.786148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:30.855090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:30.864426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:30.866156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:30.867345 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-53ff964e-b796-4b07-99a2-0104b2386ab0 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.103450 Jul 02 21:29:30.867953 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2633/5289] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:30 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:31.888884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:31.889527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:31.892591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:31.897662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:31.898629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:31.899414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:31.900343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:31.992600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:32.002490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:32.004264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:32.005438 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-beb12e7d-3bc1-4c99-b18b-272cbcf1cbb5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1365 microversion: 2.57 time: 0.120788 Jul 02 21:29:32.006006 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2657/5290] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:31 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:33.024821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:33.026242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:33.035011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:33.035879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:33.037028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:33.037827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:33.118980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:33.127666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:33.129352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:33.130558 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dbffe82e-e9e0-450b-9e74-2ff3feba3c5c tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1371 microversion: 2.57 time: 0.110190 Jul 02 21:29:33.136551 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2634/5291] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:33 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 02 21:29:34.150097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:34.150735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:34.158381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:34.158833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:34.159617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:34.166482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:34.269349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:34.278779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:34.280463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:34.281870 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-969554df-efc2-48d7-867f-c8a0906718aa tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1371 microversion: 2.57 time: 0.136775 Jul 02 21:29:34.282635 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2658/5292] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:34 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:35.300741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:35.301397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:35.309082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:35.309544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:35.310337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:35.310752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:35.390264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:35.401870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:35.404136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:35.405581 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b840bac7-4905-4021-a2c1-9fcb54231d06 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1371 microversion: 2.57 time: 0.108894 Jul 02 21:29:35.406890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2635/5293] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:35 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:36.424020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:36.424667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:36.434036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:36.434737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:36.435742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:36.436609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:36.509729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:36.519936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:36.521985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:36.523423 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0d3b303-233e-4a17-8615-a7ad49e6ade1 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1356 microversion: 2.57 time: 0.103602 Jul 02 21:29:36.524223 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2659/5294] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:36 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:36.546240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:36.546739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:36.554165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:36.554654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:36.555430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:36.555872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:36.582898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:29:36.663058 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1fa3e1db-d111-48e6-9e37-71d959337c0d tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "DELETE /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 204 len: 0 microversion: 2.57 time: 0.120814 Jul 02 21:29:36.663850 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2636/5295] 10.222.0.43 () {60 vars in 1279 bytes} [Sat Jul 2 21:29:36 2022] DELETE /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 02 21:29:36.672216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:36.672783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:36.679380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:36.679816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:36.680642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:36.681099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:36.776028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:36.785882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:36.787410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:36.789008 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c713ed60-ded0-46d2-892b-26684b4e0d7f tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1362 microversion: 2.57 time: 0.120857 Jul 02 21:29:36.789591 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2660/5296] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:36 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1362 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:37.808985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:37.809897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:37.817106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:37.817622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:37.818396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:37.818833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:37.890169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:37.898848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:37.900401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e531117f50124183adfa6a09b5f2d0b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b4e97dcb6c4d7ba62d67b02cf3bfca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:37.901885 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-95ee9069-fc07-4e33-83b8-926b25d838b5 tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 200 len: 1362 microversion: 2.57 time: 0.098728 Jul 02 21:29:37.902682 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2637/5297] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:37 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 1362 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 02 21:29:38.920995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:38.922368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] [instance: aed9b3e6-c798-441e-8e17-9a19f8f72655] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:38.929647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:38.930179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:38.931185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:38.931848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:38.948191 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] HTTP exception thrown: Instance aed9b3e6-c798-441e-8e17-9a19f8f72655 could not be found. Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Request method failure captured: Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 HTTP/1.1 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLibgLacQqEJ6yianFI1l2y3pNOZwLW-o7yJFZafp3eYaTt-xEMy_8MY3Qf_3OUP-Tx9Bl0_HRr_ma1sr94kK3r0yYFAVFtPcoBaaBqpXw1mpLkeHl2nyspPjx0d-R8PuHR9_u9rtXBEWcFpDyXHTgTA2DiMwTvx7moYUGv7_-1bcyg Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Openstack-Nova-Api-Version: 2.57 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: c1b4e97dcb6c4d7ba62d67b02cf3bfca Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerShowV257Test-301789394 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c1b4e97dcb6c4d7ba62d67b02cf3bfca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c1b4e97dcb6c4d7ba62d67b02cf3bfca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c1b4e97dcb6c4d7ba62d67b02cf3bfca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c1b4e97dcb6c4d7ba62d67b02cf3bfca"}]}] Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerShowV257Test-301789394 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: c1b4e97dcb6c4d7ba62d67b02cf3bfca Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerShowV257Test-301789394 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerShowV257Test-301789394-project Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: e531117f50124183adfa6a09b5f2d0b7 Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerShowV257Test-301789394-project Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance aed9b3e6-c798-441e-8e17-9a19f8f72655 could not be found. Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'aed9b3e6-c798-441e-8e17-9a19f8f72655'} Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aed9b3e6-c798-441e-8e17-9a19f8f72655 could not be found. Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aed9b3e6-c798-441e-8e17-9a19f8f72655 could not be found. Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:29:38.950075 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aed9b3e6-c798-441e-8e17-9a19f8f72655 could not be found. Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] Returning 404 to user: Instance aed9b3e6-c798-441e-8e17-9a19f8f72655 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb1d2f1b-8ffc-4dfd-84ab-ffd4860e962e tempest-ServerShowV257Test-301789394 tempest-ServerShowV257Test-301789394-project] 10.222.0.43 "GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655" status: 404 len: 111 microversion: 2.57 time: 0.035635 Jul 02 21:29:38.954433 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2661/5298] 10.222.0.43 () {60 vars in 1276 bytes} [Sat Jul 2 21:29:38 2022] GET /compute/v2.1/servers/aed9b3e6-c798-441e-8e17-9a19f8f72655 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:29:44.460484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:44.461253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:44.469638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:44.470121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:44.470990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:44.471508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:44.741874 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5c58a634-3640-43c8-adcb-b49caebda39f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1831 microversion: 2.1 time: 0.285927 Jul 02 21:29:44.755598 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2638/5299] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:44 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1831 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:44.760579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:44.762361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:44.773307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:44.773760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:44.774542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:44.774979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:44.943421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:44.952581 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d615495b-2872-4b83-9ef1-98bdbb6dcbda tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1680 microversion: 2.1 time: 0.195616 Jul 02 21:29:44.953524 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2662/5300] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:44 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:29:45.063868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:29:45.065373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:45.108724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:45.111035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:45.111935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:45.114079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:45.201037 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-317726eb-ec54-4601-a410-f55340fa9dd9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action" status: 200 len: 32638 microversion: 2.1 time: 0.141008 Jul 02 21:29:45.202937 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2639/5301] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:29:45 2022] POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action => generated 32638 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:29:45.413272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:29:45.413869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:45.420583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:45.421120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:45.421901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:45.422338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:45.623852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '50d182d4b3f9416fb6d8e44c841dfc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f5801df264467ab9c057b023a72caa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:45.623852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 9539da5d-964a-4632-9043-c3b504041d18] flavor_id is None. Assuming migration. {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 02 21:29:45.623852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:29:45.874324 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3abc688e-b41d-4097-ad02-9f2623004db9 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action" status: 202 len: 0 microversion: 2.1 time: 0.465387 Jul 02 21:29:45.874944 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2663/5302] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:29:45 2022] POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:29:45.884485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:45.885376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:45.894907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:45.895556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:45.896766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:45.897406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:46.062067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:46.070426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-29fa68ad-22e9-47c0-9724-397855a1d513 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1689 microversion: 2.1 time: 0.190880 Jul 02 21:29:46.071066 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2640/5303] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:45 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:47.092291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:47.093460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:47.103197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:47.103951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:47.105003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:47.105597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:47.268622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:47.277885 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-272f1480-9483-4072-93c3-bfe53e8959cb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1689 microversion: 2.1 time: 0.192554 Jul 02 21:29:47.278479 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2664/5304] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:47 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1689 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:29:48.295612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:48.296533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:48.306538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:48.308728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:48.319371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:48.319848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:48.575446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:48.586369 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fb593e7-1792-4214-8053-7de945760b01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1689 microversion: 2.1 time: 0.294798 Jul 02 21:29:48.586972 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2641/5305] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:48 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1689 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:29:49.604485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:49.605240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:49.613403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:49.613861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:49.614654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:49.615377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:49.620116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:29:49.768143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:49.775911 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4b5bdc46-c347-4818-be7b-3af3d4191e88 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.175774 Jul 02 21:29:49.776525 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2665/5306] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:49 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:50.796002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:50.800201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:50.808923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:50.809257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:50.810220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:50.810666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:50.964120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:50.973364 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9cfe3cd2-f43e-4b78-b52c-f835f18afdba tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.183196 Jul 02 21:29:50.983354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2642/5307] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:50 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:51.991723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:51.992390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:51.999809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:52.000304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:52.001094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:52.001533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:52.149346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:52.157310 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7d747fe-56b0-40ab-b4ae-864f884aba3d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.170397 Jul 02 21:29:52.167063 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2666/5308] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:51 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:53.174505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:53.175160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:53.183304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:53.183763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:53.184578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:53.185019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:53.329483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:53.337962 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0adb58af-84ec-4d41-aeeb-aa1837bb00ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.167556 Jul 02 21:29:53.338526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2643/5309] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:53 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:54.356713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:54.357580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:54.365020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:54.365881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:54.366785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:54.367337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:54.519827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:54.527508 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b948c336-53fb-452d-904e-066436f675cd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.176763 Jul 02 21:29:54.528201 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2667/5310] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:54 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:55.544483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:55.545861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:55.553888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:55.554331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:55.555169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:55.555828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:55.710707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:55.721348 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54d01c90-541d-457c-92e8-9dc2dfb77fc1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.180300 Jul 02 21:29:55.722170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2644/5311] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:55 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:56.739644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:56.740293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:56.747656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:56.748453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:56.749252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:56.749693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:57.014958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:57.027523 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48940ea1-939c-4033-9f49-226b53c4d2ed tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.292406 Jul 02 21:29:57.040176 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2668/5312] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:56 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:58.045126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:58.046448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:58.061288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:58.063200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:58.064854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:58.065571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:58.255431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:58.266424 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2505bb0-47ea-490c-b59b-606a9b1d4bee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.225563 Jul 02 21:29:58.276515 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2645/5313] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:58 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:29:59.282951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:29:59.283580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:29:59.293536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:59.294015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:59.294827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:29:59.295437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:29:59.436160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:29:59.443798 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-664505ee-5c77-4056-886d-329922d0172a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.164884 Jul 02 21:29:59.444409 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2669/5314] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:29:59 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:00.461008 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:00.461654 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:00.469163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:00.469642 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:00.470418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:00.470857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:00.610803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:00.618703 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f189f71d-39fd-49aa-ab36-2254eb48a198 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.161726 Jul 02 21:30:00.619288 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2646/5315] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:00 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:01.636567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:01.637197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:01.644775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:01.645233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:01.646025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:01.646468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:01.794865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:01.802898 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c40ef2e6-3cff-4eef-99e2-c8a9f1ceea69 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.170464 Jul 02 21:30:01.803775 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2670/5316] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:01 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:30:02.820859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:02.821516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:02.825499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:02.831190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:02.831651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:02.832504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:02.832942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:02.837840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:02.972481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:02.980352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45da8f9d-0351-4244-a9dc-084fd4eb236f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.163468 Jul 02 21:30:02.980923 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2647/5317] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:02 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:03.997963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:03.998567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:04.001715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=30 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:04.008228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:04.008684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:04.009827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:04.010271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:04.165141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:04.173060 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-806be78d-4b5c-47ca-9e8d-8fb8e0e11df9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.179186 Jul 02 21:30:04.173642 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2671/5318] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:03 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:05.191301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:05.191937 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:05.199337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:05.199800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:05.200629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:05.201078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:05.353250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:05.362712 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-081cdd9d-c8f8-4a1f-adbb-143e9ec53726 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1694 microversion: 2.1 time: 0.175430 Jul 02 21:30:05.363324 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2648/5319] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:05 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:06.380968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:06.381593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:06.388780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:06.389238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:06.390013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:06.390460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:06.599938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2135899d-e10c-45a2-a644-1057f825d28f req-6db11679-e8f7-4e7c-b099-31e42a981ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "name": "network-vif-unplugged", "status": "completed", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:06.609339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2135899d-e10c-45a2-a644-1057f825d28f req-6db11679-e8f7-4e7c-b099-31e42a981ec3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:06.609832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2135899d-e10c-45a2-a644-1057f825d28f req-6db11679-e8f7-4e7c-b099-31e42a981ec3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:06.622454 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2135899d-e10c-45a2-a644-1057f825d28f req-6db11679-e8f7-4e7c-b099-31e42a981ec3 service nova] Creating event network-vif-unplugged:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch2-master-1 Jul 02 21:30:06.628497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-2135899d-e10c-45a2-a644-1057f825d28f req-6db11679-e8f7-4e7c-b099-31e42a981ec3 service nova] Instance 9539da5d-964a-4632-9043-c3b504041d18 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:30:06.640985 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2135899d-e10c-45a2-a644-1057f825d28f req-6db11679-e8f7-4e7c-b099-31e42a981ec3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045141 Jul 02 21:30:06.641816 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2649/5320] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:30:06.656402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:06.665829 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9d2fdad5-31ba-44a0-b8fc-f15120eafbdd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1693 microversion: 2.1 time: 0.288869 Jul 02 21:30:06.666527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2672/5321] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:06 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1693 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:07.686094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:07.687702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:07.694615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:07.695086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:07.695878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:07.696357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:08.132892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:08.140805 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c53518a-6044-4b1e-a999-cbe921f25953 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1693 microversion: 2.1 time: 0.460846 Jul 02 21:30:08.141435 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2650/5322] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:07 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1693 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:30:08.666661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ea61bd5b-0707-487f-a7ce-34d4f005ef86 req-78bc7d01-a68f-465f-ad7c-700afc979bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:08.677663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ea61bd5b-0707-487f-a7ce-34d4f005ef86 req-78bc7d01-a68f-465f-ad7c-700afc979bf6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:08.678139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ea61bd5b-0707-487f-a7ce-34d4f005ef86 req-78bc7d01-a68f-465f-ad7c-700afc979bf6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:08.691084 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ea61bd5b-0707-487f-a7ce-34d4f005ef86 req-78bc7d01-a68f-465f-ad7c-700afc979bf6 service nova] Creating event network-changed:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch2-master-1 Jul 02 21:30:08.697032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-ea61bd5b-0707-487f-a7ce-34d4f005ef86 req-78bc7d01-a68f-465f-ad7c-700afc979bf6 service nova] Instance 9539da5d-964a-4632-9043-c3b504041d18 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:30:08.709871 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ea61bd5b-0707-487f-a7ce-34d4f005ef86 req-78bc7d01-a68f-465f-ad7c-700afc979bf6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048647 Jul 02 21:30:08.711840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2673/5323] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:30:09.158279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:09.158905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:09.165945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:09.166644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:09.167889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:09.168517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:09.476361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:09.485266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-630a3a4a-18ea-44cb-a718-c092693dd232 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1691 microversion: 2.1 time: 0.331186 Jul 02 21:30:09.485823 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2651/5324] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:09 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1691 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:10.507632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:10.509064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:10.516538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:10.517075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:10.517956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:10.518456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:10.786347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:10.794723 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96ff3b64-061c-4403-b3ce-53c0644cba4f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1691 microversion: 2.1 time: 0.294174 Jul 02 21:30:10.796064 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2674/5325] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:10 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:11.817921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:11.818458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:11.826891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:11.827461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:11.828380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:11.828826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:12.098742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:12.107243 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd562cd6-2128-4030-94ae-277d367e8e73 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1688 microversion: 2.1 time: 0.293455 Jul 02 21:30:12.107935 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2652/5326] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:11 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1688 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:12.124441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:12.124996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:12.132102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:12.132528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:12.133287 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:12.133736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:12.192336 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3dd4fe1-e3d9-43e8-93e5-601711370d8c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action" status: 204 len: 0 microversion: 2.1 time: 0.071921 Jul 02 21:30:12.196131 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2675/5327] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:30:12 2022] POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:30:12.201480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:12.202189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:12.208901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:12.210007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:12.211109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:12.211630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:12.820382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:12.830002 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3cca62ff-bbb2-4a1c-8394-454d95e1ae2e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1688 microversion: 2.1 time: 0.632357 Jul 02 21:30:12.830875 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2653/5328] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:12 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1688 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:13.180963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a634f51f-87b3-4ba0-a39a-e1a4cc8e855c req-8bfcd7ba-7157-45bc-a303-9049d0067525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "name": "network-vif-plugged", "status": "completed", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:13.195853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a634f51f-87b3-4ba0-a39a-e1a4cc8e855c req-8bfcd7ba-7157-45bc-a303-9049d0067525 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:13.197470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a634f51f-87b3-4ba0-a39a-e1a4cc8e855c req-8bfcd7ba-7157-45bc-a303-9049d0067525 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:13.213842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a634f51f-87b3-4ba0-a39a-e1a4cc8e855c req-8bfcd7ba-7157-45bc-a303-9049d0067525 service nova] Creating event network-vif-plugged:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch2-master-1 Jul 02 21:30:13.220096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-a634f51f-87b3-4ba0-a39a-e1a4cc8e855c req-8bfcd7ba-7157-45bc-a303-9049d0067525 service nova] Instance 9539da5d-964a-4632-9043-c3b504041d18 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:30:13.231004 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a634f51f-87b3-4ba0-a39a-e1a4cc8e855c req-8bfcd7ba-7157-45bc-a303-9049d0067525 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055343 Jul 02 21:30:13.231947 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2676/5329] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:30:13.849375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:13.849995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:13.860465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:13.861014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:13.861867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:13.862382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:14.028543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:14.038291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-927e96c5-b9b7-425e-bb3e-88e12f400e3a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1680 microversion: 2.1 time: 0.193024 Jul 02 21:30:14.038965 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2654/5330] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:13 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:38.563461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=11 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:38.564984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:38.569313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:38.570362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:38.577944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:38.578395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:38.579165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:38.579599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:38.631897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-224c2797-f15a-466c-ba6e-d208708b3e87 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action" status: 200 len: 24574 microversion: 2.1 time: 0.070423 Jul 02 21:30:38.632747 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2677/5331] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:30:38 2022] POST /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18/action => generated 24574 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:30:44.842901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:44.844671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:44.847431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=15 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:44.848648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=45 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:30:44.859416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:44.861927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:44.869615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:44.870114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:45.032887 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b2de916-5914-4022-b64d-a9268145248d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1831 microversion: 2.1 time: 0.195170 Jul 02 21:30:45.033651 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2655/5332] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:44 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1831 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:47.374311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:47.374934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:47.386524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:47.390541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f9718921-ae36-41d7-aa32-66bfbb89d781 req-3edec10b-7e84-459d-9e8c-7d73e47b20f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:47.395373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:47.396412 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:47.398462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:47.410522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f9718921-ae36-41d7-aa32-66bfbb89d781 req-3edec10b-7e84-459d-9e8c-7d73e47b20f9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:47.414511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f9718921-ae36-41d7-aa32-66bfbb89d781 req-3edec10b-7e84-459d-9e8c-7d73e47b20f9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:47.438423 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f9718921-ae36-41d7-aa32-66bfbb89d781 req-3edec10b-7e84-459d-9e8c-7d73e47b20f9 service nova] Creating event network-changed:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch2-master-1 Jul 02 21:30:47.445990 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f9718921-ae36-41d7-aa32-66bfbb89d781 req-3edec10b-7e84-459d-9e8c-7d73e47b20f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067556 Jul 02 21:30:47.447292 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2656/5333] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:30:47.452141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:30:47.633158 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70b3a7fc-c776-4655-86a8-b2d76e4b26b5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 204 len: 0 microversion: 2.1 time: 0.269880 Jul 02 21:30:47.634373 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2678/5334] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:30:47 2022] DELETE /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:30:47.644807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:47.645599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:47.655450 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:47.655683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:47.680490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:47.681804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:48.195066 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:48.223531 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-993b7c93-88db-48a0-8b32-344109d5a7ca tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1686 microversion: 2.1 time: 0.583929 Jul 02 21:30:48.240459 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2657/5335] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:47 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1686 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:49.246135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:49.248568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:49.265862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:49.268825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:49.270664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:49.271116 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:50.029578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-fd159236-0755-4283-8e2e-0c24fbdfecc6 req-30153b71-4ee4-47b0-a158-490505a0656f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9539da5d-964a-4632-9043-c3b504041d18", "name": "network-vif-deleted", "tag": "a31e1dbb-dc6b-4039-94b1-27cf061d4f14"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:50.053126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fd159236-0755-4283-8e2e-0c24fbdfecc6 req-30153b71-4ee4-47b0-a158-490505a0656f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:50.053946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fd159236-0755-4283-8e2e-0c24fbdfecc6 req-30153b71-4ee4-47b0-a158-490505a0656f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:50.069577 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-fd159236-0755-4283-8e2e-0c24fbdfecc6 req-30153b71-4ee4-47b0-a158-490505a0656f service nova] Creating event network-vif-deleted:a31e1dbb-dc6b-4039-94b1-27cf061d4f14 for instance 9539da5d-964a-4632-9043-c3b504041d18 on nch2-master-1 Jul 02 21:30:50.081970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-fd159236-0755-4283-8e2e-0c24fbdfecc6 req-30153b71-4ee4-47b0-a158-490505a0656f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055321 Jul 02 21:30:50.081970 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2658/5336] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:30:50.231670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:30:50.250892 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a453df2-9654-4757-8e19-bfc3dff1159a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 200 len: 1686 microversion: 2.1 time: 1.006725 Jul 02 21:30:50.256403 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2679/5337] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:49 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 1686 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:30:50.765649 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:30:50.765649 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:30:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:30:51.269799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:51.270699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 9539da5d-964a-4632-9043-c3b504041d18] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:30:51.279299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:51.280172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:51.281381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:30:51.282154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:30:51.299547 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] HTTP exception thrown: Instance 9539da5d-964a-4632-9043-c3b504041d18 could not be found. Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Request method failure captured: Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 HTTP/1.1 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLhkw9i0xORUg4JVijXvZ-4U1BZ1T3vJ_VfTmMqg_N2dqNUc88WBpxoj4nsbYgkfhphBvdR9ozDzk0JXzIa-QWkcPzjljVDoEVJzvK_enf0dUIxCZyWpC0p_rfy-XLmvh2U3mqnGIHAd7Qjj6CF51pfpap30_IBFcdgnFVbhTJ_4joo Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1b2fbfc815c48588a0bec36818df1a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1b2fbfc815c48588a0bec36818df1a3"}]}] Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 317a63cdd16b4fd69617fb9de95dc4ec Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9539da5d-964a-4632-9043-c3b504041d18 could not be found. Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9539da5d-964a-4632-9043-c3b504041d18'} Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9539da5d-964a-4632-9043-c3b504041d18 could not be found. Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9539da5d-964a-4632-9043-c3b504041d18 could not be found. Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:30:51.302171 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9539da5d-964a-4632-9043-c3b504041d18 could not be found. Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Returning 404 to user: Instance 9539da5d-964a-4632-9043-c3b504041d18 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:30:51.307269 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ccbaa810-275d-4dd5-b7fb-6bf723d41129 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18" status: 404 len: 111 microversion: 2.1 time: 0.041308 Jul 02 21:30:51.308354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2659/5338] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:30:51 2022] GET /compute/v2.1/servers/9539da5d-964a-4632-9043-c3b504041d18 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:30:56.165040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-43d89416-b7bc-49c9-bd12-b6d1c43db135 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '.version_select at 0x7fabe491a8b0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:30:56.195336 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-43d89416-b7bc-49c9-bd12-b6d1c43db135 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-804248385" status: 202 len: 0 microversion: 2.1 time: 0.032995 Jul 02 21:30:56.196652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2680/5339] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 21:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-804248385 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:30:56.235404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-236b90cf-755a-46ff-91fd-270c5d327b67 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: .version_select at 0x7fabd7ea6e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-915098605", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTuEV3PM3bHcr+GGMF7Q149loN0HspwcssEL5XcY6X7BMT7u5S7/yfZyohu5y4t94/iv5GL3CpH0ER86+HJj1g+2RuDU6RdgUObRCPM7ZifXm9As2wAJY4LQX1RROXiBA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:30:56.252769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-236b90cf-755a-46ff-91fd-270c5d327b67 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:30:56.258452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-236b90cf-755a-46ff-91fd-270c5d327b67 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:30:56.290651 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-236b90cf-755a-46ff-91fd-270c5d327b67 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.059421 Jul 02 21:30:56.296392 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2660/5340] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:30:56 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:31:03.636327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1939426776", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "6adcb0ea-fcea-4c77-900b-7c424fb3eec2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-915098605", "security_groups": [{"name": "tempest-secgroup-smoke-1421171625"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:03.657859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:04.144394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] validate_networks() for [('6adcb0ea-fcea-4c77-900b-7c424fb3eec2', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:31:05.272921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:31:05.274314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:31:05.274967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:31:05.276245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:31:05.277051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:31:05.288410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:05.288870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:05.289688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:05.290176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:05.327139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:31:05.333533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:31:05.352956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:31:05.355830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:31:05.429003 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-716ca21b-034d-4a22-94ae-4464b680127d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.796969 Jul 02 21:31:05.434581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2681/5341] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:31:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:31:05.441108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-22564b48-74f6-4b7a-b4bc-dfd8ca7b2756 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:05.442320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-22564b48-74f6-4b7a-b4bc-dfd8ca7b2756 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:05.449380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=18 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:05.584806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-22564b48-74f6-4b7a-b4bc-dfd8ca7b2756 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:05.597764 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-22564b48-74f6-4b7a-b4bc-dfd8ca7b2756 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1266 microversion: 2.1 time: 0.160290 Jul 02 21:31:05.608350 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2661/5342] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:05 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:06.615727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a569108-8714-4022-9ea3-5d78de1b583b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:06.616629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a569108-8714-4022-9ea3-5d78de1b583b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:06.682490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a569108-8714-4022-9ea3-5d78de1b583b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:06.689621 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a569108-8714-4022-9ea3-5d78de1b583b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1266 microversion: 2.1 time: 0.078613 Jul 02 21:31:06.690805 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2682/5343] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:06 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:07.707050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:07.707678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:07.715535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:07.715996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:07.717062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:07.717515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:07.783036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:07.791685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-44329050-9f4c-4653-8196-36f296b9bc2d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1318 microversion: 2.1 time: 0.088688 Jul 02 21:31:07.792800 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2662/5344] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:07 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1318 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:08.812791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:08.813602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:08.823318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:08.825368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:08.826060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:08.827366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:08.827965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:09.061717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:09.069515 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70758ac0-c916-46f0-85c7-fd9d26615c82 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.264302 Jul 02 21:31:09.070134 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2683/5345] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:08 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:09.854046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c46f94c5-04a3-47fc-b36d-08fa37fd84e8 req-7dda9240-d887-489c-b8bb-a47e4711dd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:09.869439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c46f94c5-04a3-47fc-b36d-08fa37fd84e8 req-7dda9240-d887-489c-b8bb-a47e4711dd4f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:09.870128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c46f94c5-04a3-47fc-b36d-08fa37fd84e8 req-7dda9240-d887-489c-b8bb-a47e4711dd4f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:09.892874 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c46f94c5-04a3-47fc-b36d-08fa37fd84e8 req-7dda9240-d887-489c-b8bb-a47e4711dd4f service nova] Creating event network-changed:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:31:09.900059 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c46f94c5-04a3-47fc-b36d-08fa37fd84e8 req-7dda9240-d887-489c-b8bb-a47e4711dd4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051835 Jul 02 21:31:09.905389 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2663/5346] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:31:10.089689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:10.090313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:10.099207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:10.099885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:10.100946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:10.101492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:10.336702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:10.344943 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9cfff1f2-51d6-4cbe-93e5-5d71816e7865 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.259497 Jul 02 21:31:10.345597 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2684/5347] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:10 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:11.362862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:11.363591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:11.372062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:11.372598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:11.373575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:11.374126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:11.659434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:11.670393 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d638481a-3de0-4281-9065-65c2ddd10f19 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.311254 Jul 02 21:31:11.670998 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2664/5348] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:11 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:12.687093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:12.687835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:12.694852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:12.695307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:12.696121 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:12.696564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:12.859028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:12.867050 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e7ec7544-2e5f-4dd6-9aa7-f0a3233f164f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.184160 Jul 02 21:31:12.867733 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2685/5349] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:12 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:13.885594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:13.886859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:13.897099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:13.898108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:13.899291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:13.899904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:14.054997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:14.062748 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5e985ed-0bbb-42e7-92c5-7377da0b981d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.181792 Jul 02 21:31:14.063371 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2665/5350] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:13 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:15.079588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:15.080368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:15.088302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:15.088781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:15.089891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:15.090740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:15.231315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:15.239554 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-893695d4-917f-4fa7-b58a-5aa2972b658e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.164161 Jul 02 21:31:15.252321 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2686/5351] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:15 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:15.507316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-396b7c58-1de2-4bb0-9556-d47ff649d273 req-3dbaaddb-1f40-4b3b-8355-6ca54d4ad084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "name": "network-vif-plugged", "status": "completed", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:15.514696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:15.519332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-396b7c58-1de2-4bb0-9556-d47ff649d273 req-3dbaaddb-1f40-4b3b-8355-6ca54d4ad084 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:15.519789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-396b7c58-1de2-4bb0-9556-d47ff649d273 req-3dbaaddb-1f40-4b3b-8355-6ca54d4ad084 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:15.532187 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-396b7c58-1de2-4bb0-9556-d47ff649d273 req-3dbaaddb-1f40-4b3b-8355-6ca54d4ad084 service nova] Creating event network-vif-plugged:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:31:15.537501 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-396b7c58-1de2-4bb0-9556-d47ff649d273 req-3dbaaddb-1f40-4b3b-8355-6ca54d4ad084 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035540 Jul 02 21:31:15.538119 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2666/5352] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:31:16.256785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:16.257403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:16.259349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:16.266986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:16.267651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:16.268735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:16.269245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:16.496083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:16.503880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d4df980-3027-4c8a-9e7a-dcd596da5f84 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1392 microversion: 2.1 time: 0.251085 Jul 02 21:31:16.504530 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2687/5353] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:16 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1392 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:17.518388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:17.524671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:17.525377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:17.533365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:17.533898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:17.534780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:17.535263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:17.749152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:17.766672 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e46e39c5-aa23-4264-80fe-9d3f71323668 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1564 microversion: 2.1 time: 0.249383 Jul 02 21:31:17.768022 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2667/5354] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:17 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1564 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:31:17.785806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:17.786443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:17.792291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:17.806413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:17.807400 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:17.808652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:17.809105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:17.951421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:17.960788 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5f98ded-9353-42f4-b1ce-4bab4bddb1cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1564 microversion: 2.1 time: 0.179353 Jul 02 21:31:17.961590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2688/5355] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:17 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:20.180522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:20.181145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:20.191762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6ab955c4-bb0d-4fe2-ada8-ab205c4d6091 req-7871ba86-b46f-4ef8-a5e2-f0f7196d1dcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:20.201243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:20.201703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:20.202514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:20.202957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:20.211359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ab955c4-bb0d-4fe2-ada8-ab205c4d6091 req-7871ba86-b46f-4ef8-a5e2-f0f7196d1dcc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:20.212124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ab955c4-bb0d-4fe2-ada8-ab205c4d6091 req-7871ba86-b46f-4ef8-a5e2-f0f7196d1dcc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:20.235067 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6ab955c4-bb0d-4fe2-ada8-ab205c4d6091 req-7871ba86-b46f-4ef8-a5e2-f0f7196d1dcc service nova] Creating event network-changed:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:31:20.243777 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6ab955c4-bb0d-4fe2-ada8-ab205c4d6091 req-7871ba86-b46f-4ef8-a5e2-f0f7196d1dcc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056216 Jul 02 21:31:20.244687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2689/5356] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:31:20.492019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:20.500264 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c4156de5-d835-4f9d-91c7-c7ee513681ff tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1564 microversion: 2.1 time: 0.323941 Jul 02 21:31:20.513295 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2668/5357] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:20 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1564 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:37.049374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:37.050152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=40 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:37.171604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1662130076", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "5034f6a7-c9e1-40c8-a895-bffa33a41d7a"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:37.239837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] validate_networks() for [('5034f6a7-c9e1-40c8-a895-bffa33a41d7a', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:31:37.599781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:31:37.600465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:31:37.601318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:31:37.601871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:31:37.602523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:31:37.616736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:37.617371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:37.618582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:37.619214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:37.638195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Getting quotas for project 6cb4e38dc4144c839e51ae6332b9ae68. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:31:37.643973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Getting quotas for user 703991a781474b48a1bfe5dca0fac66f and project 6cb4e38dc4144c839e51ae6332b9ae68. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:31:37.657590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:31:37.659971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:31:37.717439 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4f87560-99ee-41c1-b731-3ca3f5d89791 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669948 Jul 02 21:31:37.718278 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2690/5358] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:31:37.728694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-235d6821-730b-4329-bbb6-66e72e2f7a38 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:37.729269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-235d6821-730b-4329-bbb6-66e72e2f7a38 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:37.731349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=5 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:37.732001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=34 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:37.790833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-235d6821-730b-4329-bbb6-66e72e2f7a38 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:37.801542 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-235d6821-730b-4329-bbb6-66e72e2f7a38 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1214 microversion: 2.1 time: 0.073777 Jul 02 21:31:37.801542 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2669/5359] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:37 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:31:38.816152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:38.816734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:38.823876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:38.824590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:38.825613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:38.826022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:38.894320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:38.905436 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-387d14f4-c5bc-4364-803f-1c6b394350a5 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1266 microversion: 2.1 time: 0.094219 Jul 02 21:31:38.906521 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2691/5360] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:38 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:39.923468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:39.924199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:39.933674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:39.934245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:39.935122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:39.935684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:40.076684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:40.085289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b2de5360-64c0-442a-9f71-de36d692beea tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.166183 Jul 02 21:31:40.085902 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2670/5361] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:39 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:40.626620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8178293f-eab7-4480-9fbb-2f72739c1dc4 req-aa742904-cfce-4a1d-b6ee-6d676298d071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6305886-6f36-4de0-958d-a7adb9a0972c", "tag": "14c29ebe-94fc-4642-888f-91357d653e52"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:40.637194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8178293f-eab7-4480-9fbb-2f72739c1dc4 req-aa742904-cfce-4a1d-b6ee-6d676298d071 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:40.637641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8178293f-eab7-4480-9fbb-2f72739c1dc4 req-aa742904-cfce-4a1d-b6ee-6d676298d071 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:40.651234 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8178293f-eab7-4480-9fbb-2f72739c1dc4 req-aa742904-cfce-4a1d-b6ee-6d676298d071 service nova] Creating event network-changed:14c29ebe-94fc-4642-888f-91357d653e52 for instance b6305886-6f36-4de0-958d-a7adb9a0972c on nch1-master-1 Jul 02 21:31:40.656511 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8178293f-eab7-4480-9fbb-2f72739c1dc4 req-aa742904-cfce-4a1d-b6ee-6d676298d071 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033682 Jul 02 21:31:40.657130 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2692/5362] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:31:41.102820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:41.103457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:41.111432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:41.111896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:41.112724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:41.113175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:41.251746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:41.265032 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d519971f-6bd7-4a2a-b955-7c1d136eb3a6 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.165942 Jul 02 21:31:41.266042 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2671/5363] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:41 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:42.284544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:42.285242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:42.292239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:42.292685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:42.293467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:42.293901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:42.440792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:42.453071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1109b590-8532-452c-91ec-07883320c3f4 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.173709 Jul 02 21:31:42.453661 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2693/5364] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:42 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:43.475401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:43.476019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:43.483375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:43.483821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:43.484712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:43.485171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:43.619854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:43.629489 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-98647d60-9267-4e79-bba2-a23595f99a75 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.158161 Jul 02 21:31:43.630033 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2672/5365] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:43 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:43.850953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:43.851928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:43.859389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:43.859841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:43.860655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:43.861096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:43.914237 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0a39fb1-29a5-499e-84fd-e78364c7337e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action" status: 200 len: 24575 microversion: 2.1 time: 0.067246 Jul 02 21:31:43.915103 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2694/5366] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:31:43 2022] POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action => generated 24575 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:31:44.649467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:44.650206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:44.659383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:44.659842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:44.660660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:44.661104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:44.797991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:44.810891 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-42fbd941-5600-4f62-bfd9-0915a8e63d1a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.167103 Jul 02 21:31:44.811708 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2673/5367] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:44 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:45.838290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:45.839277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:45.848630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:45.849074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:45.849856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:45.850291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:45.985111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:45.993205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94ec1c34-f902-4298-9db7-a4137e5fd375 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.162230 Jul 02 21:31:45.993767 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2695/5368] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:45 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:47.010184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:47.010874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:47.017982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:47.018446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:47.019229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:47.019671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:47.142443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-60a38ec1-3574-4150-8897-4e20db9ad6e4 req-5f724587-05f7-48c8-864e-57ec41cae0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6305886-6f36-4de0-958d-a7adb9a0972c", "name": "network-vif-plugged", "status": "completed", "tag": "14c29ebe-94fc-4642-888f-91357d653e52"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:47.152389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:47.156349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60a38ec1-3574-4150-8897-4e20db9ad6e4 req-5f724587-05f7-48c8-864e-57ec41cae0e3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:47.157034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-60a38ec1-3574-4150-8897-4e20db9ad6e4 req-5f724587-05f7-48c8-864e-57ec41cae0e3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:47.160714 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14ae7f0f-fa8e-4151-8c9e-222bd7c1a9d9 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.154502 Jul 02 21:31:47.170147 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-60a38ec1-3574-4150-8897-4e20db9ad6e4 req-5f724587-05f7-48c8-864e-57ec41cae0e3 service nova] Creating event network-vif-plugged:14c29ebe-94fc-4642-888f-91357d653e52 for instance b6305886-6f36-4de0-958d-a7adb9a0972c on nch1-master-1 Jul 02 21:31:47.171644 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2674/5369] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:47 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:47.176546 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-60a38ec1-3574-4150-8897-4e20db9ad6e4 req-5f724587-05f7-48c8-864e-57ec41cae0e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038058 Jul 02 21:31:47.177128 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2696/5370] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:31:48.181952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:48.182996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:48.186411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:48.194054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:48.194717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:48.195489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:48.195991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:48.338045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:48.346016 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b9b9df8-889b-4c90-9373-3d2f30d70dfb tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1314 microversion: 2.1 time: 0.171205 Jul 02 21:31:48.346596 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2675/5371] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:48 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:49.368233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:49.369271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:49.373176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:49.374285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:31:49.386732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:49.387491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:49.388871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:49.389606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:49.533155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:49.541216 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d957ecbb-41c1-458d-bcd0-5ea7a148ea60 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1498 microversion: 2.1 time: 0.180337 Jul 02 21:31:49.541784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2697/5372] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:49 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:50.930627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:50.931162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:50.939023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:50.939480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:50.940288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:50.940732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:50.965990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:31:51.052355 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-24797b55-3bab-41b9-86d0-852735d04c93 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 204 len: 0 microversion: 2.1 time: 0.125906 Jul 02 21:31:51.053502 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2676/5373] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:31:50 2022] DELETE /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:31:51.063765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:51.064433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:51.071199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:51.071648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:51.072526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:51.072965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:51.207779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:51.215962 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e1a489b-5c66-4be9-9b6d-87e0c5f8fbfd tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1504 microversion: 2.1 time: 0.157703 Jul 02 21:31:51.216579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2698/5374] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:51 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:52.238625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:52.239415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:52.248431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:52.249024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:52.249947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:52.250467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:52.394842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:52.403282 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e58fe45e-be53-41af-89bc-ee14b51fc0d1 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1504 microversion: 2.1 time: 0.171834 Jul 02 21:31:52.403864 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2677/5375] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:52 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:53.204644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-acfb4d16-33d7-4acd-9ae8-50ac14a75e09 req-71a437e1-33c3-41db-a88c-f4d7ccdc0840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6305886-6f36-4de0-958d-a7adb9a0972c", "name": "network-vif-deleted", "tag": "14c29ebe-94fc-4642-888f-91357d653e52"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:53.214251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-acfb4d16-33d7-4acd-9ae8-50ac14a75e09 req-71a437e1-33c3-41db-a88c-f4d7ccdc0840 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:53.214689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-acfb4d16-33d7-4acd-9ae8-50ac14a75e09 req-71a437e1-33c3-41db-a88c-f4d7ccdc0840 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:53.225674 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-acfb4d16-33d7-4acd-9ae8-50ac14a75e09 req-71a437e1-33c3-41db-a88c-f4d7ccdc0840 service nova] Creating event network-vif-deleted:14c29ebe-94fc-4642-888f-91357d653e52 for instance b6305886-6f36-4de0-958d-a7adb9a0972c on nch1-master-1 Jul 02 21:31:53.230609 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-acfb4d16-33d7-4acd-9ae8-50ac14a75e09 req-71a437e1-33c3-41db-a88c-f4d7ccdc0840 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029703 Jul 02 21:31:53.231466 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2699/5376] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:31:53.426002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:53.426634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:53.434783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:53.435241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:53.436033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:53.436513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:53.473513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:53.473874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:53.474338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lazy-loading 'fault' on Instance uuid b6305886-6f36-4de0-958d-a7adb9a0972c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:31:53.517931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '703991a781474b48a1bfe5dca0fac66f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cb4e38dc4144c839e51ae6332b9ae68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:53.525970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c909eae9-84cf-4053-bf96-54eb1a5fed4a tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 200 len: 1304 microversion: 2.1 time: 0.103999 Jul 02 21:31:53.526583 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2678/5377] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:53 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:54.547818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:54.548684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] [instance: b6305886-6f36-4de0-958d-a7adb9a0972c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:54.556962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:54.557420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:54.558200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:54.558644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:54.572559 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] HTTP exception thrown: Instance b6305886-6f36-4de0-958d-a7adb9a0972c could not be found. Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Request method failure captured: Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c HTTP/1.1 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLk3uRqZ2tCodvj2zsIDx52sxparhLG9h5L3KGJXCXF_N1afCilWj5MrsZn8WeqhaK3FC9KtoTbdCl_Q4OB91pDd09Ye0nNn9Xb97EGxfwuNEy-8jZajv4dUcFgQj5X9dlikntHuQE2uv-TWEYuhpeufnpDzkJB1iaciVvBlv7MViUA Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 6cb4e38dc4144c839e51ae6332b9ae68 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-VolumesActionsTest-938317225 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6cb4e38dc4144c839e51ae6332b9ae68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6cb4e38dc4144c839e51ae6332b9ae68", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6cb4e38dc4144c839e51ae6332b9ae68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6cb4e38dc4144c839e51ae6332b9ae68"}]}] Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-VolumesActionsTest-938317225 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 6cb4e38dc4144c839e51ae6332b9ae68 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-VolumesActionsTest-938317225 Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-VolumesActionsTest-938317225-project Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 703991a781474b48a1bfe5dca0fac66f Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-VolumesActionsTest-938317225-project Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b6305886-6f36-4de0-958d-a7adb9a0972c could not be found. Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b6305886-6f36-4de0-958d-a7adb9a0972c'} Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6305886-6f36-4de0-958d-a7adb9a0972c could not be found. Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6305886-6f36-4de0-958d-a7adb9a0972c could not be found. Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:31:54.574239 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6305886-6f36-4de0-958d-a7adb9a0972c could not be found. Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] Returning 404 to user: Instance b6305886-6f36-4de0-958d-a7adb9a0972c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98798990-c014-47c7-a391-ac1bd09074f3 tempest-VolumesActionsTest-938317225 tempest-VolumesActionsTest-938317225-project] 10.222.0.43 "GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c" status: 404 len: 111 microversion: 2.1 time: 0.035662 Jul 02 21:31:54.579174 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2700/5378] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:54 2022] GET /compute/v2.1/servers/b6305886-6f36-4de0-958d-a7adb9a0972c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:31:54.854525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:54.856065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:54.863443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:54.864030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:54.864978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:54.865770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.007113 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0fefe2d9-a1a4-4c59-bae6-fc4c045c2482 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1834 microversion: 2.1 time: 0.158032 Jul 02 21:31:55.007731 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2679/5379] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:54 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1834 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:55.023527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:55.024165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:55.030832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.031292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.032073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.032519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.164974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:55.172848 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c840951b-66ad-4864-ae8c-b3c8335fa2a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1683 microversion: 2.1 time: 0.153212 Jul 02 21:31:55.173392 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2701/5380] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:55 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:55.275528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:55.276560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:55.282955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.283448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.284304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.284751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.336713 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2502abd0-fff2-4b4f-803c-ed1ff20a7b13 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action" status: 200 len: 32647 microversion: 2.1 time: 0.064954 Jul 02 21:31:55.337369 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2680/5381] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:31:55 2022] POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action => generated 32647 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:31:55.563568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:31:55.564565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:55.573310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.573764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.574544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.574989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.603452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '50d182d4b3f9416fb6d8e44c841dfc16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f5801df264467ab9c057b023a72caa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:55.604062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] flavor_id is None. Assuming migration. {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 02 21:31:55.604514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:31:55.719340 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c3084c65-0a39-442f-97e9-72fe6158619f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action" status: 202 len: 0 microversion: 2.1 time: 0.161980 Jul 02 21:31:55.719928 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2702/5382] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:31:55 2022] POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:31:55.728917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:55.729625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:55.738121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.738572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.739357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:55.740190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:55.887290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:55.897432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f0132476-da88-453e-b5e7-10e60dbc3ff3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1692 microversion: 2.1 time: 0.172735 Jul 02 21:31:55.898304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2681/5383] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:55 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:56.915245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:56.915884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:56.924723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:56.925901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:56.926914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:56.927299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:57.079334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:57.087579 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e36bab6-34c1-462f-aff9-335de77dc24b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1692 microversion: 2.1 time: 0.176630 Jul 02 21:31:57.088527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2703/5384] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:56 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:58.105589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:58.106197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:58.114508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:58.114971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:58.115850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:58.116336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:58.267107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:58.276522 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e47b4473-bb0c-4cee-95fc-f0d75787aff0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.175258 Jul 02 21:31:58.277143 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2682/5385] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:58 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:31:59.298774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:31:59.299602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:31:59.311972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:59.312780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:59.314051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:31:59.314789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:31:59.458193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:31:59.470172 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-714f8365-b756-4bdd-9f26-7be9c5af4203 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.177881 Jul 02 21:31:59.470967 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2704/5386] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:31:59 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:00.493553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:00.494598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:00.506915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:00.507683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:00.509044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:00.509790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:00.649420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:00.657372 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d9a101b-731d-4b99-b34f-06e1c8d71636 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.170765 Jul 02 21:32:00.657939 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2683/5387] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:00 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:01.674840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:01.675454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:01.683179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:01.683627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:01.684419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:01.684853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:01.905509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:01.914625 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-193f3bc8-1ded-44d7-be41-407f34d0984f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.242792 Jul 02 21:32:01.915421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2705/5388] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:01 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:02.934317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:02.934926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:02.942363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:02.942769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:02.943800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:02.944378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:03.458414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:03.462255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:03.467946 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9dd08934-2c60-4615-866d-47c0cf977caa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.537643 Jul 02 21:32:03.468579 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2684/5389] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:02 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:04.486176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:04.486900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:04.495192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:04.495650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:04.496477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:04.497004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:04.644825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:04.653433 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05010366-8636-4e38-9fe2-e1817e033c3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.171276 Jul 02 21:32:04.654041 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2706/5390] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:04 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:05.671287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:05.671919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:05.680062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:05.680525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:05.681299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:05.681734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:05.817022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:05.825790 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6ee84719-853a-4b84-a2e9-9eb0ce8ec1f0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.158757 Jul 02 21:32:05.826420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2685/5391] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:05 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:06.843425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:06.844055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:06.851591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:06.854572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:06.855406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:06.855848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:06.992923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:07.001153 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33273497-e95f-4085-bbda-9a36b30d33e8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.161661 Jul 02 21:32:07.001732 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2707/5392] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:06 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:08.019435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:08.020294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:08.022997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:08.028583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:08.029045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:08.029831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:08.030303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:08.175018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:08.187134 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e0ca1625-1d9b-4f69-8719-be4d115c1826 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.171458 Jul 02 21:32:08.187916 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2686/5393] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:08 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:09.204252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:09.204848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:09.207485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:09.213489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:09.213947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:09.214728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:09.215169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:09.218582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:09.366852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:09.374487 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-295274f8-1882-44d5-91c6-ac2d29f33e01 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.174233 Jul 02 21:32:09.375107 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2708/5394] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:09 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:10.390959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:10.391758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:10.398847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:10.399295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:10.400082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:10.400615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:10.544553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:10.552528 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-69f7b907-57f5-450b-8c5e-ca470e5241f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.165523 Jul 02 21:32:10.553592 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2687/5395] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:10 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:11.569970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:11.571268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:11.578899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:11.579369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:11.580183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:11.580642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:11.799357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:11.808809 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9da4af49-ea6d-44e3-b6d0-d3804bca82b7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.242822 Jul 02 21:32:11.809379 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2709/5396] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:11 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:12.826246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:12.826831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:12.834456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:12.834849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:12.835619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:12.836060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:12.971187 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:12.980739 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5964463d-0eb2-4d3c-b64f-4fe483942bfa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.158629 Jul 02 21:32:12.981323 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2688/5397] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:12 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:13.998486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:13.999012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:14.006261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:14.006693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:14.007470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:14.007904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:14.146214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:14.154455 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d765a57c-917f-4fe0-8345-4b6690174bbc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1697 microversion: 2.1 time: 0.159997 Jul 02 21:32:14.155045 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2710/5398] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:13 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:15.171481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:15.172151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:15.180275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:15.181023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:15.181876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:15.182385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:15.337739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:15.346291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-721d5ba1-0fff-4ee9-8aa5-9aaa393879a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1696 microversion: 2.1 time: 0.178871 Jul 02 21:32:15.346743 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2689/5399] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:15 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:15.677630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0e85d0db-ae7e-45c1-9860-68b1f0d7c9d5 req-2d7f3a08-e5b4-4283-ab6c-e6972235eb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "name": "network-vif-unplugged", "status": "completed", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:15.688531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e85d0db-ae7e-45c1-9860-68b1f0d7c9d5 req-2d7f3a08-e5b4-4283-ab6c-e6972235eb74 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:15.689388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0e85d0db-ae7e-45c1-9860-68b1f0d7c9d5 req-2d7f3a08-e5b4-4283-ab6c-e6972235eb74 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:15.702397 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0e85d0db-ae7e-45c1-9860-68b1f0d7c9d5 req-2d7f3a08-e5b4-4283-ab6c-e6972235eb74 service nova] Creating event network-vif-unplugged:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch1-master-1 Jul 02 21:32:15.708536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-0e85d0db-ae7e-45c1-9860-68b1f0d7c9d5 req-2d7f3a08-e5b4-4283-ab6c-e6972235eb74 service nova] Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:32:15.720070 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0e85d0db-ae7e-45c1-9860-68b1f0d7c9d5 req-2d7f3a08-e5b4-4283-ab6c-e6972235eb74 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046274 Jul 02 21:32:15.720983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2711/5400] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:16.364277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:16.364821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:16.372549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:16.373091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:16.373961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:16.374627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:16.526814 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:16.535970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-66171f61-555e-409d-b021-60fc0d5231b2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1696 microversion: 2.1 time: 0.175487 Jul 02 21:32:16.537312 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2690/5401] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:16 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:17.556514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:17.557224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:17.563811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:17.564285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:17.565230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:17.565658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:17.715529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:17.726491 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f174cf1c-b5f3-497b-bf5a-a2d4bfdf5f51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1694 microversion: 2.1 time: 0.176060 Jul 02 21:32:17.727042 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2712/5402] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:17 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:17.735920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f92b2999-8e33-4bdd-9afd-aae2edbde567 req-dd1be3a0-2d23-4b8e-8e12-e0a75a3c6954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:17.745190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f92b2999-8e33-4bdd-9afd-aae2edbde567 req-dd1be3a0-2d23-4b8e-8e12-e0a75a3c6954 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:17.745778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f92b2999-8e33-4bdd-9afd-aae2edbde567 req-dd1be3a0-2d23-4b8e-8e12-e0a75a3c6954 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:17.757765 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f92b2999-8e33-4bdd-9afd-aae2edbde567 req-dd1be3a0-2d23-4b8e-8e12-e0a75a3c6954 service nova] Creating event network-changed:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch1-master-1 Jul 02 21:32:17.763096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-f92b2999-8e33-4bdd-9afd-aae2edbde567 req-dd1be3a0-2d23-4b8e-8e12-e0a75a3c6954 service nova] Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:32:17.776482 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f92b2999-8e33-4bdd-9afd-aae2edbde567 req-dd1be3a0-2d23-4b8e-8e12-e0a75a3c6954 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044401 Jul 02 21:32:17.777083 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2691/5403] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:18.744255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:18.744878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:18.753338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:18.753799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:18.754651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:18.755312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:18.914078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:18.917027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13a44d9c-63b4-4186-9311-113422c55327 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1694 microversion: 2.1 time: 0.177221 Jul 02 21:32:18.917766 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2713/5404] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:18 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:19.940591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:19.941407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:19.950060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:19.950645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:19.951510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:19.952028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:20.131799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:20.141185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d18d6a8a-0318-43be-8c7c-be17ecf5824d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1694 microversion: 2.1 time: 0.205812 Jul 02 21:32:20.141939 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2692/5405] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:19 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:21.171035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:21.171683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:21.195560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:21.196028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:21.197491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:21.197981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:21.361151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:21.370330 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37490ed9-b48c-48be-ad9a-95db2d304111 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1691 microversion: 2.1 time: 0.214682 Jul 02 21:32:21.371440 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2714/5406] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:21 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1691 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:21.392226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:21.392869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:21.402499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:21.402956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:21.403738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:21.404573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:21.566426 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d2e9efcf-8281-45ca-a602-4782752a00be tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action" status: 202 len: 0 microversion: 2.1 time: 0.178889 Jul 02 21:32:21.567043 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2693/5407] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:32:21 2022] POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:32:21.576773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:21.577581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:21.584142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:21.584591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:21.585375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:21.586685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:21.746135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:21.758369 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-99a36c0c-c6a5-42f7-9366-f68d17b703ee tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1690 microversion: 2.1 time: 0.186327 Jul 02 21:32:21.759093 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2715/5408] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:21 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:22.779165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:22.779945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:22.787088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:22.787552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:22.788368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:22.788887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:22.936076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:22.944010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-881c95a9-0102-40cf-afd4-4a60d1127156 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1690 microversion: 2.1 time: 0.170786 Jul 02 21:32:22.944607 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2694/5409] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:22 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:23.479388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5236b00b-0891-49ff-bd7f-b463fc518d47 req-931befd8-4c74-41c1-b3a3-801148598673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "name": "network-vif-plugged", "status": "completed", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:23.487568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5236b00b-0891-49ff-bd7f-b463fc518d47 req-931befd8-4c74-41c1-b3a3-801148598673 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:23.488007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5236b00b-0891-49ff-bd7f-b463fc518d47 req-931befd8-4c74-41c1-b3a3-801148598673 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:23.499880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5236b00b-0891-49ff-bd7f-b463fc518d47 req-931befd8-4c74-41c1-b3a3-801148598673 service nova] Creating event network-vif-plugged:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch1-master-1 Jul 02 21:32:23.505896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-5236b00b-0891-49ff-bd7f-b463fc518d47 req-931befd8-4c74-41c1-b3a3-801148598673 service nova] Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:32:23.520911 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5236b00b-0891-49ff-bd7f-b463fc518d47 req-931befd8-4c74-41c1-b3a3-801148598673 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191709 Jul 02 21:32:23.521815 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2716/5410] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:23.961168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:23.961899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:23.969034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:23.969495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:23.970268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:23.970713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:24.108097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:24.116032 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6daea67-580e-4742-88f3-41f2df0a4089 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1690 microversion: 2.1 time: 0.158836 Jul 02 21:32:24.116649 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2695/5411] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:23 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:25.143439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:25.144496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:25.154096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:25.154988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:25.159108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:25.159663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:25.178310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2172adf2-1aac-411c-a79f-8ab8a168c712 req-3893ef21-7b12-41f1-a603-0d43018c150b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "name": "network-vif-unplugged", "status": "completed", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:25.189929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2172adf2-1aac-411c-a79f-8ab8a168c712 req-3893ef21-7b12-41f1-a603-0d43018c150b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:25.190699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2172adf2-1aac-411c-a79f-8ab8a168c712 req-3893ef21-7b12-41f1-a603-0d43018c150b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:25.214780 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2172adf2-1aac-411c-a79f-8ab8a168c712 req-3893ef21-7b12-41f1-a603-0d43018c150b service nova] Creating event network-vif-unplugged:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:32:25.222434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-2172adf2-1aac-411c-a79f-8ab8a168c712 req-3893ef21-7b12-41f1-a603-0d43018c150b service nova] Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:32:25.239652 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2172adf2-1aac-411c-a79f-8ab8a168c712 req-3893ef21-7b12-41f1-a603-0d43018c150b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.254579 Jul 02 21:32:25.240665 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2717/5412] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:25.441751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:25.451200 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5421a1da-148a-4ed9-bb46-891f20f34b51 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1690 microversion: 2.1 time: 0.321965 Jul 02 21:32:25.452146 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2696/5413] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:25 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1690 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:26.469974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:26.471569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:26.485817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:26.486349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:26.487897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:26.488437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:26.657717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:26.666894 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a3b7b525-0658-45c3-bd11-084ee0b6daf7 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1690 microversion: 2.1 time: 0.201964 Jul 02 21:32:26.667508 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2718/5414] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:26 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:27.273479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-498b1b3c-2509-44a8-9a76-97f0a3af6053 req-3db5dd2f-d15e-4186-8b90-622bde20ff07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:27.284086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-498b1b3c-2509-44a8-9a76-97f0a3af6053 req-3db5dd2f-d15e-4186-8b90-622bde20ff07 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:27.284855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-498b1b3c-2509-44a8-9a76-97f0a3af6053 req-3db5dd2f-d15e-4186-8b90-622bde20ff07 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:27.297546 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-498b1b3c-2509-44a8-9a76-97f0a3af6053 req-3db5dd2f-d15e-4186-8b90-622bde20ff07 service nova] Creating event network-changed:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:32:27.308236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-498b1b3c-2509-44a8-9a76-97f0a3af6053 req-3db5dd2f-d15e-4186-8b90-622bde20ff07 service nova] Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:32:27.321168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-498b1b3c-2509-44a8-9a76-97f0a3af6053 req-3db5dd2f-d15e-4186-8b90-622bde20ff07 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051995 Jul 02 21:32:27.322362 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2697/5415] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:27.684991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:27.685611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:27.695084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:27.695551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:27.701128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:27.701638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:27.979881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:27.990093 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e79d412-6ed5-4737-be8f-fd68e9278205 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1690 microversion: 2.1 time: 0.309422 Jul 02 21:32:28.001065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2719/5416] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:27 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1690 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:29.009434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:29.011482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:29.019968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:29.021812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:29.023548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:29.024270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:29.257786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:29.268788 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0688cec8-e61a-4f1e-be36-706f24a46703 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1683 microversion: 2.1 time: 0.265238 Jul 02 21:32:29.269881 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2698/5417] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:29 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:30.591534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0acc7d06-599e-4de1-b247-acef3aef3933 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'create', calling method: .version_select at 0x7fabe491a160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-891562335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMg29Z+4t7DKj/x7yYxfE1jn4FGnCdzIv6mekGDBXCy2yxTQpwtgPn4/soIwdzojMH6n+n1HI3t3LVU28mEDy/DksdCYzlk41eVckNPVLacEQrSLzqIeR0vRJJGAu7PEog=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:30.612501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0acc7d06-599e-4de1-b247-acef3aef3933 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for project f74b842162f6463a9e93046d070919e7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:32:30.619329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-0acc7d06-599e-4de1-b247-acef3aef3933 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for user 150099eea6064cebbd876d26a3d6fe4a and project f74b842162f6463a9e93046d070919e7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:32:30.628294 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:32:30.628773 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:32:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:32:30.663673 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0acc7d06-599e-4de1-b247-acef3aef3933 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.076123 Jul 02 21:32:30.664358 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2720/5418] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:32:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:31.937485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-63bf6a62-7229-4d89-96a2-e3196c0c7224 req-5be32d17-b4cc-4e67-b0b8-0d07d2237e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "name": "network-vif-plugged", "status": "completed", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:31.948147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63bf6a62-7229-4d89-96a2-e3196c0c7224 req-5be32d17-b4cc-4e67-b0b8-0d07d2237e5e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:31.949179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63bf6a62-7229-4d89-96a2-e3196c0c7224 req-5be32d17-b4cc-4e67-b0b8-0d07d2237e5e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:31.968693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-63bf6a62-7229-4d89-96a2-e3196c0c7224 req-5be32d17-b4cc-4e67-b0b8-0d07d2237e5e service nova] Creating event network-vif-plugged:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:32:31.976316 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-63bf6a62-7229-4d89-96a2-e3196c0c7224 req-5be32d17-b4cc-4e67-b0b8-0d07d2237e5e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042752 Jul 02 21:32:31.977728 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2699/5419] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:32.219513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-772590963", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "69a37897-9ae7-4705-b7ce-e9aca02166c9"}], "key_name": "tempest-TestNetworkBasicOps-891562335", "security_groups": [{"name": "tempest-secgroup-smoke-434689906"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:32.332717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] validate_networks() for [('69a37897-9ae7-4705-b7ce-e9aca02166c9', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:32:32.722490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:32:32.722927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:32:32.723468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:32:32.723969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:32:32.724496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:32:32.734025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:32.734561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:32.735463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:32.735896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:32.753456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for project f74b842162f6463a9e93046d070919e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:32:32.759976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for user 150099eea6064cebbd876d26a3d6fe4a and project f74b842162f6463a9e93046d070919e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:32:32.781795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:32:32.784343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:32:32.833884 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-12a82508-8c84-4f2c-894a-ec1688a664c1 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.619334 Jul 02 21:32:32.834556 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2721/5420] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:32:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:32:32.845224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0d60d0ab-2137-4997-9be5-ad33236ae6fc tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:32.845952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0d60d0ab-2137-4997-9be5-ad33236ae6fc tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:32.934028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0d60d0ab-2137-4997-9be5-ad33236ae6fc tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:32.943030 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0d60d0ab-2137-4997-9be5-ad33236ae6fc tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1247 microversion: 2.1 time: 0.101735 Jul 02 21:32:32.944286 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2700/5421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:32 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1247 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:33.963652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:33.966704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:33.976985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:33.977613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:33.978582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:33.979017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:34.045554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:34.053525 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38b06681-6a14-441a-bf3b-72aba57fa609 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1317 microversion: 2.1 time: 0.096046 Jul 02 21:32:34.054115 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2722/5422] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:33 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:35.072071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:35.076986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:35.087041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:35.087999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:35.089254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:35.089819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:35.240374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:35.248746 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d2f128a-f5da-46da-97a8-ae65b2c6873a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.181039 Jul 02 21:32:35.249340 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2701/5423] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:35 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:35.323375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-272f9be7-d5b9-489c-af30-5ddf3d00138a req-2f0f28e2-b970-4061-8911-34ef552f1e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff499d-cd3b-4cd6-9c67-b8c9165ce409", "tag": "ec8b3123-6f6c-4e7a-a57b-3c3da33ae394"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:35.337602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-272f9be7-d5b9-489c-af30-5ddf3d00138a req-2f0f28e2-b970-4061-8911-34ef552f1e37 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:35.338319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-272f9be7-d5b9-489c-af30-5ddf3d00138a req-2f0f28e2-b970-4061-8911-34ef552f1e37 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:35.356714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-272f9be7-d5b9-489c-af30-5ddf3d00138a req-2f0f28e2-b970-4061-8911-34ef552f1e37 service nova] Creating event network-changed:ec8b3123-6f6c-4e7a-a57b-3c3da33ae394 for instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 on nch1-master-1 Jul 02 21:32:35.363168 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-272f9be7-d5b9-489c-af30-5ddf3d00138a req-2f0f28e2-b970-4061-8911-34ef552f1e37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044538 Jul 02 21:32:35.364235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2723/5424] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:36.271430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:36.272552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:36.281096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:36.281580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:36.282327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:36.282807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:36.301719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:36.426685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:36.435574 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-09a2a357-6606-4885-bb1b-d5746039de75 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.171434 Jul 02 21:32:36.436193 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2702/5425] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:36 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:37.457451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:37.458436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:37.467903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:37.468628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:37.469741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:37.470378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:37.612265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:37.620400 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-833834d8-e59d-4f4c-a30e-e41f8d91e01a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.170413 Jul 02 21:32:37.620954 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2724/5426] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:37 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:38.638241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:38.638798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:38.641553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=40 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:38.647405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:38.647862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:38.648671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:38.649108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:38.791040 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:38.798853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e5e1498-5151-484c-8177-e2a8178d91d9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.164876 Jul 02 21:32:38.799443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2703/5427] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:38 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:39.816078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:39.817413 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:39.820897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:39.827554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:39.828365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:39.829159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:39.829601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:39.832872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=82 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:39.966004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:39.974077 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0d3565f-f1da-49da-8410-0fb87d5137a6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.162071 Jul 02 21:32:39.974652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2725/5428] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:39 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:40.992894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:40.993736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:41.001540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:41.001924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:41.002690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:41.003127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:41.142994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:41.152392 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8aa3f6e4-442e-47ac-9aa6-890cf06404f5 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.164076 Jul 02 21:32:41.152950 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2704/5429] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:40 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:41.356950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-64ace050-f061-4337-916c-3e7fe3e31f41 req-4fdca7c1-5e80-4ac8-8fda-adbdc67a1331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff499d-cd3b-4cd6-9c67-b8c9165ce409", "name": "network-vif-plugged", "status": "completed", "tag": "ec8b3123-6f6c-4e7a-a57b-3c3da33ae394"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:41.368451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64ace050-f061-4337-916c-3e7fe3e31f41 req-4fdca7c1-5e80-4ac8-8fda-adbdc67a1331 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:41.368964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-64ace050-f061-4337-916c-3e7fe3e31f41 req-4fdca7c1-5e80-4ac8-8fda-adbdc67a1331 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:41.386422 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-64ace050-f061-4337-916c-3e7fe3e31f41 req-4fdca7c1-5e80-4ac8-8fda-adbdc67a1331 service nova] Creating event network-vif-plugged:ec8b3123-6f6c-4e7a-a57b-3c3da33ae394 for instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 on nch1-master-1 Jul 02 21:32:41.392410 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-64ace050-f061-4337-916c-3e7fe3e31f41 req-4fdca7c1-5e80-4ac8-8fda-adbdc67a1331 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039040 Jul 02 21:32:41.393426 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2726/5430] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:42.177770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:42.179182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:42.191399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:42.192615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:42.194483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:42.194662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:42.338998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:42.347180 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc25bdc9-b7de-4f58-b749-8377279aa464 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1372 microversion: 2.1 time: 0.176166 Jul 02 21:32:42.347949 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2705/5431] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:42 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:43.374349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:43.375395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:43.379926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:43.381268 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:43.389433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:43.389908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:43.390697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:43.391138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:43.528712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:43.536509 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-257ed5b0-0d30-4ecf-b8d4-61dbe2b54280 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1544 microversion: 2.1 time: 0.169669 Jul 02 21:32:43.537088 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2727/5432] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:43 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1544 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:43.554944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:32:43.555548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:43.557558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:43.564007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:43.564505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:43.565314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:43.565756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:43.721503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:32:43.733041 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8bb6a403-797e-4379-b64a-f0fd49eae6f8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1544 microversion: 2.1 time: 0.182683 Jul 02 21:32:43.733629 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2706/5433] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:32:43 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:32:45.370362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-65528690-21ee-4544-94a3-6984466d300f req-6f60b31b-2700-4345-897a-73b5a8957388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff499d-cd3b-4cd6-9c67-b8c9165ce409", "tag": "ec8b3123-6f6c-4e7a-a57b-3c3da33ae394"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:45.381195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-65528690-21ee-4544-94a3-6984466d300f req-6f60b31b-2700-4345-897a-73b5a8957388 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:45.381764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-65528690-21ee-4544-94a3-6984466d300f req-6f60b31b-2700-4345-897a-73b5a8957388 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:45.394163 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-65528690-21ee-4544-94a3-6984466d300f req-6f60b31b-2700-4345-897a-73b5a8957388 service nova] Creating event network-changed:ec8b3123-6f6c-4e7a-a57b-3c3da33ae394 for instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 on nch1-master-1 Jul 02 21:32:45.399637 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-65528690-21ee-4544-94a3-6984466d300f req-6f60b31b-2700-4345-897a-73b5a8957388 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033596 Jul 02 21:32:45.401058 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2728/5434] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:32:55.498720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:32:55.500027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:32:55.504950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=7 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:55.505840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=29 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:32:55.513850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:55.514460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:55.515270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:32:55.515758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:32:55.578753 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78894b70-09db-409a-b4d3-5d401e953101 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action" status: 200 len: 63008 microversion: 2.1 time: 0.086333 Jul 02 21:32:55.579500 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2707/5435] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:32:55 2022] POST /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56/action => generated 63008 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:33:01.987388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:01.988530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=15 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:01.994941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:01.995943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:02.003757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:02.004267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:02.005053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:02.005498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:02.137486 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90e5e60d-1d64-439d-b9e0-e0b39b5f350f tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1834 microversion: 2.1 time: 0.152997 Jul 02 21:33:02.138071 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2729/5436] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:01 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1834 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:03.219796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-61135749-bbe1-4a32-983c-c44864c5ca07 req-83615cd4-5f3c-475a-b177-26c41606aa51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:03.222663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:03.223223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:03.235499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:03.235950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:03.239903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-61135749-bbe1-4a32-983c-c44864c5ca07 req-83615cd4-5f3c-475a-b177-26c41606aa51 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:03.240369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-61135749-bbe1-4a32-983c-c44864c5ca07 req-83615cd4-5f3c-475a-b177-26c41606aa51 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:03.241782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:03.242260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:03.263564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-61135749-bbe1-4a32-983c-c44864c5ca07 req-83615cd4-5f3c-475a-b177-26c41606aa51 service nova] Creating event network-changed:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:33:03.278739 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-61135749-bbe1-4a32-983c-c44864c5ca07 req-83615cd4-5f3c-475a-b177-26c41606aa51 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062492 Jul 02 21:33:03.280294 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2730/5437] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:33:03.287179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:33:03.375331 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7e98fbed-e842-4d25-b819-f86766d3fd99 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 204 len: 0 microversion: 2.1 time: 0.162868 Jul 02 21:33:03.376138 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2708/5438] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:33:03 2022] DELETE /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:33:03.385974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:03.386758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:03.393248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:03.393726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:03.394559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:03.395065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:03.529741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:03.538453 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-edc47441-da59-48c3-a46f-738c45daaab6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1689 microversion: 2.1 time: 0.156832 Jul 02 21:33:03.539091 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2731/5439] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:03 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:04.561999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:04.562680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:04.575390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:04.576605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:04.577388 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:04.577835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:04.729399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:04.740288 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-234d2853-8eb4-473b-bc17-8954b47787f1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1689 microversion: 2.1 time: 0.182619 Jul 02 21:33:04.741123 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2709/5440] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:04 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1689 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:05.304720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0cc17fa9-0c4d-47aa-9040-239faf5666d7 req-4da7e276-7c53-488f-a05b-ee3d7e35f576 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd307b9b-32cd-44ef-a45d-d43bab144c56", "name": "network-vif-deleted", "tag": "eea86825-af25-4b0a-87f6-02ef20638a74"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:05.315906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0cc17fa9-0c4d-47aa-9040-239faf5666d7 req-4da7e276-7c53-488f-a05b-ee3d7e35f576 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:05.316250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0cc17fa9-0c4d-47aa-9040-239faf5666d7 req-4da7e276-7c53-488f-a05b-ee3d7e35f576 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:05.333226 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0cc17fa9-0c4d-47aa-9040-239faf5666d7 req-4da7e276-7c53-488f-a05b-ee3d7e35f576 service nova] Creating event network-vif-deleted:eea86825-af25-4b0a-87f6-02ef20638a74 for instance fd307b9b-32cd-44ef-a45d-d43bab144c56 on nch2-master-1 Jul 02 21:33:05.338099 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0cc17fa9-0c4d-47aa-9040-239faf5666d7 req-4da7e276-7c53-488f-a05b-ee3d7e35f576 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037651 Jul 02 21:33:05.338715 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2732/5441] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:33:05.762092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:05.763518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:05.771628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:05.772110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:05.772902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:05.773350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:05.807636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:05.808159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:05.808628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lazy-loading 'fault' on Instance uuid fd307b9b-32cd-44ef-a45d-d43bab144c56 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:33:05.851725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:05.859212 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b870f90-010a-447a-a2c8-d95caab58b7c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 200 len: 1356 microversion: 2.1 time: 0.105002 Jul 02 21:33:05.859828 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2710/5442] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:05 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:06.989996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:06.990713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: fd307b9b-32cd-44ef-a45d-d43bab144c56] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:06.997710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:06.998172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:06.998927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:06.999392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:07.013060 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] HTTP exception thrown: Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 could not be found. Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Request method failure captured: Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 HTTP/1.1 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLhkw9i0xORUg4JVijXvZ-4U1BZ1T3vJ_VfTmMqg_N2dqNUc88WBpxoj4nsbYgkfhphBvdR9ozDzk0JXzIa-QWkcPzjljVDoEVJzvK_enf0dUIxCZyWpC0p_rfy-XLmvh2U3mqnGIHAd7Qjj6CF51pfpap30_IBFcdgnFVbhTJ_4joo Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1b2fbfc815c48588a0bec36818df1a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1b2fbfc815c48588a0bec36818df1a3"}]}] Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 317a63cdd16b4fd69617fb9de95dc4ec Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 could not be found. Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'fd307b9b-32cd-44ef-a45d-d43bab144c56'} Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 could not be found. Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 could not be found. Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:33:07.014707 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 could not be found. Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Returning 404 to user: Instance fd307b9b-32cd-44ef-a45d-d43bab144c56 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1548ff20-f2b8-49b4-85b8-7a1bdb847d1e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56" status: 404 len: 111 microversion: 2.1 time: 0.142068 Jul 02 21:33:07.019588 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2733/5443] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:06 2022] GET /compute/v2.1/servers/fd307b9b-32cd-44ef-a45d-d43bab144c56 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:33:10.636989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12627e19-d50f-498f-a238-759fb0726ec8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '.version_select at 0x7fabea2bbdc0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:10.660476 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12627e19-d50f-498f-a238-759fb0726ec8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-915098605" status: 202 len: 0 microversion: 2.1 time: 0.027437 Jul 02 21:33:10.661175 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2711/5444] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 21:33:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-915098605 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:33:10.698163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84b3ff65-55a3-4812-982c-63e4a63682a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: .version_select at 0x7fabe40805e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-762545463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHobjen4wQeCr/eX9NV7RP9bq/qv8sHDAiIklqsyKELg3RWembSGVwmIhM8cYkRqUwLdSqYdjffEqc6Ryhd/Xkle9C+fxPPaoFpeCZ1WXl7zkkvdPSs397NLqt8BabuVJQ=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:10.713573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-84b3ff65-55a3-4812-982c-63e4a63682a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:33:10.719130 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-84b3ff65-55a3-4812-982c-63e4a63682a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:33:10.744348 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84b3ff65-55a3-4812-982c-63e4a63682a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050333 Jul 02 21:33:10.744951 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2734/5445] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:33:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:33:16.519391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-837704375", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "16adfe4f-da28-4966-9e45-604921f2975c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-762545463", "security_groups": [{"name": "tempest-secgroup-smoke-867593663"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:16.528541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:16.646189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] validate_networks() for [('16adfe4f-da28-4966-9e45-604921f2975c', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:33:17.125973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:33:17.126481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:33:17.127039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:33:17.127528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:33:17.128079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:33:17.138120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:17.138673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:17.139564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:17.140101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:17.158255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:33:17.164125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:33:17.177974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:33:17.180355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:33:17.232599 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-997d95f7-7536-49e0-b8e0-2ba15d83d660 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.716746 Jul 02 21:33:17.238844 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2712/5446] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:33:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:33:17.244029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:17.251683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34cd51db-25d3-4a7c-a26b-76da3f00c152 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:17.253224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34cd51db-25d3-4a7c-a26b-76da3f00c152 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:17.361387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34cd51db-25d3-4a7c-a26b-76da3f00c152 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:17.370085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34cd51db-25d3-4a7c-a26b-76da3f00c152 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1265 microversion: 2.1 time: 0.129410 Jul 02 21:33:17.370473 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2735/5447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:17 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:17.736755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:17.738143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:17.746543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:17.747084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:17.748228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:17.748713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:17.822307 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e790693b-c146-4b7b-a8d0-9a3751241d89 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409/action" status: 200 len: 24567 microversion: 2.1 time: 0.089293 Jul 02 21:33:17.823113 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2713/5448] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:33:17 2022] POST /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409/action => generated 24567 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:33:18.388532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:18.389270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:18.396915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:18.397778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:18.398974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:18.399570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:18.494131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:18.502333 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bae5d6c2-2abd-466c-b53c-2b2f4bb81d3b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1335 microversion: 2.1 time: 0.118961 Jul 02 21:33:18.503182 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2736/5449] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:18 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:19.521078 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:19.521800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:19.529719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:19.530519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:19.531496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:19.531935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:19.798513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:19.807892 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bd06fd36-93a1-44b2-903e-8db40069922f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1390 microversion: 2.1 time: 0.291047 Jul 02 21:33:19.817927 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2714/5450] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:19 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1390 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:20.008672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9adddb37-4599-4404-8f88-645d543be97e req-e1add4aa-60a5-447d-8966-128ad36d0f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:20.020762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9adddb37-4599-4404-8f88-645d543be97e req-e1add4aa-60a5-447d-8966-128ad36d0f5f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:20.021649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9adddb37-4599-4404-8f88-645d543be97e req-e1add4aa-60a5-447d-8966-128ad36d0f5f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:20.047643 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9adddb37-4599-4404-8f88-645d543be97e req-e1add4aa-60a5-447d-8966-128ad36d0f5f service nova] Creating event network-changed:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch2-master-1 Jul 02 21:33:20.054263 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9adddb37-4599-4404-8f88-645d543be97e req-e1add4aa-60a5-447d-8966-128ad36d0f5f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049646 Jul 02 21:33:20.055502 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2737/5451] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:33:20.826063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:20.826746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:20.838180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:20.838648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:20.839447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:20.839903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:20.978475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:20.991352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd344131-36c0-42bf-97e4-74b637208071 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1390 microversion: 2.1 time: 0.168715 Jul 02 21:33:20.992453 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2715/5452] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:20 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:22.009152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:22.009869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:22.017609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:22.018022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:22.019205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:22.019642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:22.159862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:22.167879 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-90aacc53-fa3f-4820-a5de-808abccd60e4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1390 microversion: 2.1 time: 0.163467 Jul 02 21:33:22.168641 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2738/5453] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:22 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:23.185413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:23.186000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:23.193487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:23.193941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:23.194710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:23.195149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:23.338647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:23.346598 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-77733c3b-9628-404e-a8c2-e5f4e5a24977 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1390 microversion: 2.1 time: 0.165286 Jul 02 21:33:23.347189 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2716/5454] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:23 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:24.085628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ad65f65f-90be-4fe0-9e50-50d814d379ce req-bab8f91d-0feb-4100-ba5b-83de58c26f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "name": "network-vif-plugged", "status": "completed", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:24.095366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ad65f65f-90be-4fe0-9e50-50d814d379ce req-bab8f91d-0feb-4100-ba5b-83de58c26f6d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:24.095897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ad65f65f-90be-4fe0-9e50-50d814d379ce req-bab8f91d-0feb-4100-ba5b-83de58c26f6d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:24.108113 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ad65f65f-90be-4fe0-9e50-50d814d379ce req-bab8f91d-0feb-4100-ba5b-83de58c26f6d service nova] Creating event network-vif-plugged:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch2-master-1 Jul 02 21:33:24.112844 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ad65f65f-90be-4fe0-9e50-50d814d379ce req-bab8f91d-0feb-4100-ba5b-83de58c26f6d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031113 Jul 02 21:33:24.113626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2739/5455] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:33:24.367114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:24.368080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:24.376857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:24.377336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:24.378232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:24.378705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:24.518362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:24.526586 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a0abe149-1ddb-433a-a014-c1a33eb0f84f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1390 microversion: 2.1 time: 0.165988 Jul 02 21:33:24.527174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2717/5456] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:24 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:25.545980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:25.546901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:25.554075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:25.554536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:25.555321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:25.555767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:25.695134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:25.702988 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dffd7982-979c-4925-b932-032da4d99583 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1562 microversion: 2.1 time: 0.162466 Jul 02 21:33:25.703567 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2740/5457] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:25 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:25.723666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:25.724317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:25.727138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:25.732817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:25.733267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:25.734031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:25.734466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:25.870576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:25.878651 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d74f5f85-3a93-4ddc-abef-8a14e0f2e483 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1562 microversion: 2.1 time: 0.158969 Jul 02 21:33:25.879237 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2718/5458] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:25 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:27.988612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4e80b1c3-d7f3-4500-82a0-1d666ed2d2e4 req-3d383036-5b6f-4cdb-bc62-e220528609c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:27.992417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:27.993038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:28.000652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:28.001343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:28.006690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:28.009138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:28.009590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:28.010367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:28.010794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:28.019934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4e80b1c3-d7f3-4500-82a0-1d666ed2d2e4 req-3d383036-5b6f-4cdb-bc62-e220528609c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:28.020629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4e80b1c3-d7f3-4500-82a0-1d666ed2d2e4 req-3d383036-5b6f-4cdb-bc62-e220528609c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:28.033069 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4e80b1c3-d7f3-4500-82a0-1d666ed2d2e4 req-3d383036-5b6f-4cdb-bc62-e220528609c3 service nova] Creating event network-changed:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch2-master-1 Jul 02 21:33:28.038466 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4e80b1c3-d7f3-4500-82a0-1d666ed2d2e4 req-3d383036-5b6f-4cdb-bc62-e220528609c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053576 Jul 02 21:33:28.039600 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2719/5459] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:33:28.256797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:28.266478 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-879755cd-7bc0-4c37-ae68-4bd581b09034 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1562 microversion: 2.1 time: 0.283675 Jul 02 21:33:28.278406 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2741/5460] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:27 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1562 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:52.462944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:52.464104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=38 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:52.468751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-70c69ba4-9952-4317-816c-95aae5436a13 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'create', calling method: .version_select at 0x7fabd75a9c10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-839028282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAKTw9+/uU1/LhdUU+bCrVkoDAbUpQTJOXeMeVxUMP9n4fj0YZEnkmfAlE1uIw4e+hadxf0S+SOhi3iho816v8sYcQ3tjoQNTno6t+ar6jzIeA0gyqu2bCGmjclCM9Euw=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:52.485346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-70c69ba4-9952-4317-816c-95aae5436a13 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for project f74b842162f6463a9e93046d070919e7. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:33:52.494757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-70c69ba4-9952-4317-816c-95aae5436a13 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for user 150099eea6064cebbd876d26a3d6fe4a and project f74b842162f6463a9e93046d070919e7. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:33:52.521728 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-70c69ba4-9952-4317-816c-95aae5436a13 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.060616 Jul 02 21:33:52.522351 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2720/5461] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:33:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:33:53.615875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:53.616875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:53.619522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:53.620391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=28 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:33:53.626481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:53.626936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:53.627731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:53.628273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:53.689467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-783dec5d-1796-4c20-b437-e22225fcd092 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action" status: 200 len: 24572 microversion: 2.1 time: 0.078693 Jul 02 21:33:53.690126 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2742/5462] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:33:53 2022] POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:33:53.862785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-226563264", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "3d75ec66-43ca-446a-9426-697ae26f27e8"}], "key_name": "tempest-TestNetworkBasicOps-839028282", "security_groups": [{"name": "tempest-secgroup-smoke-715837600"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:53.973126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] validate_networks() for [('3d75ec66-43ca-446a-9426-697ae26f27e8', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:33:54.368675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:33:54.369103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:33:54.369580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:33:54.369992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:33:54.370410 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:33:54.381781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:54.382493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:54.383296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:54.383731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:54.405371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for project f74b842162f6463a9e93046d070919e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:33:54.412256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for user 150099eea6064cebbd876d26a3d6fe4a and project f74b842162f6463a9e93046d070919e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:33:54.428692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:33:54.433752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:33:54.490425 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0c604d85-b643-4b4e-a7ab-c3fc72770589 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.631517 Jul 02 21:33:54.496771 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2721/5463] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:33:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:33:54.516250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66b49923-8801-4a83-bb2c-88209c6284f4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:54.517255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66b49923-8801-4a83-bb2c-88209c6284f4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:54.604853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66b49923-8801-4a83-bb2c-88209c6284f4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:54.620243 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66b49923-8801-4a83-bb2c-88209c6284f4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1247 microversion: 2.1 time: 0.121498 Jul 02 21:33:54.622002 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2743/5464] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:54 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1247 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:55.639920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:55.640559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:55.651852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:55.652340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:55.653276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:55.653725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:55.719215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:55.727429 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-504d8347-7529-4fec-a9d5-ba148802a9c0 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1305 microversion: 2.1 time: 0.091528 Jul 02 21:33:55.728018 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2722/5465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:55 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:33:56.745615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:56.746361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:56.754282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:56.754743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:56.755571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:56.756237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:56.910692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:56.918748 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ef8aa726-ac92-488e-8d85-23f6500e2784 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.177792 Jul 02 21:33:56.919357 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2744/5466] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:56 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:57.037336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4f46af56-8f77-45e5-8710-120d9a0b68af req-21f0ad95-1a42-4bfd-bf3c-d870dbf79e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c329e15-e958-4f69-a9a7-39af86b7f306", "tag": "af1ce49c-e5fa-4911-830e-d3c552d8f582"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:33:57.046380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4f46af56-8f77-45e5-8710-120d9a0b68af req-21f0ad95-1a42-4bfd-bf3c-d870dbf79e6f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:57.046833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4f46af56-8f77-45e5-8710-120d9a0b68af req-21f0ad95-1a42-4bfd-bf3c-d870dbf79e6f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:57.059724 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4f46af56-8f77-45e5-8710-120d9a0b68af req-21f0ad95-1a42-4bfd-bf3c-d870dbf79e6f service nova] Creating event network-changed:af1ce49c-e5fa-4911-830e-d3c552d8f582 for instance 6c329e15-e958-4f69-a9a7-39af86b7f306 on nch1-master-1 Jul 02 21:33:57.064567 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4f46af56-8f77-45e5-8710-120d9a0b68af req-21f0ad95-1a42-4bfd-bf3c-d870dbf79e6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112533 Jul 02 21:33:57.065183 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2723/5467] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:33:57.938735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:57.940347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:57.949275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:57.949820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:57.950693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:57.951185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:58.087996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:58.095912 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3a83d474-7bbe-4afb-b1c2-d5ff9a4e29f2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.161933 Jul 02 21:33:58.096500 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2745/5468] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:57 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:33:59.114609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:33:59.115324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:33:59.122382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:59.122840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:59.123808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:33:59.124309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:33:59.263680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:33:59.271611 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-593f3cbe-01cd-427b-9d82-535d21396e87 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.162225 Jul 02 21:33:59.272241 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2724/5469] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:33:59 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:00.290593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:00.291416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:00.301011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:00.301620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:00.303029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:00.303617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:00.462046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:00.473690 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d27f31a-1657-499a-ab90-c448f07cca68 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.188185 Jul 02 21:34:00.474528 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2746/5470] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:00 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:01.495998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:01.496689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:01.507969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:01.508694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:01.509803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:01.510458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:01.650002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:01.658465 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a5d88571-c380-4867-8595-aa63d990e1aa tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.168611 Jul 02 21:34:01.659566 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2725/5471] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:01 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:02.676511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:02.677109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:02.685008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:02.685477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:02.686376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:02.686830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:02.870499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:02.878380 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a17e7c3f-f7f0-4448-89f6-415aecff246f tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.205750 Jul 02 21:34:02.878973 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2747/5472] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:02 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:03.827785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b4a07880-4a1c-4223-ba41-2c3e50a7ffd8 req-fb45141b-02a1-49ac-a3ec-0750364f909f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c329e15-e958-4f69-a9a7-39af86b7f306", "name": "network-vif-plugged", "status": "completed", "tag": "af1ce49c-e5fa-4911-830e-d3c552d8f582"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:03.838673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b4a07880-4a1c-4223-ba41-2c3e50a7ffd8 req-fb45141b-02a1-49ac-a3ec-0750364f909f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:03.839123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b4a07880-4a1c-4223-ba41-2c3e50a7ffd8 req-fb45141b-02a1-49ac-a3ec-0750364f909f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:03.851788 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b4a07880-4a1c-4223-ba41-2c3e50a7ffd8 req-fb45141b-02a1-49ac-a3ec-0750364f909f service nova] Creating event network-vif-plugged:af1ce49c-e5fa-4911-830e-d3c552d8f582 for instance 6c329e15-e958-4f69-a9a7-39af86b7f306 on nch1-master-1 Jul 02 21:34:03.856965 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b4a07880-4a1c-4223-ba41-2c3e50a7ffd8 req-fb45141b-02a1-49ac-a3ec-0750364f909f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033474 Jul 02 21:34:03.857788 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2726/5473] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:03.895182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:03.895928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:03.903849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:03.904346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:03.905402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:03.906142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:04.043254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:04.051146 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f741830-b4f5-45b9-bba5-254716413e5a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.159975 Jul 02 21:34:04.051684 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2748/5474] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:03 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:04.764325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:04.765150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:04.769764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:04.770475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:04.777954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:04.778418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:04.779250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:04.779702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:04.919755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:04.928191 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-303706bf-85ff-485e-82a0-27f867a927fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1681 microversion: 2.1 time: 0.164845 Jul 02 21:34:04.928778 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2727/5475] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:04 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:05.018946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:05.019956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:05.022018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:05.028487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.028945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.029743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.030160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.068346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:05.068957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:05.075486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.075943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.076891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.077329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.084549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e545fda9-80a5-4e11-a75f-6ba3701adac0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action" status: 200 len: 32648 microversion: 2.1 time: 0.069348 Jul 02 21:34:05.085151 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2749/5476] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:34:05 2022] POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action => generated 32648 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:34:05.214959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:05.223263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a196fa50-6af8-4698-9f71-7b6ac1b8fa54 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1372 microversion: 2.1 time: 0.158906 Jul 02 21:34:05.223820 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2728/5477] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:05 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:05.227488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:05.228343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:05.236074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.236524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.237291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.237719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.387506 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fa29f670-ffde-4951-b2a1-80246712176e tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1832 microversion: 2.1 time: 0.164331 Jul 02 21:34:05.388104 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2750/5478] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:05 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1832 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:05.411468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:05.412714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:05.418946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.419398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.420193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:05.420697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:05.457378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lazy-loading 'flavor' on Instance uuid 8e263056-53d2-485b-9b21-531b89f13e70 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:34:05.471088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Going to try to live migrate instance to another host {{(pid=131045) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 02 21:34:06.240098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:06.241277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:06.248568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:06.249030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:06.249839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:06.250279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:06.394572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:06.402653 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db0b0016-5bc6-4606-bfa0-3dd7337bad9a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1544 microversion: 2.1 time: 0.166535 Jul 02 21:34:06.403583 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2751/5479] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:06 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:34:06.418932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:06.419501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:06.425773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:06.426250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:06.427573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:06.428014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:06.566345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:06.574261 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64d6038f-c393-4fb0-a6df-94fd9b894fba tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1544 microversion: 2.1 time: 0.159079 Jul 02 21:34:06.574848 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2752/5480] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:06 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1544 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:06.862540 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27e05ae1-c983-4582-a460-42fd05de99c7 tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action" status: 202 len: 0 microversion: 2.1 time: 1.454929 Jul 02 21:34:06.863155 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2729/5481] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:34:05 2022] POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action => generated 0 bytes in 1456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:34:06.874033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:06.874194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:06.882634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:06.883085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:06.883868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:06.884345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:07.040712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:07.048724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-976d3929-e44a-4d47-ad1c-424f730687d5 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.179702 Jul 02 21:34:07.049324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2753/5482] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:06 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:34:08.021939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e1c88ef1-6f36-4836-a67e-e89c8e2144ef req-a98891c4-5c36-43c0-94bb-cea8d60eeb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:08.033188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e1c88ef1-6f36-4836-a67e-e89c8e2144ef req-a98891c4-5c36-43c0-94bb-cea8d60eeb46 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:08.033643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e1c88ef1-6f36-4836-a67e-e89c8e2144ef req-a98891c4-5c36-43c0-94bb-cea8d60eeb46 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:08.046624 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e1c88ef1-6f36-4836-a67e-e89c8e2144ef req-a98891c4-5c36-43c0-94bb-cea8d60eeb46 service nova] Creating event network-vif-unplugged:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch2-master-1 Jul 02 21:34:08.052439 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e1c88ef1-6f36-4836-a67e-e89c8e2144ef req-a98891c4-5c36-43c0-94bb-cea8d60eeb46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034941 Jul 02 21:34:08.054460 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2730/5483] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:08.068486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:08.069135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:08.085804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:08.092838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:08.094108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:08.097620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:08.356311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:08.367219 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2587d798-dabd-4a10-b3d3-daeb689969a3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.303701 Jul 02 21:34:08.368420 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2754/5484] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:08 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:09.387259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:09.387877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:09.397933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:09.398405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:09.399183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:09.399629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:09.618217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:09.627028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2128ec6b-bb50-4514-a71c-7c21c035d23f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.244645 Jul 02 21:34:09.627869 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2731/5485] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:09 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:10.079587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b31233c6-c29b-4b8a-8f7d-9d8537f5f9e2 req-f78891b9-9ae5-4752-931d-0b177bd11e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:10.089209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b31233c6-c29b-4b8a-8f7d-9d8537f5f9e2 req-f78891b9-9ae5-4752-931d-0b177bd11e91 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:10.089661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b31233c6-c29b-4b8a-8f7d-9d8537f5f9e2 req-f78891b9-9ae5-4752-931d-0b177bd11e91 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:10.107412 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b31233c6-c29b-4b8a-8f7d-9d8537f5f9e2 req-f78891b9-9ae5-4752-931d-0b177bd11e91 service nova] Creating event network-changed:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch2-master-1 Jul 02 21:34:10.113598 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b31233c6-c29b-4b8a-8f7d-9d8537f5f9e2 req-f78891b9-9ae5-4752-931d-0b177bd11e91 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038073 Jul 02 21:34:10.114421 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2755/5486] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:10.645352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:10.645962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:10.652871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:10.653606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:10.654396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:10.654841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:10.853780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:10.867256 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-906f183c-b6c9-476d-9ef3-8b9e60d2c140 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.225755 Jul 02 21:34:10.867861 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2732/5487] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:10 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:11.886352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:11.887055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:11.893729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:11.894155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:11.894941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:11.895380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:12.036195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:12.044785 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc1af609-57e8-40cd-be38-b3ca159bbaef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.163504 Jul 02 21:34:12.045492 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2756/5488] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:11 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:13.063200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:13.063810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:13.071384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:13.071873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:13.072699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:13.073116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:13.209644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:13.219055 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac539377-bcdb-44a0-9adf-1e370de6546b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.160055 Jul 02 21:34:13.219779 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2733/5489] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:13 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:14.243073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:14.243943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:14.253229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:14.253678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:14.254449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:14.254883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:14.393328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:14.401057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-38635114-28c5-4720-b983-bec13febbb0d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.164764 Jul 02 21:34:14.401626 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2757/5490] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:14 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:15.418629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:15.419247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:15.426919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:15.427744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:15.428566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:15.429012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:15.573545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:15.581781 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc7ecae6-8b1a-42fc-b6e0-6e85b3a77a9e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.167408 Jul 02 21:34:15.582373 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2734/5491] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:15 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:16.603006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:16.604303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:16.613317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:16.613783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:16.614598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:16.615041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:16.769371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:16.777403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d1f271e-9b2a-47d6-8b61-2d03143ee48e tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.181038 Jul 02 21:34:16.777974 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2758/5492] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:16 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:17.157323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7c5de9fa-3d10-409f-afef-5f076836c9df req-534d95de-378f-4373-a516-42bd7fccd760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "name": "network-vif-unplugged", "status": "completed", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:17.167024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7c5de9fa-3d10-409f-afef-5f076836c9df req-534d95de-378f-4373-a516-42bd7fccd760 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:17.167638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7c5de9fa-3d10-409f-afef-5f076836c9df req-534d95de-378f-4373-a516-42bd7fccd760 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:17.180368 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7c5de9fa-3d10-409f-afef-5f076836c9df req-534d95de-378f-4373-a516-42bd7fccd760 service nova] Creating event network-vif-unplugged:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch2-master-1 Jul 02 21:34:17.185897 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7c5de9fa-3d10-409f-afef-5f076836c9df req-534d95de-378f-4373-a516-42bd7fccd760 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032401 Jul 02 21:34:17.187610 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2735/5493] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:17.795030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:17.795612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:17.804462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:17.804927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:17.805751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:17.806196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:17.943507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:17.952558 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-573579c8-0e70-4faf-ab3c-b66c3826433f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1691 microversion: 2.1 time: 0.161535 Jul 02 21:34:17.957977 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2759/5494] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:17 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:18.973682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:18.974298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:18.980933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:18.981621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:18.982414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:18.982860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.119004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:19.126963 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ceed2ead-d46e-4c60-be41-6e729e5315cf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1681 microversion: 2.1 time: 0.159021 Jul 02 21:34:19.127587 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2736/5495] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:18 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:19.143830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:19.144456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:19.151870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:19.152357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.153131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:19.153565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.291757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:19.296741 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c710ae1e-511e-4e18-8978-de6bafd0f88d tempest-TestNetworkAdvancedServerOps-197249980 tempest-TestNetworkAdvancedServerOps-197249980-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1832 microversion: 2.1 time: 0.157426 Jul 02 21:34:19.297324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2760/5496] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:19 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1832 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:19.314356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:19.315000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:19.321614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:19.322074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.322851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:19.323318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.464861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:19.473594 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6702ee83-bc93-4939-be7b-bc2b53bac858 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1681 microversion: 2.1 time: 0.163213 Jul 02 21:34:19.474472 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2737/5497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:19 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:19.573768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:19.574571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:19.581176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:19.581650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.582389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:19.582822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:19.639750 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2bec3718-c1bb-430b-903d-77e27b019715 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action" status: 200 len: 38600 microversion: 2.1 time: 0.070448 Jul 02 21:34:19.640427 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2761/5498] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:34:19 2022] POST /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70/action => generated 38600 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:34:20.685351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:20.687219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:20.694362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-236dec61-0b5d-4657-ba9c-c1d783f8c938 req-6421fa93-086e-418d-8e53-efcec37098fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:20.695844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:20.696513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:20.697476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:20.698089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:20.705310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-236dec61-0b5d-4657-ba9c-c1d783f8c938 req-6421fa93-086e-418d-8e53-efcec37098fd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:20.705865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-236dec61-0b5d-4657-ba9c-c1d783f8c938 req-6421fa93-086e-418d-8e53-efcec37098fd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:20.718341 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-236dec61-0b5d-4657-ba9c-c1d783f8c938 req-6421fa93-086e-418d-8e53-efcec37098fd service nova] Creating event network-changed:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch1-master-1 Jul 02 21:34:20.724557 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-236dec61-0b5d-4657-ba9c-c1d783f8c938 req-6421fa93-086e-418d-8e53-efcec37098fd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034302 Jul 02 21:34:20.725776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2762/5499] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:34:20.729716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:34:20.744851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:20.855144 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cde298bb-21fd-4f37-99a1-c048474c29e3 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 204 len: 0 microversion: 2.1 time: 0.173484 Jul 02 21:34:20.859272 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2738/5500] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:34:20 2022] DELETE /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:34:20.865443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:20.866177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:20.873963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:20.874420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:20.875393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:20.875838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:21.012199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:21.020419 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3984bb6f-b05f-456b-a385-99fdf785ac4a tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1687 microversion: 2.1 time: 0.159384 Jul 02 21:34:21.021206 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2763/5501] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:20 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:34:22.040070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:22.040826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:22.048408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:22.049180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:22.050098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:22.050540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:22.128293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:22.135970 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51ee0b43-440d-40f0-b733-0237aa36088c tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 200 len: 1501 microversion: 2.1 time: 0.100744 Jul 02 21:34:22.136578 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2739/5502] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:22 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 1501 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:22.740894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-dc2c4100-5c10-4aff-a1df-969f94b6327d req-ac7b92b9-4590-4344-9ec7-1d01b6c57952 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e263056-53d2-485b-9b21-531b89f13e70", "name": "network-vif-deleted", "tag": "8aa4142c-2f7d-4643-857c-25980822b1ba"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:22.753679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc2c4100-5c10-4aff-a1df-969f94b6327d req-ac7b92b9-4590-4344-9ec7-1d01b6c57952 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:22.754145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-dc2c4100-5c10-4aff-a1df-969f94b6327d req-ac7b92b9-4590-4344-9ec7-1d01b6c57952 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:22.769709 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-dc2c4100-5c10-4aff-a1df-969f94b6327d req-ac7b92b9-4590-4344-9ec7-1d01b6c57952 service nova] Creating event network-vif-deleted:8aa4142c-2f7d-4643-857c-25980822b1ba for instance 8e263056-53d2-485b-9b21-531b89f13e70 on nch1-master-1 Jul 02 21:34:22.774955 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-dc2c4100-5c10-4aff-a1df-969f94b6327d req-ac7b92b9-4590-4344-9ec7-1d01b6c57952 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037840 Jul 02 21:34:22.775754 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2764/5503] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:23.153793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:23.154419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 8e263056-53d2-485b-9b21-531b89f13e70] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:23.157460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:23.163379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:23.163838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:23.164657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:23.165103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:23.181105 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] HTTP exception thrown: Instance 8e263056-53d2-485b-9b21-531b89f13e70 could not be found. Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Request method failure captured: Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 HTTP/1.1 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLhkw9i0xORUg4JVijXvZ-4U1BZ1T3vJ_VfTmMqg_N2dqNUc88WBpxoj4nsbYgkfhphBvdR9ozDzk0JXzIa-QWkcPzjljVDoEVJzvK_enf0dUIxCZyWpC0p_rfy-XLmvh2U3mqnGIHAd7Qjj6CF51pfpap30_IBFcdgnFVbhTJ_4joo Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1b2fbfc815c48588a0bec36818df1a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1b2fbfc815c48588a0bec36818df1a3"}]}] Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 317a63cdd16b4fd69617fb9de95dc4ec Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8e263056-53d2-485b-9b21-531b89f13e70 could not be found. Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8e263056-53d2-485b-9b21-531b89f13e70'} Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e263056-53d2-485b-9b21-531b89f13e70 could not be found. Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e263056-53d2-485b-9b21-531b89f13e70 could not be found. Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:23.182782 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e263056-53d2-485b-9b21-531b89f13e70 could not be found. Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Returning 404 to user: Instance 8e263056-53d2-485b-9b21-531b89f13e70 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6e6a43d2-51c6-493f-a02c-666d515688fc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70" status: 404 len: 111 microversion: 2.1 time: 0.034558 Jul 02 21:34:23.187887 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2740/5504] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:23 2022] GET /compute/v2.1/servers/8e263056-53d2-485b-9b21-531b89f13e70 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:34:26.507702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-942b8122-5950-4099-bf7c-ea16ee2cfa63 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '.version_select at 0x7fabe4673820>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:26.514222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=49 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:26.526802 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-942b8122-5950-4099-bf7c-ea16ee2cfa63 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-762545463" status: 202 len: 0 microversion: 2.1 time: 0.024739 Jul 02 21:34:26.527617 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2765/5505] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 21:34:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-762545463 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:34:26.556964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-736aeff4-1c56-4998-aa4c-aef7d4c67c1b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: .version_select at 0x7fabd75bdaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1474338739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNW8nL6H41kQSXso6FiGlX7VU/Stm6LhgG4VQK7NKf3C95Pdwee46qdFG+Tf7+ePgmBfvW0eke0T90f/t/OM8fKRRfI6BHoznbmZLyOAnOMihy/mxqNVGKXLEKKc1xU7Og=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:26.572417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-736aeff4-1c56-4998-aa4c-aef7d4c67c1b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:34:26.577730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-736aeff4-1c56-4998-aa4c-aef7d4c67c1b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:34:26.604333 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-736aeff4-1c56-4998-aa4c-aef7d4c67c1b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051806 Jul 02 21:34:26.605129 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2741/5506] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:34:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:32.331582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-191130472", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "2295f9a3-1f7c-4c80-899f-77f34b6c5c4c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1474338739", "security_groups": [{"name": "tempest-secgroup-smoke-1662506999"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:32.453251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] validate_networks() for [('2295f9a3-1f7c-4c80-899f-77f34b6c5c4c', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:34:32.765793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:32.869197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:34:32.869623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:34:32.870094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:34:32.870685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:34:32.871264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:34:32.886471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:32.886920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:32.887717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:32.890552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:32.906218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:34:32.911895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Getting quotas for user 317a63cdd16b4fd69617fb9de95dc4ec and project e1b2fbfc815c48588a0bec36818df1a3. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:34:32.925108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:34:32.929551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:34:33.015599 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f925aed5-d647-432e-9acc-766ea6bc5c78 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689962 Jul 02 21:34:33.016404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2766/5507] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:34:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:34:33.027002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-754d0269-c97f-42a9-afd3-9f333236bacb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:33.027624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-754d0269-c97f-42a9-afd3-9f333236bacb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:33.085344 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-754d0269-c97f-42a9-afd3-9f333236bacb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:33.098470 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-754d0269-c97f-42a9-afd3-9f333236bacb tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1266 microversion: 2.1 time: 0.075453 Jul 02 21:34:33.107173 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2742/5508] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:33 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:34.115682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:34.116936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:34.126292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:34.127104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:34.128645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:34.129275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:34.242133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:34.266329 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1c61eb60-e33d-4209-8960-e37392dfa00b tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1326 microversion: 2.1 time: 0.155005 Jul 02 21:34:34.266976 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2767/5509] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:34 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:35.285007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:35.286392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:35.289872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:35.296966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:35.300985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:35.301843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:35.302670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:35.545051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:35.554296 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e915a93e-843e-4806-aca7-5eb7781130c9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1392 microversion: 2.1 time: 0.274117 Jul 02 21:34:35.554968 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2743/5510] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:35 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1392 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:35.901870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3c46e09d-a06f-4c18-832f-d7270130f575 req-9488e69d-ba07-4c40-86c5-907a76d98c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707c9f7e-314f-4053-97b7-f88bc4fa1295", "tag": "d76e1bec-50c3-4640-97b5-9dd78e048943"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:35.915995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c46e09d-a06f-4c18-832f-d7270130f575 req-9488e69d-ba07-4c40-86c5-907a76d98c7a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:35.916608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3c46e09d-a06f-4c18-832f-d7270130f575 req-9488e69d-ba07-4c40-86c5-907a76d98c7a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:35.938580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3c46e09d-a06f-4c18-832f-d7270130f575 req-9488e69d-ba07-4c40-86c5-907a76d98c7a service nova] Creating event network-changed:d76e1bec-50c3-4640-97b5-9dd78e048943 for instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 on nch2-master-1 Jul 02 21:34:35.945071 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3c46e09d-a06f-4c18-832f-d7270130f575 req-9488e69d-ba07-4c40-86c5-907a76d98c7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049153 Jul 02 21:34:35.946293 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2768/5511] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:36.572728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:36.573358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:36.581012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:36.581505 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:36.582296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:36.582744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:36.723500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:36.732414 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d116e26-0253-45a6-9301-905f1079ba29 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1392 microversion: 2.1 time: 0.163097 Jul 02 21:34:36.732640 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2744/5512] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:36 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:37.757270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:37.757969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:37.765847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:37.766296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:37.767070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:37.767503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:37.952719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:37.960664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e40fb7dc-4fa7-4de4-93a6-f82c8a081789 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1392 microversion: 2.1 time: 0.210100 Jul 02 21:34:37.961233 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2769/5513] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:37 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:38.977965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:38.978589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:38.986021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:38.986449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:38.987233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:38.987678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:39.123726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:39.131767 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4811d0a0-0e46-4df2-9130-5ac4e16993cc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1392 microversion: 2.1 time: 0.157786 Jul 02 21:34:39.132383 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2745/5514] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:38 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:40.152782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:40.153815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:40.165641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:40.166398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:40.167779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:40.168559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:40.309310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:40.317316 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de125e63-a13d-4dd6-9f65-f1f93eadb4f8 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1392 microversion: 2.1 time: 0.171235 Jul 02 21:34:40.317987 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2770/5515] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:40 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:40.439652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-cf46494e-b7ae-42d4-8341-1040bb46ee03 req-e849d265-ec96-4fd0-8b62-6a1747d73bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c9f7e-314f-4053-97b7-f88bc4fa1295", "name": "network-vif-plugged", "status": "completed", "tag": "d76e1bec-50c3-4640-97b5-9dd78e048943"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:40.451312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-cf46494e-b7ae-42d4-8341-1040bb46ee03 req-e849d265-ec96-4fd0-8b62-6a1747d73bd5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:40.451766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-cf46494e-b7ae-42d4-8341-1040bb46ee03 req-e849d265-ec96-4fd0-8b62-6a1747d73bd5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:40.463984 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-cf46494e-b7ae-42d4-8341-1040bb46ee03 req-e849d265-ec96-4fd0-8b62-6a1747d73bd5 service nova] Creating event network-vif-plugged:d76e1bec-50c3-4640-97b5-9dd78e048943 for instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 on nch2-master-1 Jul 02 21:34:40.469358 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-cf46494e-b7ae-42d4-8341-1040bb46ee03 req-e849d265-ec96-4fd0-8b62-6a1747d73bd5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033567 Jul 02 21:34:40.469971 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2746/5516] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:41.338242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:41.339258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:41.351404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:41.352089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:41.353390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:41.354124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:41.493868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:41.505248 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8d821f35-f6fb-41fb-bd33-e2e236715680 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1392 microversion: 2.1 time: 0.173320 Jul 02 21:34:41.506084 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2771/5517] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:41 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:42.525904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:42.526586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:42.533692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:42.534144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:42.535028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:42.535475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:42.673414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:42.681795 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-927e806d-302e-45b4-bf6b-63bae2b1ce1d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1564 microversion: 2.1 time: 0.160291 Jul 02 21:34:42.682380 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2747/5518] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:42 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:42.698091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:42.698843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:42.706316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:42.706861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:42.707709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:42.708256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:42.850233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:42.858681 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dbff6ba1-de33-4be1-8873-1d9f7710ddaf tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1564 microversion: 2.1 time: 0.164539 Jul 02 21:34:42.859341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2772/5519] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:42 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:43.427943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:43.428485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:43.430651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:43.436361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:43.436828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:43.437876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:43.438131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:43.469623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:34:43.561621 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de4b9477-e9f4-4362-93b5-5d7f1cd4d7e4 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 204 len: 0 microversion: 2.1 time: 0.137734 Jul 02 21:34:43.562804 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2748/5520] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:34:43 2022] DELETE /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:34:43.571564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:43.572227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:43.577841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:43.578534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:43.580375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:43.581023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:43.581878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:43.582329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:43.811486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:43.819662 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fc537d6-0b86-4da2-964b-0322f3e1fc4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1550 microversion: 2.1 time: 0.252257 Jul 02 21:34:43.820282 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2773/5521] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:43 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1550 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:44.837732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:44.838691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:44.847534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:44.848365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:44.849337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:44.849964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:45.015609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:45.016415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:45.023870 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:45.024378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:45.025167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:45.025818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:45.041811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:45.049836 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75749c36-33a7-4867-a42e-8e3c78f19545 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1550 microversion: 2.1 time: 0.216695 Jul 02 21:34:45.060625 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2749/5522] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:44 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1550 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:45.065610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1dc96afb-5224-41a9-9304-4a3927841fb6 req-733614b7-dfd7-48e0-80c8-94f7aed6a165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707c9f7e-314f-4053-97b7-f88bc4fa1295", "tag": "d76e1bec-50c3-4640-97b5-9dd78e048943"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:45.073925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1dc96afb-5224-41a9-9304-4a3927841fb6 req-733614b7-dfd7-48e0-80c8-94f7aed6a165 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:45.074380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1dc96afb-5224-41a9-9304-4a3927841fb6 req-733614b7-dfd7-48e0-80c8-94f7aed6a165 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:45.087171 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1dc96afb-5224-41a9-9304-4a3927841fb6 req-733614b7-dfd7-48e0-80c8-94f7aed6a165 service nova] Creating event network-changed:d76e1bec-50c3-4640-97b5-9dd78e048943 for instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 on nch2-master-1 Jul 02 21:34:45.093228 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1dc96afb-5224-41a9-9304-4a3927841fb6 req-733614b7-dfd7-48e0-80c8-94f7aed6a165 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031200 Jul 02 21:34:45.094734 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2750/5523] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:45.296184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:45.304751 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-04339f68-2793-4043-bee3-9da492b32a94 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1564 microversion: 2.1 time: 0.293548 Jul 02 21:34:45.305522 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2774/5524] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:45 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1564 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:34:46.070013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:46.071277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:46.078597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:46.078987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:46.079817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:46.084777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:46.155831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:46.166245 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63263440-b9d2-4722-83bf-c3d303d95731 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 200 len: 1332 microversion: 2.1 time: 0.101392 Jul 02 21:34:46.167036 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2751/5525] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:46 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:47.108156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f916a669-148d-4bfc-ab6f-b942f404dcf9 req-6a5dee79-f977-492b-ba4f-3684eb4326bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c329e15-e958-4f69-a9a7-39af86b7f306", "name": "network-vif-deleted", "tag": "af1ce49c-e5fa-4911-830e-d3c552d8f582"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:47.117691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f916a669-148d-4bfc-ab6f-b942f404dcf9 req-6a5dee79-f977-492b-ba4f-3684eb4326bf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:47.118140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f916a669-148d-4bfc-ab6f-b942f404dcf9 req-6a5dee79-f977-492b-ba4f-3684eb4326bf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:47.129191 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f916a669-148d-4bfc-ab6f-b942f404dcf9 req-6a5dee79-f977-492b-ba4f-3684eb4326bf service nova] Creating event network-vif-deleted:af1ce49c-e5fa-4911-830e-d3c552d8f582 for instance 6c329e15-e958-4f69-a9a7-39af86b7f306 on nch1-master-1 Jul 02 21:34:47.134307 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f916a669-148d-4bfc-ab6f-b942f404dcf9 req-6a5dee79-f977-492b-ba4f-3684eb4326bf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029880 Jul 02 21:34:47.134950 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2775/5526] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:47.186397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:47.187024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: 6c329e15-e958-4f69-a9a7-39af86b7f306] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:47.194781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:47.195263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:47.196070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:47.196570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:47.210924 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] HTTP exception thrown: Instance 6c329e15-e958-4f69-a9a7-39af86b7f306 could not be found. Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Request method failure captured: Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 HTTP/1.1 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLlni__KoVOchQJ1TXXqp3yVtqrbGgQ8VTU49f_wfEqc7WjVO-FS4yKerGGbEvFD2R3dimwRonmEW4IlqnGdIZEZ4oJeIlQGUVPou6bvzhIz5d9cS8K06wFB1j1pHuLhsemHLVkPXj_Ojc9pu8eJdMsRNEyeTBNv1dARohjP1W0n8KY Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: f74b842162f6463a9e93046d070919e7 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f74b842162f6463a9e93046d070919e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f74b842162f6463a9e93046d070919e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f74b842162f6463a9e93046d070919e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f74b842162f6463a9e93046d070919e7"}]}] Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: f74b842162f6463a9e93046d070919e7 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestNetworkBasicOps-1299219633-project Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 150099eea6064cebbd876d26a3d6fe4a Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestNetworkBasicOps-1299219633-project Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 6c329e15-e958-4f69-a9a7-39af86b7f306 could not be found. Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '6c329e15-e958-4f69-a9a7-39af86b7f306'} Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c329e15-e958-4f69-a9a7-39af86b7f306 could not be found. Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c329e15-e958-4f69-a9a7-39af86b7f306 could not be found. Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:34:47.212988 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c329e15-e958-4f69-a9a7-39af86b7f306 could not be found. Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Returning 404 to user: Instance 6c329e15-e958-4f69-a9a7-39af86b7f306 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5939e8cf-1ec7-47fd-9c62-1894f36587ec tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306" status: 404 len: 111 microversion: 2.1 time: 0.031690 Jul 02 21:34:47.218219 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2752/5527] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:47 2022] GET /compute/v2.1/servers/6c329e15-e958-4f69-a9a7-39af86b7f306 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:34:47.387643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bb664d59-3b86-49e8-ae34-5b0ac34ef92e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '.version_select at 0x7fabd791a0d0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:47.406977 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bb664d59-3b86-49e8-ae34-5b0ac34ef92e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-839028282" status: 202 len: 0 microversion: 2.1 time: 0.023498 Jul 02 21:34:47.407588 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2776/5528] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:34:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-839028282 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:34:49.716961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:49.717467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:49.720206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-51bf5795-1919-4a6a-9107-2121d098b0ba req-4f5c45b4-6f96-4f39-8f72-fc4a69005074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff499d-cd3b-4cd6-9c67-b8c9165ce409", "tag": "ec8b3123-6f6c-4e7a-a57b-3c3da33ae394"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:49.725663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:49.726113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:49.726891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:49.727296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:49.729765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-51bf5795-1919-4a6a-9107-2121d098b0ba req-4f5c45b4-6f96-4f39-8f72-fc4a69005074 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:49.730255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-51bf5795-1919-4a6a-9107-2121d098b0ba req-4f5c45b4-6f96-4f39-8f72-fc4a69005074 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:49.741398 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-51bf5795-1919-4a6a-9107-2121d098b0ba req-4f5c45b4-6f96-4f39-8f72-fc4a69005074 service nova] Creating event network-changed:ec8b3123-6f6c-4e7a-a57b-3c3da33ae394 for instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 on nch1-master-1 Jul 02 21:34:49.746628 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-51bf5795-1919-4a6a-9107-2121d098b0ba req-4f5c45b4-6f96-4f39-8f72-fc4a69005074 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031118 Jul 02 21:34:49.748085 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2777/5529] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:34:49.759275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:34:49.853992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-026079c7-762e-4cb0-af98-5cc46b0b3969 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 204 len: 0 microversion: 2.1 time: 0.140185 Jul 02 21:34:49.854666 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2753/5530] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:34:49 2022] DELETE /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:34:49.863750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:49.864732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:49.871363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:49.872062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:49.873035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:49.873638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:50.045996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:50.055432 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-610550d0-bf7f-4cc8-b977-8e5ceaca18ad tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1668 microversion: 2.1 time: 0.196002 Jul 02 21:34:50.056026 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2778/5531] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:49 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1668 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:51.073574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:51.074208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:51.081533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:51.082020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:51.082783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:51.083268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:51.241786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:51.254041 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-04f02863-5338-4522-b16c-2aa5944006b8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1668 microversion: 2.1 time: 0.184670 Jul 02 21:34:51.254815 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2754/5532] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:51 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:51.911294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0dd7a5d6-c19d-4945-ab67-5400c4c17772 req-c0524b11-eb03-4145-a18e-0e5bd1c8dc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff499d-cd3b-4cd6-9c67-b8c9165ce409", "name": "network-vif-deleted", "tag": "ec8b3123-6f6c-4e7a-a57b-3c3da33ae394"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:34:51.920818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0dd7a5d6-c19d-4945-ab67-5400c4c17772 req-c0524b11-eb03-4145-a18e-0e5bd1c8dc2f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:51.921251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0dd7a5d6-c19d-4945-ab67-5400c4c17772 req-c0524b11-eb03-4145-a18e-0e5bd1c8dc2f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:51.933499 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0dd7a5d6-c19d-4945-ab67-5400c4c17772 req-c0524b11-eb03-4145-a18e-0e5bd1c8dc2f service nova] Creating event network-vif-deleted:ec8b3123-6f6c-4e7a-a57b-3c3da33ae394 for instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 on nch1-master-1 Jul 02 21:34:51.938283 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0dd7a5d6-c19d-4945-ab67-5400c4c17772 req-c0524b11-eb03-4145-a18e-0e5bd1c8dc2f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030853 Jul 02 21:34:51.938921 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2779/5533] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:34:52.276868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:52.278898 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:52.287713 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:52.288170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:52.289155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:52.289601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:52.330356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:52.330810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:52.331280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lazy-loading 'fault' on Instance uuid ebff499d-cd3b-4cd6-9c67-b8c9165ce409 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:34:52.379975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:34:52.387746 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aa697b6d-2306-4144-a6b6-2aa5ce0976d8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 200 len: 1337 microversion: 2.1 time: 0.115273 Jul 02 21:34:52.388582 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2755/5534] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:52 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 1337 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:34:53.406743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:53.407443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: ebff499d-cd3b-4cd6-9c67-b8c9165ce409] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:34:53.414120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:53.414576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:53.415348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:34:53.415849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:34:53.429891 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] HTTP exception thrown: Instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 could not be found. Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Request method failure captured: Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 HTTP/1.1 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLlni__KoVOchQJ1TXXqp3yVtqrbGgQ8VTU49f_wfEqc7WjVO-FS4yKerGGbEvFD2R3dimwRonmEW4IlqnGdIZEZ4oJeIlQGUVPou6bvzhIz5d9cS8K06wFB1j1pHuLhsemHLVkPXj_Ojc9pu8eJdMsRNEyeTBNv1dARohjP1W0n8KY Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f74b842162f6463a9e93046d070919e7 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f74b842162f6463a9e93046d070919e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f74b842162f6463a9e93046d070919e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f74b842162f6463a9e93046d070919e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f74b842162f6463a9e93046d070919e7"}]}] Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f74b842162f6463a9e93046d070919e7 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestNetworkBasicOps-1299219633-project Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 150099eea6064cebbd876d26a3d6fe4a Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkBasicOps-1299219633-project Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 could not be found. Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'ebff499d-cd3b-4cd6-9c67-b8c9165ce409'} Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 could not be found. Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 could not be found. Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:34:53.431696 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 could not be found. Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Returning 404 to user: Instance ebff499d-cd3b-4cd6-9c67-b8c9165ce409 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f5dd729-4f71-4156-b0e3-ca1b72b8bb71 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409" status: 404 len: 111 microversion: 2.1 time: 0.031681 Jul 02 21:34:53.436065 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2780/5535] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:34:53 2022] GET /compute/v2.1/servers/ebff499d-cd3b-4cd6-9c67-b8c9165ce409 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:34:53.606483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8cd7f88d-5ed4-4a84-b211-3f0222d5ad9d tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '.version_select at 0x7fabd758b160>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:34:53.614271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:34:53.630353 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8cd7f88d-5ed4-4a84-b211-3f0222d5ad9d tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-891562335" status: 202 len: 0 microversion: 2.1 time: 0.027828 Jul 02 21:34:53.634280 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2756/5536] 10.222.0.43 () {58 vars in 1253 bytes} [Sat Jul 2 21:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-891562335 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:35:01.896879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e958e827-3f0b-413c-a486-48ae5372ad59 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'create', calling method: .version_select at 0x7fabe4304ca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1406999969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8drOTJ28MBOQyrDpUK/ln2LAQ1rqCl3t0My0z0Fm3L8PmFZbV5DmN0UZQt4su/C59u4OAJ6i4sG28N3ONrqofxZBJelsUVO7v5LXMJtlRxuqfiCcM6i0UwwSxoIsfBhg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:01.901994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:01.916440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e958e827-3f0b-413c-a486-48ae5372ad59 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for project f74b842162f6463a9e93046d070919e7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:35:01.922944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-e958e827-3f0b-413c-a486-48ae5372ad59 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for user 150099eea6064cebbd876d26a3d6fe4a and project f74b842162f6463a9e93046d070919e7. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:35:01.949149 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e958e827-3f0b-413c-a486-48ae5372ad59 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.056111 Jul 02 21:35:01.949790 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2781/5537] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:35:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:03.004259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1123244762", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "cc94ec0c-0792-4b2b-9eaa-8a122bd33c21"}], "key_name": "tempest-TestNetworkBasicOps-1406999969", "security_groups": [{"name": "tempest-secgroup-smoke-873888506"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:03.014415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:03.127923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] validate_networks() for [('cc94ec0c-0792-4b2b-9eaa-8a122bd33c21', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:35:03.505990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:35:03.506624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:35:03.507138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:35:03.507538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:35:03.507969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:35:03.517698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:03.518153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:03.518948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:03.519385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:03.537308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for project f74b842162f6463a9e93046d070919e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:35:03.543077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Getting quotas for user 150099eea6064cebbd876d26a3d6fe4a and project f74b842162f6463a9e93046d070919e7. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:35:03.557001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:35:03.559317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:35:03.606407 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-20739cb4-a65a-4121-a66b-3f6e50b55447 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.606589 Jul 02 21:35:03.607413 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2757/5538] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:35:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:35:03.617470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7753ceb-6a1a-4c9f-a876-05fad5281749 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:03.618038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7753ceb-6a1a-4c9f-a876-05fad5281749 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:03.621949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=60 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:03.695263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c7753ceb-6a1a-4c9f-a876-05fad5281749 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:03.709200 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7753ceb-6a1a-4c9f-a876-05fad5281749 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1249 microversion: 2.1 time: 0.095645 Jul 02 21:35:03.712938 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2782/5539] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:03 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:04.737211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:04.740364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:04.760321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:04.760981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:04.762972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:04.763490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:04.849757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:04.861736 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e314ebc8-fa13-4da7-ac09-7708e88f51ee tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1309 microversion: 2.1 time: 0.136363 Jul 02 21:35:04.862692 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2758/5540] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:04 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1309 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:05.879371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:05.880089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:05.888506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:05.888967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:05.889770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:05.890235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:06.044206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:06.053700 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93cffe3d-d5b7-4acd-b258-9f221e4d83fd tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.178363 Jul 02 21:35:06.085739 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2783/5541] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:05 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:06.234829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e5de8bf7-828b-401e-a27c-fd56bd0e9cb0 req-817efe37-1d61-404b-a24b-2be67c549e9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94af3c4-3a4a-4710-8480-50bde0644df2", "tag": "02ffc705-5c53-4301-af22-75c4340b7bdd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:06.245273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e5de8bf7-828b-401e-a27c-fd56bd0e9cb0 req-817efe37-1d61-404b-a24b-2be67c549e9e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:06.246311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e5de8bf7-828b-401e-a27c-fd56bd0e9cb0 req-817efe37-1d61-404b-a24b-2be67c549e9e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:06.258962 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e5de8bf7-828b-401e-a27c-fd56bd0e9cb0 req-817efe37-1d61-404b-a24b-2be67c549e9e service nova] Creating event network-changed:02ffc705-5c53-4301-af22-75c4340b7bdd for instance b94af3c4-3a4a-4710-8480-50bde0644df2 on nch1-master-1 Jul 02 21:35:06.263957 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e5de8bf7-828b-401e-a27c-fd56bd0e9cb0 req-817efe37-1d61-404b-a24b-2be67c549e9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035664 Jul 02 21:35:06.264991 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2759/5542] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:35:07.087609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:07.088186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:07.096550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:07.097008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:07.097788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:07.098229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:07.241366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:07.249205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c948b460-bc4c-4f92-92a1-dc61364d578a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.165754 Jul 02 21:35:07.249800 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2784/5543] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:07 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:08.269638 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:08.270418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:08.277080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:08.277545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:08.278326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:08.278767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:08.421242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:08.430086 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba306645-06c0-4e6c-8a1e-f429c7e5af4b tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.166852 Jul 02 21:35:08.430690 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2760/5544] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:08 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:09.451798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:09.453093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:09.464728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:09.465479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:09.466746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:09.467511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:09.611897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:09.619941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-78b43790-c1d9-4ed0-90d1-6ada69939d58 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.174816 Jul 02 21:35:09.620570 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2785/5545] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:09 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:10.570808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:10.571862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:10.579188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:10.579712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:10.580548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:10.580988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:10.637499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:10.638067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:10.644471 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc01c8cd-b436-424d-8d0e-cd0c10d893a0 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295/action" status: 200 len: 24564 microversion: 2.1 time: 0.078017 Jul 02 21:35:10.646261 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2761/5546] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:35:10 2022] POST /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295/action => generated 24564 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:35:10.646418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:10.646851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:10.647645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:10.648214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:10.783157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:10.790918 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2b7df610-dd1f-47eb-baf6-092484c09fb8 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.157860 Jul 02 21:35:10.791479 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2786/5547] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:10 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:35:11.813682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:11.814849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:11.822956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:11.823407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:11.824208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:11.824643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:11.961113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:11.969204 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-252bae9e-e3ac-4a09-bf3f-78f0fc4026f3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.162938 Jul 02 21:35:11.969743 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2762/5548] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:11 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:12.152185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-008ca51b-6e9c-44e4-b602-706b24afe807 req-a1d28c69-5197-4fc1-882c-bc958ffa87aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94af3c4-3a4a-4710-8480-50bde0644df2", "name": "network-vif-plugged", "status": "completed", "tag": "02ffc705-5c53-4301-af22-75c4340b7bdd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:12.162683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-008ca51b-6e9c-44e4-b602-706b24afe807 req-a1d28c69-5197-4fc1-882c-bc958ffa87aa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:12.163122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-008ca51b-6e9c-44e4-b602-706b24afe807 req-a1d28c69-5197-4fc1-882c-bc958ffa87aa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:12.174951 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-008ca51b-6e9c-44e4-b602-706b24afe807 req-a1d28c69-5197-4fc1-882c-bc958ffa87aa service nova] Creating event network-vif-plugged:02ffc705-5c53-4301-af22-75c4340b7bdd for instance b94af3c4-3a4a-4710-8480-50bde0644df2 on nch1-master-1 Jul 02 21:35:12.180533 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-008ca51b-6e9c-44e4-b602-706b24afe807 req-a1d28c69-5197-4fc1-882c-bc958ffa87aa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032665 Jul 02 21:35:12.181138 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2787/5549] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:12.991709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:12.992455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:13.001294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:13.001784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:13.002609 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:13.003079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:13.150357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:13.160782 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-468ab046-3c12-4dee-b9ee-2900b8be91d3 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1374 microversion: 2.1 time: 0.173340 Jul 02 21:35:13.161332 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2763/5550] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:12 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:14.183638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:14.184886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:14.189445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:14.195427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:14.195918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:14.196727 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:14.197160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:14.336788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:14.348279 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6de8cee-dff3-4db7-8464-8a5a8a8dde1e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1545 microversion: 2.1 time: 0.172293 Jul 02 21:35:14.348878 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2788/5551] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:14 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1545 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:14.367221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:14.367851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:14.371523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:14.372292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:14.382002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:14.382665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:14.383774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:14.384251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:14.524819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:14.533833 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4dce6119-c475-48d2-b355-1b94807552f6 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1545 microversion: 2.1 time: 0.172179 Jul 02 21:35:14.535738 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2764/5552] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:14 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1545 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:15.632071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:15.632632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:15.639710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:15.640239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:15.641048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:15.641477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:15.656248 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] HTTP exception thrown: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Request method failure captured: Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad HTTP/1.1 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLa3kF1RbKEycaMXSjM7YhSbgQRkJ_dH_xg2HlbQUtEWyrK5HznoAcacUAwV31eIgz9iUvP6wc6vbw3mgaugf3SLWaom5MtjJJunpBQ-jeNLDxp1Vqt90z62Lgpjg5zT_7erl0H17w89t2Yhfk4BMyOwZ6ks7geq805mjBxGlLcfvwA Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44ceefe86e694dc8a2c9a478eeb1d1c5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}] Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: a90caf8a110549e39bbaf7ec50a6207d Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '7695c9ea-dedd-41a5-bbd1-1b9027f019ad'} Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:35:15.658079 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Returning 404 to user: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6d48b29b-a41b-44df-ae8e-7d1e71a20cf7 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 404 len: 111 microversion: 2.1 time: 0.031460 Jul 02 21:35:15.663720 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2789/5553] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:35:15 2022] DELETE /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:35:15.669217 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:15.669844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] [instance: 7695c9ea-dedd-41a5-bbd1-1b9027f019ad] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:15.677473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:15.677928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:15.678701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:15.679134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:15.693343 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] HTTP exception thrown: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Request method failure captured: Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad HTTP/1.1 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLa3kF1RbKEycaMXSjM7YhSbgQRkJ_dH_xg2HlbQUtEWyrK5HznoAcacUAwV31eIgz9iUvP6wc6vbw3mgaugf3SLWaom5MtjJJunpBQ-jeNLDxp1Vqt90z62Lgpjg5zT_7erl0H17w89t2Yhfk4BMyOwZ6ks7geq805mjBxGlLcfvwA Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_44ceefe86e694dc8a2c9a478eeb1d1c5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/44ceefe86e694dc8a2c9a478eeb1d1c5"}]}] Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 44ceefe86e694dc8a2c9a478eeb1d1c5 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeTestJSON-393062371 Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: a90caf8a110549e39bbaf7ec50a6207d Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeTestJSON-393062371-project Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '7695c9ea-dedd-41a5-bbd1-1b9027f019ad'} Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:35:15.695165 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] Returning 404 to user: Instance 7695c9ea-dedd-41a5-bbd1-1b9027f019ad could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e846d74-d8fa-4356-9c95-247816d6e411 tempest-AttachVolumeTestJSON-393062371 tempest-AttachVolumeTestJSON-393062371-project] 10.222.0.43 "GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad" status: 404 len: 111 microversion: 2.1 time: 0.031659 Jul 02 21:35:15.699576 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2765/5554] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:15 2022] GET /compute/v2.1/servers/7695c9ea-dedd-41a5-bbd1-1b9027f019ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:35:16.174506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a570e941-d703-457e-a131-f09013ff1574 req-c784e2d8-ead6-4c8d-b96c-85eca9fe83f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94af3c4-3a4a-4710-8480-50bde0644df2", "tag": "02ffc705-5c53-4301-af22-75c4340b7bdd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:16.184747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a570e941-d703-457e-a131-f09013ff1574 req-c784e2d8-ead6-4c8d-b96c-85eca9fe83f7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:16.185205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a570e941-d703-457e-a131-f09013ff1574 req-c784e2d8-ead6-4c8d-b96c-85eca9fe83f7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:16.205162 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a570e941-d703-457e-a131-f09013ff1574 req-c784e2d8-ead6-4c8d-b96c-85eca9fe83f7 service nova] Creating event network-changed:02ffc705-5c53-4301-af22-75c4340b7bdd for instance b94af3c4-3a4a-4710-8480-50bde0644df2 on nch1-master-1 Jul 02 21:35:16.211082 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a570e941-d703-457e-a131-f09013ff1574 req-c784e2d8-ead6-4c8d-b96c-85eca9fe83f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040299 Jul 02 21:35:16.212413 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2790/5555] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:21.718929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:21.720845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:21.728575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:21.729068 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:21.729878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:21.730377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:21.811869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:35:21.812462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:35:21.812981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:35:21.813392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:35:21.813823 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:35:21.888416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:21.895175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:21.895760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:21.896703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:21.897269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:21.926006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-72b191d7-27ee-4c73-b2eb-7475ffc81f5f tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295/action" status: 202 len: 1136 microversion: 2.1 time: 0.214318 Jul 02 21:35:21.935996 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2766/5556] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:35:21 2022] POST /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295/action => generated 1136 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 02 21:35:21.942497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:21.943856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:21.951888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:21.952422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:21.953204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:21.953641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:22.207407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:22.216416 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-69bda4e0-8099-4bb8-afa5-66d5cdfce5f6 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.278662 Jul 02 21:35:22.217628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2791/5557] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:21 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:23.237966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:23.239247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:23.247023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:23.247701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:23.248870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:23.249315 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:23.394209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:23.406596 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e19f705-4de9-4e36-9e01-427e7d9252ef tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.175374 Jul 02 21:35:23.408065 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2767/5558] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:23 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:24.424576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:24.425940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:24.433867 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:24.434328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:24.435116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:24.435559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:24.507976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51e938db-3e8b-4c67-a873-cc239db47a97 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Action: 'create', calling method: .version_select at 0x7fabd797d550>, body: {"keypair": {"name": "tempest-keypair-723108984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM90TAlm04xd7xtoH/8wPCifPDH22/rwPfF6yvO1H86LlGT1Zw4RHBHsSUHFquJdL/qBDUGInkBg0wXYLGIwwgxy3xQCiFRipvOvn5kaJS6OMAE/a+GhTV8a8X4nTQp4vw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:24.535263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-51e938db-3e8b-4c67-a873-cc239db47a97 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:35:24.544995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-51e938db-3e8b-4c67-a873-cc239db47a97 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for user 39889b52b09a40ecacbf5a790e5bd20e and project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:35:24.583038 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51e938db-3e8b-4c67-a873-cc239db47a97 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206767 Jul 02 21:35:24.583677 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2792/5559] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:35:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:24.595428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:24.604010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-334006d5-0b87-4dab-b576-f3a99f8bcbd1 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.183444 Jul 02 21:35:24.613181 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2768/5560] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:24 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:25.622223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:25.622862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:25.629369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:25.629857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:25.630637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:25.631302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:25.833898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:25.842008 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7aaf55d9-4e49-4524-93d4-e050e882128d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.224592 Jul 02 21:35:25.842834 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2793/5561] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:25 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:25.999114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607819608", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8684c175-5583-46cf-8c24-8f0a439e8112"}], "security_groups": [{"name": "tempest-securitygroup--903008324"}], "key_name": "tempest-keypair-723108984", "user_data": "}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:26.108146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] validate_networks() for [('8684c175-5583-46cf-8c24-8f0a439e8112', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:35:26.488070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:35:26.488685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:35:26.489247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:35:26.489740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:35:26.490224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:35:26.500277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:26.500765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:26.501575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:26.502026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:26.519661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:35:26.524986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for user 39889b52b09a40ecacbf5a790e5bd20e and project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:35:26.537777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:35:26.540150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:35:26.587870 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-838d227f-eebf-448a-9215-2c498f8cb415 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593219 Jul 02 21:35:26.588867 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2769/5562] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:35:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:35:26.600437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02d5003e-33f7-4cda-9573-e95c248a2c7c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:26.601122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-02d5003e-33f7-4cda-9573-e95c248a2c7c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:26.685511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-02d5003e-33f7-4cda-9573-e95c248a2c7c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:26.702078 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02d5003e-33f7-4cda-9573-e95c248a2c7c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1241 microversion: 2.1 time: 0.105545 Jul 02 21:35:26.702680 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2794/5563] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:26 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1241 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:26.859374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:26.860146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:26.868606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:26.869300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:26.870370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:26.872208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:27.079748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:27.089757 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-10ee1911-be33-4db8-b358-9a610be2f3dd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.234708 Jul 02 21:35:27.091395 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2770/5564] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:26 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:27.719032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:27.719660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:27.728143 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:27.728603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:27.729403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:27.729841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:27.833618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:27.843220 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ae4095f-f447-4f42-84ca-ea947fa1d760 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1301 microversion: 2.1 time: 0.127892 Jul 02 21:35:27.854839 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2795/5565] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:27 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1301 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:28.110987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:28.111602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:28.119514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:28.119963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:28.120811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:28.121239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:28.352869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:28.362180 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bebf85fe-a434-4892-b816-9c9fdceaee44 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.255146 Jul 02 21:35:28.371598 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2771/5566] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:28 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:28.862228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:28.862859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:28.873151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:28.873602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:28.875633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:28.876693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:29.067507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:29.076437 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73d9d465-2001-4d53-8b13-3a81af0a1129 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.218287 Jul 02 21:35:29.086382 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2796/5567] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:28 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:29.379416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:29.380165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:29.398234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:29.398980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:29.400070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:29.400612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-387e18b5-2952-401b-ac1d-8b9c2c9d0a98 req-0a169060-b2c1-443f-adb1-0e52768b27ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b0a3ec-0c62-4d32-8f98-be05ddcaab91", "tag": "93b46cbf-1735-452a-b577-f14fd9b95ff9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:29.401138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:29.410350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-387e18b5-2952-401b-ac1d-8b9c2c9d0a98 req-0a169060-b2c1-443f-adb1-0e52768b27ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:29.410802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-387e18b5-2952-401b-ac1d-8b9c2c9d0a98 req-0a169060-b2c1-443f-adb1-0e52768b27ce service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:29.425871 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-387e18b5-2952-401b-ac1d-8b9c2c9d0a98 req-0a169060-b2c1-443f-adb1-0e52768b27ce service nova] Creating event network-changed:93b46cbf-1735-452a-b577-f14fd9b95ff9 for instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 on nch2-master-1 Jul 02 21:35:29.437199 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-387e18b5-2952-401b-ac1d-8b9c2c9d0a98 req-0a169060-b2c1-443f-adb1-0e52768b27ce service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040267 Jul 02 21:35:29.437832 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2797/5568] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:29.660583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:29.668693 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33b974ce-cc92-4ffb-a2a6-3d63c749f343 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.293617 Jul 02 21:35:29.669270 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2772/5569] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:29 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:30.095264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:30.096357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:30.102814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:30.103266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:30.104055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:30.104506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:30.241700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:30.249655 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5d83bfef-39a6-43a3-8f34-d998f13c0eeb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.159750 Jul 02 21:35:30.250295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2798/5570] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:30 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:30.689696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:30.690318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:30.697958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:30.698424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:30.699197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:30.699637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:30.840840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:30.849289 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e385d5b-3638-411c-810f-2ff1262be908 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.165641 Jul 02 21:35:30.859658 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2773/5571] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:30 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:31.269018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:31.269768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:31.278611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:31.279115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:31.280606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:31.281054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:31.663406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:31.671850 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86627eb6-5730-443d-82ed-daba7d4bae34 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.406924 Jul 02 21:35:31.672707 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2799/5572] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:31 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:31.871138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:31.872169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:31.881334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:31.881797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:31.882613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:31.883060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:31.901637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:32.044756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:32.053435 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b2f98142-5de9-45d3-9b57-31e7e1384184 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.189043 Jul 02 21:35:32.054246 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2774/5573] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:31 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:32.691322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:32.691907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:32.694918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:32.701072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:32.701594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:32.702382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:32.702974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:32.843563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:32.852354 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-adbddd8c-35bd-452c-a1d4-219ec242c909 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.166422 Jul 02 21:35:32.852953 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2800/5574] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:32 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:33.073793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:33.074590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:33.078050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:33.083901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:33.084385 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:33.085169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:33.085607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:33.224971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:33.236477 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-698007da-5601-4186-bfe9-a6e0e6ec89e2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1691 microversion: 2.1 time: 0.169130 Jul 02 21:35:33.237096 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2775/5575] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:33 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:33.869803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:33.870389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:33.877772 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:33.878220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:33.879024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:33.879451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:33.883470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=81 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:34.015861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:34.023903 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-166e2194-9b2f-4e21-a906-fe2dd53d2964 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.158377 Jul 02 21:35:34.024549 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2801/5576] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:33 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:34.258302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:34.259313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:34.272671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:34.274199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:34.275688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:34.276529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:34.423987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:34.435143 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-da56671f-ee27-4e48-a7f4-e75a4cd709f4 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1697 microversion: 2.1 time: 0.183222 Jul 02 21:35:34.435883 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2776/5577] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:34 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:34.650897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2e7039ec-1036-4b76-9217-03542bed37e5 req-11be5e89-c3c8-4508-85b0-b5c00d18a29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b0a3ec-0c62-4d32-8f98-be05ddcaab91", "name": "network-vif-plugged", "status": "completed", "tag": "93b46cbf-1735-452a-b577-f14fd9b95ff9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:34.660099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2e7039ec-1036-4b76-9217-03542bed37e5 req-11be5e89-c3c8-4508-85b0-b5c00d18a29c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:34.660575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2e7039ec-1036-4b76-9217-03542bed37e5 req-11be5e89-c3c8-4508-85b0-b5c00d18a29c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:34.673833 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2e7039ec-1036-4b76-9217-03542bed37e5 req-11be5e89-c3c8-4508-85b0-b5c00d18a29c service nova] Creating event network-vif-plugged:93b46cbf-1735-452a-b577-f14fd9b95ff9 for instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 on nch2-master-1 Jul 02 21:35:34.679675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2e7039ec-1036-4b76-9217-03542bed37e5 req-11be5e89-c3c8-4508-85b0-b5c00d18a29c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032685 Jul 02 21:35:34.680310 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2802/5578] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:35.042137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:35.042822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:35.052443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:35.052904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:35.053690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:35.054946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:35.263934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:35.274952 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f682a1c-56a9-4d51-9449-e4d86d38e1c3 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.237756 Jul 02 21:35:35.275445 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2777/5579] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:35 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:35.457929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:35.458644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:35.466239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:35.466701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:35.467483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:35.467926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:35.604600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:35.612894 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4ea12907-d94f-4363-9bae-65272cd4c2d2 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1697 microversion: 2.1 time: 0.160973 Jul 02 21:35:35.613472 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2803/5580] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:35 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:36.296648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:36.297616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:36.305593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:36.306059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:36.306845 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:36.307291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:36.447020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:36.454901 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b066a8a-64ee-4451-b73f-aad946595873 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1366 microversion: 2.1 time: 0.164938 Jul 02 21:35:36.455477 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2778/5581] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:36 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:36.632484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:36.633093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:36.643731 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:36.644212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:36.645601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:36.646058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:36.700061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:36.807851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:36.816556 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76f8c283-82e2-4666-a7b5-ea09a5736bb9 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1682 microversion: 2.1 time: 0.189474 Jul 02 21:35:36.817220 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2804/5582] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:36 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:37.471825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:37.472414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:37.474363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:37.475061 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:35:37.482623 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:37.483082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:37.483857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:37.484322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:37.617229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:35:37.629101 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-87aa728e-8001-422f-834d-9a3841a2e4fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1556 microversion: 2.1 time: 0.161111 Jul 02 21:35:37.629994 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2779/5583] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:35:37 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:35:37.646560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:35:37.647109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:37.654022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:37.654473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:37.655237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:37.655671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:37.741121 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a92751dd-8fe0-4362-82db-59999ba9753b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098248 Jul 02 21:35:37.741852 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2805/5584] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:35:37 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:38.653088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-46a9e21c-ddb5-444d-baed-593487529f25 req-ca939da2-6696-4f82-a56b-9375ea502632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c9f7e-314f-4053-97b7-f88bc4fa1295", "name": "network-vif-plugged", "status": "completed", "tag": "d76e1bec-50c3-4640-97b5-9dd78e048943"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:38.662900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-46a9e21c-ddb5-444d-baed-593487529f25 req-ca939da2-6696-4f82-a56b-9375ea502632 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:38.663517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-46a9e21c-ddb5-444d-baed-593487529f25 req-ca939da2-6696-4f82-a56b-9375ea502632 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:38.677589 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-46a9e21c-ddb5-444d-baed-593487529f25 req-ca939da2-6696-4f82-a56b-9375ea502632 service nova] Creating event network-vif-plugged:d76e1bec-50c3-4640-97b5-9dd78e048943 for instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 on nch2-master-1 Jul 02 21:35:38.683337 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-46a9e21c-ddb5-444d-baed-593487529f25 req-ca939da2-6696-4f82-a56b-9375ea502632 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033907 Jul 02 21:35:38.684219 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2780/5585] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:35:38.721492 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-88d21bd9-58dc-48c7-aa4a-bb14ec972616 req-b7314a74-303b-463d-a0e1-eaed292e777f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5b0a3ec-0c62-4d32-8f98-be05ddcaab91", "tag": "93b46cbf-1735-452a-b577-f14fd9b95ff9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:38.729999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88d21bd9-58dc-48c7-aa4a-bb14ec972616 req-b7314a74-303b-463d-a0e1-eaed292e777f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:38.730450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-88d21bd9-58dc-48c7-aa4a-bb14ec972616 req-b7314a74-303b-463d-a0e1-eaed292e777f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:38.741920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-88d21bd9-58dc-48c7-aa4a-bb14ec972616 req-b7314a74-303b-463d-a0e1-eaed292e777f service nova] Creating event network-changed:93b46cbf-1735-452a-b577-f14fd9b95ff9 for instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 on nch2-master-1 Jul 02 21:35:38.747150 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-88d21bd9-58dc-48c7-aa4a-bb14ec972616 req-b7314a74-303b-463d-a0e1-eaed292e777f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030370 Jul 02 21:35:38.748160 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2806/5586] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:35:48.542213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:35:48.543261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:35:48.549827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:48.550276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:48.551401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:35:48.551820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:35:48.613301 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3dce0441-c9d4-4e5f-987c-b7cc25a3c4c9 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2/action" status: 200 len: 24573 microversion: 2.1 time: 0.076462 Jul 02 21:35:48.613927 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2781/5587] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:35:48 2022] POST /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2/action => generated 24573 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:36:03.036576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=13 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:03.037562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=25 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:03.043338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:03.044644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:03.053663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:03.054111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:03.054891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:03.055339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:03.111245 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4e5b623-c6f6-4c00-975f-86b8aeb9eefa tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "POST /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295/action" status: 200 len: 24527 microversion: 2.1 time: 0.077196 Jul 02 21:36:03.112069 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2807/5588] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:36:03 2022] POST /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295/action => generated 24527 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:36:14.197625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:14.198265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:14.201062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=13 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:14.201807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=38 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:14.208027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:14.208708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:14.209492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:14.209938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:14.235256 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1e6ffffd-b81f-4467-9995-88db2913f310 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91/ips" status: 200 len: 149 microversion: 2.1 time: 0.041974 Jul 02 21:36:14.235854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2782/5589] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:36:14 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:15.178423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:15.179119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:15.179729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2043d14c-316c-4dfe-82a4-04be5a12ea37 req-6fbac801-e46a-4a96-bdff-18c1ff30ed26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707c9f7e-314f-4053-97b7-f88bc4fa1295", "tag": "d76e1bec-50c3-4640-97b5-9dd78e048943"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:15.181951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:15.182680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:15.189518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.190057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.190281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2043d14c-316c-4dfe-82a4-04be5a12ea37 req-6fbac801-e46a-4a96-bdff-18c1ff30ed26 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.190924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2043d14c-316c-4dfe-82a4-04be5a12ea37 req-6fbac801-e46a-4a96-bdff-18c1ff30ed26 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.191051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.191453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.203564 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2043d14c-316c-4dfe-82a4-04be5a12ea37 req-6fbac801-e46a-4a96-bdff-18c1ff30ed26 service nova] Creating event network-changed:d76e1bec-50c3-4640-97b5-9dd78e048943 for instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 on nch2-master-1 Jul 02 21:36:15.209037 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2043d14c-316c-4dfe-82a4-04be5a12ea37 req-6fbac801-e46a-4a96-bdff-18c1ff30ed26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034527 Jul 02 21:36:15.209655 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2783/5590] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:15.220145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:36:15.308724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0797b28a-b51a-42e3-8b83-9ff02dd23e31 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 204 len: 0 microversion: 2.1 time: 0.135945 Jul 02 21:36:15.313814 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2808/5591] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:36:15 2022] DELETE /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:36:15.321461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:15.322371 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:15.330226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.330692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.331487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.331936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.547579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:15.557185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e49b1a9f-4c69-4838-a3f1-435af2dd81ea tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1688 microversion: 2.1 time: 0.241696 Jul 02 21:36:15.557865 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2784/5592] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:15 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1688 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:15.606463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:15.607061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:15.613615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.614068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.614897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.615338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.644447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:36:15.737378 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0e52aeba-b64e-4ca9-a2dd-1453ff097fc1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 204 len: 0 microversion: 2.1 time: 0.134855 Jul 02 21:36:15.738050 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2809/5593] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:36:15 2022] DELETE /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:36:15.746555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:15.747423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:15.753913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.754571 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.755355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:15.755798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:15.898293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:15.906115 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b6739ae0-7ec8-496c-8e4b-a6c0f9a18da5 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1680 microversion: 2.1 time: 0.163503 Jul 02 21:36:15.907569 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2785/5594] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:15 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:16.575801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:16.576551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:16.583874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:16.584403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:16.585179 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:16.585611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:16.786831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:16.794913 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab1cbc8a-b9b4-4dcf-af8b-c7ccf2541fdc tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1688 microversion: 2.1 time: 0.223543 Jul 02 21:36:16.795493 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2810/5595] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:16 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1688 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:16.929716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:16.930732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:16.942598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:16.943351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:16.944212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:16.944655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:17.095925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:17.104243 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a19b9590-7732-4a80-91f5-2565bb376840 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1680 microversion: 2.1 time: 0.181855 Jul 02 21:36:17.104818 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2786/5596] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:16 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:17.813465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:17.814058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:17.822818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:17.823235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:17.824148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:17.824528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:17.994220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:18.001992 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-518de9d8-1f0b-493c-9834-39e048473ebd tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1688 microversion: 2.1 time: 0.192830 Jul 02 21:36:18.009826 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2811/5597] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:17 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:18.121573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:18.122564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:18.130140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:18.130837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:18.131748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:18.132323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:18.292684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:18.301154 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3753af7d-4119-4481-8f95-68e1e6dbfb63 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1680 microversion: 2.1 time: 0.183209 Jul 02 21:36:18.301757 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2787/5598] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:18 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1680 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:18.767589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-00490699-d9bb-4493-8f76-71dcfcd48aa7 req-7f01e38b-eaf3-4634-94c2-1e68cd13c65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707c9f7e-314f-4053-97b7-f88bc4fa1295", "name": "network-vif-deleted", "tag": "d76e1bec-50c3-4640-97b5-9dd78e048943"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:18.784028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00490699-d9bb-4493-8f76-71dcfcd48aa7 req-7f01e38b-eaf3-4634-94c2-1e68cd13c65a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:18.784684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-00490699-d9bb-4493-8f76-71dcfcd48aa7 req-7f01e38b-eaf3-4634-94c2-1e68cd13c65a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:18.810305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-00490699-d9bb-4493-8f76-71dcfcd48aa7 req-7f01e38b-eaf3-4634-94c2-1e68cd13c65a service nova] Creating event network-vif-deleted:d76e1bec-50c3-4640-97b5-9dd78e048943 for instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 on nch2-master-1 Jul 02 21:36:18.815483 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-00490699-d9bb-4493-8f76-71dcfcd48aa7 req-7f01e38b-eaf3-4634-94c2-1e68cd13c65a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051714 Jul 02 21:36:18.816527 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2812/5599] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:19.019598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:19.020274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:19.026956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.027421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.028283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.028733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.078347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.079053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.079682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lazy-loading 'fault' on Instance uuid 707c9f7e-314f-4053-97b7-f88bc4fa1295 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:36:19.145795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '317a63cdd16b4fd69617fb9de95dc4ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1b2fbfc815c48588a0bec36818df1a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:19.157103 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c71a863d-a694-490f-bb49-532ff9c492ad tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 200 len: 1356 microversion: 2.1 time: 0.141854 Jul 02 21:36:19.159409 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2788/5600] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:19 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 1356 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:19.194848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:19.198196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:19.216781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.217242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.221126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.221593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.314476 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e31ba95-6c83-4549-8b32-1967278d1a64 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "POST /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2/action" status: 200 len: 32636 microversion: 2.1 time: 0.124300 Jul 02 21:36:19.315798 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2813/5601] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:36:19 2022] POST /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2/action => generated 32636 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:36:19.326090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:19.327047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:19.338513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.340166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.341491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.342219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.384784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:19.385767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:19.386304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lazy-loading 'fault' on Instance uuid e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:36:19.436518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:19.445334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48aec93e-464c-42c3-b121-f52b1d877199 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 200 len: 1331 microversion: 2.1 time: 0.130472 Jul 02 21:36:19.446170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2789/5602] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:19 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 1331 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:20.187528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:20.187915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] [instance: 707c9f7e-314f-4053-97b7-f88bc4fa1295] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:20.195224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.195684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.196551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.196999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.212305 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] HTTP exception thrown: Instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 could not be found. Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Request method failure captured: Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 HTTP/1.1 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLhkw9i0xORUg4JVijXvZ-4U1BZ1T3vJ_VfTmMqg_N2dqNUc88WBpxoj4nsbYgkfhphBvdR9ozDzk0JXzIa-QWkcPzjljVDoEVJzvK_enf0dUIxCZyWpC0p_rfy-XLmvh2U3mqnGIHAd7Qjj6CF51pfpap30_IBFcdgnFVbhTJ_4joo Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e1b2fbfc815c48588a0bec36818df1a3", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e1b2fbfc815c48588a0bec36818df1a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e1b2fbfc815c48588a0bec36818df1a3"}]}] Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: e1b2fbfc815c48588a0bec36818df1a3 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2031603079 Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 317a63cdd16b4fd69617fb9de95dc4ec Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2031603079-project Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 could not be found. Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '707c9f7e-314f-4053-97b7-f88bc4fa1295'} Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 could not be found. Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 could not be found. Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.213955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 could not be found. Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Returning 404 to user: Instance 707c9f7e-314f-4053-97b7-f88bc4fa1295 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:36:20.218602 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-87b9e8fe-f096-4bfc-b0d1-8f252f0eaa74 tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295" status: 404 len: 111 microversion: 2.1 time: 0.034034 Jul 02 21:36:20.219379 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2814/5603] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:20 2022] GET /compute/v2.1/servers/707c9f7e-314f-4053-97b7-f88bc4fa1295 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:36:20.462901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:20.463525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:20.471812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.472640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.473417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.473871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.489239 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 HTTP/1.1 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'e5b0a3ec-0c62-4d32-8f98-be05ddcaab91'} Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:36:20.491047 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca4599ff-9b42-4cf2-8a83-10579a675f04 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 404 len: 111 microversion: 2.1 time: 0.033640 Jul 02 21:36:20.496671 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2790/5604] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:20 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:36:20.501777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b28aac37-3214-4a00-a735-fa0f1dea48c2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '.version_select at 0x7fabd7896310>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:20.523620 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b28aac37-3214-4a00-a735-fa0f1dea48c2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-723108984" status: 202 len: 0 microversion: 2.1 time: 0.025365 Jul 02 21:36:20.528289 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2815/5605] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-723108984 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:36:20.771415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:20.771916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:20.774208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-436f0585-8709-436b-9268-b3fa66ec5870 req-161f43df-9932-44e9-8b0b-99caca6cc367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94af3c4-3a4a-4710-8480-50bde0644df2", "tag": "02ffc705-5c53-4301-af22-75c4340b7bdd"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:20.778286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.778920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.779877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.780490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.785799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-436f0585-8709-436b-9268-b3fa66ec5870 req-161f43df-9932-44e9-8b0b-99caca6cc367 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.786549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-436f0585-8709-436b-9268-b3fa66ec5870 req-161f43df-9932-44e9-8b0b-99caca6cc367 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.806417 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-436f0585-8709-436b-9268-b3fa66ec5870 req-161f43df-9932-44e9-8b0b-99caca6cc367 service nova] Creating event network-changed:02ffc705-5c53-4301-af22-75c4340b7bdd for instance b94af3c4-3a4a-4710-8480-50bde0644df2 on nch1-master-1 Jul 02 21:36:20.816183 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-436f0585-8709-436b-9268-b3fa66ec5870 req-161f43df-9932-44e9-8b0b-99caca6cc367 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045843 Jul 02 21:36:20.817360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2816/5606] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:20.817913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:36:20.848516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-43c32f6b-44ba-4216-b740-7bc84702bb57 req-7d14461c-dccb-4c17-9f4c-fc1cfab7379f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5b0a3ec-0c62-4d32-8f98-be05ddcaab91", "name": "network-vif-deleted", "tag": "93b46cbf-1735-452a-b577-f14fd9b95ff9"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:20.868706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c32f6b-44ba-4216-b740-7bc84702bb57 req-7d14461c-dccb-4c17-9f4c-fc1cfab7379f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.870432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43c32f6b-44ba-4216-b740-7bc84702bb57 req-7d14461c-dccb-4c17-9f4c-fc1cfab7379f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.889871 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-43c32f6b-44ba-4216-b740-7bc84702bb57 req-7d14461c-dccb-4c17-9f4c-fc1cfab7379f service nova] Creating event network-vif-deleted:93b46cbf-1735-452a-b577-f14fd9b95ff9 for instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 on nch2-master-1 Jul 02 21:36:20.896634 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-43c32f6b-44ba-4216-b740-7bc84702bb57 req-7d14461c-dccb-4c17-9f4c-fc1cfab7379f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054451 Jul 02 21:36:20.897351 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2817/5607] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:20.954490 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f6f920c7-1d9b-48c6-8f4d-af5268c4877e tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 204 len: 0 microversion: 2.1 time: 0.186676 Jul 02 21:36:20.956306 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2791/5608] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:36:20 2022] DELETE /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:36:20.966877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:20.968571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:20.986494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.986972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:20.987776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:20.988279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:21.295022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:21.304297 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ee60b1a9-e280-4aa9-bd0f-f07907487d4a tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1669 microversion: 2.1 time: 0.343025 Jul 02 21:36:21.305859 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2818/5609] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:20 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1669 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:21.597524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cf8fa272-82a3-493a-b8c1-d31d6be7c1b2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Action: 'create', calling method: .version_select at 0x7fabd74f3940>, body: {"keypair": {"name": "tempest-keypair-1112477321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOVWSrpqyL07gL+TQmNrsILEIxe6Vk0Xi6cG27f8srnJHUnrBcPBRPoYyXxvbpJB48VOdkoH1AHCsCqrzkchievBfRsKsx9gIaxGmSkG2GmIioYLdbNIU85bJLPTkEUUA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:21.629701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-cf8fa272-82a3-493a-b8c1-d31d6be7c1b2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:36:21.642125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-cf8fa272-82a3-493a-b8c1-d31d6be7c1b2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for user 39889b52b09a40ecacbf5a790e5bd20e and project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:36:21.693118 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cf8fa272-82a3-493a-b8c1-d31d6be7c1b2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.100175 Jul 02 21:36:21.693916 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2792/5610] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:36:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:22.330894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:22.333009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:22.345677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:22.346378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:22.347777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:22.348613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:22.689688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:22.701449 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ceea5c54-ed79-47ca-9f0a-dc21ad186d92 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1669 microversion: 2.1 time: 0.376993 Jul 02 21:36:22.702284 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2819/5611] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:22 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1669 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:23.708520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ddd5e2bd-8f77-4eef-b6ea-cc2ecd403856 req-ea922a80-e057-4105-b5aa-d8bb81078905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94af3c4-3a4a-4710-8480-50bde0644df2", "name": "network-vif-deleted", "tag": "02ffc705-5c53-4301-af22-75c4340b7bdd"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:23.717795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ddd5e2bd-8f77-4eef-b6ea-cc2ecd403856 req-ea922a80-e057-4105-b5aa-d8bb81078905 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:23.718245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ddd5e2bd-8f77-4eef-b6ea-cc2ecd403856 req-ea922a80-e057-4105-b5aa-d8bb81078905 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:23.718867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:23.719524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:23.727086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:23.727499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:23.728514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:23.729146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:23.744312 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ddd5e2bd-8f77-4eef-b6ea-cc2ecd403856 req-ea922a80-e057-4105-b5aa-d8bb81078905 service nova] Creating event network-vif-deleted:02ffc705-5c53-4301-af22-75c4340b7bdd for instance b94af3c4-3a4a-4710-8480-50bde0644df2 on nch1-master-1 Jul 02 21:36:23.750939 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ddd5e2bd-8f77-4eef-b6ea-cc2ecd403856 req-ea922a80-e057-4105-b5aa-d8bb81078905 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049957 Jul 02 21:36:23.751551 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2793/5612] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:36:23.826348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '150099eea6064cebbd876d26a3d6fe4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f74b842162f6463a9e93046d070919e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:23.835311 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f4003c44-7e0b-4be6-8be4-cb8f3241c76c tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 200 len: 1484 microversion: 2.1 time: 0.120249 Jul 02 21:36:23.836157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2820/5613] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:23 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 1484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:24.317687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-210644946", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8684c175-5583-46cf-8c24-8f0a439e8112"}], "security_groups": [{"name": "tempest-securitygroup--1908403816"}], "key_name": "tempest-keypair-1112477321", "user_data": "}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:24.436869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] validate_networks() for [('8684c175-5583-46cf-8c24-8f0a439e8112', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:36:24.855326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:24.855934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] [instance: b94af3c4-3a4a-4710-8480-50bde0644df2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:24.869763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:24.870660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:24.871640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:24.872273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:24.888665 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] HTTP exception thrown: Instance b94af3c4-3a4a-4710-8480-50bde0644df2 could not be found. Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Request method failure captured: Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 HTTP/1.1 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLlni__KoVOchQJ1TXXqp3yVtqrbGgQ8VTU49f_wfEqc7WjVO-FS4yKerGGbEvFD2R3dimwRonmEW4IlqnGdIZEZ4oJeIlQGUVPou6bvzhIz5d9cS8K06wFB1j1pHuLhsemHLVkPXj_Ojc9pu8eJdMsRNEyeTBNv1dARohjP1W0n8KY Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: f74b842162f6463a9e93046d070919e7 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f74b842162f6463a9e93046d070919e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f74b842162f6463a9e93046d070919e7", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f74b842162f6463a9e93046d070919e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f74b842162f6463a9e93046d070919e7"}]}] Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: f74b842162f6463a9e93046d070919e7 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkBasicOps-1299219633 Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestNetworkBasicOps-1299219633-project Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 150099eea6064cebbd876d26a3d6fe4a Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkBasicOps-1299219633-project Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b94af3c4-3a4a-4710-8480-50bde0644df2 could not be found. Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b94af3c4-3a4a-4710-8480-50bde0644df2'} Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94af3c4-3a4a-4710-8480-50bde0644df2 could not be found. Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94af3c4-3a4a-4710-8480-50bde0644df2 could not be found. Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:36:24.891097 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94af3c4-3a4a-4710-8480-50bde0644df2 could not be found. Jul 02 21:36:24.895543 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:36:24.897628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Returning 404 to user: Instance b94af3c4-3a4a-4710-8480-50bde0644df2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:36:24.899039 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e40ff0fb-5276-4d34-89ff-648a0ca98bc2 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2" status: 404 len: 111 microversion: 2.1 time: 0.050155 Jul 02 21:36:24.910147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2821/5614] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:24 2022] GET /compute/v2.1/servers/b94af3c4-3a4a-4710-8480-50bde0644df2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:36:25.194490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:36:25.194955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:36:25.195335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:36:25.195916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:36:25.196534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:36:25.206455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:25.207084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:25.208070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:25.209019 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:25.214950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-175d78a2-f4b2-439c-a738-c703fcab1c35 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] Calling method '.version_select at 0x7fabe4569d30>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:25.228255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:36:25.235881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for user 39889b52b09a40ecacbf5a790e5bd20e and project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:36:25.242454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-175d78a2-f4b2-439c-a738-c703fcab1c35 tempest-TestNetworkBasicOps-1299219633 tempest-TestNetworkBasicOps-1299219633-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1406999969" status: 202 len: 0 microversion: 2.1 time: 0.032371 Jul 02 21:36:25.243668 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2822/5615] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 21:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1406999969 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:36:25.258418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-117bbc67-76c7-4244-999f-473211b0051d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] Calling method '.version_select at 0x7fabd78b6dc0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:25.261846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:36:25.264215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:36:25.297670 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-117bbc67-76c7-4244-999f-473211b0051d tempest-TestNetworkAdvancedServerOps-2031603079 tempest-TestNetworkAdvancedServerOps-2031603079-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1474338739" status: 202 len: 0 microversion: 2.1 time: 0.052787 Jul 02 21:36:25.298288 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2823/5616] 10.222.0.43 () {58 vars in 1283 bytes} [Sat Jul 2 21:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1474338739 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:36:25.319603 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-caf0a1c2-b5e7-4cb0-b8ec-c7d9ad95588e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.006440 Jul 02 21:36:25.324865 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2794/5617] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:36:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:36:25.330939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88866b86-2af1-42b3-b6d1-dfd28395758c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:25.331864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88866b86-2af1-42b3-b6d1-dfd28395758c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:25.423955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88866b86-2af1-42b3-b6d1-dfd28395758c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:25.434695 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88866b86-2af1-42b3-b6d1-dfd28395758c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1241 microversion: 2.1 time: 0.108325 Jul 02 21:36:25.444669 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2824/5618] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:25 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:26.453620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:26.454568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:26.472560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:26.474395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:26.475300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:26.477552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:26.617463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:26.627541 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-29b4dfff-7733-4a08-8bbe-1b5ad8a04a92 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1301 microversion: 2.1 time: 0.178071 Jul 02 21:36:26.628978 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2795/5619] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:26 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1301 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:27.647819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:27.650123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:27.665935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:27.666384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:27.667366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:27.667804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:28.070105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:28.078402 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f8441997-3500-4333-8a60-9162f420e89c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.436207 Jul 02 21:36:28.082849 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2825/5620] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:27 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:28.998915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-23259b69-2c36-4996-83a2-3b63764ee3e6 req-93b2f533-b628-4806-a735-1a66285a3afa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add824ea-8e06-476d-bdb0-3778c52cfc10", "tag": "62d9d91d-a7e6-4da5-8878-d74f49fbf5e0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:29.024487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-23259b69-2c36-4996-83a2-3b63764ee3e6 req-93b2f533-b628-4806-a735-1a66285a3afa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:29.025543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-23259b69-2c36-4996-83a2-3b63764ee3e6 req-93b2f533-b628-4806-a735-1a66285a3afa service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:29.050338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-23259b69-2c36-4996-83a2-3b63764ee3e6 req-93b2f533-b628-4806-a735-1a66285a3afa service nova] Creating event network-changed:62d9d91d-a7e6-4da5-8878-d74f49fbf5e0 for instance add824ea-8e06-476d-bdb0-3778c52cfc10 on nch1-master-1 Jul 02 21:36:29.064685 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-23259b69-2c36-4996-83a2-3b63764ee3e6 req-93b2f533-b628-4806-a735-1a66285a3afa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069350 Jul 02 21:36:29.065789 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2796/5621] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:29.099786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:29.100529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:29.117577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:29.117909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:29.118883 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:29.119337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:29.316300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-02df9b91-3f06-413d-a725-302baf9ee83e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Action: 'create', calling method: .version_select at 0x7fabd78963a0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1019164937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqBfCu3TtxUDhiwjWQkRgt45buklsW2NB/hvXt7FaqyKS0wIM1qc3sxaroHYT5gcfL46laXDlr9VvsFMYLikX5qsV7gBLfzaMM6byRYloXdpicS9M0Mvzn8/z/UORTsSg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:29.331968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-02df9b91-3f06-413d-a725-302baf9ee83e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Getting quotas for project 655a8ac13c4d47208cc9437074595d8d. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:36:29.337648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-02df9b91-3f06-413d-a725-302baf9ee83e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Getting quotas for user 253740c520d7432da9b93d8d2e7aa418 and project 655a8ac13c4d47208cc9437074595d8d. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:36:29.369627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-02df9b91-3f06-413d-a725-302baf9ee83e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.340048 Jul 02 21:36:29.370232 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2826/5622] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:36:29 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:36:29.537744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:29.551293 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6a39505d-3bde-4e88-ac3b-b721a72a80ad tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.455313 Jul 02 21:36:29.563482 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2797/5623] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:29 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:36:30.570092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:30.570741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:30.577103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:30.577571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:30.578340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:30.578778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:30.724065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:30.731875 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b7bf591-2c89-4977-85aa-889eb4c2d35f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.166799 Jul 02 21:36:30.732704 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2827/5624] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:30 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:31.751680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:31.752470 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:31.759136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:31.759871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:31.760806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:31.761343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:32.365960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:32.374185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4c812c04-5dbb-4387-9777-bf0b453292a0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.628420 Jul 02 21:36:32.385417 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2798/5625] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:31 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:33.405969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:33.420930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:33.439052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:33.439658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:33.440626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:33.441168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:33.612785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:33.622508 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fdad2e32-30bb-476e-9825-86c202aedbbb tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.233121 Jul 02 21:36:33.624665 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2828/5626] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:33 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:34.643763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:34.644463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:34.655442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:34.656488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:34.657600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:34.658236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:34.709474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-398b8146-1f66-4301-bead-b1940342fa2b req-cf983d34-d4af-4945-9c0f-046f1006a183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add824ea-8e06-476d-bdb0-3778c52cfc10", "name": "network-vif-plugged", "status": "completed", "tag": "62d9d91d-a7e6-4da5-8878-d74f49fbf5e0"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:34.734778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-398b8146-1f66-4301-bead-b1940342fa2b req-cf983d34-d4af-4945-9c0f-046f1006a183 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:34.735232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-398b8146-1f66-4301-bead-b1940342fa2b req-cf983d34-d4af-4945-9c0f-046f1006a183 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:34.762931 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-398b8146-1f66-4301-bead-b1940342fa2b req-cf983d34-d4af-4945-9c0f-046f1006a183 service nova] Creating event network-vif-plugged:62d9d91d-a7e6-4da5-8878-d74f49fbf5e0 for instance add824ea-8e06-476d-bdb0-3778c52cfc10 on nch1-master-1 Jul 02 21:36:34.775559 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-398b8146-1f66-4301-bead-b1940342fa2b req-cf983d34-d4af-4945-9c0f-046f1006a183 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070132 Jul 02 21:36:34.780218 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2829/5627] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:34.931851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:34.944700 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-559e6daf-91dc-47b5-9759-62a920d3e472 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.308254 Jul 02 21:36:34.945870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2799/5628] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:34 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:35.546278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-112077978-access_point-1675097698", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "26798759-325e-429a-bede-8145c4d6ff18"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1019164937", "security_groups": [{"name": "tempest-secgroup_access--1148018548"}, {"name": "tempest-secgroup_general--1028789911"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:35.736086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] validate_networks() for [('26798759-325e-429a-bede-8145c4d6ff18', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:36:35.965295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:35.966565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:35.969915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:35.970806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:35.981362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:35.982026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:35.983504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:35.983962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:36.234290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:36.238091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:36.244229 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d3f3b738-b229-4658-b87a-39abd1afcfc0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1367 microversion: 2.1 time: 0.284703 Jul 02 21:36:36.255090 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2800/5629] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:35 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:36.313683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:36:36.314502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:36:36.315119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:36:36.315824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:36:36.316404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:36:36.326591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:36.327402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:36.328523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:36.329063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:36.349035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Getting quotas for project 655a8ac13c4d47208cc9437074595d8d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:36:36.355162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Getting quotas for user 253740c520d7432da9b93d8d2e7aa418 and project 655a8ac13c4d47208cc9437074595d8d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:36:36.369712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:36:36.372009 ncdv-master-1 devstack@n-api.service[131044]: WARNING nova.utils [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-112077978-access_point-1675097698 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-112077978-acc Jul 02 21:36:36.372968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:36:36.426937 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-505bef61-1f82-4d9e-9b9a-c25193207c1d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.885293 Jul 02 21:36:36.427894 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2830/5630] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:36:35 2022] POST /compute/v2.1/servers => generated 458 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:36:36.438698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-61456cd8-4e6a-4508-b1e6-0c9e18c0944a tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:36.440116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-61456cd8-4e6a-4508-b1e6-0c9e18c0944a tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:36.547496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-61456cd8-4e6a-4508-b1e6-0c9e18c0944a tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:36.561701 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-61456cd8-4e6a-4508-b1e6-0c9e18c0944a tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1294 microversion: 2.1 time: 0.127393 Jul 02 21:36:36.562456 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2801/5631] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:36 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1294 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:37.265663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:37.266290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:37.274906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:37.275356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:37.276184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:37.276627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:37.301549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:37.435651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:37.444255 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-292ce9e5-4247-47c8-83e2-a5fd3684fe7b tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1557 microversion: 2.1 time: 0.186310 Jul 02 21:36:37.444887 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2831/5632] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:37 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1557 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:37.461278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:37.461882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:37.469667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:37.470374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:37.471154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:37.471584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:37.560073 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b4ae69d4-197e-439a-8615-7b4e7fab3538 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102787 Jul 02 21:36:37.560689 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2802/5633] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:36:37 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:37.580705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:37.581715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:37.588924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:37.590485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:37.591530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:37.592293 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:37.720721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:37.732244 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0d77e83-d937-4604-86cc-b39983a34cc4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1346 microversion: 2.1 time: 0.156848 Jul 02 21:36:37.741696 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2832/5634] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:37 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1346 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:38.655350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a2f3dc95-c7f6-4313-8d25-8f73dc6a62c1 req-22afa63e-dfa3-4dcf-a55d-17bde4220898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add824ea-8e06-476d-bdb0-3778c52cfc10", "tag": "62d9d91d-a7e6-4da5-8878-d74f49fbf5e0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:38.664597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a2f3dc95-c7f6-4313-8d25-8f73dc6a62c1 req-22afa63e-dfa3-4dcf-a55d-17bde4220898 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:38.665036 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a2f3dc95-c7f6-4313-8d25-8f73dc6a62c1 req-22afa63e-dfa3-4dcf-a55d-17bde4220898 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:38.678534 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a2f3dc95-c7f6-4313-8d25-8f73dc6a62c1 req-22afa63e-dfa3-4dcf-a55d-17bde4220898 service nova] Creating event network-changed:62d9d91d-a7e6-4da5-8878-d74f49fbf5e0 for instance add824ea-8e06-476d-bdb0-3778c52cfc10 on nch1-master-1 Jul 02 21:36:38.685153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a2f3dc95-c7f6-4313-8d25-8f73dc6a62c1 req-22afa63e-dfa3-4dcf-a55d-17bde4220898 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Jul 02 21:36:38.686918 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2803/5635] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:38.750886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:38.752888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:38.767454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:38.768955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:38.772082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:38.772557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:39.030576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:39.048357 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f222f4c2-421d-46af-a80e-baaef31478b4 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1472 microversion: 2.1 time: 0.302540 Jul 02 21:36:39.055465 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2833/5636] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:38 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1472 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:39.249393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5b04b641-28d4-4f39-9943-d7425f6bafc2 req-730de5a5-c257-4c30-a8cd-f9267b68a3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab5d54e-75d3-45b0-b1ed-88f386d5bf75", "tag": "295df6fa-bbcc-490c-a943-15bc5973b25b"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:39.268081 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5b04b641-28d4-4f39-9943-d7425f6bafc2 req-730de5a5-c257-4c30-a8cd-f9267b68a3dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:39.268942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5b04b641-28d4-4f39-9943-d7425f6bafc2 req-730de5a5-c257-4c30-a8cd-f9267b68a3dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:39.290587 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5b04b641-28d4-4f39-9943-d7425f6bafc2 req-730de5a5-c257-4c30-a8cd-f9267b68a3dd service nova] Creating event network-changed:295df6fa-bbcc-490c-a943-15bc5973b25b for instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 on nch2-master-1 Jul 02 21:36:39.308966 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5b04b641-28d4-4f39-9943-d7425f6bafc2 req-730de5a5-c257-4c30-a8cd-f9267b68a3dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064751 Jul 02 21:36:39.312010 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2804/5637] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:36:40.076763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:40.077652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:40.082972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:40.088598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:40.089261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:40.090370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:40.090997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:40.237768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:40.249281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eccb0b09-18c5-480f-a508-b5ac95f3e2d8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1472 microversion: 2.1 time: 0.178143 Jul 02 21:36:40.249925 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2834/5638] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:40 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:41.269384 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:41.270102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:41.277614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:41.278210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:41.279035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:41.279454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:41.426770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:41.437059 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a1523050-e05f-482e-b921-aef699382a09 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1472 microversion: 2.1 time: 0.172664 Jul 02 21:36:41.438094 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2805/5639] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:41 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:42.458867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:42.459990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:42.476873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:42.477741 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:42.478628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:42.479071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:42.625742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:42.634192 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5a6d2422-cfba-4412-82a1-877a958fece7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1472 microversion: 2.1 time: 0.182280 Jul 02 21:36:42.634772 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2835/5640] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:42 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1472 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:43.028998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-dbf1be12-da22-49b3-91b7-78644651e071 req-719a6b10-2427-4fdc-b0e1-6bfbb5dd9651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab5d54e-75d3-45b0-b1ed-88f386d5bf75", "name": "network-vif-plugged", "status": "completed", "tag": "295df6fa-bbcc-490c-a943-15bc5973b25b"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:43.038520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-dbf1be12-da22-49b3-91b7-78644651e071 req-719a6b10-2427-4fdc-b0e1-6bfbb5dd9651 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:43.039164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-dbf1be12-da22-49b3-91b7-78644651e071 req-719a6b10-2427-4fdc-b0e1-6bfbb5dd9651 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:43.052054 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-dbf1be12-da22-49b3-91b7-78644651e071 req-719a6b10-2427-4fdc-b0e1-6bfbb5dd9651 service nova] Creating event network-vif-plugged:295df6fa-bbcc-490c-a943-15bc5973b25b for instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 on nch2-master-1 Jul 02 21:36:43.056893 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-dbf1be12-da22-49b3-91b7-78644651e071 req-719a6b10-2427-4fdc-b0e1-6bfbb5dd9651 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031782 Jul 02 21:36:43.057503 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2806/5641] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:36:43.653011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:43.653638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:43.661409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:43.661903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:43.662680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:43.663152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:43.811625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:43.819382 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-33a8cb42-3a1d-4143-8435-c8e672a39969 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1472 microversion: 2.1 time: 0.170704 Jul 02 21:36:43.819923 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2836/5642] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:43 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:44.840534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:44.841235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:44.843406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:44.850488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:44.851015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:44.851788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:44.852256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:44.999604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:45.009173 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-59e80262-e9a8-46ae-a4da-1b247567713b tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1644 microversion: 2.1 time: 0.174482 Jul 02 21:36:45.010040 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2807/5643] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:44 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1644 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:45.030558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:45.031198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:45.038578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:45.039059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:45.039836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:45.040320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:45.186517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:36:45.194699 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d62e0ff2-adfe-45db-ac78-2350ed3c30d5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1644 microversion: 2.1 time: 0.168058 Jul 02 21:36:45.195537 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2837/5644] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:45 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1644 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:45.212683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:36:45.213604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:36:45.220612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:45.221169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:45.221946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:45.222383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:45.470613 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f01887b1-95cf-48cd-a810-6dc6cad3a88f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1795 microversion: 2.1 time: 0.263525 Jul 02 21:36:45.471200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2808/5645] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:36:45 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1795 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:36:47.412855 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b7d42b4b-f1c3-4ace-9cd3-87452e630b06 req-8a841a55-b89d-4c18-8264-56d58864beff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab5d54e-75d3-45b0-b1ed-88f386d5bf75", "tag": "295df6fa-bbcc-490c-a943-15bc5973b25b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:36:47.417879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:47.418681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:36:47.426250 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b7d42b4b-f1c3-4ace-9cd3-87452e630b06 req-8a841a55-b89d-4c18-8264-56d58864beff service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:36:47.426791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b7d42b4b-f1c3-4ace-9cd3-87452e630b06 req-8a841a55-b89d-4c18-8264-56d58864beff service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:36:47.439626 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b7d42b4b-f1c3-4ace-9cd3-87452e630b06 req-8a841a55-b89d-4c18-8264-56d58864beff service nova] Creating event network-changed:295df6fa-bbcc-490c-a943-15bc5973b25b for instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 on nch2-master-1 Jul 02 21:36:47.445610 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b7d42b4b-f1c3-4ace-9cd3-87452e630b06 req-8a841a55-b89d-4c18-8264-56d58864beff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036354 Jul 02 21:36:47.446716 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2838/5646] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:29.526789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1999348772", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "b74324a4-ad92-4238-bc79-231830051277"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1019164937", "security_groups": []}, "os:scheduler_hints": {"different_host": ["fab5d54e-75d3-45b0-b1ed-88f386d5bf75"]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:29.534233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:29.535146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:29.535819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=28 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:29.585999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] validate_networks() for [('b74324a4-ad92-4238-bc79-231830051277', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:37:30.006053 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:37:30.006649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:37:30.007269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:37:30.008366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:37:30.008366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:37:30.019508 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:30.020126 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:30.021054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:30.021601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:30.051493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Getting quotas for project 655a8ac13c4d47208cc9437074595d8d. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:37:30.059015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Getting quotas for user 253740c520d7432da9b93d8d2e7aa418 and project 655a8ac13c4d47208cc9437074595d8d. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:37:30.073595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:37:30.076478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:37:30.131948 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-41ba2de0-494b-4d0f-b5f0-cb26625fbf13 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.609226 Jul 02 21:37:30.133417 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2809/5647] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:37:29 2022] POST /compute/v2.1/servers => generated 361 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:37:30.147379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd1c2099-ca2d-42ac-8290-a0f31f6bcd7f tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:30.148817 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd1c2099-ca2d-42ac-8290-a0f31f6bcd7f tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:30.152496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=8 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:30.153512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=42 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:30.236202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd1c2099-ca2d-42ac-8290-a0f31f6bcd7f tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:30.243883 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd1c2099-ca2d-42ac-8290-a0f31f6bcd7f tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1242 microversion: 2.1 time: 0.101809 Jul 02 21:37:30.244507 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2839/5648] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:30 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:31.262256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:31.262989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:31.277810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:31.278279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:31.279215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:31.279662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:31.375313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:31.385450 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-847f7812-9cc6-4e56-b98e-4cfb9afba0a5 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1294 microversion: 2.1 time: 0.128162 Jul 02 21:37:31.392498 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2810/5649] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:31 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:32.408623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:32.409473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:32.418377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:32.419133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:32.420399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:32.421077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:32.538550 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:32.547117 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84f1c50d-175b-49c5-9a93-5ded798eb2ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.142398 Jul 02 21:37:32.547966 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2840/5650] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:32 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:33.023646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-fcdae63b-c4a7-4481-bc35-5849e1245eff req-a4f819ab-3d80-488e-a453-e776e97bbada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29ac988e-4276-4964-bc09-6d8fc769f9fc", "tag": "e168a4ea-b3c6-4d61-803b-004d66fb7e73"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:33.034710 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fcdae63b-c4a7-4481-bc35-5849e1245eff req-a4f819ab-3d80-488e-a453-e776e97bbada service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:33.035302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-fcdae63b-c4a7-4481-bc35-5849e1245eff req-a4f819ab-3d80-488e-a453-e776e97bbada service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:33.051420 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-fcdae63b-c4a7-4481-bc35-5849e1245eff req-a4f819ab-3d80-488e-a453-e776e97bbada service nova] Creating event network-changed:e168a4ea-b3c6-4d61-803b-004d66fb7e73 for instance 29ac988e-4276-4964-bc09-6d8fc769f9fc on nch1-master-1 Jul 02 21:37:33.059868 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-fcdae63b-c4a7-4481-bc35-5849e1245eff req-a4f819ab-3d80-488e-a453-e776e97bbada service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194601 Jul 02 21:37:33.061525 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2811/5651] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:33.566212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:33.567459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:33.575540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:33.575658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:33.576453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:33.576897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:33.689971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:33.697891 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9110707d-c9a5-4c47-a830-9bc491603f41 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.135810 Jul 02 21:37:33.698493 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2841/5652] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:33 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:34.721355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:34.722538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:34.733086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:34.733545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:34.734330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:34.734775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:34.833832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:34.841973 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c99856fa-7db1-47c7-8466-2ae454dd4958 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.129268 Jul 02 21:37:34.842552 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2812/5653] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:34 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:35.858625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:35.859258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:35.866350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:35.866804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:35.867566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:35.868008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:35.974845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:35.983851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-65ed6e4a-bc61-4ca8-9b6f-1e4a9fd16040 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.129092 Jul 02 21:37:35.984638 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2842/5654] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:35 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:37.001745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:37.002498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:37.009447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:37.009904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:37.010677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:37.011111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:37.100098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:37.108267 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fa5f2a67-7595-4e4e-a279-63f967381efa tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.111022 Jul 02 21:37:37.108854 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2813/5655] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:36 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:38.125861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:38.126438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:38.133586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:38.134044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:38.134820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:38.135259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:38.221739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:38.229635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c040f768-693a-4b2b-a399-94129d1cded3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.108070 Jul 02 21:37:38.230222 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2843/5656] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:38 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:38.984458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4fd7b8b0-81ae-4455-9b9c-9a09614d6a34 req-42d064cd-156d-44b2-addb-7091cbd8b53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ac988e-4276-4964-bc09-6d8fc769f9fc", "name": "network-vif-plugged", "status": "completed", "tag": "e168a4ea-b3c6-4d61-803b-004d66fb7e73"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:38.992811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4fd7b8b0-81ae-4455-9b9c-9a09614d6a34 req-42d064cd-156d-44b2-addb-7091cbd8b53c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:38.993259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4fd7b8b0-81ae-4455-9b9c-9a09614d6a34 req-42d064cd-156d-44b2-addb-7091cbd8b53c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:39.004696 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4fd7b8b0-81ae-4455-9b9c-9a09614d6a34 req-42d064cd-156d-44b2-addb-7091cbd8b53c service nova] Creating event network-vif-plugged:e168a4ea-b3c6-4d61-803b-004d66fb7e73 for instance 29ac988e-4276-4964-bc09-6d8fc769f9fc on nch1-master-1 Jul 02 21:37:39.009509 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4fd7b8b0-81ae-4455-9b9c-9a09614d6a34 req-42d064cd-156d-44b2-addb-7091cbd8b53c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093958 Jul 02 21:37:39.010081 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2814/5657] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:39.249570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:39.250352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:39.260542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:39.261239 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:39.262380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:39.263206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:39.346923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:39.355173 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b2a73a8-5b76-4167-a9f9-eda8a95250e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.111336 Jul 02 21:37:39.355764 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2844/5658] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:39 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:40.372974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:40.373686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:40.378137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:40.378886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:40.386416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:40.386878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:40.387658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:40.388104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:40.474757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:40.482733 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eaf38a04-8297-4fba-b74a-982e240e356e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1300 microversion: 2.1 time: 0.113054 Jul 02 21:37:40.483294 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2815/5659] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:40 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:41.504707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:41.505729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:41.508897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:41.517094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.517559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.518337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.518780 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.604246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:41.612201 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-880fefe9-a5f2-4563-bcbc-99d1d1dd9e31 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1472 microversion: 2.1 time: 0.114545 Jul 02 21:37:41.612776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2845/5660] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:41 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:41.630789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:41.631415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:41.639461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.639858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.640720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.641259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.727968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:41.735819 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ecb75070-ac35-4204-8381-935cabc21884 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1472 microversion: 2.1 time: 0.110913 Jul 02 21:37:41.736454 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2816/5661] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:41 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1472 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:41.751790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:41.752611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:41.758867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.759316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.760109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.760552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.847971 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d676a6a3-d25f-4f59-9de3-326a88247e0f tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1623 microversion: 2.1 time: 0.099949 Jul 02 21:37:41.848602 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2846/5662] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:41 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:37:41.867088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:41.868107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:41.876226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.876691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:41.877468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:41.877909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:42.014233 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5bee6700-4ae1-40d6-91f3-8e1552b87696 tempest-TestSecurityGroupsBasicOps-1338529683 tempest-TestSecurityGroupsBasicOps-1338529683-project-admin] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1913 microversion: 2.1 time: 0.153308 Jul 02 21:37:42.014787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2817/5663] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:41 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1913 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:42.074621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:42.075477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:42.082465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:42.082911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:42.083681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:42.084142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:42.113815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:37:42.198736 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-feadc77c-5d1b-40a7-9afc-8725d443f523 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "DELETE /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 204 len: 0 microversion: 2.1 time: 0.127784 Jul 02 21:37:42.199374 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2847/5664] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:37:42 2022] DELETE /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:37:42.208006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:42.208675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:42.215016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:42.215478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:42.216288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:42.216723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:42.614909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:42.626153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-caf12fab-8df1-4786-a22f-d5c300ab1fef tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1478 microversion: 2.1 time: 0.422291 Jul 02 21:37:42.626770 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2818/5665] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:42 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1478 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:37:43.586246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:43.586940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:43.594443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:43.594916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:43.595681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:43.596161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:43.620558 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f45bdac1-70a0-4666-b4fb-aff64befd359 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10/ips" status: 200 len: 149 microversion: 2.1 time: 0.038857 Jul 02 21:37:43.621148 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2848/5666] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:37:43 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:43.644071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:43.644696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:43.652165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:43.652622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:43.653404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:43.653854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:43.735230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:43.743165 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-998ee352-07a2-4392-9759-786fca1b05e7 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1478 microversion: 2.1 time: 0.103059 Jul 02 21:37:43.743750 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2819/5667] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:43 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1478 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:44.329000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-c3a7a2ac-23b2-45b8-99a7-de3c1584596a req-44714b15-3781-427a-9be4-3141dd794b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29ac988e-4276-4964-bc09-6d8fc769f9fc", "name": "network-vif-deleted", "tag": "e168a4ea-b3c6-4d61-803b-004d66fb7e73"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:44.338035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c3a7a2ac-23b2-45b8-99a7-de3c1584596a req-44714b15-3781-427a-9be4-3141dd794b1d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:44.338469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-c3a7a2ac-23b2-45b8-99a7-de3c1584596a req-44714b15-3781-427a-9be4-3141dd794b1d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:44.350705 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-c3a7a2ac-23b2-45b8-99a7-de3c1584596a req-44714b15-3781-427a-9be4-3141dd794b1d service nova] Creating event network-vif-deleted:e168a4ea-b3c6-4d61-803b-004d66fb7e73 for instance 29ac988e-4276-4964-bc09-6d8fc769f9fc on nch1-master-1 Jul 02 21:37:44.355891 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-c3a7a2ac-23b2-45b8-99a7-de3c1584596a req-44714b15-3781-427a-9be4-3141dd794b1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030690 Jul 02 21:37:44.356541 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2849/5668] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:44.761971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:44.762624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:44.770051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:44.770514 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:44.771295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:44.771740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:44.805752 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:44.806210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:44.806672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lazy-loading 'fault' on Instance uuid 29ac988e-4276-4964-bc09-6d8fc769f9fc {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:37:44.852855 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:44.860638 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78ce6705-7476-4b42-a4bf-be2f1eeb110d tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 200 len: 1332 microversion: 2.1 time: 0.102845 Jul 02 21:37:44.867299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2820/5669] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:44 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:44.954584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:44.955177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:44.961866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:44.962348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:44.963119 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:44.963563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:44.989288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:37:45.069452 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4aa03131-c750-495a-9b05-59efdf71656c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 204 len: 0 microversion: 2.1 time: 0.119953 Jul 02 21:37:45.070564 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2850/5670] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:37:44 2022] DELETE /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:37:45.079464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:45.080210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:45.086762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:45.087293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:45.088173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:45.088727 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:45.218730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:45.226586 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3f538a22-9437-4223-a7a1-ca48dd862efa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1681 microversion: 2.1 time: 0.151611 Jul 02 21:37:45.227168 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2821/5671] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:45 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:37:45.878562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:45.879262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: 29ac988e-4276-4964-bc09-6d8fc769f9fc] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:45.885723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:45.886163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:45.886915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:45.887356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:45.901941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] HTTP exception thrown: Instance 29ac988e-4276-4964-bc09-6d8fc769f9fc could not be found. Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Request method failure captured: Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc HTTP/1.1 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLpbRYpC9u-q1ksL7VAcHNNFhTlFfUdzl6PWSNo-noFra0ru3q2yP7cCqCh6EieoTIAJ-i2vqtdGC5eDvod9w4N6-hLlTnrkmOB7KtQh4alIBZVsCpxbKCmdjEnOXdIULJ30UarA-yDyWaOIOKunQ6_iTyn9WG6NEweQCWhfTocqWcI Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 655a8ac13c4d47208cc9437074595d8d Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-112077978 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655a8ac13c4d47208cc9437074595d8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_655a8ac13c4d47208cc9437074595d8d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655a8ac13c4d47208cc9437074595d8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/655a8ac13c4d47208cc9437074595d8d"}]}] Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestSecurityGroupsBasicOps-112077978 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 655a8ac13c4d47208cc9437074595d8d Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-112077978 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestSecurityGroupsBasicOps-112077978-project Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 253740c520d7432da9b93d8d2e7aa418 Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestSecurityGroupsBasicOps-112077978-project Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 29ac988e-4276-4964-bc09-6d8fc769f9fc could not be found. Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '29ac988e-4276-4964-bc09-6d8fc769f9fc'} Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29ac988e-4276-4964-bc09-6d8fc769f9fc could not be found. Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29ac988e-4276-4964-bc09-6d8fc769f9fc could not be found. Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:37:45.903648 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29ac988e-4276-4964-bc09-6d8fc769f9fc could not be found. Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Returning 404 to user: Instance 29ac988e-4276-4964-bc09-6d8fc769f9fc could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f81dbe87-3212-403c-ab83-c5c6de408dbf tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc" status: 404 len: 111 microversion: 2.1 time: 0.031162 Jul 02 21:37:45.909638 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2851/5672] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:45 2022] GET /compute/v2.1/servers/29ac988e-4276-4964-bc09-6d8fc769f9fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:37:46.244243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:46.244870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:46.252437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:46.252890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:46.253664 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:46.254096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:46.397133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:46.405677 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b767a2b8-9f68-43c2-adb9-82dd1259843c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1681 microversion: 2.1 time: 0.165315 Jul 02 21:37:46.406313 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2822/5673] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:46 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:47.422989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:47.423620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:47.431601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:47.432436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:47.433476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:47.434134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:47.541344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:47.550016 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c5b09c2-31ad-41f5-bc1b-4d781642aa8c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 200 len: 1613 microversion: 2.1 time: 0.130626 Jul 02 21:37:47.550713 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2852/5674] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:47 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 1613 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:37:47.762453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f3737445-6a0d-4dbd-b21f-f744f8377577 req-b80c28a8-801a-4edc-8d54-a57383ee3b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add824ea-8e06-476d-bdb0-3778c52cfc10", "name": "network-vif-deleted", "tag": "62d9d91d-a7e6-4da5-8878-d74f49fbf5e0"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:47.775207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f3737445-6a0d-4dbd-b21f-f744f8377577 req-b80c28a8-801a-4edc-8d54-a57383ee3b71 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:47.775660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f3737445-6a0d-4dbd-b21f-f744f8377577 req-b80c28a8-801a-4edc-8d54-a57383ee3b71 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:47.800645 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f3737445-6a0d-4dbd-b21f-f744f8377577 req-b80c28a8-801a-4edc-8d54-a57383ee3b71 service nova] Creating event network-vif-deleted:62d9d91d-a7e6-4da5-8878-d74f49fbf5e0 for instance add824ea-8e06-476d-bdb0-3778c52cfc10 on nch1-master-1 Jul 02 21:37:47.814556 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f3737445-6a0d-4dbd-b21f-f744f8377577 req-b80c28a8-801a-4edc-8d54-a57383ee3b71 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055280 Jul 02 21:37:47.815725 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2823/5675] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:48.567721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:48.568527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:48.575567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:48.576106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:48.576973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:48.577439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:48.598784 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 HTTP/1.1 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'add824ea-8e06-476d-bdb0-3778c52cfc10'} Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:37:48.600666 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:37:48.605502 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:48.606719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:37:48.607810 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9db65150-7d65-4c0e-83a9-46c468056847 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 404 len: 111 microversion: 2.1 time: 0.044326 Jul 02 21:37:48.608717 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2853/5676] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:48 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:37:48.618353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c048c0d-0bf7-498b-9ed8-52a56e189b64 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '.version_select at 0x7fabea2bb3a0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:48.640738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c048c0d-0bf7-498b-9ed8-52a56e189b64 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112477321" status: 202 len: 0 microversion: 2.1 time: 0.027031 Jul 02 21:37:48.641345 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2824/5677] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:37:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1112477321 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:37:49.459737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba5f74ae-c5ed-498d-8cbc-4358be25f618 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Action: 'create', calling method: .version_select at 0x7fabd7fceee0>, body: {"keypair": {"name": "tempest-keypair-65681978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoOXQ1S/IMdRXvJguQKhSP0/jPJk4EhHyon5P8R1KgtW6Is9e4AOXXmGIHYSVR1o4eehU6GuCHwKYE5z3GARhww7coquIQz1lXsYaYMgjpQgHSWilDnTqgA8WiXmPnHig=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:49.475888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ba5f74ae-c5ed-498d-8cbc-4358be25f618 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:37:49.481522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-ba5f74ae-c5ed-498d-8cbc-4358be25f618 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for user 39889b52b09a40ecacbf5a790e5bd20e and project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:37:49.523499 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba5f74ae-c5ed-498d-8cbc-4358be25f618 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.067684 Jul 02 21:37:49.524519 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2854/5678] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:37:49 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:50.469167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:50.470083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:50.472891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-96ba7665-62a2-4814-8c1d-608c92ce46fd req-42385d58-75a3-434f-b85a-1019b60b5f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fab5d54e-75d3-45b0-b1ed-88f386d5bf75", "tag": "295df6fa-bbcc-490c-a943-15bc5973b25b"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:50.478600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:50.479353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:50.480680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:50.481335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:50.484433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-96ba7665-62a2-4814-8c1d-608c92ce46fd req-42385d58-75a3-434f-b85a-1019b60b5f3f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:50.484927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-96ba7665-62a2-4814-8c1d-608c92ce46fd req-42385d58-75a3-434f-b85a-1019b60b5f3f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:50.501495 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-96ba7665-62a2-4814-8c1d-608c92ce46fd req-42385d58-75a3-434f-b85a-1019b60b5f3f service nova] Creating event network-changed:295df6fa-bbcc-490c-a943-15bc5973b25b for instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 on nch2-master-1 Jul 02 21:37:50.511151 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-96ba7665-62a2-4814-8c1d-608c92ce46fd req-42385d58-75a3-434f-b85a-1019b60b5f3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042681 Jul 02 21:37:50.512253 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2855/5679] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:50.518111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:37:50.617391 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-16a6dcc9-47cf-4115-a12a-67a79fab2881 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 204 len: 0 microversion: 2.1 time: 0.152071 Jul 02 21:37:50.620019 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2825/5680] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:37:50 2022] DELETE /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:37:50.628246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:50.629553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:50.636313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:50.637028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:50.637987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:50.638530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:50.802996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:50.810873 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-450624a4-d74f-432c-9dc1-a974761480b8 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1768 microversion: 2.1 time: 0.187502 Jul 02 21:37:50.821691 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2856/5681] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:50 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1768 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:51.091789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-30038727", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8684c175-5583-46cf-8c24-8f0a439e8112"}], "security_groups": [{"name": "tempest-securitygroup--491345028"}], "key_name": "tempest-keypair-65681978", "user_data": "}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:51.195909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] validate_networks() for [('8684c175-5583-46cf-8c24-8f0a439e8112', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:37:51.585834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:37:51.586457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:37:51.586746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:37:51.587170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:37:51.587593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:37:51.597778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:51.598264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:51.599082 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:51.599525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:51.618018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:37:51.624023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Getting quotas for user 39889b52b09a40ecacbf5a790e5bd20e and project 89d5b5b1b03f495d9dcdfdc29598fe8f. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:37:51.638201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:37:51.640729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:37:51.695126 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17f4e946-8ab7-445a-9e68-1e4ee562f195 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.612144 Jul 02 21:37:51.695855 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2826/5682] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:37:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:37:51.706226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00dbae84-0ba1-430b-98a4-68393da71c31 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:51.706845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00dbae84-0ba1-430b-98a4-68393da71c31 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:51.760730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00dbae84-0ba1-430b-98a4-68393da71c31 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:51.767542 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00dbae84-0ba1-430b-98a4-68393da71c31 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1238 microversion: 2.1 time: 0.065336 Jul 02 21:37:51.768129 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2857/5683] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:51 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:51.828237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:51.828829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:51.837059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:51.837645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:51.838707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:51.839327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:52.000606 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:52.004522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:52.009501 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1125b40b-6eba-492d-b88e-d826857e32ce tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1768 microversion: 2.1 time: 0.185368 Jul 02 21:37:52.012126 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2827/5684] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:51 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1768 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:52.785394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:52.786622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:52.794836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:52.795572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:52.796561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:52.797173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:52.822684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:37:52.878102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:52.884959 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1b11eb7b-cb64-4b44-9f48-99b0fd816806 req-47444a9e-4df7-47d7-9277-02b3a594593a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fab5d54e-75d3-45b0-b1ed-88f386d5bf75", "name": "network-vif-deleted", "tag": "295df6fa-bbcc-490c-a943-15bc5973b25b"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:52.886862 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dca66790-36e9-4c56-a2c0-b89427e8e223 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1308 microversion: 2.1 time: 0.105437 Jul 02 21:37:52.887472 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2858/5685] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:52 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:52.904559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1b11eb7b-cb64-4b44-9f48-99b0fd816806 req-47444a9e-4df7-47d7-9277-02b3a594593a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:52.905225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1b11eb7b-cb64-4b44-9f48-99b0fd816806 req-47444a9e-4df7-47d7-9277-02b3a594593a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:52.917719 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1b11eb7b-cb64-4b44-9f48-99b0fd816806 req-47444a9e-4df7-47d7-9277-02b3a594593a service nova] Creating event network-vif-deleted:295df6fa-bbcc-490c-a943-15bc5973b25b for instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 on nch2-master-1 Jul 02 21:37:52.923015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1b11eb7b-cb64-4b44-9f48-99b0fd816806 req-47444a9e-4df7-47d7-9277-02b3a594593a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043067 Jul 02 21:37:52.923622 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2828/5686] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:37:53.027982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:53.029108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:53.036333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:53.036795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:53.037633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:53.038080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:53.073745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:53.074202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:53.074660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lazy-loading 'fault' on Instance uuid fab5d54e-75d3-45b0-b1ed-88f386d5bf75 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:37:53.129313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '253740c520d7432da9b93d8d2e7aa418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '655a8ac13c4d47208cc9437074595d8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:53.137212 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ff745d4-aef7-4cc9-862d-0df56053451e tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 200 len: 1384 microversion: 2.1 time: 0.114078 Jul 02 21:37:53.137811 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2859/5687] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:53 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 1384 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:37:53.907559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:53.908459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:53.915434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:53.915958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:53.916759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:53.917423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:54.155269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:54.160033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] [instance: fab5d54e-75d3-45b0-b1ed-88f386d5bf75] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:54.167646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:54.168124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:54.168919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:54.169385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:54.185027 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] HTTP exception thrown: Instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 could not be found. Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Request method failure captured: Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 HTTP/1.1 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLpbRYpC9u-q1ksL7VAcHNNFhTlFfUdzl6PWSNo-noFra0ru3q2yP7cCqCh6EieoTIAJ-i2vqtdGC5eDvod9w4N6-hLlTnrkmOB7KtQh4alIBZVsCpxbKCmdjEnOXdIULJ30UarA-yDyWaOIOKunQ6_iTyn9WG6NEweQCWhfTocqWcI Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 655a8ac13c4d47208cc9437074595d8d Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-112077978 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655a8ac13c4d47208cc9437074595d8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_655a8ac13c4d47208cc9437074595d8d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/655a8ac13c4d47208cc9437074595d8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/655a8ac13c4d47208cc9437074595d8d"}]}] Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestSecurityGroupsBasicOps-112077978 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 655a8ac13c4d47208cc9437074595d8d Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-112077978 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestSecurityGroupsBasicOps-112077978-project Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 253740c520d7432da9b93d8d2e7aa418 Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestSecurityGroupsBasicOps-112077978-project Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 could not be found. Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'fab5d54e-75d3-45b0-b1ed-88f386d5bf75'} Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 could not be found. Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 could not be found. Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:37:54.186758 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 could not be found. Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Returning 404 to user: Instance fab5d54e-75d3-45b0-b1ed-88f386d5bf75 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-51104ce6-6916-4db8-ad6a-5a689fcdc585 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75" status: 404 len: 111 microversion: 2.1 time: 0.037215 Jul 02 21:37:54.192940 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2860/5688] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:54 2022] GET /compute/v2.1/servers/fab5d54e-75d3-45b0-b1ed-88f386d5bf75 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:37:54.464851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:54.473965 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-418183ab-643e-4835-8459-6dc1fc460602 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.572092 Jul 02 21:37:54.475332 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2829/5689] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:53 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:54.767627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-636c5460-15e0-46e0-8519-a0f940b1d502 req-e18e8fb5-5365-4f1b-8532-581ab9847a88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9764406-cf54-4bff-adfe-04e148c3985b", "tag": "bd54fabf-22fc-4cd1-9b29-4961a2333998"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:37:54.777709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-636c5460-15e0-46e0-8519-a0f940b1d502 req-e18e8fb5-5365-4f1b-8532-581ab9847a88 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:54.777709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-636c5460-15e0-46e0-8519-a0f940b1d502 req-e18e8fb5-5365-4f1b-8532-581ab9847a88 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:54.794916 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-636c5460-15e0-46e0-8519-a0f940b1d502 req-e18e8fb5-5365-4f1b-8532-581ab9847a88 service nova] Creating event network-changed:bd54fabf-22fc-4cd1-9b29-4961a2333998 for instance b9764406-cf54-4bff-adfe-04e148c3985b on nch1-master-1 Jul 02 21:37:54.800635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-636c5460-15e0-46e0-8519-a0f940b1d502 req-e18e8fb5-5365-4f1b-8532-581ab9847a88 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036841 Jul 02 21:37:54.801467 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2861/5690] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:37:55.492577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:55.493291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:55.501105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:55.501565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:55.502346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:55.502776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:55.727794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:55.736032 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d5b3e19-d6b1-432b-9d4a-0c6c1e910c2c tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.247395 Jul 02 21:37:55.736644 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2830/5691] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:55 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:56.753149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:56.754487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:56.762679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:56.763542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:56.764592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:56.765206 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:56.929077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:56.937328 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d87e64bc-a50c-4442-a03e-3695cfdfd65e tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.188454 Jul 02 21:37:56.944299 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2862/5692] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:56 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:57.956375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:57.961000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:57.969364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:57.969839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:57.970639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:57.971043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:58.111754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:58.119310 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8b7f044f-aa93-4422-9489-18d8289ce2d6 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.168548 Jul 02 21:37:58.119899 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2831/5693] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:57 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:37:58.146199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8a6553f6-bac5-4c82-9006-445d884a76e3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] Calling method '.version_select at 0x7fabe4ad4af0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:58.166284 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8a6553f6-bac5-4c82-9006-445d884a76e3 tempest-TestSecurityGroupsBasicOps-112077978 tempest-TestSecurityGroupsBasicOps-112077978-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1019164937" status: 202 len: 0 microversion: 2.1 time: 0.023958 Jul 02 21:37:58.167015 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2863/5694] 10.222.0.43 () {58 vars in 1277 bytes} [Sat Jul 2 21:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1019164937 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:37:59.137567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:37:59.138269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:37:59.150521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:59.151007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:59.151987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:37:59.152454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:37:59.351562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:37:59.359520 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ca93d2c6-3af3-4ff6-ade8-37f2f12c2a58 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.226471 Jul 02 21:37:59.360108 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2832/5695] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:37:59 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:38:00.377660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:38:00.378231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:38:00.380876 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:00.386806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:00.387259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:00.391308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:00.391804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:00.532490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:38:00.540814 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ba1d3a5-56a5-4403-99ec-e6b1d6a4176a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.168319 Jul 02 21:38:00.541405 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2864/5696] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:38:00 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:38:00.937626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-8ad02789-903c-4e95-8440-3603a15ecd3f req-5c9a2d63-bf9f-4482-a727-2414d1541a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9764406-cf54-4bff-adfe-04e148c3985b", "name": "network-vif-plugged", "status": "completed", "tag": "bd54fabf-22fc-4cd1-9b29-4961a2333998"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:38:00.946966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:00.949252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8ad02789-903c-4e95-8440-3603a15ecd3f req-5c9a2d63-bf9f-4482-a727-2414d1541a8a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:00.949699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-8ad02789-903c-4e95-8440-3603a15ecd3f req-5c9a2d63-bf9f-4482-a727-2414d1541a8a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:00.963357 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-8ad02789-903c-4e95-8440-3603a15ecd3f req-5c9a2d63-bf9f-4482-a727-2414d1541a8a service nova] Creating event network-vif-plugged:bd54fabf-22fc-4cd1-9b29-4961a2333998 for instance b9764406-cf54-4bff-adfe-04e148c3985b on nch1-master-1 Jul 02 21:38:00.968531 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-8ad02789-903c-4e95-8440-3603a15ecd3f req-5c9a2d63-bf9f-4482-a727-2414d1541a8a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035503 Jul 02 21:38:00.969505 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2833/5697] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:38:01.557763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:38:01.559066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:38:01.566386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:01.567097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:01.567869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:01.568405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:01.765564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:02.131799 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:38:02.140360 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d2b1a42e-0210-4fa7-b473-e62ae7c3c4e0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1363 microversion: 2.1 time: 0.586613 Jul 02 21:38:02.141288 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2865/5698] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:38:01 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1363 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:38:03.159493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:38:03.160553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:38:03.162585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:03.163484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:38:03.172312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:03.172765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:03.173547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:03.174518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:03.429684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:38:03.438666 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1bbadd51-e54c-4c5d-92d9-35890852c6d1 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1554 microversion: 2.1 time: 0.283749 Jul 02 21:38:03.439602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2834/5699] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:38:03 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1554 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:38:03.457848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:38:03.458375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:38:03.468158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:03.469437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:03.470416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:03.471609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:03.560793 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-35f0900e-c2d9-4c22-9699-259802409ce9 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106869 Jul 02 21:38:03.561425 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2866/5700] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:38:03 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:38:04.663374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-32d0edf6-ed18-41a3-ba8d-35fa8570aafc req-df13c19a-ce10-450e-8667-e68be4d9715b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9764406-cf54-4bff-adfe-04e148c3985b", "tag": "bd54fabf-22fc-4cd1-9b29-4961a2333998"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:38:04.675209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-32d0edf6-ed18-41a3-ba8d-35fa8570aafc req-df13c19a-ce10-450e-8667-e68be4d9715b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:38:04.675661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-32d0edf6-ed18-41a3-ba8d-35fa8570aafc req-df13c19a-ce10-450e-8667-e68be4d9715b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:38:04.692880 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-32d0edf6-ed18-41a3-ba8d-35fa8570aafc req-df13c19a-ce10-450e-8667-e68be4d9715b service nova] Creating event network-changed:bd54fabf-22fc-4cd1-9b29-4961a2333998 for instance b9764406-cf54-4bff-adfe-04e148c3985b on nch1-master-1 Jul 02 21:38:04.699667 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-32d0edf6-ed18-41a3-ba8d-35fa8570aafc req-df13c19a-ce10-450e-8667-e68be4d9715b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041863 Jul 02 21:38:04.700486 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2835/5701] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:39:09.682645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=5 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:09.683835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:09.690760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:09.691580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:09.698901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:09.699355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:09.700217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:09.700660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:09.724456 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e5b53454-cef0-48b8-b552-891a0691f3dc tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b/ips" status: 200 len: 151 microversion: 2.1 time: 0.046199 Jul 02 21:39:09.725029 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2867/5702] 10.222.0.43 () {58 vars in 1247 bytes} [Sat Jul 2 21:39:09 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:39:10.859525 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:39:10.860686 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:39:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:39:11.077281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=5 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:11.078044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=36 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:39:11.083063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:11.083923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:11.092485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:11.092936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:11.093712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:11.094156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:11.123119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:39:11.207805 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79f69a0b-a950-4cd0-9313-51a981c0a971 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 204 len: 0 microversion: 2.1 time: 0.133772 Jul 02 21:39:11.208430 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2836/5703] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:39:11 2022] DELETE /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:39:11.216887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:11.217535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:11.224964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:11.225437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:11.226226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:11.226666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:11.364587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:39:11.372893 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0af2b2c8-50cb-4cea-b59d-df8767b79d96 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1679 microversion: 2.1 time: 0.159990 Jul 02 21:39:11.373548 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2868/5704] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:11 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:39:12.399002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:12.399596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:12.407097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:12.407554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:12.408376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:12.408854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:12.547689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:39:12.559372 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-456a612b-c42e-44c4-a4fb-296f266af8fa tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1679 microversion: 2.1 time: 0.165406 Jul 02 21:39:12.560107 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2837/5705] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:12 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:39:13.580356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:13.580952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:13.588509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:13.588888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:13.589723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:13.590155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:13.653422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39889b52b09a40ecacbf5a790e5bd20e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89d5b5b1b03f495d9dcdfdc29598fe8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:39:13.661425 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0c5e11c-959b-4c1a-b7f5-9bef61e75321 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 200 len: 1612 microversion: 2.1 time: 0.085054 Jul 02 21:39:13.662020 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2869/5706] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:13 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 1612 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:39:13.821357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f5b58e1e-3432-4d08-8b7f-d640de43ef77 req-9688907c-caa4-4d7d-ba8d-068afc64d91d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9764406-cf54-4bff-adfe-04e148c3985b", "name": "network-vif-deleted", "tag": "bd54fabf-22fc-4cd1-9b29-4961a2333998"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:39:13.831301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f5b58e1e-3432-4d08-8b7f-d640de43ef77 req-9688907c-caa4-4d7d-ba8d-068afc64d91d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:13.832520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f5b58e1e-3432-4d08-8b7f-d640de43ef77 req-9688907c-caa4-4d7d-ba8d-068afc64d91d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:13.848107 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f5b58e1e-3432-4d08-8b7f-d640de43ef77 req-9688907c-caa4-4d7d-ba8d-068afc64d91d service nova] Creating event network-vif-deleted:bd54fabf-22fc-4cd1-9b29-4961a2333998 for instance b9764406-cf54-4bff-adfe-04e148c3985b on nch1-master-1 Jul 02 21:39:13.855168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f5b58e1e-3432-4d08-8b7f-d640de43ef77 req-9688907c-caa4-4d7d-ba8d-068afc64d91d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036591 Jul 02 21:39:13.856174 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2838/5707] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:39:14.679282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:14.679914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:14.687032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:14.687480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:14.688273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:14.688705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:14.706473 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b HTTP/1.1 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b9764406-cf54-4bff-adfe-04e148c3985b'} Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:14.708301 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c45adfff-930a-4f3f-a8ce-99f58ccf4ac2 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 404 len: 111 microversion: 2.1 time: 0.034621 Jul 02 21:39:14.714205 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2870/5708] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:14 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:39:14.720280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5284d0c2-39cc-4238-957e-bced9a85f210 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '.version_select at 0x7fabd72255e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:14.740689 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5284d0c2-39cc-4238-957e-bced9a85f210 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-65681978" status: 202 len: 0 microversion: 2.1 time: 0.024739 Jul 02 21:39:14.741237 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2839/5709] 10.222.0.43 () {58 vars in 1214 bytes} [Sat Jul 2 21:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-65681978 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:39:15.563136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:15.563636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:15.570508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.570931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.571714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.572199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.586255 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b HTTP/1.1 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b9764406-cf54-4bff-adfe-04e148c3985b'} Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:15.587798 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-70ef8374-b30c-4156-84c5-d4f30f215313 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 404 len: 111 microversion: 2.1 time: 0.030085 Jul 02 21:39:15.592955 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2871/5710] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:39:15 2022] DELETE /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:39:15.599675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:15.600539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: b9764406-cf54-4bff-adfe-04e148c3985b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:15.611025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.611517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.612323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.612773 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.626530 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b HTTP/1.1 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b9764406-cf54-4bff-adfe-04e148c3985b'} Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.628269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance b9764406-cf54-4bff-adfe-04e148c3985b could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d46bb1d2-f1ab-4d40-baf0-22d0acc07e6f tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b" status: 404 len: 111 microversion: 2.1 time: 0.035012 Jul 02 21:39:15.633819 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2840/5711] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:15 2022] GET /compute/v2.1/servers/b9764406-cf54-4bff-adfe-04e148c3985b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:39:15.773186 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:15.773726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:15.781011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.781487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.782233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.782665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.796952 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 HTTP/1.1 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'add824ea-8e06-476d-bdb0-3778c52cfc10'} Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:15.798871 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dafc0aa8-2970-4eac-bee2-6825246f0742 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 404 len: 111 microversion: 2.1 time: 0.031233 Jul 02 21:39:15.803839 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2872/5712] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:39:15 2022] DELETE /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:39:15.813792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:15.814486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: add824ea-8e06-476d-bdb0-3778c52cfc10] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:15.821396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.821864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.822678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.823120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.837174 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 HTTP/1.1 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'add824ea-8e06-476d-bdb0-3778c52cfc10'} Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:15.838706 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance add824ea-8e06-476d-bdb0-3778c52cfc10 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71147f6c-d431-4b7c-bec6-fcf7b495a51a tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10" status: 404 len: 111 microversion: 2.1 time: 0.030463 Jul 02 21:39:15.844135 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2841/5713] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:15 2022] GET /compute/v2.1/servers/add824ea-8e06-476d-bdb0-3778c52cfc10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:39:15.991480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:15.991978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:15.998375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:15.998818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:15.999572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:16.000006 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:16.013839 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 HTTP/1.1 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'e5b0a3ec-0c62-4d32-8f98-be05ddcaab91'} Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:16.015388 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-032d8c1d-dd1f-448a-80f0-83cdaf9ab7c0 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 404 len: 111 microversion: 2.1 time: 0.030123 Jul 02 21:39:16.020518 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2873/5714] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:39:15 2022] DELETE /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:39:16.027262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:39:16.027956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] [instance: e5b0a3ec-0c62-4d32-8f98-be05ddcaab91] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:39:16.037167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:16.037778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:16.038897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:39:16.039528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:39:16.057116 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] HTTP exception thrown: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Request method failure captured: Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 HTTP/1.1 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLocLlXU2KDGXd0Go4z_d79XJoqG_O8WKEzshgbdfCiBATUVt7i4Vn9r-UXl131-h0WOMkfbBVvEE4RIc40QfWJuc1Dkf9KKKpzYS10J5D3jTLSEaeCF1K8-BktuOAfGlJwccV3w2eKeJd2Bif1LQTF34EEu0UO-Q0ILD0h_IEs40lM Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_89d5b5b1b03f495d9dcdfdc29598fe8f", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/89d5b5b1b03f495d9dcdfdc29598fe8f"}]}] Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 89d5b5b1b03f495d9dcdfdc29598fe8f Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1081120822 Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 39889b52b09a40ecacbf5a790e5bd20e Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-AttachVolumeNegativeTest-1081120822-project Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'e5b0a3ec-0c62-4d32-8f98-be05ddcaab91'} Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:39:16.058637 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] Returning 404 to user: Instance e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-928ef504-b15a-43a5-8339-9fcd3682e378 tempest-AttachVolumeNegativeTest-1081120822 tempest-AttachVolumeNegativeTest-1081120822-project] 10.222.0.43 "GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91" status: 404 len: 111 microversion: 2.1 time: 0.038536 Jul 02 21:39:16.067006 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2842/5715] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:39:16 2022] GET /compute/v2.1/servers/e5b0a3ec-0c62-4d32-8f98-be05ddcaab91 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:40:09.105851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:09.106479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=24 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:40:09.227578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Calling method '.version_select at 0x7fabd76b03a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:40:09.229085 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:40:09.229085 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:40:09.230890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:40:09.231599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:40:09.254394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:40:09.254854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:40:09.265621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:40:09.266061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:40:09.272303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5654f827-d844-4fd4-a3b8-7eb057fbf893 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1421503356-project-admin] 10.222.0.43 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.172318 Jul 02 21:40:09.272889 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2874/5716] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:40:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:40:50.645045 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:40:50.645045 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:40:50.782985 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:40:50.783580 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:40:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:42:12.764882 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [-] [35662bbb-83f2-4e2a-9c02-91311131c30d] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 21:42:12.766158 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0110b08e-b0dd-476d-bbab-ad64d125228e] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 21:42:12.766778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:12.767522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:12.919150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-666796013", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "094b68a7-3476-49ff-bca8-5e723cbb9b76"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:13.086101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] validate_networks() for [('094b68a7-3476-49ff-bca8-5e723cbb9b76', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:42:13.621915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:42:13.622353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:42:13.622837 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:42:13.623255 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:42:13.623667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:42:13.633842 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:13.634296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:13.635107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:13.635549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:13.653282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Getting quotas for project edb2a5910eb04623bb47ab18226f51d2. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:42:13.658890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Getting quotas for user bd6d8214cf274e198771f8c5f9c6dc6d and project edb2a5910eb04623bb47ab18226f51d2. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:42:13.674943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:42:13.677376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:42:13.728674 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33bbe41b-fdf2-4745-954c-6725685bc325 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965816 Jul 02 21:42:13.729335 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2843/5717] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:42:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:42:13.737797 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 21:42:13.738720 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 21:42:13.739489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:13.740222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:13.744930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d6087a1-3f40-45dc-ab2c-ef1303c483bf tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:13.745478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d6087a1-3f40-45dc-ab2c-ef1303c483bf tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:13.860300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d6087a1-3f40-45dc-ab2c-ef1303c483bf tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:13.867773 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d6087a1-3f40-45dc-ab2c-ef1303c483bf tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1214 microversion: 2.1 time: 0.131948 Jul 02 21:42:13.868419 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2875/5718] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:13 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:14.892151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d995c005-c672-4d81-b5ad-5b719c927e11 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:14.892782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d995c005-c672-4d81-b5ad-5b719c927e11 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:14.905447 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] [35662bbb-83f2-4e2a-9c02-91311131c30d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32944. Jul 02 21:42:14.912566 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] [0110b08e-b0dd-476d-bbab-ad64d125228e] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32946. Jul 02 21:42:14.960079 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d995c005-c672-4d81-b5ad-5b719c927e11 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:14.967890 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d995c005-c672-4d81-b5ad-5b719c927e11 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1214 microversion: 2.1 time: 0.085491 Jul 02 21:42:14.968540 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2844/5719] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:14 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:15.987942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44556f23-1924-47fd-bb30-c7a3add864d2 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:15.989305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44556f23-1924-47fd-bb30-c7a3add864d2 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:16.010164 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32958. Jul 02 21:42:16.016235 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32956. Jul 02 21:42:16.067029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44556f23-1924-47fd-bb30-c7a3add864d2 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:16.073988 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44556f23-1924-47fd-bb30-c7a3add864d2 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1214 microversion: 2.1 time: 0.092421 Jul 02 21:42:16.074542 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2876/5720] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:15 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:17.092640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4db9e4bf-35dc-48eb-8cda-d48ffe012dfa tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:17.094132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4db9e4bf-35dc-48eb-8cda-d48ffe012dfa tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:17.151396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4db9e4bf-35dc-48eb-8cda-d48ffe012dfa tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:17.158684 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4db9e4bf-35dc-48eb-8cda-d48ffe012dfa tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1214 microversion: 2.1 time: 0.071511 Jul 02 21:42:17.159334 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2845/5721] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:17 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:42:18.177678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:18.178301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:18.186605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:18.187107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:18.188071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:18.188565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:18.258677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:18.266673 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-73897e29-6935-4fdd-b652-e6a3f20cb824 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1218 microversion: 2.1 time: 0.093631 Jul 02 21:42:18.267254 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2877/5722] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:18 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:19.284269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:19.284930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:19.293249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:19.293723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:19.295138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:19.295590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:19.360890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:19.368892 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-51d91081-8709-4939-a333-bd90bfe6472d tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1272 microversion: 2.1 time: 0.088603 Jul 02 21:42:19.369458 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2846/5723] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:19 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:20.365950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51293d1-0b6f-41c6-a0f9-52074bd2dc77", "tag": "4af2ae03-3c8c-4b80-a6fa-980da7805608"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:20.374960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:20.375411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:20.386253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:20.386838 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] Creating event network-changed:4af2ae03-3c8c-4b80-a6fa-980da7805608 for instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 on nch2-master-1 Jul 02 21:42:20.388881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:20.390257 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] [e0999d02-7152-493f-b310-117f30d0e319] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 21:42:20.396531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:20.396976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:20.397877 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:20.398321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:20.536619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:20.544503 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d2eed28d-2396-4885-9df9-2b89d0ca1b91 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1314 microversion: 2.1 time: 0.162123 Jul 02 21:42:20.545548 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2847/5724] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:20 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:42:21.402510 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] [e0999d02-7152-493f-b310-117f30d0e319] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32978. Jul 02 21:42:21.408980 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-581180fc-09bc-4eae-a244-badda6aebdb0 req-31b715c2-5d22-49df-bb07-5dc2f4eff40b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.122004 Jul 02 21:42:21.409596 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2878/5725] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:42:21.565929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:21.566948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:21.578925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:21.579684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:21.580755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:21.581201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:21.727674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:21.736027 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bac113ed-347e-4bd6-a9a2-acbce31b2fa6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1314 microversion: 2.1 time: 0.176579 Jul 02 21:42:21.736689 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2848/5726] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:21 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:22.756705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:22.757403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:22.764135 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:22.764631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:22.765426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:22.765882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:22.902034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:22.912068 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bdeeddd2-18f3-46c7-bd27-8127b8331c87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1314 microversion: 2.1 time: 0.161251 Jul 02 21:42:22.912799 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2879/5727] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:22 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:23.931619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:23.932415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:23.935779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:23.943441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:23.944013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:23.945012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:23.945557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:24.084372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:24.092653 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ad63ff0-c030-44d0-afb2-031dcd1ea474 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1314 microversion: 2.1 time: 0.165966 Jul 02 21:42:24.093231 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2849/5728] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:23 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:24.453857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-30619d4a-d95a-4f51-bcab-876f6aa52336 req-b079d9f6-ac25-4ee0-ba75-f4cdbca1fb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51293d1-0b6f-41c6-a0f9-52074bd2dc77", "name": "network-vif-plugged", "status": "completed", "tag": "4af2ae03-3c8c-4b80-a6fa-980da7805608"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:24.463977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-30619d4a-d95a-4f51-bcab-876f6aa52336 req-b079d9f6-ac25-4ee0-ba75-f4cdbca1fb58 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:24.464615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-30619d4a-d95a-4f51-bcab-876f6aa52336 req-b079d9f6-ac25-4ee0-ba75-f4cdbca1fb58 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:24.476335 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-30619d4a-d95a-4f51-bcab-876f6aa52336 req-b079d9f6-ac25-4ee0-ba75-f4cdbca1fb58 service nova] Creating event network-vif-plugged:4af2ae03-3c8c-4b80-a6fa-980da7805608 for instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 on nch2-master-1 Jul 02 21:42:24.481402 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-30619d4a-d95a-4f51-bcab-876f6aa52336 req-b079d9f6-ac25-4ee0-ba75-f4cdbca1fb58 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Jul 02 21:42:24.482001 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2880/5729] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:42:25.110462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:25.111086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:25.118700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:25.119162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:25.119946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:25.120433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:25.257172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:25.265037 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad730956-dc70-4c44-a1bf-754ab6d4d5ec tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1314 microversion: 2.1 time: 0.158584 Jul 02 21:42:25.265580 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2850/5730] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:25 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:26.283398 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:26.288080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:26.288830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:26.296213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.296673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.297465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.297899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.435689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:26.445580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b77fc9d-337b-4ee5-ba4e-2f89b2628291 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1502 microversion: 2.1 time: 0.165351 Jul 02 21:42:26.446147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2881/5731] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:26 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:26.461818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:26.462406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:26.469740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.470201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.470976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.471518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.607656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:26.619636 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed075f39-9c94-4734-aa53-81ca516cbe7f tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1502 microversion: 2.1 time: 0.161422 Jul 02 21:42:26.620528 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2851/5732] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:26 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:42:26.640457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:26.641024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:26.647701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.648177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.648947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.649385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.673578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lazy-loading 'flavor' on Instance uuid c51293d1-0b6f-41c6-a0f9-52074bd2dc77 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:42:26.745559 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1f4d4a5d-51be-4665-a4c8-1e6666c461c3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action" status: 202 len: 0 microversion: 2.1 time: 0.110127 Jul 02 21:42:26.746213 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2882/5733] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:42:26 2022] POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:42:26.757077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:26.757698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:26.764662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.765158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.766035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:26.766772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:26.915110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:26.924154 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d574559-4d70-4d8b-a5a5-f3f737addd95 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1510 microversion: 2.1 time: 0.172890 Jul 02 21:42:26.924845 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2852/5734] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:26 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:27.945187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:27.945888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:27.952893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:27.953347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:27.954127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:27.954593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:28.098355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:28.106467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e402e7c1-1b24-43b3-8be6-d212352683ba tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1493 microversion: 2.1 time: 0.167124 Jul 02 21:42:28.107049 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2883/5735] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:27 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1493 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:28.123605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:28.124189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:28.126113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:28.132515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:28.132970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:28.133774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:28.134222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:28.207187 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad8b0799-cc51-493c-9ca6-d08007ba16e1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action" status: 202 len: 0 microversion: 2.1 time: 0.087259 Jul 02 21:42:28.207797 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2853/5736] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:42:28 2022] POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:42:28.215992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:28.216650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:28.223379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:28.223834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:28.224670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:28.225104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:28.358761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:28.366735 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9c8332e7-c0bf-4ce0-9c62-a93f3e06e91b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1499 microversion: 2.1 time: 0.154679 Jul 02 21:42:28.367337 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2884/5737] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:28 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:29.390544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:29.391538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:29.402299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:29.403052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:29.404415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:29.405160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:29.546676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:29.554497 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-949d3125-16cc-4194-8c69-8f20248a633b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1499 microversion: 2.1 time: 0.172842 Jul 02 21:42:29.555097 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2854/5738] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:29 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1499 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:30.578687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:30.580385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:30.588260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:30.588672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:30.589438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:30.589897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:30.618617 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:42:30.619190 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:42:30.730073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:30.738120 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0c7f1783-60c6-4e8f-b856-a73da2c885a6 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1502 microversion: 2.1 time: 0.169077 Jul 02 21:42:30.738683 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2885/5739] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:30 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:30.754993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:30.755539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:30.762992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:30.763458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:30.764271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:30.764716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:30.793970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lazy-loading 'flavor' on Instance uuid c51293d1-0b6f-41c6-a0f9-52074bd2dc77 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:42:30.870749 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:42:30.871003 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:42:30.883241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-696143f8-a2e7-440b-8e4c-4b9e06b68a5a tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action" status: 202 len: 0 microversion: 2.1 time: 0.132128 Jul 02 21:42:30.884299 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2855/5740] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:42:30 2022] POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:42:30.892826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:30.893464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:30.899885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:30.900403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:30.901277 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:30.901813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:31.042517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:31.050810 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f970a5ab-2c5f-4b94-80fa-eeea38599881 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1510 microversion: 2.1 time: 0.161914 Jul 02 21:42:31.051400 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2886/5741] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:30 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:32.073280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:32.074456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:32.084700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:32.085159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:32.085956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:32.086403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:32.530140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:32.538658 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9473074-a269-498f-bb34-abd325d81438 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1493 microversion: 2.1 time: 0.472607 Jul 02 21:42:32.539220 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2856/5742] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:32 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1493 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:32.556020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:32.556604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:32.563684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:32.564183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:32.564985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:32.565466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:32.635969 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d7aea38e-05d2-474b-a67b-e1a7efd50561 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action" status: 202 len: 0 microversion: 2.1 time: 0.083710 Jul 02 21:42:32.636546 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2887/5743] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:42:32 2022] POST /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:42:32.645028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:32.645726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:32.652561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:32.653102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:32.653956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:32.654511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:32.798577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:32.806945 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45d05aa1-47a1-4e28-9f0d-d651d3e4638b tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1499 microversion: 2.1 time: 0.166001 Jul 02 21:42:32.807616 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2857/5744] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:32 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:42:33.825364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:33.826120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:33.833150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:33.833605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:33.834392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:33.834832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:33.976791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:33.984633 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-86d49756-c6c9-4304-9351-66c154e8f6d1 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1499 microversion: 2.1 time: 0.163584 Jul 02 21:42:33.985207 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2888/5745] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:33 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:35.006437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:35.007511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:35.019652 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:35.020471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:35.021808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:35.022249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:35.170506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:35.178567 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-076b2d16-10b7-4e1d-9c8f-a8545b5deedd tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1502 microversion: 2.1 time: 0.178852 Jul 02 21:42:35.179134 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2858/5746] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:34 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1502 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:35.195300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:35.195853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:35.203962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:35.204458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:35.205237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:35.205767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:35.233816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:42:35.311340 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5b19540e-bc14-4a07-96af-f3c93d642a87 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 204 len: 0 microversion: 2.1 time: 0.119643 Jul 02 21:42:35.312132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2889/5747] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:42:35 2022] DELETE /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:42:35.320683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:35.321297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:35.327774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:35.328343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:35.329118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:35.329553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:35.348013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:35.472520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:35.482718 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd854b1d-6493-4d1f-bccb-90c76517a4ee tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1508 microversion: 2.1 time: 0.165860 Jul 02 21:42:35.483519 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2859/5748] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:35 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:36.509229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:36.510409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:36.521164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:36.521625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:36.522397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:36.522848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:36.542676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:42:36.673124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:36.681015 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-258b7370-4c59-460e-85e3-e6d1d3117792 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1508 microversion: 2.1 time: 0.178992 Jul 02 21:42:36.681579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2890/5749] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:36 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:37.698306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:37.699812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:37.710673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:37.711240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:37.712133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:37.712566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:37.758912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-63d27603-662f-4f9b-b0de-372c15c3c6b3 req-063e8a9c-8a3a-472b-b85c-b24d5942ed04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51293d1-0b6f-41c6-a0f9-52074bd2dc77", "name": "network-vif-deleted", "tag": "4af2ae03-3c8c-4b80-a6fa-980da7805608"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:42:37.768497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-63d27603-662f-4f9b-b0de-372c15c3c6b3 req-063e8a9c-8a3a-472b-b85c-b24d5942ed04 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:37.768941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-63d27603-662f-4f9b-b0de-372c15c3c6b3 req-063e8a9c-8a3a-472b-b85c-b24d5942ed04 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:37.779249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd6d8214cf274e198771f8c5f9c6dc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edb2a5910eb04623bb47ab18226f51d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:42:37.780790 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-63d27603-662f-4f9b-b0de-372c15c3c6b3 req-063e8a9c-8a3a-472b-b85c-b24d5942ed04 service nova] Creating event network-vif-deleted:4af2ae03-3c8c-4b80-a6fa-980da7805608 for instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 on nch2-master-1 Jul 02 21:42:37.785930 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-63d27603-662f-4f9b-b0de-372c15c3c6b3 req-063e8a9c-8a3a-472b-b85c-b24d5942ed04 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030728 Jul 02 21:42:37.786786 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2891/5750] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:42:37.787902 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb1b30d5-d330-40ff-9be2-7530b305e3d3 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 200 len: 1466 microversion: 2.1 time: 0.093966 Jul 02 21:42:37.788713 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2860/5751] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:37 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 1466 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:42:38.810972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:42:38.812099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] [instance: c51293d1-0b6f-41c6-a0f9-52074bd2dc77] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:42:38.824512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:38.825276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:38.826547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:42:38.827292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:42:38.843915 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] HTTP exception thrown: Instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 could not be found. Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Request method failure captured: Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 HTTP/1.1 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLuzsSRLlk1oYrLyIYnSOH07gbwofHcc0ersJS1AWLptcFvsy2NIJCAYrxb_P9QpnVat7816-cb8NtGTuVp7Il9OMKErUVCySHbdKovOUriAnJI-xGeDrtnB22QoyXz3aMj654XOlUiMbEc5dmb0wL1zBrKoIDeZR_Vf9aE-KgUptow Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: edb2a5910eb04623bb47ab18226f51d2 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestServerAdvancedOps-575366081 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edb2a5910eb04623bb47ab18226f51d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_edb2a5910eb04623bb47ab18226f51d2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/edb2a5910eb04623bb47ab18226f51d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/edb2a5910eb04623bb47ab18226f51d2"}]}] Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestServerAdvancedOps-575366081 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: edb2a5910eb04623bb47ab18226f51d2 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestServerAdvancedOps-575366081 Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestServerAdvancedOps-575366081-project Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: bd6d8214cf274e198771f8c5f9c6dc6d Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestServerAdvancedOps-575366081-project Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 could not be found. Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c51293d1-0b6f-41c6-a0f9-52074bd2dc77'} Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 could not be found. Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 could not be found. Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:42:38.845597 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 could not be found. Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] Returning 404 to user: Instance c51293d1-0b6f-41c6-a0f9-52074bd2dc77 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e88e223f-ecce-4f15-8512-182a402dea54 tempest-TestServerAdvancedOps-575366081 tempest-TestServerAdvancedOps-575366081-project] 10.222.0.43 "GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77" status: 404 len: 111 microversion: 2.1 time: 0.043045 Jul 02 21:42:38.851622 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2892/5752] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:42:38 2022] GET /compute/v2.1/servers/c51293d1-0b6f-41c6-a0f9-52074bd2dc77 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:43:02.390110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:02.391244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=8 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:02.509778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-414539347", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:02.560935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] validate_networks() for None {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:43:02.844835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:43:02.845396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:43:02.846163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:43:02.846603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:43:02.847111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:43:02.861188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:02.861799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:02.862996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:02.863632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:02.882825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Getting quotas for project 237fdb950d1d477fadba51149c76c201. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:43:02.888478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Getting quotas for user df426b59e996478083e92098ec70b244 and project 237fdb950d1d477fadba51149c76c201. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:43:02.902361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:43:02.904719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:43:02.950977 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3bfd5a03-0456-48ed-aede-5cc1c3ef2495 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566158 Jul 02 21:43:02.951797 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2861/5753] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:43:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:43:02.962520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4cfd3287-ff65-4258-b3eb-6f9b2152b056 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:02.963136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4cfd3287-ff65-4258-b3eb-6f9b2152b056 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:02.966908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:02.967632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:03.326994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4cfd3287-ff65-4258-b3eb-6f9b2152b056 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:03.336404 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4cfd3287-ff65-4258-b3eb-6f9b2152b056 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1221 microversion: 2.1 time: 0.378158 Jul 02 21:43:03.336977 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2893/5754] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:02 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1221 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:04.359246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e6cde1bd-e8cf-4a6f-9ba0-05f704f30356 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:04.360542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e6cde1bd-e8cf-4a6f-9ba0-05f704f30356 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:04.419705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e6cde1bd-e8cf-4a6f-9ba0-05f704f30356 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:04.427088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e6cde1bd-e8cf-4a6f-9ba0-05f704f30356 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1221 microversion: 2.1 time: 0.075908 Jul 02 21:43:04.427657 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2862/5755] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:04 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:05.444258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-988b84b4-8fa7-4de6-b0dd-4b682ec2b466 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:05.444874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-988b84b4-8fa7-4de6-b0dd-4b682ec2b466 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:05.499933 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-988b84b4-8fa7-4de6-b0dd-4b682ec2b466 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:05.507598 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-988b84b4-8fa7-4de6-b0dd-4b682ec2b466 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1221 microversion: 2.1 time: 0.067379 Jul 02 21:43:05.508204 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2894/5756] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:05 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:06.525135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8f847bd9-e1ed-43ae-a1c6-f01f41b38125 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:06.525815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8f847bd9-e1ed-43ae-a1c6-f01f41b38125 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:06.582905 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8f847bd9-e1ed-43ae-a1c6-f01f41b38125 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:06.590021 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8f847bd9-e1ed-43ae-a1c6-f01f41b38125 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1221 microversion: 2.1 time: 0.068996 Jul 02 21:43:06.590596 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2863/5757] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:06 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1221 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:07.607150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:07.607795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:07.615299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:07.615746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:07.616565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:07.617007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:07.684612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:07.692961 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45f7e1a9-1c9b-45f9-bbc2-37099f760d94 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1225 microversion: 2.1 time: 0.089699 Jul 02 21:43:07.693545 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2895/5758] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:07 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:08.710558 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:08.711116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:08.719585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:08.720074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:08.720909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:08.721358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:08.784659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:08.792803 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-88f0822d-f98c-4657-8ec2-a67b1ff39388 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1279 microversion: 2.1 time: 0.086366 Jul 02 21:43:08.793314 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2864/5759] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:08 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1279 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:09.810534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:09.811144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:09.818402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:09.818849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:09.819636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:09.820066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:09.841711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4d7ef05e-e3bb-4b35-9a12-473261f0ff1c req-4edeeb29-3f29-4d60-9158-14ce76eab7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f58490e-f121-485c-bc28-023f6dc3ebd5", "tag": "1c5bbe6b-47da-4042-aced-abf30234ea98"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:09.852460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4d7ef05e-e3bb-4b35-9a12-473261f0ff1c req-4edeeb29-3f29-4d60-9158-14ce76eab7d4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:09.853111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4d7ef05e-e3bb-4b35-9a12-473261f0ff1c req-4edeeb29-3f29-4d60-9158-14ce76eab7d4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:09.881878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4d7ef05e-e3bb-4b35-9a12-473261f0ff1c req-4edeeb29-3f29-4d60-9158-14ce76eab7d4 service nova] Creating event network-changed:1c5bbe6b-47da-4042-aced-abf30234ea98 for instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 on nch2-master-1 Jul 02 21:43:09.889274 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4d7ef05e-e3bb-4b35-9a12-473261f0ff1c req-4edeeb29-3f29-4d60-9158-14ce76eab7d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053419 Jul 02 21:43:09.890242 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2865/5760] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:43:09.980679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:09.988714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d0b0e9c-e130-4bd6-b481-cbd97cbdce71 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1321 microversion: 2.1 time: 0.182049 Jul 02 21:43:09.989350 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2896/5761] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:09 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:11.006299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:11.006990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:11.014871 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:11.015329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:11.016110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:11.016583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:11.152612 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:11.164516 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1354839f-db33-43c7-b613-cb38b46a2696 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1321 microversion: 2.1 time: 0.162465 Jul 02 21:43:11.165064 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2866/5762] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:11 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:12.186427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:12.187475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:12.196906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:12.197299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:12.198075 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:12.198638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:12.341808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:12.353537 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b00ecde4-9cf3-4bac-a844-4d47cff549ff tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1321 microversion: 2.1 time: 0.173207 Jul 02 21:43:12.354167 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2897/5763] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:12 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:13.373953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:13.374640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:13.377647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:13.383656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:13.384135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:13.385223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:13.385697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:13.536149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:13.544926 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b9829ae0-c2db-4210-b1f7-cf72a8cb4f82 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1321 microversion: 2.1 time: 0.174974 Jul 02 21:43:13.545501 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2867/5764] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:13 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:14.562256 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:14.562875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:14.570298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:14.570743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:14.571507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:14.571948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:14.718428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:14.726117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b1cadbe4-2099-4a3e-8273-6bf64679c449 req-e6420e6f-1d75-4bc9-8dae-38586e93726d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f58490e-f121-485c-bc28-023f6dc3ebd5", "name": "network-vif-plugged", "status": "completed", "tag": "1c5bbe6b-47da-4042-aced-abf30234ea98"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:14.727265 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0695729-a519-441b-abc7-c6115e584749 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1321 microversion: 2.1 time: 0.168969 Jul 02 21:43:14.727854 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2898/5765] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:14 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:14.735178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b1cadbe4-2099-4a3e-8273-6bf64679c449 req-e6420e6f-1d75-4bc9-8dae-38586e93726d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:14.735624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b1cadbe4-2099-4a3e-8273-6bf64679c449 req-e6420e6f-1d75-4bc9-8dae-38586e93726d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:14.746782 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b1cadbe4-2099-4a3e-8273-6bf64679c449 req-e6420e6f-1d75-4bc9-8dae-38586e93726d service nova] Creating event network-vif-plugged:1c5bbe6b-47da-4042-aced-abf30234ea98 for instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 on nch2-master-1 Jul 02 21:43:14.752014 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b1cadbe4-2099-4a3e-8273-6bf64679c449 req-e6420e6f-1d75-4bc9-8dae-38586e93726d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104372 Jul 02 21:43:14.752716 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2868/5766] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:15.748291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:15.749322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:15.752375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:15.760076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:15.760569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:15.761347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:15.761787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:15.905917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:15.913856 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de5fc6b2-09f8-479b-a67f-6186a725cbc4 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1321 microversion: 2.1 time: 0.172171 Jul 02 21:43:15.914432 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2899/5767] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:15 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:16.932076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:16.933208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:16.936359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=10 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:16.943709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:16.944241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:16.945020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:16.945489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.083188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:17.091545 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ed713854-73bf-4eb9-a52c-58aa17339195 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1470 microversion: 2.1 time: 0.164476 Jul 02 21:43:17.097234 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2869/5768] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:16 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:17.176966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77acb36a-121d-4461-a0a8-e10abbecd9f0 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Calling method '.version_select at 0x7fabd775f430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.252328 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77acb36a-121d-4461-a0a8-e10abbecd9f0 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5b2d9b803e34402e94d8ef6d847357b5" status: 200 len: 371 microversion: 2.1 time: 0.145891 Jul 02 21:43:17.253270 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2900/5769] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:43:17 2022] GET /compute/v2.1/os-quota-sets/5b2d9b803e34402e94d8ef6d847357b5 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:17.263954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-903ad077-b18b-4b85-8c77-19bca069041a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1685197756", "id": 206990780, "os-flavor-access:is_public": "True"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:17.265761 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:43:17.265761 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:43:17.282189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-903ad077-b18b-4b85-8c77-19bca069041a tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.022466 Jul 02 21:43:17.282767 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2870/5770] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:43:17 2022] POST /compute/v2.1/flavors => generated 435 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:17.294146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "206990780"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:17.295226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:17.302266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.302710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.303460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.303889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.465200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ec917e25e6d440248410efacbaf8b6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2d9b803e34402e94d8ef6d847357b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:17.475201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1685197756 {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:43:17.482459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.482909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.483705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.484172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.505476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Getting quotas for project 237fdb950d1d477fadba51149c76c201. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:43:17.510851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Getting quotas for user df426b59e996478083e92098ec70b244 and project 237fdb950d1d477fadba51149c76c201. Resources: {'ram', 'cores'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:43:17.523955 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] ram quota exceeded for 5b2d9b803e34402e94d8ef6d847357b5, tried to resize instance. Jul 02 21:43:17.524527 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Request method failure captured: Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5/action HTTP/1.1 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 38 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLvmH_RdNPa3wRMeHhTSmbbjLOvCaHmbHAlaFG1zL6xseJ5BxRvm_UR7TxSurBpHMl6mfYyshX15EBJC-QDlTStwVrlsZzbrjnxQAnsulppHVPOqDuMPUp3hOEcI94gUijeOpUocPgkEe06wnlKImkVKU5SAoBBqNO3AwJjbnX6QIdg Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 5b2d9b803e34402e94d8ef6d847357b5 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1331591714 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Role: admin,member,reader Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: admin,member,reader Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b2d9b803e34402e94d8ef6d847357b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5b2d9b803e34402e94d8ef6d847357b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b2d9b803e34402e94d8ef6d847357b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5b2d9b803e34402e94d8ef6d847357b5"}]}] Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1331591714 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 5b2d9b803e34402e94d8ef6d847357b5 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1331591714 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersAdminNegativeTestJSON-1331591714-project-admin Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: ec917e25e6d440248410efacbaf8b6d8 Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1331591714-project-admin Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: {"resize": {"flavorRef": "206990780"}} Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '8f58490e-f121-485c-bc28-023f6dc3ebd5', 'body': {'resize': {'flavorRef': '206990780'}}} Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:43:17.526572 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8197d3d8-5559-4969-9ae9-de1c826a9494 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5/action" status: 403 len: 118 microversion: 2.1 time: 0.238202 Jul 02 21:43:17.534048 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2901/5771] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:43:17 2022] POST /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5/action => generated 118 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:43:17.537142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d0c245e9-0e15-45f1-b6c5-ff19f6ec1a3b tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.537983 ncdv-master-1 devstack@n-api.service[131045]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:43:17.537983 ncdv-master-1 devstack@n-api.service[131045]: warnings.warn(msg) Jul 02 21:43:17.557516 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d0c245e9-0e15-45f1-b6c5-ff19f6ec1a3b tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/206990780" status: 202 len: 0 microversion: 2.1 time: 0.024126 Jul 02 21:43:17.558200 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2871/5772] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:43:17 2022] DELETE /compute/v2.1/flavors/206990780 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:43:17.566284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6f1466d8-7431-4d02-ac6c-25526493435d tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.585625 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6f1466d8-7431-4d02-ac6c-25526493435d tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022992 Jul 02 21:43:17.586174 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2902/5773] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:43:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:17.602952 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26db7003-9dbc-4bc6-a684-5c5fc3355363 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Calling method '.version_select at 0x7fabd74c18b0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.675680 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26db7003-9dbc-4bc6-a684-5c5fc3355363 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "GET /compute/v2.1/os-quota-sets/5b2d9b803e34402e94d8ef6d847357b5" status: 200 len: 371 microversion: 2.1 time: 0.076311 Jul 02 21:43:17.676242 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2872/5774] 10.222.0.43 () {58 vars in 1241 bytes} [Sat Jul 2 21:43:17 2022] GET /compute/v2.1/os-quota-sets/5b2d9b803e34402e94d8ef6d847357b5 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:17.686621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de9b01ac-0669-430d-a115-d4d10f48972c tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1779926154", "id": 993358837, "os-flavor-access:is_public": "True"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:17.688308 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:43:17.688308 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:43:17.705140 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de9b01ac-0669-430d-a115-d4d10f48972c tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022347 Jul 02 21:43:17.705717 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2903/5775] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:43:17 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:17.716982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "993358837"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:17.718150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:17.724665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.725120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.725884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.726317 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.815276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ec917e25e6d440248410efacbaf8b6d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b2d9b803e34402e94d8ef6d847357b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:17.821859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1779926154 {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:43:17.828556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.829290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.830086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.830523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.851025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Getting quotas for project 237fdb950d1d477fadba51149c76c201. Resources: {'ram', 'cores'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:43:17.856229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Getting quotas for user df426b59e996478083e92098ec70b244 and project 237fdb950d1d477fadba51149c76c201. Resources: {'ram', 'cores'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:43:17.868218 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.compute.api [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] cores quota exceeded for 5b2d9b803e34402e94d8ef6d847357b5, tried to resize instance. Jul 02 21:43:17.868757 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Request method failure captured: Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5/action HTTP/1.1 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 38 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLvmH_RdNPa3wRMeHhTSmbbjLOvCaHmbHAlaFG1zL6xseJ5BxRvm_UR7TxSurBpHMl6mfYyshX15EBJC-QDlTStwVrlsZzbrjnxQAnsulppHVPOqDuMPUp3hOEcI94gUijeOpUocPgkEe06wnlKImkVKU5SAoBBqNO3AwJjbnX6QIdg Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 5b2d9b803e34402e94d8ef6d847357b5 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1331591714 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Role: admin,member,reader Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: admin,member,reader Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b2d9b803e34402e94d8ef6d847357b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5b2d9b803e34402e94d8ef6d847357b5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5b2d9b803e34402e94d8ef6d847357b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5b2d9b803e34402e94d8ef6d847357b5"}]}] Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1331591714 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 5b2d9b803e34402e94d8ef6d847357b5 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1331591714 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdminNegativeTestJSON-1331591714-project-admin Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: ec917e25e6d440248410efacbaf8b6d8 Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1331591714-project-admin Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: {"resize": {"flavorRef": "993358837"}} Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8f58490e-f121-485c-bc28-023f6dc3ebd5', 'body': {'resize': {'flavorRef': '993358837'}}} Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:43:17.870840 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9d35cee7-f752-45f7-851d-78d50cdfec5e tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "POST /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5/action" status: 403 len: 113 microversion: 2.1 time: 0.159575 Jul 02 21:43:17.879387 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2873/5776] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:43:17 2022] POST /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5/action => generated 113 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:43:17.882704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438d2518-5657-4356-9421-9da4d9011241 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.883460 ncdv-master-1 devstack@n-api.service[131044]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 21:43:17.883460 ncdv-master-1 devstack@n-api.service[131044]: warnings.warn(msg) Jul 02 21:43:17.901672 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-438d2518-5657-4356-9421-9da4d9011241 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "DELETE /compute/v2.1/flavors/993358837" status: 202 len: 0 microversion: 2.1 time: 0.022809 Jul 02 21:43:17.902402 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2904/5777] 10.222.0.43 () {58 vars in 1157 bytes} [Sat Jul 2 21:43:17 2022] DELETE /compute/v2.1/flavors/993358837 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:43:17.911738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-328ea471-96e7-4dce-a3d6-dbb7cac57208 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.933355 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-328ea471-96e7-4dce-a3d6-dbb7cac57208 tempest-ServersAdminNegativeTestJSON-1331591714 tempest-ServersAdminNegativeTestJSON-1331591714-project-admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025860 Jul 02 21:43:17.933956 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2874/5778] 10.222.0.43 () {58 vars in 1145 bytes} [Sat Jul 2 21:43:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:17.954610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:17.955178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:17.961859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.962317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.963128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:17.963570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:17.992381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:43:18.073246 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-067d5f68-514a-4c60-b9e5-0c92a57a8540 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 204 len: 0 microversion: 2.1 time: 0.122507 Jul 02 21:43:18.073849 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2905/5779] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:43:17 2022] DELETE /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:43:18.082876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:18.083496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:18.091074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:18.091533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:18.092346 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:18.092790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:18.221480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:18.230126 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-70c4f6fa-9218-4202-ba01-52e84f849855 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1476 microversion: 2.1 time: 0.151064 Jul 02 21:43:18.230291 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2875/5780] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:18 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:19.253765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:19.254695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:19.264618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:19.265207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:19.266243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:19.266822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:19.411767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:19.419878 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4d955e3-9d2d-464c-8ee4-9fd82aa7e255 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1476 microversion: 2.1 time: 0.171856 Jul 02 21:43:19.420465 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2906/5781] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:19 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1476 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:19.973626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e98a6122-f78f-4116-9367-8abe6e590806 req-96188f18-570a-4c94-80e4-be61bea4f546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f58490e-f121-485c-bc28-023f6dc3ebd5", "name": "network-vif-deleted", "tag": "1c5bbe6b-47da-4042-aced-abf30234ea98"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:19.984203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e98a6122-f78f-4116-9367-8abe6e590806 req-96188f18-570a-4c94-80e4-be61bea4f546 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:19.984706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e98a6122-f78f-4116-9367-8abe6e590806 req-96188f18-570a-4c94-80e4-be61bea4f546 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:19.997486 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e98a6122-f78f-4116-9367-8abe6e590806 req-96188f18-570a-4c94-80e4-be61bea4f546 service nova] Creating event network-vif-deleted:1c5bbe6b-47da-4042-aced-abf30234ea98 for instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 on nch2-master-1 Jul 02 21:43:20.003989 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e98a6122-f78f-4116-9367-8abe6e590806 req-96188f18-570a-4c94-80e4-be61bea4f546 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034110 Jul 02 21:43:20.005134 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2876/5782] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:20.436918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:20.437541 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:20.445175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:20.445659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:20.446448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:20.446915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:20.479670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:20.480157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:20.480650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lazy-loading 'fault' on Instance uuid 8f58490e-f121-485c-bc28-023f6dc3ebd5 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:43:20.525022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df426b59e996478083e92098ec70b244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '237fdb950d1d477fadba51149c76c201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:20.533303 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-be9903bc-821d-43d9-be0c-844e01496e80 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 200 len: 1311 microversion: 2.1 time: 0.100453 Jul 02 21:43:20.535888 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2907/5783] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:20 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:21.558165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:21.558882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] [instance: 8f58490e-f121-485c-bc28-023f6dc3ebd5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:21.565889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:21.566347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:21.567127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:21.567568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:21.589356 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] HTTP exception thrown: Instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 could not be found. Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Request method failure captured: Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 HTTP/1.1 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLvlxdhH1AIcXql-R57o5gOalYAdsP-oEPH2AWCMvh6z5pDyXQQkegOaCOJZ_kcwVl6SnCA5duJ04vKqHHbXl4VFxoIu4USOJ6LsRO5uCjgX6dODgUUpAY4dM4u6S-rlGmLXDSvihC4k2HXlY7etNNXVDmZCZtl8B2eqRHpMlWRdswM Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 237fdb950d1d477fadba51149c76c201 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-490637913 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/237fdb950d1d477fadba51149c76c201"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_237fdb950d1d477fadba51149c76c201", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/237fdb950d1d477fadba51149c76c201"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/237fdb950d1d477fadba51149c76c201"}]}] Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersAdminNegativeTestJSON-490637913 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 237fdb950d1d477fadba51149c76c201 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-490637913 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersAdminNegativeTestJSON-490637913-project Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: df426b59e996478083e92098ec70b244 Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersAdminNegativeTestJSON-490637913-project Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 could not be found. Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '8f58490e-f121-485c-bc28-023f6dc3ebd5'} Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 could not be found. Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 could not be found. Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:43:21.591015 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 could not be found. Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] Returning 404 to user: Instance 8f58490e-f121-485c-bc28-023f6dc3ebd5 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8e1a1b9b-a3ce-4729-8470-b59561dc0d40 tempest-ServersAdminNegativeTestJSON-490637913 tempest-ServersAdminNegativeTestJSON-490637913-project] 10.222.0.43 "GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5" status: 404 len: 111 microversion: 2.1 time: 0.040621 Jul 02 21:43:21.594550 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2877/5784] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:21 2022] GET /compute/v2.1/servers/8f58490e-f121-485c-bc28-023f6dc3ebd5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:43:27.972163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:27.977604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:28.116465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1323946452", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "a092a851-b8c9-4757-b693-108ed93fc721"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:28.169785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] validate_networks() for [('a092a851-b8c9-4757-b693-108ed93fc721', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:43:28.586384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:43:28.586814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:43:28.587299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:43:28.587718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:43:28.588201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:43:28.598833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:28.599288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:28.600118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:28.600565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:28.619531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Getting quotas for project 61edc6aa7303432cbe3b5bdc5bc64584. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:43:28.625512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Getting quotas for user 3034eabff02e4bb99a9a1b73fddc51f9 and project 61edc6aa7303432cbe3b5bdc5bc64584. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:43:28.638576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:43:28.640948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:43:28.688783 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eee1b34b-3335-4e1e-a980-9437e97201cb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724919 Jul 02 21:43:28.689834 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2908/5785] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:43:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:43:28.699776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27b988ef-ac7b-445e-8003-c511b3ec4a40 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:28.700657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27b988ef-ac7b-445e-8003-c511b3ec4a40 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:28.704951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:28.706242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:28.770908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27b988ef-ac7b-445e-8003-c511b3ec4a40 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:28.779075 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27b988ef-ac7b-445e-8003-c511b3ec4a40 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1215 microversion: 2.1 time: 0.083330 Jul 02 21:43:28.779990 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2878/5786] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:28 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:43:29.799551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:29.808619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:29.822017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:29.822771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:29.824181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:29.824907 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:29.922469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:29.931467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1020ecf-d584-4302-ab63-7eee6aca1ca0 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1285 microversion: 2.1 time: 0.139465 Jul 02 21:43:29.932009 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2909/5787] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:29 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:30.949151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:30.950395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:30.966285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:30.967491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:30.971112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:30.973167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:31.250513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:31.267816 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d89d4414-43dc-41a7-9b86-5810bc389e6f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1315 microversion: 2.1 time: 0.322093 Jul 02 21:43:31.269160 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2879/5788] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:30 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:31.331031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-7a4b2780-2bce-4ef5-8c43-47b036dccbd6 req-1e2772d4-b257-49aa-8d43-929ed6d6e0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d", "tag": "39f9d764-d68a-454e-bceb-13f0b8e8adb7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:31.354490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7a4b2780-2bce-4ef5-8c43-47b036dccbd6 req-1e2772d4-b257-49aa-8d43-929ed6d6e0fe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:31.354881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-7a4b2780-2bce-4ef5-8c43-47b036dccbd6 req-1e2772d4-b257-49aa-8d43-929ed6d6e0fe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:31.379563 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-7a4b2780-2bce-4ef5-8c43-47b036dccbd6 req-1e2772d4-b257-49aa-8d43-929ed6d6e0fe service nova] Creating event network-changed:39f9d764-d68a-454e-bceb-13f0b8e8adb7 for instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d on nch2-master-1 Jul 02 21:43:31.385423 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-7a4b2780-2bce-4ef5-8c43-47b036dccbd6 req-1e2772d4-b257-49aa-8d43-929ed6d6e0fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058151 Jul 02 21:43:31.387179 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2910/5789] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:32.292018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:32.292637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:32.300309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:32.300800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:32.301610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:32.302056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:32.446646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:32.448945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=64 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:32.455951 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7b70aa08-407d-4a64-b937-a508444b55b1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1315 microversion: 2.1 time: 0.169593 Jul 02 21:43:32.456577 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2880/5790] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:32 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:33.478319 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:33.479476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:33.483936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:33.493030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:33.493482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:33.494269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:33.494705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:33.498261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:33.647430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:33.658180 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1d79964-720f-434a-8cb8-fcfc23cecbf1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1315 microversion: 2.1 time: 0.186831 Jul 02 21:43:33.658959 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2911/5791] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:33 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:34.675794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:34.676719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:34.679526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:34.684729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:34.685319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:34.686259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:34.686876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:34.828240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:34.837213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2e89bbf9-e9d1-46e7-a008-8f43e8a10674 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1315 microversion: 2.1 time: 0.165561 Jul 02 21:43:34.837730 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2881/5792] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:34 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:35.859982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:35.861025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:35.873454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:35.874404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:35.875706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:35.876488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:36.016109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:36.023781 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1528c81-6c81-4634-98c3-3bdbb36e742a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1315 microversion: 2.1 time: 0.172020 Jul 02 21:43:36.024371 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2912/5793] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:35 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:36.782343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2a54d99b-a2d3-42e0-a936-1d3bea1bde3c req-95959d0f-3748-4a80-a19e-f05fb91fb683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d", "name": "network-vif-plugged", "status": "completed", "tag": "39f9d764-d68a-454e-bceb-13f0b8e8adb7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:36.792094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2a54d99b-a2d3-42e0-a936-1d3bea1bde3c req-95959d0f-3748-4a80-a19e-f05fb91fb683 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:36.792563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2a54d99b-a2d3-42e0-a936-1d3bea1bde3c req-95959d0f-3748-4a80-a19e-f05fb91fb683 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:36.804461 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2a54d99b-a2d3-42e0-a936-1d3bea1bde3c req-95959d0f-3748-4a80-a19e-f05fb91fb683 service nova] Creating event network-vif-plugged:39f9d764-d68a-454e-bceb-13f0b8e8adb7 for instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d on nch2-master-1 Jul 02 21:43:36.809599 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2a54d99b-a2d3-42e0-a936-1d3bea1bde3c req-95959d0f-3748-4a80-a19e-f05fb91fb683 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031032 Jul 02 21:43:36.810217 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2882/5794] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:43:37.044874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:37.045758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:37.061496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:37.061947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:37.062896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:37.063463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:37.203471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:37.214094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64b0c70b-337d-43f3-be24-7adc17d640b2 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1315 microversion: 2.1 time: 0.176240 Jul 02 21:43:37.214649 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2913/5795] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:37 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:38.238197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:38.238848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:38.245810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:38.246252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:38.247010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:38.247462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:38.381353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:38.389507 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9034437c-4c30-4f71-b998-0be83eecb19a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1503 microversion: 2.1 time: 0.156589 Jul 02 21:43:38.390272 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2883/5796] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:38 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:43:38.418096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:43:38.419433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:38.426879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:38.427333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:38.428111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:38.428588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:38.501553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:38.507494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Old instance type m1.heat2, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:43:38.514112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:43:38.514526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:43:38.515000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:43:38.515395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:43:38.515801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:43:38.611537 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:38.628223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d6a46b43-7393-496b-8b11-f7a7066f4c65 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "POST /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d/action" status: 202 len: 0 microversion: 2.1 time: 0.214275 Jul 02 21:43:38.628848 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2914/5797] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:43:38 2022] POST /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:43:38.637406 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:38.638027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:38.644908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:38.645367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:38.646172 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:38.646610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:38.780970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:38.783441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:38.790817 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-25295169-5d61-463d-9105-3b63507db5c6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1512 microversion: 2.1 time: 0.157384 Jul 02 21:43:38.791419 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2884/5798] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:38 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:43:39.809777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:39.810315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:39.812302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:43:39.819983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:39.820540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:39.821318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:39.821751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:39.965609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:39.979674 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c80a7bb5-2041-47e7-80b2-1339f838714c tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1512 microversion: 2.1 time: 0.173320 Jul 02 21:43:39.981642 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2915/5799] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:39 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:41.000704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:41.001935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:41.011956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:41.012451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:41.013387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:41.014192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:41.149974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:41.158056 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8781fc25-333a-406f-8765-ad5cb50b8800 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.162507 Jul 02 21:43:41.158641 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2885/5800] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:40 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:42.178069 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:42.178811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:42.187118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:42.187572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:42.188399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:42.188836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:42.324370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:42.332673 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a4245297-2b23-428e-b462-16be9d055ef5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.159910 Jul 02 21:43:42.333258 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2916/5801] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:42 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:43.353363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:43.353955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:43.361819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:43.362292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:43.363094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:43.363554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:43.511999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:43.523902 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a6fe1456-1c29-4074-ac41-1a0ad7253f0b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.176109 Jul 02 21:43:43.524797 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2886/5802] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:43 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:44.549473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:44.550284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:44.559238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:44.559689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:44.560499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:44.560952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:44.695235 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:44.703060 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-477f28f8-a962-4b0e-8069-cf56229034b5 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.158931 Jul 02 21:43:44.703639 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2917/5803] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:44 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:45.722121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:45.722640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:45.729864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:45.730325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:45.731101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:45.731543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:45.881368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:45.889334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8e3e338-a4e6-4ace-8dfa-65d9da10d176 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.172173 Jul 02 21:43:45.889910 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2887/5804] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:45 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:46.909356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:46.909972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:46.916911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:46.917367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:46.918570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:46.919012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:47.061635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:47.071991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6641e297-a0c0-451f-a467-0d759dd4de5e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.168306 Jul 02 21:43:47.072708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2918/5805] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:46 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:48.093142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:48.094197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:48.104777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:48.105219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:48.105999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:48.106477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:48.251190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:48.263572 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4b61f82c-f742-4c81-aac3-ef73075258ab tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.176746 Jul 02 21:43:48.264498 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2888/5806] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:48 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:49.285800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:49.286457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:49.296167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:49.296743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:49.297721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:49.298322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:49.431182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:49.439026 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a454d77d-6dc0-483e-af78-b3ace68793ca tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.158275 Jul 02 21:43:49.439603 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2919/5807] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:49 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:50.460556 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:50.461596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:50.469743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:50.470206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:50.470986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:50.471439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:50.610064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:50.618170 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5d90c97b-3de5-4bd4-b1eb-799cbf32e088 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.164261 Jul 02 21:43:50.618760 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2889/5808] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:50 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:51.639146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:51.640261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:51.652245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:51.652997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:51.654264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:51.654989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:51.802563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:51.810668 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d3d7c81-423a-4c70-816e-b9eec06cd895 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.178195 Jul 02 21:43:51.811247 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2920/5809] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:51 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:52.830350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:52.830944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:52.841480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:52.841942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:52.842719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:52.843135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:52.975424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:52.983738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-475bcf84-c50b-448f-bf50-69866f0e2ad6 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.159871 Jul 02 21:43:52.984362 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2890/5810] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:52 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:54.002560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:54.003315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:54.012328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:54.012790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:54.013566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:54.014005 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:54.157285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:54.165519 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-957dd92e-9bf9-44e6-90b6-6734dfce9b13 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.167842 Jul 02 21:43:54.166105 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2921/5811] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:53 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:55.191119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:55.192214 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:55.202502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:55.202953 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:55.203703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:55.204199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:55.338573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:55.346877 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-da61296d-5164-4263-a620-34a7332e1532 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.162539 Jul 02 21:43:55.347382 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2891/5812] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:55 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:56.364999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:56.365596 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:56.373864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:56.374314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:56.375071 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:56.375504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:56.521896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:56.530344 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64bf78b2-df22-4a1e-82d1-009fd9915823 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.169793 Jul 02 21:43:56.530914 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2922/5813] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:56 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:57.551095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:57.551956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:57.563158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:57.563769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:57.565015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:57.565673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:57.710433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:57.718284 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-700438d6-6df3-4cd5-a3f0-e90419cd8fa4 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.173514 Jul 02 21:43:57.718858 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2892/5814] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:57 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:58.739652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:58.740758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:58.752358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:58.752844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:58.753620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:58.754062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:58.895897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:43:58.907828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a0d595b-17ff-4d9b-8139-49da4af350f8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.174655 Jul 02 21:43:58.908514 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2923/5815] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:58 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:43:59.934327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:43:59.935353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:43:59.947572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:59.948413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:43:59.949707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:43:59.950444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:00.100795 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:00.108878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-12abdbba-8dec-4c98-a73b-db8a226f2ceb tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.181173 Jul 02 21:44:00.109548 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2893/5816] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:43:59 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:01.126883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:01.127494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:01.135504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:01.135956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:01.136913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:01.137346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:01.270580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:01.278585 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e9ebbfe-272e-4229-a72c-f8935e86b415 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.155651 Jul 02 21:44:01.279172 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2924/5817] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:01 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:02.298548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:02.299237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:02.308501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:02.309067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:02.310033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:02.310585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:02.447506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:02.459191 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-66d299c0-32e4-466d-9996-f43b81eb1e28 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.165973 Jul 02 21:44:02.460115 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2894/5818] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:02 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:03.483339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:03.484395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:03.492291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:03.492737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:03.493500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:03.493925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:03.631410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:03.633723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:03.640351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0409e2b-1600-4ee5-931a-1c81195d9c09 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.163411 Jul 02 21:44:03.640894 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2925/5819] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:03 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:04.662372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:04.663458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:04.675661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:04.676448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:04.677717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:04.678436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:04.686897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=82 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:04.816940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:04.824698 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5bcd0c3b-9669-4e31-b92c-697e2dabf465 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.169177 Jul 02 21:44:04.825304 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2895/5820] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:04 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:05.846526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:05.847509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:05.852622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:05.862236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:05.862697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:05.863471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:05.863913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:05.999894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:06.008355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47b903b0-2365-4fa5-a3db-4daa67702ad1 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.168389 Jul 02 21:44:06.008983 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2926/5821] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:05 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:07.029977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:07.030961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:07.034449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=30 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:07.040641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:07.041143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:07.042004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:07.042474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:07.181807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:07.189853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e625654-0e91-40ea-9a05-f076337a904e tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.166538 Jul 02 21:44:07.190471 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2896/5822] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:07 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:08.210830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:08.211898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:08.222430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:08.222886 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:08.223663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:08.224128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:08.631945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:08.643205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1142815-efae-4dfd-937e-1d43936e614b tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.439098 Jul 02 21:44:08.643784 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2927/5823] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:08 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:09.664722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:09.665757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:09.676650 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:09.677108 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:09.677885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:09.678333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:09.813480 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:09.821675 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-07ccdad7-ca23-4baa-98e7-0118e1cba327 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.163671 Jul 02 21:44:09.822232 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2897/5824] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:09 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:10.791828 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:44:10.792451 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:44:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:44:10.841629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:10.842539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:10.852984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:10.853609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:10.854756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:10.855390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:10.995057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:11.002949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bfab801c-a1d3-4b3e-a4b8-e9cbbb8a40bd tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.166857 Jul 02 21:44:11.003526 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2928/5825] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:10 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:12.020419 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:12.021037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:12.028655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:12.029145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:12.029920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:12.030359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:12.164563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:12.176794 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-65aeb765-119c-4101-8080-1624782e75c8 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1517 microversion: 2.1 time: 0.160015 Jul 02 21:44:12.177525 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2898/5826] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:12 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:13.197798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:13.198634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:13.205766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:13.206212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:13.206989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:13.207418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:13.437671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:13.445983 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-13ab30f7-b0fd-45be-9f8a-809ab827c825 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1516 microversion: 2.1 time: 0.252155 Jul 02 21:44:13.456864 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2929/5827] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:13 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:13.880825 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-1aa0858c-2c33-4295-a2e5-7146cffa0a1a req-f4e0b21e-be0b-43e5-94f1-018947699ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d", "name": "network-vif-unplugged", "status": "completed", "tag": "39f9d764-d68a-454e-bceb-13f0b8e8adb7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:13.890400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1aa0858c-2c33-4295-a2e5-7146cffa0a1a req-f4e0b21e-be0b-43e5-94f1-018947699ff7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:13.890856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-1aa0858c-2c33-4295-a2e5-7146cffa0a1a req-f4e0b21e-be0b-43e5-94f1-018947699ff7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:13.909207 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-1aa0858c-2c33-4295-a2e5-7146cffa0a1a req-f4e0b21e-be0b-43e5-94f1-018947699ff7 service nova] Creating event network-vif-unplugged:39f9d764-d68a-454e-bceb-13f0b8e8adb7 for instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d on nch1-master-1 Jul 02 21:44:13.919753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-1aa0858c-2c33-4295-a2e5-7146cffa0a1a req-f4e0b21e-be0b-43e5-94f1-018947699ff7 service nova] Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:44:13.936429 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-1aa0858c-2c33-4295-a2e5-7146cffa0a1a req-f4e0b21e-be0b-43e5-94f1-018947699ff7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131846 Jul 02 21:44:13.937871 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2899/5828] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:44:14.464702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:14.465273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:14.473128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:14.473585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:14.474337 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:14.474770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:14.985971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:14.993897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b308a61a-2f51-4e24-b888-710d22cc4c1a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1516 microversion: 2.1 time: 0.533160 Jul 02 21:44:14.994462 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2930/5829] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:14 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1516 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:15.961326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b73b40c5-e68c-4eda-a6ca-5f23fdcecfda req-42fe1c62-77b5-4dea-9f0e-728b3a6433ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d", "tag": "39f9d764-d68a-454e-bceb-13f0b8e8adb7"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:15.973229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b73b40c5-e68c-4eda-a6ca-5f23fdcecfda req-42fe1c62-77b5-4dea-9f0e-728b3a6433ef service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:15.973700 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b73b40c5-e68c-4eda-a6ca-5f23fdcecfda req-42fe1c62-77b5-4dea-9f0e-728b3a6433ef service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:15.988649 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b73b40c5-e68c-4eda-a6ca-5f23fdcecfda req-42fe1c62-77b5-4dea-9f0e-728b3a6433ef service nova] Creating event network-changed:39f9d764-d68a-454e-bceb-13f0b8e8adb7 for instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d on nch1-master-1 Jul 02 21:44:15.994421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-b73b40c5-e68c-4eda-a6ca-5f23fdcecfda req-42fe1c62-77b5-4dea-9f0e-728b3a6433ef service nova] Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:44:16.005832 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b73b40c5-e68c-4eda-a6ca-5f23fdcecfda req-42fe1c62-77b5-4dea-9f0e-728b3a6433ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051095 Jul 02 21:44:16.006575 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2900/5830] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:44:16.011108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:16.011734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:16.018450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:16.018938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:16.019716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:16.020183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:16.154830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:16.163137 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ea714664-2c8d-4867-b6bd-48e1b853f842 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1514 microversion: 2.1 time: 0.155916 Jul 02 21:44:16.163744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2931/5831] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:16 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:17.182342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:17.183054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:17.189974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:17.190436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:17.191223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:17.191667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:17.337479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:17.345481 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e99b5545-c6f7-4de6-817a-4601eb270817 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1514 microversion: 2.1 time: 0.168369 Jul 02 21:44:17.346053 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2901/5832] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:17 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:18.362322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:18.362970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:18.370300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:18.370872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:18.371667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:18.372150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:18.513289 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:18.521721 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-531deb83-f7cf-4ee2-9f0d-5dfb8db7bc27 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1511 microversion: 2.1 time: 0.163496 Jul 02 21:44:18.522973 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2932/5833] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:18 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:18.538462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:18.538958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:18.546448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:18.546894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:18.547648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:18.548593 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:18.575378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:44:18.628335 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.compute.api [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Found an unconfirmed migration during delete, id: 16, status: finished Jul 02 21:44:20.465673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b93f272a-1edf-4123-a0ed-a94faef72ab1 req-3acafc21-572a-49e7-a1cf-3bc41672d24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d", "name": "network-vif-plugged", "status": "completed", "tag": "39f9d764-d68a-454e-bceb-13f0b8e8adb7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:20.475798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b93f272a-1edf-4123-a0ed-a94faef72ab1 req-3acafc21-572a-49e7-a1cf-3bc41672d24c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:20.476334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b93f272a-1edf-4123-a0ed-a94faef72ab1 req-3acafc21-572a-49e7-a1cf-3bc41672d24c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:20.488108 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b93f272a-1edf-4123-a0ed-a94faef72ab1 req-3acafc21-572a-49e7-a1cf-3bc41672d24c service nova] Creating event network-vif-plugged:39f9d764-d68a-454e-bceb-13f0b8e8adb7 for instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d on nch1-master-1 Jul 02 21:44:20.493566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-b93f272a-1edf-4123-a0ed-a94faef72ab1 req-3acafc21-572a-49e7-a1cf-3bc41672d24c service nova] Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:44:20.504333 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b93f272a-1edf-4123-a0ed-a94faef72ab1 req-3acafc21-572a-49e7-a1cf-3bc41672d24c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042367 Jul 02 21:44:20.505183 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2933/5834] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:44:20.963138 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-16a2d885-9601-49a7-b73d-504abc340b41 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 204 len: 0 microversion: 2.1 time: 2.428399 Jul 02 21:44:20.964126 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2902/5835] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:44:18 2022] DELETE /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 0 bytes in 2430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:44:20.973361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:20.973992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:20.980343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:20.980776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:20.981536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:20.981964 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:21.120926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:21.128795 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a34c28d2-10dd-4640-a095-7e3f13c3cc0f tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1503 microversion: 2.1 time: 0.159925 Jul 02 21:44:21.129367 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2934/5836] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:20 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:22.147983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:22.149042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:22.159365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:22.160014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:22.161168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:22.161762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:22.298826 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3034eabff02e4bb99a9a1b73fddc51f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61edc6aa7303432cbe3b5bdc5bc64584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:22.306707 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e05e28cf-fafb-40cd-973b-998634248dcf tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 200 len: 1503 microversion: 2.1 time: 0.164957 Jul 02 21:44:22.307288 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2903/5837] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:22 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:22.986271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-75da4a2f-c88f-4443-98c7-19d6ad189597 req-008049d1-0e70-48d6-8337-8cfc24424642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d", "name": "network-vif-deleted", "tag": "39f9d764-d68a-454e-bceb-13f0b8e8adb7"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:22.996455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75da4a2f-c88f-4443-98c7-19d6ad189597 req-008049d1-0e70-48d6-8337-8cfc24424642 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:22.996911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75da4a2f-c88f-4443-98c7-19d6ad189597 req-008049d1-0e70-48d6-8337-8cfc24424642 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.009205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-75da4a2f-c88f-4443-98c7-19d6ad189597 req-008049d1-0e70-48d6-8337-8cfc24424642 service nova] Creating event network-vif-deleted:39f9d764-d68a-454e-bceb-13f0b8e8adb7 for instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d on nch1-master-1 Jul 02 21:44:23.018166 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-75da4a2f-c88f-4443-98c7-19d6ad189597 req-008049d1-0e70-48d6-8337-8cfc24424642 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035525 Jul 02 21:44:23.018790 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2935/5838] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:44:23.324287 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:23.324841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:23.333083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:23.333572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.334362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:23.334805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.348939 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] HTTP exception thrown: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Request method failure captured: Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d HTTP/1.1 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLv_yoOw-_SkjfjuInanMqIVBk0GYJd0ncl-THWkolusug3j5JffCDz_y8JQqsUVq-AkfSxNPAZ92hkOvazEvaFsZOQeyVgCyXlfC--_9q_2FqZ8G4uF2rmYhiBz5rKeB0FxD9Ga1tXp7QVeEwOauE54S798-0PohgiCCDe7jnxS3Vk Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 61edc6aa7303432cbe3b5bdc5bc64584 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61edc6aa7303432cbe3b5bdc5bc64584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61edc6aa7303432cbe3b5bdc5bc64584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61edc6aa7303432cbe3b5bdc5bc64584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61edc6aa7303432cbe3b5bdc5bc64584"}]}] Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 61edc6aa7303432cbe3b5bdc5bc64584 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-747229333-project Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3034eabff02e4bb99a9a1b73fddc51f9 Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-747229333-project Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d'} Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:44:23.350594 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Returning 404 to user: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f138eca1-3c7b-4ab6-ad97-e9e9b617ff75 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 404 len: 111 microversion: 2.1 time: 0.031852 Jul 02 21:44:23.354634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2904/5839] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:23 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:44:23.368525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:23.369123 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:23.375843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:23.376349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.377218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:23.377848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.392205 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] HTTP exception thrown: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Request method failure captured: Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d HTTP/1.1 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLv_yoOw-_SkjfjuInanMqIVBk0GYJd0ncl-THWkolusug3j5JffCDz_y8JQqsUVq-AkfSxNPAZ92hkOvazEvaFsZOQeyVgCyXlfC--_9q_2FqZ8G4uF2rmYhiBz5rKeB0FxD9Ga1tXp7QVeEwOauE54S798-0PohgiCCDe7jnxS3Vk Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 61edc6aa7303432cbe3b5bdc5bc64584 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61edc6aa7303432cbe3b5bdc5bc64584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61edc6aa7303432cbe3b5bdc5bc64584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61edc6aa7303432cbe3b5bdc5bc64584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61edc6aa7303432cbe3b5bdc5bc64584"}]}] Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 61edc6aa7303432cbe3b5bdc5bc64584 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-DeleteServersTestJSON-747229333-project Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 3034eabff02e4bb99a9a1b73fddc51f9 Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-DeleteServersTestJSON-747229333-project Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d'} Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:44:23.393911 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Returning 404 to user: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c0b59136-4a2f-4014-81ef-fb9973f6f379 tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 404 len: 111 microversion: 2.1 time: 0.031276 Jul 02 21:44:23.397158 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2936/5840] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:44:23 2022] DELETE /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:44:23.404154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:23.404805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] [instance: c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:23.411088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:23.411550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.412338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:23.412775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:23.427072 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] HTTP exception thrown: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Request method failure captured: Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d HTTP/1.1 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLv_yoOw-_SkjfjuInanMqIVBk0GYJd0ncl-THWkolusug3j5JffCDz_y8JQqsUVq-AkfSxNPAZ92hkOvazEvaFsZOQeyVgCyXlfC--_9q_2FqZ8G4uF2rmYhiBz5rKeB0FxD9Ga1tXp7QVeEwOauE54S798-0PohgiCCDe7jnxS3Vk Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 61edc6aa7303432cbe3b5bdc5bc64584 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61edc6aa7303432cbe3b5bdc5bc64584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_61edc6aa7303432cbe3b5bdc5bc64584", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/61edc6aa7303432cbe3b5bdc5bc64584"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/61edc6aa7303432cbe3b5bdc5bc64584"}]}] Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 61edc6aa7303432cbe3b5bdc5bc64584 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-DeleteServersTestJSON-747229333 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-DeleteServersTestJSON-747229333-project Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 3034eabff02e4bb99a9a1b73fddc51f9 Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-DeleteServersTestJSON-747229333-project Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d'} Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:44:23.428600 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] Returning 404 to user: Instance c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-79e9abe7-6658-4643-a15e-111dc469351a tempest-DeleteServersTestJSON-747229333 tempest-DeleteServersTestJSON-747229333-project] 10.222.0.43 "GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d" status: 404 len: 111 microversion: 2.1 time: 0.029876 Jul 02 21:44:23.432696 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2905/5841] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:23 2022] GET /compute/v2.1/servers/c4bf22e3-3b25-4204-b0f2-354c3fb4ea5d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:44:32.012750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1557880505", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "9ceac873-7f88-4dea-b11b-3f9a7baaa9f7"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:32.068654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] validate_networks() for [('9ceac873-7f88-4dea-b11b-3f9a7baaa9f7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:44:32.472470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:44:32.472912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:44:32.473390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:44:32.473803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:44:32.474215 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:44:32.488222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:32.488941 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:32.489755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:32.490223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:32.508447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Getting quotas for project a9cfe7f066614ef9a09226654bd28c58. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:44:32.515034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Getting quotas for user dde1c0b088674b45b74dff3367a491d1 and project a9cfe7f066614ef9a09226654bd28c58. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:44:32.532857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:44:32.535228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:44:32.582640 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5472f049-1b70-4ee7-8ebb-040575e05f1d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713969 Jul 02 21:44:32.585218 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2937/5842] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:44:32.593801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4d832e0e-080d-4552-a921-18cbccaca6a8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:32.594564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4d832e0e-080d-4552-a921-18cbccaca6a8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:32.664488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4d832e0e-080d-4552-a921-18cbccaca6a8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:32.673616 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4d832e0e-080d-4552-a921-18cbccaca6a8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1218 microversion: 2.1 time: 0.083576 Jul 02 21:44:32.683357 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2906/5843] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:32 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:33.694089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:33.694826 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:33.705425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:33.705916 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:33.706922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:33.707377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:33.773746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:33.781895 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dd8f78cb-9c63-47bf-acd7-bd635308c242 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1288 microversion: 2.1 time: 0.094259 Jul 02 21:44:33.782552 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2938/5844] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:33 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:34.800903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:34.801721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:34.810088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:34.813119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:34.814249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:34.815498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:34.816235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:35.022886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:35.032213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c743574c-2962-4077-a1e6-67e6f58160cd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1318 microversion: 2.1 time: 0.236666 Jul 02 21:44:35.033329 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2907/5845] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:34 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:35.101917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e655d7d0-27c3-4fb3-a5f0-2daf25509955 req-cf3a3edb-cc5e-44a3-86e5-07cb299a0c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3592f9-ab9e-46ee-b83f-7d9c93126c76", "tag": "8a35d78c-9805-421e-a349-307c6a88453f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:35.123518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e655d7d0-27c3-4fb3-a5f0-2daf25509955 req-cf3a3edb-cc5e-44a3-86e5-07cb299a0c4e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:35.124468 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e655d7d0-27c3-4fb3-a5f0-2daf25509955 req-cf3a3edb-cc5e-44a3-86e5-07cb299a0c4e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:35.141777 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e655d7d0-27c3-4fb3-a5f0-2daf25509955 req-cf3a3edb-cc5e-44a3-86e5-07cb299a0c4e service nova] Creating event network-changed:8a35d78c-9805-421e-a349-307c6a88453f for instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 on nch2-master-1 Jul 02 21:44:35.147609 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e655d7d0-27c3-4fb3-a5f0-2daf25509955 req-cf3a3edb-cc5e-44a3-86e5-07cb299a0c4e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062659 Jul 02 21:44:35.148673 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2939/5846] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:44:36.050147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:36.050793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:36.058257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:36.058707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:36.059473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:36.059904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:36.195510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:36.203692 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2551d968-7842-4a4f-a70b-0dc8d8efcb82 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1318 microversion: 2.1 time: 0.157525 Jul 02 21:44:36.204439 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2908/5847] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:36 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:37.226417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:37.227658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:37.232101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:37.239079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:37.239524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:37.240302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:37.240757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:37.244395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=68 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:37.381646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:37.389313 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-23c353b7-7805-41c1-acbe-e272b1a9081c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1318 microversion: 2.1 time: 0.170268 Jul 02 21:44:37.389879 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2940/5848] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:37 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:38.406789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:38.407454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:38.410221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:38.416032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:38.416515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:38.417616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:38.418063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:38.558152 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:38.566295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b4adcc9e-0442-4351-910c-dbdc80321501 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1318 microversion: 2.1 time: 0.163492 Jul 02 21:44:38.566863 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2909/5849] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:38 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:39.014998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b562516c-099d-44ad-9215-36b8f5258b07 req-186b4e74-9e8f-434e-8d6f-79db74ca57d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3592f9-ab9e-46ee-b83f-7d9c93126c76", "name": "network-vif-plugged", "status": "completed", "tag": "8a35d78c-9805-421e-a349-307c6a88453f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:39.024749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b562516c-099d-44ad-9215-36b8f5258b07 req-186b4e74-9e8f-434e-8d6f-79db74ca57d1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:39.025208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b562516c-099d-44ad-9215-36b8f5258b07 req-186b4e74-9e8f-434e-8d6f-79db74ca57d1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:39.038895 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b562516c-099d-44ad-9215-36b8f5258b07 req-186b4e74-9e8f-434e-8d6f-79db74ca57d1 service nova] Creating event network-vif-plugged:8a35d78c-9805-421e-a349-307c6a88453f for instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 on nch2-master-1 Jul 02 21:44:39.044448 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b562516c-099d-44ad-9215-36b8f5258b07 req-186b4e74-9e8f-434e-8d6f-79db74ca57d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033152 Jul 02 21:44:39.045056 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2941/5850] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:44:39.587146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:39.588221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:39.599973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:39.600804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:39.602237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:39.602968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:39.739672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:39.748054 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-459d775f-b315-4956-a20c-d134c33b10a2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1318 microversion: 2.1 time: 0.167608 Jul 02 21:44:39.748656 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2910/5851] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:39 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:40.771756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:40.772940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:40.783163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:40.783609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:40.784406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:40.784851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:40.925425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:40.933634 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8b6d85a-6fdb-4a5f-bb5d-82bba1c09a55 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1508 microversion: 2.1 time: 0.170381 Jul 02 21:44:40.934200 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2942/5852] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:40 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:40.950327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:40.950943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:40.958630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:40.959096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:40.959895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:40.960524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.097945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:41.106209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-df19df72-b666-473a-9608-6e6d91cfe8a1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1508 microversion: 2.1 time: 0.159786 Jul 02 21:44:41.106810 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2911/5853] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:40 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:41.122455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:41.123600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:41.130171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.130630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.131404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.131858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.200015 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-91998d3d-ed15-4f5d-920e-967d32a6a09d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "PUT /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1080 microversion: 2.1 time: 0.081154 Jul 02 21:44:41.200880 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2943/5854] 10.222.0.43 () {60 vars in 1255 bytes} [Sat Jul 2 21:44:41 2022] PUT /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1080 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:41.214736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:41.215363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:41.221786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.222240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.223011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.223482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.353962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:41.361936 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a43f8cd-16b1-412e-9216-3a3cdf3b90f6 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1506 microversion: 2.1 time: 0.151084 Jul 02 21:44:41.362518 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2912/5855] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:41 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:41.378191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:41.378804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:41.385352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.385810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.386627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.387074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.531375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:41.539795 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f99da69c-237c-446a-b653-979259a096fe tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1506 microversion: 2.1 time: 0.165685 Jul 02 21:44:41.540436 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2944/5856] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:41 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:41.556601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:44:41.557596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:41.563910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.564417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.565179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.565610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.596351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:41.602250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Old instance type m1.heat2, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:44:41.608757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:44:41.609145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:44:41.609616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:44:41.610035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:44:41.610518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:44:41.683922 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2b38fa9f-422e-46b8-b9b8-e8dd358e14b1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76/action" status: 202 len: 0 microversion: 2.1 time: 0.131284 Jul 02 21:44:41.684597 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2913/5857] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:44:41 2022] POST /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:44:41.693108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:41.693760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:41.700652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.701106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.702234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:41.702349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:41.834878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:41.842929 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-521e9b1e-01bd-49bc-a5e6-3c45c39aa5fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1517 microversion: 2.1 time: 0.154000 Jul 02 21:44:41.843681 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2945/5858] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:41 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:42.861064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:42.861800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:42.864748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:42.871288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:42.871740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:42.872554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:42.872993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:43.013096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:43.021037 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-195dadec-839d-478e-963d-3bcd47a5afc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1517 microversion: 2.1 time: 0.164032 Jul 02 21:44:43.021614 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2914/5859] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:42 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:44.039158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:44.039787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:44.042234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:44.042937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:44:44.050527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:44.050977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:44.051752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:44.052222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:44.194552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:44.202585 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-15c201af-f211-41e7-b511-c01b9bfe83ba tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.167451 Jul 02 21:44:44.203156 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2946/5860] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:44 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:45.220430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:45.221071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:45.228092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:45.228552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:45.229330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:45.229767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:45.364861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:45.375894 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9307964-bba1-4a3d-bb56-7cb4b71fd204 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.159306 Jul 02 21:44:45.376695 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2915/5861] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:45 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:46.402638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:46.403656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:46.412288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:46.412750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:46.413530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:46.413973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:46.548556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:46.560085 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-abecd2cd-d144-4202-be58-e42940389d32 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.164159 Jul 02 21:44:46.560934 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2947/5862] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:46 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:47.581890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:47.582529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:47.589869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:47.590350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:47.591113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:47.591543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:47.736961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:47.744901 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fbaf1b2e-66e3-44d5-a741-6db282a100d9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.168521 Jul 02 21:44:47.745475 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2916/5863] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:47 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:48.762195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:48.762820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:48.770125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:48.770597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:48.771376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:48.771822 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:48.907874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:48.916307 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d67db418-6add-4e4d-84e8-07ba8dfbfe8e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.158353 Jul 02 21:44:48.917205 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2948/5864] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:48 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:49.935644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:49.936534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:49.945631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:49.946183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:49.947197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:49.947757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:50.094417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:50.103489 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b7062d62-2a90-4df8-a49a-744756501f47 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.172498 Jul 02 21:44:50.104079 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2917/5865] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:49 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:51.123671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:51.124486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:51.132765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:51.133218 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:51.134013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:51.134456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:51.271626 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:51.279624 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c42befb4-4825-4735-a0bc-ef4bb2af09e9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.160504 Jul 02 21:44:51.280221 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2949/5866] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:51 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:52.301101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:52.302067 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:52.314743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:52.314920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:52.316355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:52.317342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:52.457027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:52.464959 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b675d946-5e83-4cb8-9805-81161f8a659a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.170599 Jul 02 21:44:52.465539 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2918/5867] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:52 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:53.486617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:53.487609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:53.499399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:53.500203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:53.501507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:53.502219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:53.646586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:53.657947 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c298cea1-a742-484b-9541-89b2b6eba3a3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.177856 Jul 02 21:44:53.658721 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2950/5868] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:53 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:54.679251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:54.680309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:54.691321 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:54.691746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:54.692580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:54.693015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:55.158139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:55.165826 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54ad08d2-ae84-4933-a1b0-01bf5d7046e2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.493164 Jul 02 21:44:55.166441 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2919/5869] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:54 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:56.187171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:56.188237 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:56.196355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:56.196819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:56.197603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:56.198043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:56.336334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:56.348074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d019a630-9527-4185-8f2d-0e90b3c33fd4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.167658 Jul 02 21:44:56.348658 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2951/5870] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:56 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:57.370179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:57.370856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:57.378510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:57.378998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:57.379780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:57.380272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:57.522158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:57.533724 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f015dde-a63f-47e2-aceb-0fd26177b8ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.169724 Jul 02 21:44:57.534571 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2920/5871] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:57 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:58.559918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:58.561061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:58.570018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:58.570475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:58.571246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:58.571691 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:58.710221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:58.717974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-040efeef-c4b9-42dd-9e6b-cd97cfcccdec tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.164636 Jul 02 21:44:58.718572 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2952/5872] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:58 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:44:59.738743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:44:59.739479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:44:59.748070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:59.748602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:59.749506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:44:59.750012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:44:59.894494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:44:59.907123 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8224def2-2143-437a-b0bd-35a953a4492e tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.173591 Jul 02 21:44:59.907123 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2921/5873] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:44:59 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:00.929368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:00.930390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:00.941692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:00.942142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:00.942926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:00.943370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:01.084073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:01.092187 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6fe6f5ae-1f7f-4bcb-803d-ce83b6528708 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.169458 Jul 02 21:45:01.092765 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2953/5874] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:00 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:02.109665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:02.110310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:02.117829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:02.118288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:02.119113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:02.119551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:02.123604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:02.254158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:02.262219 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-086d5327-47a9-4902-86b1-8877f68ee2e5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.156484 Jul 02 21:45:02.262729 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2922/5875] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:02 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:03.283582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:03.284791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:03.297058 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:03.297809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:03.299078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:03.299827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:03.446695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:03.454989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f1df8535-6764-4c13-90bf-7dec003fac57 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.178036 Jul 02 21:45:03.455569 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2954/5876] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:03 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:04.476471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:04.477497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:04.489446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:04.490205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:04.491472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:04.492240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:04.632678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:04.645588 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-33028fe7-8286-4386-bbd5-5861f1672947 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.175523 Jul 02 21:45:04.646495 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2923/5877] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:04 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:05.672746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:05.673776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:05.681911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:05.682374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:05.683157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:05.683591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:05.837486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:05.845755 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df82229f-5cf4-4125-82c3-bfc645b29e13 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.180121 Jul 02 21:45:05.846339 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2955/5878] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:05 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:06.865072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:06.865888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:06.875767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:06.876425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:06.877492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:06.878077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:07.013879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:07.022024 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b7993681-e2d4-4018-a0ca-c3ac0e995e5a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.162277 Jul 02 21:45:07.022607 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2924/5879] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:06 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:08.043401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:08.044480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:08.049063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=32 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:08.055745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:08.056255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:08.057023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:08.057473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:08.060150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:08.196073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:08.204006 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7a0cda89-7c10-4178-ba30-43f56a6e9334 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.167566 Jul 02 21:45:08.204597 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2956/5880] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:08 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:09.221521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:09.222171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:09.224986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=36 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:09.230687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:09.231146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:09.231927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:09.232399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:09.371142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:09.379983 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-afcbd685-4238-4acf-b1c9-7852a7e90107 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.162407 Jul 02 21:45:09.380581 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2925/5881] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:09 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:10.397001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:10.397591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:10.404816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:10.405263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:10.406051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:10.406481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:10.540996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:10.552957 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e2e53de1-621e-44db-b31a-333a516c0f46 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1522 microversion: 2.1 time: 0.159916 Jul 02 21:45:10.553716 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2957/5882] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:10 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:11.296162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-ee9cb85d-f582-464d-9d15-c0863a990104 req-a0f489dd-7dd6-49bc-9999-cd24d2c2c14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3592f9-ab9e-46ee-b83f-7d9c93126c76", "name": "network-vif-unplugged", "status": "completed", "tag": "8a35d78c-9805-421e-a349-307c6a88453f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:11.307415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ee9cb85d-f582-464d-9d15-c0863a990104 req-a0f489dd-7dd6-49bc-9999-cd24d2c2c14d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:11.308089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-ee9cb85d-f582-464d-9d15-c0863a990104 req-a0f489dd-7dd6-49bc-9999-cd24d2c2c14d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:11.323224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-ee9cb85d-f582-464d-9d15-c0863a990104 req-a0f489dd-7dd6-49bc-9999-cd24d2c2c14d service nova] Creating event network-vif-unplugged:8a35d78c-9805-421e-a349-307c6a88453f for instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 on nch1-master-1 Jul 02 21:45:11.328881 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-ee9cb85d-f582-464d-9d15-c0863a990104 req-a0f489dd-7dd6-49bc-9999-cd24d2c2c14d service nova] Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:45:11.341081 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-ee9cb85d-f582-464d-9d15-c0863a990104 req-a0f489dd-7dd6-49bc-9999-cd24d2c2c14d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049837 Jul 02 21:45:11.342076 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2926/5883] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:45:11.573697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:11.574512 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:11.584544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:11.584998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:11.585792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:11.586232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:11.794304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:11.802655 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-444bec53-fb2d-4c99-82ab-7ead3f1bf27b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1521 microversion: 2.1 time: 0.235021 Jul 02 21:45:11.803341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2958/5884] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:11 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:12.826325 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:12.827492 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:12.838524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:12.839283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:12.840615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:12.841357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:12.985775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:12.993861 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d813622a-bf97-456d-90b4-f17148a57ce9 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1519 microversion: 2.1 time: 0.176282 Jul 02 21:45:12.994415 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2927/5885] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:12 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:13.357270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-28357899-f560-4e18-9377-ee03e27ef6e4 req-f9fb55cf-ed8e-4cfb-81c7-89ac4dd4a790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c3592f9-ab9e-46ee-b83f-7d9c93126c76", "tag": "8a35d78c-9805-421e-a349-307c6a88453f"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:13.366643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-28357899-f560-4e18-9377-ee03e27ef6e4 req-f9fb55cf-ed8e-4cfb-81c7-89ac4dd4a790 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:13.368137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-28357899-f560-4e18-9377-ee03e27ef6e4 req-f9fb55cf-ed8e-4cfb-81c7-89ac4dd4a790 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:13.380642 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-28357899-f560-4e18-9377-ee03e27ef6e4 req-f9fb55cf-ed8e-4cfb-81c7-89ac4dd4a790 service nova] Creating event network-changed:8a35d78c-9805-421e-a349-307c6a88453f for instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 on nch1-master-1 Jul 02 21:45:13.386275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-28357899-f560-4e18-9377-ee03e27ef6e4 req-f9fb55cf-ed8e-4cfb-81c7-89ac4dd4a790 service nova] Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:45:13.397423 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-28357899-f560-4e18-9377-ee03e27ef6e4 req-f9fb55cf-ed8e-4cfb-81c7-89ac4dd4a790 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043912 Jul 02 21:45:13.398389 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2959/5886] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:45:14.011958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:14.012721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:14.021250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:14.021744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:14.022562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:14.023006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:14.159589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:14.168363 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-88c286ba-7b51-4501-b6be-2da215b3ca23 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1519 microversion: 2.1 time: 0.161202 Jul 02 21:45:14.168990 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2928/5887] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:14 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:15.187985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:15.188724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:15.195484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:15.195944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:15.196752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:15.197195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:15.428523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:15.436576 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1eab8439-4daa-4adc-89ca-c29e846cdd7b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1519 microversion: 2.1 time: 0.253925 Jul 02 21:45:15.437504 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2960/5888] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:15 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:16.454375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:16.454971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:16.461822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:16.462277 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:16.463046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:16.463485 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:16.601432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:16.609404 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8e4dcc4-cee3-4fc8-8227-5f030f5fc081 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1516 microversion: 2.1 time: 0.159000 Jul 02 21:45:16.609991 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2929/5889] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:16 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:16.625923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:16.626465 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:16.633849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:16.634314 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:16.635107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:16.635555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:16.699984 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-570fe43b-7da7-43e1-b777-8d80693e74dd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76/action" status: 204 len: 0 microversion: 2.1 time: 0.077918 Jul 02 21:45:16.700687 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2961/5890] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:45:16 2022] POST /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:45:16.709177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:16.710004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:16.716334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:16.716966 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:16.717901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:16.718473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:16.859618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:16.867474 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-54dffd5f-7e12-4e13-b66c-a2d107e54afb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1516 microversion: 2.1 time: 0.162349 Jul 02 21:45:16.868154 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2930/5891] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:16 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:17.886543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:17.887253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:17.894136 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:17.894630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:17.895430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:17.895868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:18.037781 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:18.046863 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-218bacb4-f108-4ea7-b3ab-cebcd6999926 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1508 microversion: 2.1 time: 0.165486 Jul 02 21:45:18.047782 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2962/5892] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:17 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:18.064022 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:18.064670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:18.072264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:18.072724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:18.073648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:18.074161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:18.215142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:18.223046 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1844bf96-b54b-4692-bbbc-3f36ec16e57c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1508 microversion: 2.1 time: 0.163032 Jul 02 21:45:18.223627 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2931/5893] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:18 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:18.242736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c0907fe-44f2-4d3f-a434-acf7c96549ae tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'create', calling method: .version_select at 0x7fabd78de670>, body: {"keypair": {"name": "tempest-keypair-1513124166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXCGUfIWRwpAmci8SmnIObFUZWrSBYRgg1diiJ0Fjb8td5/UWK1oMiYC/gMtIg4VsCcLZ4XTCClx5Hmn0+Jpic9pu6S1pmx+B48tgqeYSTG1lrbDgx0SzQjMQpaae2uOA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:18.257773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7c0907fe-44f2-4d3f-a434-acf7c96549ae tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Getting quotas for project a9cfe7f066614ef9a09226654bd28c58. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:45:18.263352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7c0907fe-44f2-4d3f-a434-acf7c96549ae tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Getting quotas for user dde1c0b088674b45b74dff3367a491d1 and project a9cfe7f066614ef9a09226654bd28c58. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:45:18.295390 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c0907fe-44f2-4d3f-a434-acf7c96549ae tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056600 Jul 02 21:45:18.296006 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2963/5894] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:45:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:45:18.679879 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-24348524-b61d-46cd-b7b5-e5e7ed28a709 req-bc3e48ff-55e0-4878-8507-eaabd65e6881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3592f9-ab9e-46ee-b83f-7d9c93126c76", "name": "network-vif-plugged", "status": "completed", "tag": "8a35d78c-9805-421e-a349-307c6a88453f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:18.688531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-24348524-b61d-46cd-b7b5-e5e7ed28a709 req-bc3e48ff-55e0-4878-8507-eaabd65e6881 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:18.689035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-24348524-b61d-46cd-b7b5-e5e7ed28a709 req-bc3e48ff-55e0-4878-8507-eaabd65e6881 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:18.701388 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-24348524-b61d-46cd-b7b5-e5e7ed28a709 req-bc3e48ff-55e0-4878-8507-eaabd65e6881 service nova] Creating event network-vif-plugged:8a35d78c-9805-421e-a349-307c6a88453f for instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 on nch1-master-1 Jul 02 21:45:18.707443 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-24348524-b61d-46cd-b7b5-e5e7ed28a709 req-bc3e48ff-55e0-4878-8507-eaabd65e6881 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031609 Jul 02 21:45:18.708133 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2932/5895] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:45:19.547518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:19.548212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:19.556064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:19.556539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:19.557322 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:19.557764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:19.691549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:19.699661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f730eb95-215d-4c25-a851-042059897f38 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 200 len: 1508 microversion: 2.1 time: 0.156653 Jul 02 21:45:19.700297 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2964/5896] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:19 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:19.717559 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:19.718121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:19.724964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:19.725423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:19.726204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:19.726647 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:19.754570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:45:19.835595 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e57ea389-5b67-4d18-89de-6313ed555cde tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 204 len: 0 microversion: 2.1 time: 0.122910 Jul 02 21:45:19.836230 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2933/5897] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:45:19 2022] DELETE /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:45:19.899182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1415469332", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "9ceac873-7f88-4dea-b11b-3f9a7baaa9f7"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:19.963551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] validate_networks() for [('9ceac873-7f88-4dea-b11b-3f9a7baaa9f7', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:45:20.375454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:45:20.375881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:45:20.376500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:45:20.376888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:45:20.377423 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:45:20.387841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:20.388331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:20.389144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:20.389582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:20.406894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Getting quotas for project a9cfe7f066614ef9a09226654bd28c58. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:45:20.412774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Getting quotas for user dde1c0b088674b45b74dff3367a491d1 and project a9cfe7f066614ef9a09226654bd28c58. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:45:20.426789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:45:20.429112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:45:20.478467 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6020564b-4398-4f2a-8c7b-02e62b3e468d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587111 Jul 02 21:45:20.479137 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2965/5898] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:45:20.489989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-97e44f54-42a6-4078-87ac-720a26218bd1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:20.490675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-97e44f54-42a6-4078-87ac-720a26218bd1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:20.545852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-97e44f54-42a6-4078-87ac-720a26218bd1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:20.553221 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-97e44f54-42a6-4078-87ac-720a26218bd1 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1218 microversion: 2.1 time: 0.067630 Jul 02 21:45:20.553818 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2934/5899] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:20 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:21.571865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:21.572765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:21.580926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:21.581677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:21.582634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:21.583257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:21.671367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:21.679667 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7164ddd-b62f-43ae-9bd5-4e214252c7eb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1288 microversion: 2.1 time: 0.112744 Jul 02 21:45:21.680303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2966/5900] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:21 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:21.958457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-81295ca1-5d2c-4a74-8e6b-7d5117c51bf9 req-b608c589-dcf9-4b01-9c10-71538eaf5edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c3592f9-ab9e-46ee-b83f-7d9c93126c76", "name": "network-vif-deleted", "tag": "8a35d78c-9805-421e-a349-307c6a88453f"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:21.972125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-81295ca1-5d2c-4a74-8e6b-7d5117c51bf9 req-b608c589-dcf9-4b01-9c10-71538eaf5edf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:21.972829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-81295ca1-5d2c-4a74-8e6b-7d5117c51bf9 req-b608c589-dcf9-4b01-9c10-71538eaf5edf service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:22.002843 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-81295ca1-5d2c-4a74-8e6b-7d5117c51bf9 req-b608c589-dcf9-4b01-9c10-71538eaf5edf service nova] Creating event network-vif-deleted:8a35d78c-9805-421e-a349-307c6a88453f for instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 on nch1-master-1 Jul 02 21:45:22.009096 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-81295ca1-5d2c-4a74-8e6b-7d5117c51bf9 req-b608c589-dcf9-4b01-9c10-71538eaf5edf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056747 Jul 02 21:45:22.010034 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2935/5901] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:45:22.696503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:22.697117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:22.704320 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:22.704783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:22.705562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:22.706139 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:22.836784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:22.844673 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-760e2152-083b-4192-81c8-949dd5908460 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.152206 Jul 02 21:45:22.845249 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2967/5902] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:22 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:23.191507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-adfb5379-5c2b-41d0-916a-3704d931be25 req-acfd7f16-5c89-4d39-931d-7db405c9aacc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd576236-0c6a-450d-b591-7c33285df5a2", "tag": "5d2c9f9c-4c74-4e9a-a9bc-ae49132df767"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:23.205809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-adfb5379-5c2b-41d0-916a-3704d931be25 req-acfd7f16-5c89-4d39-931d-7db405c9aacc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:23.206273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-adfb5379-5c2b-41d0-916a-3704d931be25 req-acfd7f16-5c89-4d39-931d-7db405c9aacc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:23.218386 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-adfb5379-5c2b-41d0-916a-3704d931be25 req-acfd7f16-5c89-4d39-931d-7db405c9aacc service nova] Creating event network-changed:5d2c9f9c-4c74-4e9a-a9bc-ae49132df767 for instance cd576236-0c6a-450d-b591-7c33285df5a2 on nch2-master-1 Jul 02 21:45:23.229165 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-adfb5379-5c2b-41d0-916a-3704d931be25 req-acfd7f16-5c89-4d39-931d-7db405c9aacc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043047 Jul 02 21:45:23.229787 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2936/5903] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:45:23.866057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:23.867016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:23.879481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:23.879992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:23.880751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:23.881188 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:24.021868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:24.031394 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1e40d38-94cf-4eb3-b8dd-736282ef475c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.171777 Jul 02 21:45:24.032257 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2968/5904] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:23 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:25.053052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:25.053613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:25.060466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:25.060928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:25.061691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:25.062158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:25.203688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:25.211607 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d5215171-210f-4c44-8ea4-a208eccf589d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.165490 Jul 02 21:45:25.212222 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2937/5905] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:25 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:26.233261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:26.234280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:26.246585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:26.247365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:26.248905 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:26.249893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:26.394107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:26.402053 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ab78d807-dfcc-41dc-b81b-5bdaff20b982 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.175434 Jul 02 21:45:26.402644 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2969/5906] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:26 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:27.422588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:27.423221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:27.431403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:27.431894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:27.432690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:27.433194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:27.575585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:27.583488 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-76e8cd76-dce7-4c46-be66-48cd4571792a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.167262 Jul 02 21:45:27.584088 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2938/5907] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:27 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:28.601163 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:28.601771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:28.609586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:28.610052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:28.610834 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:28.611281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:28.757726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:28.765784 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c93e402-6f3b-4d7d-9332-f197d99b525f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.168808 Jul 02 21:45:28.766374 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2970/5908] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:28 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:29.209729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-37a5da07-8841-48cf-8706-864bec9a9b36 req-3f7e3628-7c26-4842-86ab-6f78e220e5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd576236-0c6a-450d-b591-7c33285df5a2", "name": "network-vif-plugged", "status": "completed", "tag": "5d2c9f9c-4c74-4e9a-a9bc-ae49132df767"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:29.219683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-37a5da07-8841-48cf-8706-864bec9a9b36 req-3f7e3628-7c26-4842-86ab-6f78e220e5e1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:29.220118 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-37a5da07-8841-48cf-8706-864bec9a9b36 req-3f7e3628-7c26-4842-86ab-6f78e220e5e1 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:29.233053 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-37a5da07-8841-48cf-8706-864bec9a9b36 req-3f7e3628-7c26-4842-86ab-6f78e220e5e1 service nova] Creating event network-vif-plugged:5d2c9f9c-4c74-4e9a-a9bc-ae49132df767 for instance cd576236-0c6a-450d-b591-7c33285df5a2 on nch2-master-1 Jul 02 21:45:29.238246 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-37a5da07-8841-48cf-8706-864bec9a9b36 req-3f7e3628-7c26-4842-86ab-6f78e220e5e1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032267 Jul 02 21:45:29.238831 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2939/5909] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:45:29.787224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:29.787858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:29.796017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:29.796554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:29.797372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:29.797839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:29.936202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:29.944393 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-27d3fc1e-1146-4af0-90c6-2e07f54a324f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1318 microversion: 2.1 time: 0.164006 Jul 02 21:45:29.944941 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2971/5910] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:29 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:30.961716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:30.968634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:30.969832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:30.978978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:30.979540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:30.980557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:30.981100 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.119528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:31.127610 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cf4bdc32-9bf0-439d-9502-a6f02512ff58 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1508 microversion: 2.1 time: 0.168309 Jul 02 21:45:31.128218 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2940/5911] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:30 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:31.143883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:31.144528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:31.146620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:31.147282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=10 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:31.154036 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:31.154479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.155245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:31.155676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.293318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:31.301465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f2d8b8e-5889-45de-b86d-cfdaea3211c0 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1508 microversion: 2.1 time: 0.161409 Jul 02 21:45:31.302041 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2972/5912] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:31 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:31.317610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:45:31.318586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:31.324850 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:31.325304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.326060 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:31.326496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.330665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:31.358976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:31.365211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Old instance type m1.heat2, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:45:31.371672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:45:31.372094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:45:31.372598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:45:31.372989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:45:31.373403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:45:31.448254 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab5ddb7b-a9de-412f-86ac-4e65a535898d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2/action" status: 202 len: 0 microversion: 2.1 time: 0.134598 Jul 02 21:45:31.448865 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2941/5913] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:45:31 2022] POST /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:45:31.457015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:31.457651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:31.463968 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:31.464488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.465280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:31.465707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:31.484174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:31.605088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:31.612974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7be34006-d2ae-4bea-ae42-19fb99cfe235 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1515 microversion: 2.1 time: 0.159858 Jul 02 21:45:31.613624 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2973/5914] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:31 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:32.631099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:32.631724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:32.638158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:32.638622 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:32.639392 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:32.639838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:32.771756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:32.782580 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e3962ca2-5db0-47cb-9f3b-42f2d7635403 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1515 microversion: 2.1 time: 0.156396 Jul 02 21:45:32.783152 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2942/5915] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:32 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:33.805684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:33.806581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:33.814520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:33.814985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:33.815770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:33.816253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:33.968700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:33.976948 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-807b0550-5017-415e-ba2b-3eb55b023ce2 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.175354 Jul 02 21:45:33.977533 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2974/5916] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:33 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:34.998815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:34.999640 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:35.009930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:35.010379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:35.011160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:35.011601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:35.147720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:35.160525 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-876b970d-3c1b-4a78-9120-b3e662a24bac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.168267 Jul 02 21:45:35.161391 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2943/5917] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:34 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:36.179312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:36.179932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:36.187448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:36.187902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:36.188710 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:36.189150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:36.330788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:36.339370 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4001bf3e-294d-448b-8733-ef485803bd51 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.164124 Jul 02 21:45:36.340061 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2975/5918] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:36 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:37.357250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:37.357803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:37.365031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:37.365486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:37.366267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:37.366706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:37.510557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:37.522067 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0d8aba5b-c6c3-454e-8d78-ae5a088f1115 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.168620 Jul 02 21:45:37.522870 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2944/5919] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:37 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:45:38.544209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:38.545259 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:38.549573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:38.557603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:38.558054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:38.558835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:38.559280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:38.699339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:38.707143 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd8fb9ca-a626-4b44-8879-595c9d9537f7 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.170098 Jul 02 21:45:38.707694 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2976/5920] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:38 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:39.728517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:39.729272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:39.732964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:45:39.740608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:39.741213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:39.742293 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:39.742880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:39.887046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:39.898090 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4e7a007a-e77a-4795-a2d8-af41df34885f tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.175706 Jul 02 21:45:39.898669 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2945/5921] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:39 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:40.919389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:40.920623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:40.931219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:40.931673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:40.932488 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:40.932925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:41.066896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:41.078351 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-67a125b8-c735-4246-8c96-c19d24b222fd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.165938 Jul 02 21:45:41.078982 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2977/5922] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:40 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:42.096376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:42.097001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:42.104742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:42.105194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:42.105969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:42.106674 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:42.251671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:42.263755 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c6149777-93ea-4829-ad7d-bef306df1978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.171339 Jul 02 21:45:42.264676 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2946/5923] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:42 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:43.285753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:43.286784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:43.295418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:43.295883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:43.296702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:43.297147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:43.432865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:43.440648 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-da470bf6-4e57-425d-911e-b6b3a8ba7aa4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.161595 Jul 02 21:45:43.441260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2978/5924] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:43 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:44.461585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:44.462243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:44.470074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:44.470549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:44.471397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:44.471864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:44.603603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:44.611394 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-41135765-3a62-418b-986c-66244a2e0bbc tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.155843 Jul 02 21:45:44.611953 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2947/5925] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:44 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:45.629004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:45.629633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:45.637270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:45.637733 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:45.638509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:45.638963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:45.775761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:45.784000 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29e4b12c-4fea-4738-8c14-f615d0647f8b tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.159031 Jul 02 21:45:45.784627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2979/5926] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:45 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:46.804928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:46.805764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:46.814288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:46.814862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:46.815834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:46.816440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:46.952401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:46.963531 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8a1f8e04-e825-4561-9efd-b51a93349978 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.164711 Jul 02 21:45:46.964376 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2948/5927] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:46 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:47.989950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:47.990970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:48.001680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:48.002448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:48.003812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:48.004633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:48.142344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:48.150556 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6389abbe-5f2a-438c-8db1-e66830964709 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.167695 Jul 02 21:45:48.151146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2980/5928] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:47 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:49.172662 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:49.173666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:49.183005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:49.183458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:49.184441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:49.184856 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:49.316362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:49.324622 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-88de1324-829a-4ef9-b656-ccaa86688734 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.158957 Jul 02 21:45:49.325206 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2949/5929] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:49 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:50.349216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:50.349829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:50.358433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:50.358971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:50.359872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:50.360429 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:50.505502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:50.513949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b0120a68-55ae-409b-b167-9f0aafbc7915 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.169647 Jul 02 21:45:50.514553 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2981/5930] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:50 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:50.628737 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:45:50.629565 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:45:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:45:51.535801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:51.536880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:51.547364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:51.547779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:51.548618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:51.549376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:51.703895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:51.716439 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cbbe3d1b-5274-4e57-a38c-9587092b5fc3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.186876 Jul 02 21:45:51.717255 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2950/5931] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:51 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:52.738768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:52.739726 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:52.747774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:52.748264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:52.749031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:52.749461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:52.892712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:52.900722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3d3b6e46-859b-483b-957b-14f76ec472ee tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.168606 Jul 02 21:45:52.901299 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2982/5932] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:52 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:53.922858 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:53.923933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:53.936323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:53.937267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:53.938536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:53.939258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:54.089781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:54.098008 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-973c6878-e220-4187-a8e6-de1bfe5d37ac tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.182233 Jul 02 21:45:54.098621 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2951/5933] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:53 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:55.116693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:55.117306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:55.124948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:55.125404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:55.126178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:55.126617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:55.258946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:55.267006 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10b7bf33-6cbd-49c4-b004-2f6679de9f60 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.155348 Jul 02 21:45:55.267591 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2983/5934] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:55 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:56.289335 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:56.290043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:56.298948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:56.299482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:56.300658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:56.301239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:56.443087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:56.454734 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f97bebe5-915a-416e-b76a-3454ceb286ed tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.171747 Jul 02 21:45:56.455513 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2952/5935] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:56 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:57.477649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:57.478431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:57.488479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:57.489274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:57.490321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:57.490910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:57.631003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:57.639412 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a21ec58b-142c-4f51-910f-3cbc14f8072d tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.168282 Jul 02 21:45:57.640020 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2984/5936] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:57 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:58.656976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:58.657584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:58.664944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:58.665766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:58.666531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:58.666962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:58.820660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:45:58.828576 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ce2eee9e-fe2f-4bd6-8279-95d2705eb256 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.175533 Jul 02 21:45:58.829131 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2953/5937] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:58 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:45:59.849787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:45:59.850654 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:45:59.860221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:59.860793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:45:59.861590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:45:59.862207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:00.009507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:00.017332 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e097fc7e-f6be-4297-a7ec-51fa8d5f701a tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1520 microversion: 2.1 time: 0.173507 Jul 02 21:46:00.017909 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2985/5938] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:45:59 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:01.034809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:01.035531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:01.043190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:01.043645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:01.044447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:01.044886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:01.273016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:01.281110 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-49ce1a57-1f95-4b1b-81aa-50612bf7a815 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1519 microversion: 2.1 time: 0.250215 Jul 02 21:46:01.281693 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2954/5939] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:01 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1519 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:01.359661 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-491ace16-613c-4e22-bfe9-613aceb4cb3c req-9758d676-cac5-455e-8d43-b989f9fe1694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd576236-0c6a-450d-b591-7c33285df5a2", "name": "network-vif-unplugged", "status": "completed", "tag": "5d2c9f9c-4c74-4e9a-a9bc-ae49132df767"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:01.372306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-491ace16-613c-4e22-bfe9-613aceb4cb3c req-9758d676-cac5-455e-8d43-b989f9fe1694 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:01.372777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-491ace16-613c-4e22-bfe9-613aceb4cb3c req-9758d676-cac5-455e-8d43-b989f9fe1694 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:01.390813 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-491ace16-613c-4e22-bfe9-613aceb4cb3c req-9758d676-cac5-455e-8d43-b989f9fe1694 service nova] Creating event network-vif-unplugged:5d2c9f9c-4c74-4e9a-a9bc-ae49132df767 for instance cd576236-0c6a-450d-b591-7c33285df5a2 on nch1-master-1 Jul 02 21:46:01.397167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-491ace16-613c-4e22-bfe9-613aceb4cb3c req-9758d676-cac5-455e-8d43-b989f9fe1694 service nova] Instance cd576236-0c6a-450d-b591-7c33285df5a2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:46:01.409244 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-491ace16-613c-4e22-bfe9-613aceb4cb3c req-9758d676-cac5-455e-8d43-b989f9fe1694 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054179 Jul 02 21:46:01.410250 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2986/5940] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:46:02.298969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:02.299574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:02.306981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:02.307661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:02.308493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:02.308936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:02.312996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:02.530799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:02.538896 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-059f21dc-4d83-4ed7-bb8d-b421a0143700 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1519 microversion: 2.1 time: 0.243848 Jul 02 21:46:02.539705 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2955/5941] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:02 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:03.430999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ed986384-a864-4c87-8f1d-229e38356618 req-35ad7cd5-b08b-4e13-8eb7-d0669fde4b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd576236-0c6a-450d-b591-7c33285df5a2", "tag": "5d2c9f9c-4c74-4e9a-a9bc-ae49132df767"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:03.439856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ed986384-a864-4c87-8f1d-229e38356618 req-35ad7cd5-b08b-4e13-8eb7-d0669fde4b05 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:03.440348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ed986384-a864-4c87-8f1d-229e38356618 req-35ad7cd5-b08b-4e13-8eb7-d0669fde4b05 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:03.442967 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=79 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:03.453627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ed986384-a864-4c87-8f1d-229e38356618 req-35ad7cd5-b08b-4e13-8eb7-d0669fde4b05 service nova] Creating event network-changed:5d2c9f9c-4c74-4e9a-a9bc-ae49132df767 for instance cd576236-0c6a-450d-b591-7c33285df5a2 on nch1-master-1 Jul 02 21:46:03.459210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-ed986384-a864-4c87-8f1d-229e38356618 req-35ad7cd5-b08b-4e13-8eb7-d0669fde4b05 service nova] Instance cd576236-0c6a-450d-b591-7c33285df5a2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:46:03.470230 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ed986384-a864-4c87-8f1d-229e38356618 req-35ad7cd5-b08b-4e13-8eb7-d0669fde4b05 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045789 Jul 02 21:46:03.470813 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2987/5942] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:46:03.559607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:03.560273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:03.567769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:03.568259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:03.569367 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:03.570113 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:03.709114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:03.717088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-17d66b9a-8ace-44b6-aecf-24e0bfe85515 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1517 microversion: 2.1 time: 0.161853 Jul 02 21:46:03.717671 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2956/5943] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:03 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:04.735806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:04.736548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:04.744207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:04.744667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:04.745448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:04.745895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:04.891083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:04.899964 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3acd2f4e-63b2-4d10-b80f-b1f97e19a7df tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1517 microversion: 2.1 time: 0.168595 Jul 02 21:46:04.900599 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2988/5944] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:04 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:05.919023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:05.919689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:05.928628 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:05.929163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:05.930104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:05.930620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:06.080435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:06.088617 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9c7374bb-8372-4379-ad92-000bb1543c92 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1514 microversion: 2.1 time: 0.174647 Jul 02 21:46:06.089198 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2957/5945] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:05 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:06.105486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:06.106025 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:06.113563 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:06.114011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:06.114813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:06.115231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:06.177439 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb529f7b-8176-451d-ab5e-85cdc43b7d2c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "POST /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2/action" status: 204 len: 0 microversion: 2.1 time: 0.075759 Jul 02 21:46:06.178082 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2989/5946] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:46:06 2022] POST /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:46:06.186726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:06.187338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:06.194619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:06.195090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:06.195834 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:06.196307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:06.341000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:06.349546 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-97022d1e-bb45-4ecd-bc49-6e4fbb0f781c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1514 microversion: 2.1 time: 0.166690 Jul 02 21:46:06.350394 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2958/5947] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:06 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:46:07.372088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:07.372704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:07.379341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.380102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.380922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.381375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.521392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:07.529118 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-10012b52-cf3a-4348-bbf5-e4d57a67f472 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1506 microversion: 2.1 time: 0.162486 Jul 02 21:46:07.529711 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2990/5948] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:07 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:07.546519 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:07.547159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:07.554407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.554861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.555646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.556117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.698670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:07.708411 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-35508b7e-fbad-43e4-ad3f-de8745f90919 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1506 microversion: 2.1 time: 0.165716 Jul 02 21:46:07.708971 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2959/5949] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:07 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:07.724747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:07.725401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:07.731659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.732111 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.732898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.733326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.867161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:07.875260 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ae09664-4188-4d82-924f-3739a325333c tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1506 microversion: 2.1 time: 0.154466 Jul 02 21:46:07.875840 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2991/5950] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:07 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:46:07.894241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:07.894829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:07.902348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.902803 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.903584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:07.904029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:07.929901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:46:08.014549 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a5773d7a-66d1-43c3-b41a-6d3392e12426 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 204 len: 0 microversion: 2.1 time: 0.125842 Jul 02 21:46:08.015502 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2960/5951] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:46:07 2022] DELETE /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:46:08.033511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:08.034013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:08.040841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:08.041302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:08.042076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:08.042516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:08.067974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:46:08.114287 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.compute.api [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Instance is already in deleting state, ignoring this request Jul 02 21:46:08.115123 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53d13eeb-a935-4a6d-a14a-ba5cac4c6efd tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 204 len: 0 microversion: 2.1 time: 0.085678 Jul 02 21:46:08.115704 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2992/5952] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:46:08 2022] DELETE /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:46:08.126692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:08.127873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:08.134636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:08.135088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:08.135835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:08.136307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:08.279343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:08.287330 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0029ad53-1ad9-4309-bb34-cf1bd6020dcb tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1512 microversion: 2.1 time: 0.166982 Jul 02 21:46:08.287907 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2961/5953] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:08 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:08.891042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2c5a30c9-2fdd-4f28-a5d9-aae0ce8175bb req-6d982198-4645-453e-9889-c86d0c6d0292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd576236-0c6a-450d-b591-7c33285df5a2", "name": "network-vif-plugged", "status": "completed", "tag": "5d2c9f9c-4c74-4e9a-a9bc-ae49132df767"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:08.895528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:08.903060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c5a30c9-2fdd-4f28-a5d9-aae0ce8175bb req-6d982198-4645-453e-9889-c86d0c6d0292 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:08.903532 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2c5a30c9-2fdd-4f28-a5d9-aae0ce8175bb req-6d982198-4645-453e-9889-c86d0c6d0292 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:08.916288 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2c5a30c9-2fdd-4f28-a5d9-aae0ce8175bb req-6d982198-4645-453e-9889-c86d0c6d0292 service nova] Creating event network-vif-plugged:5d2c9f9c-4c74-4e9a-a9bc-ae49132df767 for instance cd576236-0c6a-450d-b591-7c33285df5a2 on nch1-master-1 Jul 02 21:46:08.921337 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2c5a30c9-2fdd-4f28-a5d9-aae0ce8175bb req-6d982198-4645-453e-9889-c86d0c6d0292 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034108 Jul 02 21:46:08.921906 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2993/5954] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:46:09.305193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:09.305766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:09.313358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:09.313815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:09.314615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:09.315052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:09.447318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dde1c0b088674b45b74dff3367a491d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9cfe7f066614ef9a09226654bd28c58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:09.455703 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a15435e4-267a-4823-9f0f-a260707b52c5 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 200 len: 1512 microversion: 2.1 time: 0.154505 Jul 02 21:46:09.456396 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2962/5955] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:09 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:10.104078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-99f82f3a-ac42-4d31-8172-251926489c02 req-52489399-896d-4014-a27e-b0c08504737c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd576236-0c6a-450d-b591-7c33285df5a2", "name": "network-vif-deleted", "tag": "5d2c9f9c-4c74-4e9a-a9bc-ae49132df767"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:10.113702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99f82f3a-ac42-4d31-8172-251926489c02 req-52489399-896d-4014-a27e-b0c08504737c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:10.114599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-99f82f3a-ac42-4d31-8172-251926489c02 req-52489399-896d-4014-a27e-b0c08504737c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:10.127288 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-99f82f3a-ac42-4d31-8172-251926489c02 req-52489399-896d-4014-a27e-b0c08504737c service nova] Creating event network-vif-deleted:5d2c9f9c-4c74-4e9a-a9bc-ae49132df767 for instance cd576236-0c6a-450d-b591-7c33285df5a2 on nch1-master-1 Jul 02 21:46:10.133549 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-99f82f3a-ac42-4d31-8172-251926489c02 req-52489399-896d-4014-a27e-b0c08504737c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Jul 02 21:46:10.135014 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2994/5956] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:46:10.476632 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:10.477289 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: cd576236-0c6a-450d-b591-7c33285df5a2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:10.480191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:10.485719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:10.486168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:10.486931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:10.487364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:10.501855 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] HTTP exception thrown: Instance cd576236-0c6a-450d-b591-7c33285df5a2 could not be found. Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Request method failure captured: Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 HTTP/1.1 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLw_tgJmlpQMIfpKPYLae7t9qwy94bo7JGJiaPnPqRtsxFr_fGRsIoul9Vqn0yia8Mu8H4L7coxpbBySYJtyd_A8Vq1ObgNs5defKrAdJVlkVR3LdTNZsqjkZbL9c96lg95db3HuSNUkK2M6N7S0TgiJwqAYjIfsd0VunXLeLswzYuU Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a9cfe7f066614ef9a09226654bd28c58 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9cfe7f066614ef9a09226654bd28c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9cfe7f066614ef9a09226654bd28c58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9cfe7f066614ef9a09226654bd28c58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9cfe7f066614ef9a09226654bd28c58"}]}] Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a9cfe7f066614ef9a09226654bd28c58 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiskConfigTestJSON-1524318416-project Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: dde1c0b088674b45b74dff3367a491d1 Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiskConfigTestJSON-1524318416-project Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance cd576236-0c6a-450d-b591-7c33285df5a2 could not be found. Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'cd576236-0c6a-450d-b591-7c33285df5a2'} Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd576236-0c6a-450d-b591-7c33285df5a2 could not be found. Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd576236-0c6a-450d-b591-7c33285df5a2 could not be found. Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:46:10.503455 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd576236-0c6a-450d-b591-7c33285df5a2 could not be found. Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Returning 404 to user: Instance cd576236-0c6a-450d-b591-7c33285df5a2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc685ce9-92ef-4603-a6db-f4d9e11e2084 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2" status: 404 len: 111 microversion: 2.1 time: 0.033774 Jul 02 21:46:10.507345 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2963/5957] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:10 2022] GET /compute/v2.1/servers/cd576236-0c6a-450d-b591-7c33285df5a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:46:10.517719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-428d782a-af5d-48d3-b65c-d18daf59b4e3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '.version_select at 0x7fabe4040430>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:10.546199 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-428d782a-af5d-48d3-b65c-d18daf59b4e3 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513124166" status: 202 len: 0 microversion: 2.1 time: 0.035472 Jul 02 21:46:10.546766 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2995/5958] 10.222.0.43 () {58 vars in 1220 bytes} [Sat Jul 2 21:46:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513124166 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:46:11.224368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:11.224896 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:11.231128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:11.231572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:11.232370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:11.232796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:11.252324 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] HTTP exception thrown: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Request method failure captured: Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 HTTP/1.1 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLw_tgJmlpQMIfpKPYLae7t9qwy94bo7JGJiaPnPqRtsxFr_fGRsIoul9Vqn0yia8Mu8H4L7coxpbBySYJtyd_A8Vq1ObgNs5defKrAdJVlkVR3LdTNZsqjkZbL9c96lg95db3HuSNUkK2M6N7S0TgiJwqAYjIfsd0VunXLeLswzYuU Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: a9cfe7f066614ef9a09226654bd28c58 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9cfe7f066614ef9a09226654bd28c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9cfe7f066614ef9a09226654bd28c58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9cfe7f066614ef9a09226654bd28c58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9cfe7f066614ef9a09226654bd28c58"}]}] Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: a9cfe7f066614ef9a09226654bd28c58 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerDiskConfigTestJSON-1524318416-project Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: dde1c0b088674b45b74dff3367a491d1 Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerDiskConfigTestJSON-1524318416-project Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '9c3592f9-ab9e-46ee-b83f-7d9c93126c76'} Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:46:11.254719 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Returning 404 to user: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-656454cb-21ff-47bc-aaec-f8f0c29241a4 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 404 len: 111 microversion: 2.1 time: 0.035754 Jul 02 21:46:11.259074 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2964/5959] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:46:11 2022] DELETE /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:46:11.266303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:11.267043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] [instance: 9c3592f9-ab9e-46ee-b83f-7d9c93126c76] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:11.277634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:11.278164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:11.279100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:11.279672 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:11.296783 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] HTTP exception thrown: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Request method failure captured: Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 HTTP/1.1 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLw_tgJmlpQMIfpKPYLae7t9qwy94bo7JGJiaPnPqRtsxFr_fGRsIoul9Vqn0yia8Mu8H4L7coxpbBySYJtyd_A8Vq1ObgNs5defKrAdJVlkVR3LdTNZsqjkZbL9c96lg95db3HuSNUkK2M6N7S0TgiJwqAYjIfsd0VunXLeLswzYuU Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: a9cfe7f066614ef9a09226654bd28c58 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9cfe7f066614ef9a09226654bd28c58"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a9cfe7f066614ef9a09226654bd28c58", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a9cfe7f066614ef9a09226654bd28c58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a9cfe7f066614ef9a09226654bd28c58"}]}] Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: a9cfe7f066614ef9a09226654bd28c58 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1524318416 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerDiskConfigTestJSON-1524318416-project Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: dde1c0b088674b45b74dff3367a491d1 Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerDiskConfigTestJSON-1524318416-project Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9c3592f9-ab9e-46ee-b83f-7d9c93126c76'} Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:46:11.298462 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] Returning 404 to user: Instance 9c3592f9-ab9e-46ee-b83f-7d9c93126c76 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9daf0e3a-92f2-40cb-8d4d-f7b30a6b0cf8 tempest-ServerDiskConfigTestJSON-1524318416 tempest-ServerDiskConfigTestJSON-1524318416-project] 10.222.0.43 "GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76" status: 404 len: 111 microversion: 2.1 time: 0.038858 Jul 02 21:46:11.303395 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2996/5960] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:11 2022] GET /compute/v2.1/servers/9c3592f9-ab9e-46ee-b83f-7d9c93126c76 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:46:20.155982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0b569c60-0a8a-482d-b0bb-2d7bcd1467b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'create', calling method: .version_select at 0x7fabd7160e50>, body: {"keypair": {"name": "tempest-keypair-242631515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2Ovj21/Wse+c3u+E3be07+M/iK2GmFMynevoHui+X+iYv+z0wJLh6VGLS8jMw+RIsgdTwdHj9owzudJ6+riiXaldIMEo8kSOHcwSBLpmIbhxFEvoyjAm8/CSizB9HWdA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:20.172235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0b569c60-0a8a-482d-b0bb-2d7bcd1467b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for project 9b8a33f323614b27850f584b9600f12d. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:46:20.177902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0b569c60-0a8a-482d-b0bb-2d7bcd1467b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for user 9d9fe7d5b9094981a3ee9ab8456cc467 and project 9b8a33f323614b27850f584b9600f12d. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:46:20.209203 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0b569c60-0a8a-482d-b0bb-2d7bcd1467b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187603 Jul 02 21:46:20.210011 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2965/5961] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:46:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:46:21.555542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-42029009", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ec78456c-b341-4383-8e20-f5f1a92c4378"}], "security_groups": [{"name": "tempest-securitygroup--546487852"}], "key_name": "tempest-keypair-242631515", "user_data": "}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:21.562965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:21.564245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:21.693784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] validate_networks() for [('ec78456c-b341-4383-8e20-f5f1a92c4378', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:46:22.127801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:46:22.128551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:46:22.129098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:46:22.129574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:46:22.130057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:46:22.140911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:22.141464 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:22.142364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:22.142868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:22.160331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:46:22.167792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for user 9d9fe7d5b9094981a3ee9ab8456cc467 and project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:46:22.182184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:46:22.185039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:46:22.256707 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-928f22aa-3407-47c6-97d0-617e9ab00a64 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.705765 Jul 02 21:46:22.257396 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2997/5962] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:46:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:46:22.270138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93443e86-7c23-4e28-9dba-643b0b4ac0bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:22.274767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93443e86-7c23-4e28-9dba-643b0b4ac0bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:22.283930 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:22.355912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93443e86-7c23-4e28-9dba-643b0b4ac0bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:22.365366 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93443e86-7c23-4e28-9dba-643b0b4ac0bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1236 microversion: 2.1 time: 0.101467 Jul 02 21:46:22.367453 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2966/5963] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:22 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:23.385187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:23.385877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:23.392955 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:23.393418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:23.394274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:23.394782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:23.462316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:23.471537 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-77d7fe37-e6f6-4572-afc6-c41606781150 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1306 microversion: 2.1 time: 0.091585 Jul 02 21:46:23.472524 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2998/5964] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:23 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:24.489677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:24.490327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:24.498044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:24.498819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:24.499987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:24.500566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:24.659861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:24.668371 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d06d8cc0-7f4e-4665-92f6-1bb9ca45ad32 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.182968 Jul 02 21:46:24.669343 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2967/5965] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:24 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:24.807923 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9046000b-3a0b-478c-ac7e-cc6a1e1c40ae req-986951fb-d38c-432e-aa8a-2658f5e1c79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:24.832594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9046000b-3a0b-478c-ac7e-cc6a1e1c40ae req-986951fb-d38c-432e-aa8a-2658f5e1c79b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:24.835034 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9046000b-3a0b-478c-ac7e-cc6a1e1c40ae req-986951fb-d38c-432e-aa8a-2658f5e1c79b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:24.850538 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9046000b-3a0b-478c-ac7e-cc6a1e1c40ae req-986951fb-d38c-432e-aa8a-2658f5e1c79b service nova] Creating event network-changed:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch2-master-1 Jul 02 21:46:24.856236 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9046000b-3a0b-478c-ac7e-cc6a1e1c40ae req-986951fb-d38c-432e-aa8a-2658f5e1c79b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053013 Jul 02 21:46:24.857695 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 2999/5966] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:46:25.688629 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:25.689363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:25.698565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:25.699141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:25.700117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:25.700702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:25.838942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:25.847029 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7d3052ca-4d4a-4e3e-a112-faad8fb63c6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.163496 Jul 02 21:46:25.847651 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2968/5967] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:25 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:26.865234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:26.866131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:26.874059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:26.874522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:26.875346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:26.875736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:27.029893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:27.037790 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-45ae5640-a01f-40fa-92e8-f2d26f5a905d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.176985 Jul 02 21:46:27.038705 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3000/5968] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:26 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:28.058811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:28.059192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:28.066587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:28.066977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:28.067761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:28.068246 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:28.208723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:28.220499 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3bf17dab-bc2d-435b-be83-6362004858f8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.167650 Jul 02 21:46:28.221414 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2969/5969] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:28 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:29.242092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:29.243798 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:29.251984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:29.252484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:29.253276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:29.253721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:29.387226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:29.395098 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-613bf957-6f54-4cd4-b176-3b07203aab22 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.159734 Jul 02 21:46:29.395715 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3001/5970] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:29 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:30.411911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:30.412633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:30.421668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:30.422119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:30.422892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:30.423326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:30.565301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:30.576689 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-511fcd80-ff25-4578-8850-ca28bdb81cbc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.168980 Jul 02 21:46:30.578541 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2970/5971] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:30 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:31.446146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6132e7f4-d91f-4a15-8ad5-e5bb9de50891 req-27cda196-7ba5-4c01-80f7-b5b082de4832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "name": "network-vif-plugged", "status": "completed", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:31.455860 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6132e7f4-d91f-4a15-8ad5-e5bb9de50891 req-27cda196-7ba5-4c01-80f7-b5b082de4832 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:31.456397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6132e7f4-d91f-4a15-8ad5-e5bb9de50891 req-27cda196-7ba5-4c01-80f7-b5b082de4832 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:31.468972 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6132e7f4-d91f-4a15-8ad5-e5bb9de50891 req-27cda196-7ba5-4c01-80f7-b5b082de4832 service nova] Creating event network-vif-plugged:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch2-master-1 Jul 02 21:46:31.474200 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6132e7f4-d91f-4a15-8ad5-e5bb9de50891 req-27cda196-7ba5-4c01-80f7-b5b082de4832 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031892 Jul 02 21:46:31.474802 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3002/5972] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:46:31.593870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:31.594433 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:31.601616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:31.602062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:31.603031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:31.603500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:31.737309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:31.745249 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d168cf2c-2f8d-47fb-8944-99c46dc49e1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.155355 Jul 02 21:46:31.745851 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2971/5973] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:31 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:32.767175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:32.768584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:32.777590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:32.778745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:32.790958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:32.791658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:32.792850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:32.793270 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:32.926254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:32.934240 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8087db11-9106-4787-9579-fa4ee16139d9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1361 microversion: 2.1 time: 0.168818 Jul 02 21:46:32.934834 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3003/5974] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:32 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:33.954949 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:33.957719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:33.962584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:46:33.970077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:33.970526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:33.971306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:33.971738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:34.108578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:46:34.116684 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f96172c-145a-4b92-9ad5-342991530fd8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1548 microversion: 2.1 time: 0.168497 Jul 02 21:46:34.117256 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2972/5975] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:46:33 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1548 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:46:34.133224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:46:34.133755 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:46:34.141414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:34.141872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:34.142646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:34.143088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:34.231257 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7cf0c6a-7869-453a-9534-3532873bb244 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101944 Jul 02 21:46:34.231875 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3004/5976] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:46:34 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:46:35.288587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-65727ef9-68d1-4152-84bf-9811181609cd req-0113748a-0e70-4938-8e90-53e45364275f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:46:35.298200 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-65727ef9-68d1-4152-84bf-9811181609cd req-0113748a-0e70-4938-8e90-53e45364275f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:46:35.298646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-65727ef9-68d1-4152-84bf-9811181609cd req-0113748a-0e70-4938-8e90-53e45364275f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:46:35.309992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-65727ef9-68d1-4152-84bf-9811181609cd req-0113748a-0e70-4938-8e90-53e45364275f service nova] Creating event network-changed:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch2-master-1 Jul 02 21:46:35.315381 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-65727ef9-68d1-4152-84bf-9811181609cd req-0113748a-0e70-4938-8e90-53e45364275f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030442 Jul 02 21:46:35.315958 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2973/5977] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:11.457920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:11.458705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:11.464094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:11.464792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:11.473665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:11.474198 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:11.475122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:11.475658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:11.620588 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:11.632845 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-930997e6-5125-4b1f-9274-fb0dfac8a737 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1667 microversion: 2.1 time: 0.177029 Jul 02 21:47:11.633728 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3005/5978] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:11 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1667 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:11.652077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:11.652802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:11.655398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:11.656055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=38 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:11.662245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:11.662698 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:11.663473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:11.664310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:11.802114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:11.810079 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3d75162d-ca70-4c8a-b179-ee94ea66c174 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1667 microversion: 2.1 time: 0.162281 Jul 02 21:47:11.810668 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2974/5979] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:11 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:47:11.834583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:11.835341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:11.844091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:11.844561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:11.845366 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:11.845802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:11.991455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:11.999450 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-410032f2-3d0d-40ad-9def-375f86862945 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1667 microversion: 2.1 time: 0.171147 Jul 02 21:47:12.000022 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3006/5980] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:11 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1667 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:12.015655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:12.016682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:12.023042 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:12.023484 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:12.024416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:12.024853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:12.054428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:12.060585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Old instance type m1.heat2, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:47:12.067155 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:47:12.067578 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:47:12.068085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:47:12.068503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:47:12.068914 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:47:12.136257 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3973d6e0-6ef7-43e8-a128-10b775a8f21e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca/action" status: 202 len: 0 microversion: 2.1 time: 0.124502 Jul 02 21:47:12.137041 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2975/5981] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:47:12 2022] POST /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:47:12.145230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:12.145819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:12.151992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:12.152480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:12.153244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:12.153682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:12.284562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:12.292746 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9be28ce5-0e42-4596-bd47-79b348425b0d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1676 microversion: 2.1 time: 0.151427 Jul 02 21:47:12.293322 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3007/5982] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:12 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:13.315491 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:13.316129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:13.322915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:13.323379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:13.324196 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:13.324639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:13.528979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:13.536863 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1ea2cbc-06da-4255-aef6-79feb3437482 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1676 microversion: 2.1 time: 0.228877 Jul 02 21:47:13.537442 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2976/5983] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:13 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:14.558761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:14.559852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:14.571682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:14.572498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:14.573765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:14.574497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:14.779983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:14.788155 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cae944f-fb00-4901-850d-2afd47f5954f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.236075 Jul 02 21:47:14.789126 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3008/5984] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:14 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:15.811349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:15.812245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:15.819525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:15.819979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:15.820782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:15.821220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:15.961045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:15.969471 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9434e7cf-52aa-41a9-8e29-ad08452d5cb0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.165323 Jul 02 21:47:15.970060 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2977/5985] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:15 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:16.990434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:16.991308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:17.004292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:17.004754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:17.005533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:17.005979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:17.148543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:17.156679 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74240712-6e7c-4cae-8f5f-03573c059f8d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.173088 Jul 02 21:47:17.157253 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3009/5986] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:16 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:18.179015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:18.180106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:18.192193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:18.192954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:18.194240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:18.194983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:18.334857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:18.342795 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a731beda-8e01-4b15-8d2e-0af46de872b6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.170358 Jul 02 21:47:18.343305 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2978/5987] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:18 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:19.365452 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:19.366535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:19.377656 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:19.378114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:19.378894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:19.379339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:19.517351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:19.529619 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2f399f58-6656-4b29-b090-df0e28e2c4a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.170705 Jul 02 21:47:19.530552 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3010/5988] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:19 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:20.552860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:20.553874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:20.565740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:20.566496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:20.567772 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:20.568562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:20.715828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:20.724240 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3694f260-08a2-41bc-a128-2abcf7d5b746 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.178014 Jul 02 21:47:20.724824 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2979/5989] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:20 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:21.746062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:21.747146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:21.757013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:21.757469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:21.758241 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:21.758678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:21.894636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:21.902789 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6e26d29-f30e-4576-b22f-384e56462659 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.163437 Jul 02 21:47:21.903376 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3011/5990] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:21 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:22.920676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:22.921301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:22.929189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:22.929709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:22.930543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:22.930995 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:23.081681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:23.089824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-165efbf5-04b2-4200-8aa3-282ce27145f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.173075 Jul 02 21:47:23.090404 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2980/5991] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:22 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:24.109623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:24.110281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:24.117844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:24.118302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:24.119149 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:24.119758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:24.260701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:24.268581 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-549254be-c2bf-4128-b567-5f69bfaea5a3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.163211 Jul 02 21:47:24.269212 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3012/5992] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:24 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:25.289573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:25.290565 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:25.302362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:25.303109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:25.304444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:25.305203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:25.731088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:25.739375 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6283ee80-e3c9-4be6-9831-f3ad2b98e610 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.456932 Jul 02 21:47:25.739952 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2981/5993] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:25 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:26.761409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:26.762431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:26.774285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:26.775042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:26.776389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:26.777128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:26.912329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:26.920960 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-439a55b2-059e-4489-abad-12e7faf174fd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.166418 Jul 02 21:47:26.921544 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3013/5994] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:26 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:27.942635 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:27.943592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:27.957183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:27.957946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:27.958972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:27.959413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:28.433538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:28.441264 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dcd10d4f-ee0b-41da-9cab-dc7d6bc57d41 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.505308 Jul 02 21:47:28.441869 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2982/5995] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:27 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:29.461962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:29.462627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:29.471482 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:29.472008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:29.472950 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:29.473453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:29.623962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:29.633642 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93aa3ed1-ed72-4c15-9ecd-59e70df0efa0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.177045 Jul 02 21:47:29.634260 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3014/5996] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:29 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:30.658691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:30.659436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:30.668476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:30.668925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:30.669691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:30.670149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:30.803423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:30.811199 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4f3c6308-62c6-43b9-aaa5-3cf6679138b5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1681 microversion: 2.1 time: 0.157946 Jul 02 21:47:30.811862 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2983/5997] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:30 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:31.828890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:31.829723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:31.837437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:31.837963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:31.838749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:31.839190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:32.041349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:32.049409 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-19d981a4-3d0d-42cc-8650-14218c9b0d1a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1680 microversion: 2.1 time: 0.224663 Jul 02 21:47:32.054142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-894a7dc9-e249-42c7-b2eb-94db5d7b38f4 req-93a23e3f-d99e-4736-951c-965ccfdd5a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "name": "network-vif-unplugged", "status": "completed", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:32.059627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3015/5998] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:31 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:32.063685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-894a7dc9-e249-42c7-b2eb-94db5d7b38f4 req-93a23e3f-d99e-4736-951c-965ccfdd5a3b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:32.064219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-894a7dc9-e249-42c7-b2eb-94db5d7b38f4 req-93a23e3f-d99e-4736-951c-965ccfdd5a3b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:32.076911 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-894a7dc9-e249-42c7-b2eb-94db5d7b38f4 req-93a23e3f-d99e-4736-951c-965ccfdd5a3b service nova] Creating event network-vif-unplugged:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch1-master-1 Jul 02 21:47:32.082847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-894a7dc9-e249-42c7-b2eb-94db5d7b38f4 req-93a23e3f-d99e-4736-951c-965ccfdd5a3b service nova] Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:47:32.096363 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-894a7dc9-e249-42c7-b2eb-94db5d7b38f4 req-93a23e3f-d99e-4736-951c-965ccfdd5a3b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045834 Jul 02 21:47:32.097154 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2984/5999] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:33.070419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:33.070419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:33.079355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:33.079808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:33.080720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:33.081159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:33.225381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:33.233624 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e682d5d-4752-4d49-8705-f366d34d283b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1680 microversion: 2.1 time: 0.169461 Jul 02 21:47:33.234202 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3016/6000] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:33 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:34.113588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-63764ed0-b6cd-47b4-8be1-44a8d8956a72 req-88c9a599-39b4-4c4e-a5a2-5db715859fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:34.122104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63764ed0-b6cd-47b4-8be1-44a8d8956a72 req-88c9a599-39b4-4c4e-a5a2-5db715859fe6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:34.122540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-63764ed0-b6cd-47b4-8be1-44a8d8956a72 req-88c9a599-39b4-4c4e-a5a2-5db715859fe6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:34.134099 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-63764ed0-b6cd-47b4-8be1-44a8d8956a72 req-88c9a599-39b4-4c4e-a5a2-5db715859fe6 service nova] Creating event network-changed:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch1-master-1 Jul 02 21:47:34.139465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-63764ed0-b6cd-47b4-8be1-44a8d8956a72 req-88c9a599-39b4-4c4e-a5a2-5db715859fe6 service nova] Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:47:34.150183 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-63764ed0-b6cd-47b4-8be1-44a8d8956a72 req-88c9a599-39b4-4c4e-a5a2-5db715859fe6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041693 Jul 02 21:47:34.150746 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2985/6001] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:34.251148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:34.251777 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:34.259227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:34.259685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:34.260496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:34.260977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:34.398671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:34.406453 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-986d618f-2dbf-4ed0-a51b-027e0a5d5707 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1678 microversion: 2.1 time: 0.159389 Jul 02 21:47:34.407251 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3017/6002] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:34 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:35.429767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:35.430552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:35.438494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:35.439088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:35.439958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:35.440504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:35.581876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:35.590344 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a7b3ff06-e6a3-4ee3-aa12-4f4b0be8a969 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1678 microversion: 2.1 time: 0.168660 Jul 02 21:47:35.590943 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2986/6003] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:35 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:36.608328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:36.609062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:36.616390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:36.616824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:36.617597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:36.618054 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:36.843544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:36.853826 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96d32493-4828-4de2-bc43-80996c32bf81 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1675 microversion: 2.1 time: 0.249519 Jul 02 21:47:36.854432 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3018/6004] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:36 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:36.870750 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:36.871316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:36.878690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:36.879131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:36.879919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:36.880403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:36.944457 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3559d06c-31e8-4722-a442-2793aa43fcfc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca/action" status: 204 len: 0 microversion: 2.1 time: 0.077552 Jul 02 21:47:36.945086 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2987/6005] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:47:36 2022] POST /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:47:36.953522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:36.954587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:36.961184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:36.961544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:36.962547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:36.962965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:37.116187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:37.125465 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7bb97fb0-0ca0-4232-b554-b86c98cc3d94 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1675 microversion: 2.1 time: 0.175939 Jul 02 21:47:37.127881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3019/6006] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:36 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:38.144597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:38.145299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:38.152303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.152921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.153741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.154177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.299915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:38.302446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:38.309323 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a818b2ba-7c81-4c27-8b96-73426a21b6ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1667 microversion: 2.1 time: 0.169945 Jul 02 21:47:38.309943 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2988/6007] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:38 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:38.326943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:38.327564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:38.335360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.335818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.336704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.337151 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.474041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:38.482372 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e9492433-5fac-42c7-b109-7a937633eb8b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1667 microversion: 2.1 time: 0.159517 Jul 02 21:47:38.482962 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3020/6008] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:38 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:38.501431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:38.502046 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:38.509050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.509501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.510603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.511045 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.654096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:38.662213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bf8a0b36-d6d8-4f0e-b7f7-d7ed78a64bf5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1667 microversion: 2.1 time: 0.164447 Jul 02 21:47:38.662855 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2989/6009] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:38 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:38.679098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:38.679531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:38.685938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.686401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.687178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.692082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.711976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=100 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:38.720655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:47:38.805580 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48dc9eeb-1db7-4792-be81-bbdf102169b1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 204 len: 0 microversion: 2.1 time: 0.128910 Jul 02 21:47:38.806210 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3021/6010] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:47:38 2022] DELETE /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:47:38.815318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:38.815942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:38.822583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.823076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.823886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:38.824359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:38.960454 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:38.968720 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5ba5ce1e-62ea-4580-a1ac-8b6bbf123e3d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1673 microversion: 2.1 time: 0.157895 Jul 02 21:47:38.969298 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2990/6011] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:38 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:39.264324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-ef8e3000-b338-404a-b857-fb51c142040f req-b909ca89-e421-4ad9-bade-fbe6fd345f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "name": "network-vif-plugged", "status": "completed", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:39.275232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef8e3000-b338-404a-b857-fb51c142040f req-b909ca89-e421-4ad9-bade-fbe6fd345f30 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:39.275671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-ef8e3000-b338-404a-b857-fb51c142040f req-b909ca89-e421-4ad9-bade-fbe6fd345f30 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:39.287872 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-ef8e3000-b338-404a-b857-fb51c142040f req-b909ca89-e421-4ad9-bade-fbe6fd345f30 service nova] Creating event network-vif-plugged:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch1-master-1 Jul 02 21:47:39.293353 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-ef8e3000-b338-404a-b857-fb51c142040f req-b909ca89-e421-4ad9-bade-fbe6fd345f30 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033316 Jul 02 21:47:39.294147 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3022/6012] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:39.990001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:39.990989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:39.999111 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:39.999577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:40.000475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:40.000929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:40.148077 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:40.155988 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-27e611dd-ae37-420e-bb47-de701e7ba2f5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1673 microversion: 2.1 time: 0.172689 Jul 02 21:47:40.156587 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2991/6013] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:39 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:41.174852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:41.175693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:41.183842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:41.184448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:41.185283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:41.185775 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:41.279897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:41.287841 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-79dd2cd3-ab2f-4a28-81df-2b7b194be1af tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 200 len: 1606 microversion: 2.1 time: 0.117401 Jul 02 21:47:41.288843 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3023/6014] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:41 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 1606 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:41.357604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d26e68e7-09a8-4181-9f2c-fddd979e38b7 req-55cb6d36-3a55-4fc4-89bd-15c3b47586cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a08bb4fd-d582-41b4-a50a-fa65a943b1ca", "name": "network-vif-deleted", "tag": "121b5b6e-44e4-477d-aeea-6c3916d8f158"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:41.367407 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d26e68e7-09a8-4181-9f2c-fddd979e38b7 req-55cb6d36-3a55-4fc4-89bd-15c3b47586cd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:41.367861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d26e68e7-09a8-4181-9f2c-fddd979e38b7 req-55cb6d36-3a55-4fc4-89bd-15c3b47586cd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:41.379793 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d26e68e7-09a8-4181-9f2c-fddd979e38b7 req-55cb6d36-3a55-4fc4-89bd-15c3b47586cd service nova] Creating event network-vif-deleted:121b5b6e-44e4-477d-aeea-6c3916d8f158 for instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca on nch1-master-1 Jul 02 21:47:41.385494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d26e68e7-09a8-4181-9f2c-fddd979e38b7 req-55cb6d36-3a55-4fc4-89bd-15c3b47586cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Jul 02 21:47:41.386339 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2992/6015] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:42.306534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:42.307099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:42.310302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:42.316011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:42.316491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:42.317267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:42.317700 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:42.333065 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca HTTP/1.1 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a08bb4fd-d582-41b4-a50a-fa65a943b1ca'} Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:47:42.334751 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-09e1f3c9-6f29-4f7e-80c7-45c6a042a11d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 404 len: 111 microversion: 2.1 time: 0.033720 Jul 02 21:47:42.338582 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3024/6016] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:42 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:47:42.349880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:42.350721 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:42.353225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=43 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:42.359305 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:42.359941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:42.360581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:42.361025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:42.374810 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca HTTP/1.1 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a08bb4fd-d582-41b4-a50a-fa65a943b1ca'} Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:47:42.376532 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ef9d5f09-b726-4585-a417-0b47db735d53 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 404 len: 111 microversion: 2.1 time: 0.032409 Jul 02 21:47:42.380851 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2993/6017] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:42 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:47:42.429138 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1150116795", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ec78456c-b341-4383-8e20-f5f1a92c4378"}], "security_groups": [{"name": "tempest-securitygroup--546487852"}], "key_name": "tempest-keypair-242631515", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:42.536201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] validate_networks() for [('ec78456c-b341-4383-8e20-f5f1a92c4378', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:47:42.917382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:47:42.917808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:47:42.918282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:47:42.918687 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:47:42.919118 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:47:42.929191 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:42.929747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:42.930575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:42.931023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:42.948738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:47:42.954286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for user 9d9fe7d5b9094981a3ee9ab8456cc467 and project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:47:42.967419 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:47:42.969812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:47:43.025535 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f377a360-0d5b-47da-bcce-98b3f7953627 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.600453 Jul 02 21:47:43.026161 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3025/6018] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:47:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:47:43.036567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78269aeb-6bef-4320-9b89-60e892208b61 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:43.037194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78269aeb-6bef-4320-9b89-60e892208b61 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:43.093583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-78269aeb-6bef-4320-9b89-60e892208b61 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:43.100866 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78269aeb-6bef-4320-9b89-60e892208b61 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1238 microversion: 2.1 time: 0.068257 Jul 02 21:47:43.101576 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2994/6019] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:43 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:44.119996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:44.120947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:44.130701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:44.131513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:44.131919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:44.132392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:44.214103 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:44.221770 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1ea7705e-987b-4b2c-9898-c290d23e60fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1308 microversion: 2.1 time: 0.107240 Jul 02 21:47:44.222327 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3026/6020] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:44 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:45.239184 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:45.239751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:45.248168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:45.248738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:45.249551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:45.250001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:45.467104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:45.475508 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9077aa4b-e3b2-497f-ab9e-e6f1a4cf11bf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.240489 Jul 02 21:47:45.476106 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2995/6021] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:45 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:45.553416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9910e5a5-043d-455a-81ba-26538df1af76 req-133ba38a-1118-4724-8d1f-e6b508475c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:45.570965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9910e5a5-043d-455a-81ba-26538df1af76 req-133ba38a-1118-4724-8d1f-e6b508475c26 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:45.571416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9910e5a5-043d-455a-81ba-26538df1af76 req-133ba38a-1118-4724-8d1f-e6b508475c26 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:45.598859 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9910e5a5-043d-455a-81ba-26538df1af76 req-133ba38a-1118-4724-8d1f-e6b508475c26 service nova] Creating event network-changed:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch1-master-1 Jul 02 21:47:45.604471 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9910e5a5-043d-455a-81ba-26538df1af76 req-133ba38a-1118-4724-8d1f-e6b508475c26 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056861 Jul 02 21:47:45.605092 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3027/6022] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:46.493868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:46.494471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:46.502089 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:46.502555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:46.503345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:46.503792 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:46.645057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:46.653473 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-891153ff-4133-48ae-b16e-96f568dc5cf3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.163953 Jul 02 21:47:46.654078 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2996/6023] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:46 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:47.672066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:47.672785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:47.679688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:47.680161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:47.680919 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:47.681350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:47.825542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:47.833761 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b754630f-753e-4b8d-a5b4-eb16f642d4ba tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.166057 Jul 02 21:47:47.834340 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3028/6024] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:47 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:48.850945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:48.851570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:48.858976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:48.859441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:48.860264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:48.860685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:48.997477 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:49.005746 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d67e323d-3855-431d-a30a-414268d416ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.158849 Jul 02 21:47:49.006331 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2997/6025] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:48 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:50.027558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:50.028508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:50.040079 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:50.040536 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:50.041298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:50.041734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:50.187081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:50.198683 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d4975b02-81b1-49f8-8739-a2a3ed845af1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.178078 Jul 02 21:47:50.199449 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3029/6026] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:50 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:51.221171 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:51.221860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:51.229142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:51.229599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:51.230467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:51.230906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:51.332425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-555e9280-ebb9-4c75-800e-2adcccac96da req-3917528d-9c6d-4a58-aba4-1d57bb5b8cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "name": "network-vif-plugged", "status": "completed", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:51.343104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-555e9280-ebb9-4c75-800e-2adcccac96da req-3917528d-9c6d-4a58-aba4-1d57bb5b8cf5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:51.343744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-555e9280-ebb9-4c75-800e-2adcccac96da req-3917528d-9c6d-4a58-aba4-1d57bb5b8cf5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:51.356515 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-555e9280-ebb9-4c75-800e-2adcccac96da req-3917528d-9c6d-4a58-aba4-1d57bb5b8cf5 service nova] Creating event network-vif-plugged:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch1-master-1 Jul 02 21:47:51.362579 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-555e9280-ebb9-4c75-800e-2adcccac96da req-3917528d-9c6d-4a58-aba4-1d57bb5b8cf5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Jul 02 21:47:51.363897 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3030/6027] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:47:51.371817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:51.379603 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8177ba0-8daa-4b64-8caf-f7a13bbd975d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.162385 Jul 02 21:47:51.380195 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2998/6028] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:51 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:52.403636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:52.405331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:52.415348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:52.415787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:52.416618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:52.417172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:52.550057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:52.558371 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9221e571-9dc3-4274-8222-192bef289318 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1363 microversion: 2.1 time: 0.163287 Jul 02 21:47:52.558950 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3031/6029] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:52 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:53.578339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:53.579154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:53.582541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:53.589438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:53.590018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:53.590986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:53.591544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:53.726408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:47:53.734480 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-00c4bfcf-d61f-4941-bb8d-bdf523273492 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1550 microversion: 2.1 time: 0.161303 Jul 02 21:47:53.735033 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 2999/6030] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:47:53 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:47:53.751462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:47:53.752010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:47:53.753994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:53.754646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:47:53.761934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:53.762382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:53.763175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:53.763611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:53.859022 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0eb14f3-9a55-48e3-b8da-16e6057842c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111546 Jul 02 21:47:53.859907 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3032/6031] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:47:53 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:47:55.369928 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f56ec5c3-5ad4-4de7-8860-95b4bd21716e req-2690a9a9-de44-45e7-a3b3-fda26c70de1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:47:55.379789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f56ec5c3-5ad4-4de7-8860-95b4bd21716e req-2690a9a9-de44-45e7-a3b3-fda26c70de1e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:47:55.380387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f56ec5c3-5ad4-4de7-8860-95b4bd21716e req-2690a9a9-de44-45e7-a3b3-fda26c70de1e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:47:55.392630 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f56ec5c3-5ad4-4de7-8860-95b4bd21716e req-2690a9a9-de44-45e7-a3b3-fda26c70de1e service nova] Creating event network-changed:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch1-master-1 Jul 02 21:47:55.398261 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f56ec5c3-5ad4-4de7-8860-95b4bd21716e req-2690a9a9-de44-45e7-a3b3-fda26c70de1e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119188 Jul 02 21:47:55.398877 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3000/6032] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:49:06.196088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:06.197107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:06.202461 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce3a20d6-aa51-4e06-8989-f687d6983954 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:06.210497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce3a20d6-aa51-4e06-8989-f687d6983954 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:06.210940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ce3a20d6-aa51-4e06-8989-f687d6983954 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:06.234171 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ce3a20d6-aa51-4e06-8989-f687d6983954 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Going to try to stop instance {{(pid=131044) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 21:49:06.281025 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce3a20d6-aa51-4e06-8989-f687d6983954 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action" status: 202 len: 0 microversion: 2.1 time: 0.087739 Jul 02 21:49:06.281628 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3033/6033] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:49:06 2022] POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:49:06.288924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=17 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:06.290092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=55 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:06.294848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:06.295634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:06.303362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:06.303818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:06.304621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:06.305058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:06.453158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:06.461075 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d9730ccb-4572-45df-a63b-dcbc497a08b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.174817 Jul 02 21:49:06.461652 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3001/6034] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:06 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:49:07.485274 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:07.486440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:07.497371 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:07.498141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:07.499522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:07.499970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:07.636575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:07.644963 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29bfe841-a4a6-4bbf-90b5-d1c522432443 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.168530 Jul 02 21:49:07.645547 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3034/6035] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:07 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:08.667658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:08.668789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:08.681921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:08.682694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:08.683983 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:08.684788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:08.822789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:08.834489 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2ab92f7c-83e9-4071-8988-35649798d9ce tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.174056 Jul 02 21:49:08.835285 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3002/6036] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:08 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:09.857743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:09.858873 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:09.866407 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:09.866867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:09.867647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:09.868096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:10.028940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:10.037176 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9f01783d-5aad-484e-af8d-dcf0d854bfbd tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.186786 Jul 02 21:49:10.037730 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3035/6037] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:09 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:10.641713 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:49:10.642624 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:49:10.804961 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:49:10.805350 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:49:11.055193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:11.055761 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:11.063201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:11.063739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:11.064553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:11.064993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:11.198778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:11.206659 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c79951a3-8a4d-425f-9eaa-e85b8d98bdac tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.155608 Jul 02 21:49:11.207251 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3003/6038] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:11 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:12.228354 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:12.229367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:12.238376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:12.238831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:12.239590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:12.240030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:12.376470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:12.387578 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-020c5743-1f07-4645-a0ca-7458b84c2d16 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.165614 Jul 02 21:49:12.388486 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3036/6039] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:12 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:13.405831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:13.406409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:13.414360 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:13.414821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:13.416141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:13.416596 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:13.557699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:13.569374 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d82516de-67c8-45df-aee2-10e21f7b48cc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.167926 Jul 02 21:49:13.570205 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3004/6040] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:13 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:14.590854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:14.591640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:14.602679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:14.603305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:14.604533 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:14.605180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:14.741331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:14.749456 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9b15c5e4-5dbe-48ac-924b-3ddad197e6e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.163253 Jul 02 21:49:14.749999 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3037/6041] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:14 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:15.771098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:15.772411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:15.782518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:15.782986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:15.783780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:15.784273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:15.921189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:15.929000 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75e7732d-3262-4aa6-ae42-de6c4d275c28 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.164657 Jul 02 21:49:15.929547 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3005/6042] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:15 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:16.950098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:16.950853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:16.959899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:16.960543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:16.961560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:16.962141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:17.100156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:17.109079 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a66cadc0-6166-4a46-ad46-999161a8a628 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1656 microversion: 2.1 time: 0.164304 Jul 02 21:49:17.109691 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3038/6043] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:16 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:17.125944 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:17.126968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:17.134308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:17.134770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:17.135548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:17.135997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:17.164389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:17.170550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Old instance type m1.heat2, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:49:17.176841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:49:17.177268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:49:17.177751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:49:17.178164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:49:17.178566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:49:17.243893 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd9ae500-c9ef-4f94-94b1-5307b569cc65 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action" status: 202 len: 0 microversion: 2.1 time: 0.122030 Jul 02 21:49:17.244640 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3006/6044] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:49:17 2022] POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:49:17.253528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:17.254238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:17.260959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:17.261491 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:17.262316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:17.262762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:17.415094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:17.423289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-de489985-47c8-4560-82a7-a912106b6abe tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.174099 Jul 02 21:49:17.423878 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3039/6045] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:17 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:18.441759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:18.442389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:18.449121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:18.449584 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:18.450364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:18.450812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:18.591488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:18.599955 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cc8a90cb-ac89-4c1c-84bc-f9a603f44131 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.163154 Jul 02 21:49:18.600512 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3007/6046] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:18 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:19.618484 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:19.619165 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:19.629487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:19.630017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:19.630856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:19.631335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:19.774415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:19.784715 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a6c1ea1-0124-43ac-aec2-8fdacacabd72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1679 microversion: 2.1 time: 0.170241 Jul 02 21:49:19.785306 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3040/6047] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:19 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:20.807070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:20.808838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:20.821555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:20.822021 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:20.822822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:20.823267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:20.966353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:20.975108 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1d1de75e-7c25-47b7-a8d3-c1a47ade57a7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1684 microversion: 2.1 time: 0.174912 Jul 02 21:49:20.975702 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3008/6048] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:20 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:21.993621 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:21.994238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:22.001290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:22.001744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:22.002507 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:22.003115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:22.156391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:22.166639 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c6f1e687-2e79-4929-a3e4-7e47761828e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1683 microversion: 2.1 time: 0.176854 Jul 02 21:49:22.167332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3041/6049] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:21 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:22.424968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c7a906f9-fb3d-46b8-a6e3-3f194221cb50 req-666bc510-8cf8-4ee2-8980-efd6fd60891d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "name": "network-vif-unplugged", "status": "completed", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:22.435106 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c7a906f9-fb3d-46b8-a6e3-3f194221cb50 req-666bc510-8cf8-4ee2-8980-efd6fd60891d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:22.435688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c7a906f9-fb3d-46b8-a6e3-3f194221cb50 req-666bc510-8cf8-4ee2-8980-efd6fd60891d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:22.452217 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c7a906f9-fb3d-46b8-a6e3-3f194221cb50 req-666bc510-8cf8-4ee2-8980-efd6fd60891d service nova] Creating event network-vif-unplugged:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch2-master-1 Jul 02 21:49:22.457706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-c7a906f9-fb3d-46b8-a6e3-3f194221cb50 req-666bc510-8cf8-4ee2-8980-efd6fd60891d service nova] Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:49:22.468962 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c7a906f9-fb3d-46b8-a6e3-3f194221cb50 req-666bc510-8cf8-4ee2-8980-efd6fd60891d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048011 Jul 02 21:49:22.470296 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3009/6050] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:49:23.189105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:23.189932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:23.199549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:23.200334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:23.201219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:23.201670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:23.336598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:23.344816 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-98fef3c5-2991-458d-965f-e4613810a009 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1683 microversion: 2.1 time: 0.162833 Jul 02 21:49:23.345096 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3042/6051] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:23 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:24.369793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:24.371313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:24.379489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:24.379946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:24.380753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:24.381195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:24.487510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d254cdd6-1dc1-45f4-bc60-df4f6255c13b req-727dad74-25ff-4d5c-b04b-73e98d085589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:24.497394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d254cdd6-1dc1-45f4-bc60-df4f6255c13b req-727dad74-25ff-4d5c-b04b-73e98d085589 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:24.497828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d254cdd6-1dc1-45f4-bc60-df4f6255c13b req-727dad74-25ff-4d5c-b04b-73e98d085589 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:24.510348 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d254cdd6-1dc1-45f4-bc60-df4f6255c13b req-727dad74-25ff-4d5c-b04b-73e98d085589 service nova] Creating event network-changed:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch2-master-1 Jul 02 21:49:24.516495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-d254cdd6-1dc1-45f4-bc60-df4f6255c13b req-727dad74-25ff-4d5c-b04b-73e98d085589 service nova] Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:49:24.523695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:24.527520 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d254cdd6-1dc1-45f4-bc60-df4f6255c13b req-727dad74-25ff-4d5c-b04b-73e98d085589 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044041 Jul 02 21:49:24.528198 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3043/6052] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:49:24.532603 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5a4aa113-5a40-405c-88ad-31fc1ef67fc7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1681 microversion: 2.1 time: 0.172714 Jul 02 21:49:24.533211 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3010/6053] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:24 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:25.555152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:25.555888 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:25.566125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:25.566868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:25.568112 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:25.568891 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:25.715986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:25.724017 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ffd4084f-89f4-446a-b698-f8f383b4c8e6 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1677 microversion: 2.1 time: 0.174125 Jul 02 21:49:25.724558 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3044/6054] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:25 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:25.740906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:25.741473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:25.748929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:25.749390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:25.750148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:25.750587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:25.813139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4239792a-89e8-4879-8539-c4f45328a268 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action" status: 204 len: 0 microversion: 2.1 time: 0.076066 Jul 02 21:49:25.813788 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3011/6055] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:49:25 2022] POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:49:25.823097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:25.823734 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:25.830115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:25.830597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:25.831428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:25.831909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:26.081887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:26.090386 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-438edcdb-9fa2-489e-8341-9a930693bc67 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1677 microversion: 2.1 time: 0.272191 Jul 02 21:49:26.090951 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3045/6056] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:25 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1677 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:27.109932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:27.110805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:27.117538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:27.118002 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:27.119000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:27.119444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:27.258804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:27.266996 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-46f623ea-0a7f-40ab-ab3a-40467eb96645 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1677 microversion: 2.1 time: 0.162552 Jul 02 21:49:27.267595 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3012/6057] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:27 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:49:28.285296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:28.286115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:28.293668 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.294209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.295045 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.295485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.394351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-db6a9457-2b21-4cc5-8245-e3f2f8fb2d18 req-959de26c-03a4-4ead-b677-6e9c8f529e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "name": "network-vif-plugged", "status": "completed", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:28.402718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-db6a9457-2b21-4cc5-8245-e3f2f8fb2d18 req-959de26c-03a4-4ead-b677-6e9c8f529e9f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.403168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-db6a9457-2b21-4cc5-8245-e3f2f8fb2d18 req-959de26c-03a4-4ead-b677-6e9c8f529e9f service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.414907 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-db6a9457-2b21-4cc5-8245-e3f2f8fb2d18 req-959de26c-03a4-4ead-b677-6e9c8f529e9f service nova] Creating event network-vif-plugged:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch2-master-1 Jul 02 21:49:28.420412 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-db6a9457-2b21-4cc5-8245-e3f2f8fb2d18 req-959de26c-03a4-4ead-b677-6e9c8f529e9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103083 Jul 02 21:49:28.421021 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3013/6058] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:49:28.437669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:28.445486 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9ec3aa13-9f3b-4f6a-97a4-9b2318d4f62f tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1656 microversion: 2.1 time: 0.164523 Jul 02 21:49:28.446077 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3046/6059] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:28 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:28.462672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:28.463389 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:28.470050 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.470511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.471288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.471733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.635884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:28.645399 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e868302c-39f9-4a7e-8815-8405bd5b73b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1656 microversion: 2.1 time: 0.186983 Jul 02 21:49:28.645981 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3014/6060] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:28 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1656 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:28.663597 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5ae865cc-ac19-43db-8e94-8a18b56686a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:28.670567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ae865cc-ac19-43db-8e94-8a18b56686a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.671294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5ae865cc-ac19-43db-8e94-8a18b56686a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.694685 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5ae865cc-ac19-43db-8e94-8a18b56686a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Going to try to start instance {{(pid=131044) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 21:49:28.730893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:28.741812 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5ae865cc-ac19-43db-8e94-8a18b56686a1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action" status: 202 len: 0 microversion: 2.1 time: 0.083606 Jul 02 21:49:28.742430 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3047/6061] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:49:28 2022] POST /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:49:28.752592 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:28.753213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:28.759552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.760144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.761084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:28.761521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:28.896459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:28.904206 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-900e196e-6bb9-4891-874c-db7dacfa9a77 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1665 microversion: 2.1 time: 0.155468 Jul 02 21:49:28.904786 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3015/6062] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:28 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:29.923545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:29.924291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:29.932837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:29.933294 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:29.934085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:29.934529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:30.072683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:30.080819 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-29833bef-fe2a-49c6-afe8-da00af920be0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1669 microversion: 2.1 time: 0.162242 Jul 02 21:49:30.081413 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3048/6063] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:29 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:30.097639 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:30.098157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:30.105359 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:30.105807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:30.106582 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:30.107020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:30.109807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:30.140309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:49:30.221620 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-23ff55ee-a73f-4f81-91f1-8583a3cd34fc tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 204 len: 0 microversion: 2.1 time: 0.127317 Jul 02 21:49:30.222265 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3016/6064] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:49:30 2022] DELETE /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:49:30.233795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:30.234618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:30.241129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:30.241581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:30.242346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:30.242783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:30.373166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:30.382105 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5f5757c7-e7d1-4091-aaef-025262ba98b4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1675 microversion: 2.1 time: 0.154083 Jul 02 21:49:30.382652 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3049/6065] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:30 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:31.402535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:31.403230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:31.412104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:31.412594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:31.413381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:31.413830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:31.556012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:31.564266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b4c3b7fa-1314-4bd5-a663-3db3e97cf867 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1675 microversion: 2.1 time: 0.167243 Jul 02 21:49:31.564892 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3017/6066] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:31 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:32.581751 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:32.582458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:32.589989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:32.590560 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:32.591358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:32.591806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:32.660108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:32.668673 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0f2da93-e384-4eee-9e30-bc4a63239663 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 200 len: 1608 microversion: 2.1 time: 0.091185 Jul 02 21:49:32.669483 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3050/6067] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:32 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 1608 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:49:32.887350 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c4e1a648-8dee-4ce3-87f5-30d2fffbf789 req-7753f233-2b92-437e-accf-0195db244f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d870cc8b-68d5-482c-98e0-6c44d2206fc6", "name": "network-vif-deleted", "tag": "dd68e1f0-d2c6-4ea3-865e-b45b5ee07048"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:32.899828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c4e1a648-8dee-4ce3-87f5-30d2fffbf789 req-7753f233-2b92-437e-accf-0195db244f75 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:32.900302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c4e1a648-8dee-4ce3-87f5-30d2fffbf789 req-7753f233-2b92-437e-accf-0195db244f75 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:32.914067 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c4e1a648-8dee-4ce3-87f5-30d2fffbf789 req-7753f233-2b92-437e-accf-0195db244f75 service nova] Creating event network-vif-deleted:dd68e1f0-d2c6-4ea3-865e-b45b5ee07048 for instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 on nch2-master-1 Jul 02 21:49:32.920469 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c4e1a648-8dee-4ce3-87f5-30d2fffbf789 req-7753f233-2b92-437e-accf-0195db244f75 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037525 Jul 02 21:49:32.921774 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3018/6068] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:49:33.686434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:33.687043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:33.694581 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:33.695026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:33.695784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:33.696303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:33.710529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 HTTP/1.1 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'd870cc8b-68d5-482c-98e0-6c44d2206fc6'} Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:49:33.712381 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-14db722a-15fe-4c6c-a834-94726cd636fb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 404 len: 111 microversion: 2.1 time: 0.031388 Jul 02 21:49:33.716257 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3051/6069] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:33 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:49:33.730615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:33.731589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:33.739778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:33.740379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:33.741275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:33.741796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:33.757151 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 HTTP/1.1 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd870cc8b-68d5-482c-98e0-6c44d2206fc6'} Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:49:33.758894 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aa9cd5da-a15d-46db-bb1e-e32ea2dc35ed tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 404 len: 111 microversion: 2.1 time: 0.034786 Jul 02 21:49:33.762570 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3019/6070] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:33 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:49:33.809709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-677745135", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ec78456c-b341-4383-8e20-f5f1a92c4378"}], "security_groups": [{"name": "tempest-securitygroup--546487852"}], "key_name": "tempest-keypair-242631515", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:33.914584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] validate_networks() for [('ec78456c-b341-4383-8e20-f5f1a92c4378', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:49:34.345688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:49:34.346046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:49:34.346528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:49:34.346937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:49:34.347373 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:49:34.357829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:34.358305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:34.359100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:34.359637 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:34.377829 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:49:34.383279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for user 9d9fe7d5b9094981a3ee9ab8456cc467 and project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:49:34.395704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:49:34.398073 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:49:34.444558 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-241bc4a1-07a0-4500-95ba-abdeb2be37d7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.638794 Jul 02 21:49:34.445193 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3052/6071] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:49:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:49:34.455374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dea4c0bc-2d4c-4549-9e22-1061a209c139 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:34.455991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dea4c0bc-2d4c-4549-9e22-1061a209c139 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:34.511475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dea4c0bc-2d4c-4549-9e22-1061a209c139 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:34.519573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dea4c0bc-2d4c-4549-9e22-1061a209c139 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1237 microversion: 2.1 time: 0.068122 Jul 02 21:49:34.520140 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3020/6072] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:34 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:35.538575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:35.539830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:35.547037 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:35.547467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:35.548576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:35.549009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:35.618779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:35.627074 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2e48ad3c-fb42-4a20-be3f-1eecbbcb397c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1297 microversion: 2.1 time: 0.093835 Jul 02 21:49:35.635783 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3053/6073] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:35 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:36.646960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:36.647763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:36.650862 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:36.658543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:36.659007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:36.659809 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:36.660345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:36.893655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:36.901914 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c7814243-e688-4f57-bfee-5503766ff409 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.259266 Jul 02 21:49:36.902501 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3021/6074] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:36 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:37.486480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fb6569ca-4d68-4ee8-afd5-492c78641d3f req-61b4eac0-d800-4aab-9659-54c14356254e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:37.490360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:37.502513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fb6569ca-4d68-4ee8-afd5-492c78641d3f req-61b4eac0-d800-4aab-9659-54c14356254e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:37.503145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fb6569ca-4d68-4ee8-afd5-492c78641d3f req-61b4eac0-d800-4aab-9659-54c14356254e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:37.522348 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fb6569ca-4d68-4ee8-afd5-492c78641d3f req-61b4eac0-d800-4aab-9659-54c14356254e service nova] Creating event network-changed:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:49:37.527468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fb6569ca-4d68-4ee8-afd5-492c78641d3f req-61b4eac0-d800-4aab-9659-54c14356254e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126880 Jul 02 21:49:37.528109 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3054/6075] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:49:37.920330 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:37.920943 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:37.928365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:37.928817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:37.929602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:37.930039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:38.067693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:38.078444 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7edee5f2-0b52-42fb-a761-9f9d6359ea72 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.162196 Jul 02 21:49:38.079360 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3022/6076] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:37 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:39.106752 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:39.107913 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:39.115692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:39.116189 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:39.116959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:39.117401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:39.255569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:39.263713 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e6da85be-02bb-4931-8532-d2c787fb9f03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.165827 Jul 02 21:49:39.264328 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3055/6077] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:39 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:40.280891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:40.281495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:40.289637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:40.290072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:40.290900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:40.291375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:40.510280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:40.520499 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-321898dc-9dae-4c5c-9a30-7efb6abdf9ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.243643 Jul 02 21:49:40.521078 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3023/6078] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:40 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:41.541421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:41.542193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:41.551470 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:41.551926 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:41.552739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:41.553176 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:41.701300 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:41.708883 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53f6b22a-3524-478b-9a91-22e8fd2a0c7d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.173394 Jul 02 21:49:41.709462 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3056/6079] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:41 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:42.728766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:42.729453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:42.739210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:42.739663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:42.740441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:42.740912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:42.889471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:42.897701 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e8b5703c-7ec6-412b-9f24-bd450031c218 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.174340 Jul 02 21:49:42.898281 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3024/6080] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:42 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:43.862096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1694e1b6-7cea-41c7-a7ed-9e4748e37f5f req-2a7ef525-05bd-4d6c-b06a-f523780c3258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "name": "network-vif-plugged", "status": "completed", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:43.871594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1694e1b6-7cea-41c7-a7ed-9e4748e37f5f req-2a7ef525-05bd-4d6c-b06a-f523780c3258 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:43.872064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1694e1b6-7cea-41c7-a7ed-9e4748e37f5f req-2a7ef525-05bd-4d6c-b06a-f523780c3258 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:43.883941 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1694e1b6-7cea-41c7-a7ed-9e4748e37f5f req-2a7ef525-05bd-4d6c-b06a-f523780c3258 service nova] Creating event network-vif-plugged:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:49:43.889097 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1694e1b6-7cea-41c7-a7ed-9e4748e37f5f req-2a7ef525-05bd-4d6c-b06a-f523780c3258 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030904 Jul 02 21:49:43.889883 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3057/6081] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:49:43.915920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:43.916603 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:43.926298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:43.926774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:43.927568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:43.928011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:44.124500 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:44.132745 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-414c6ec6-144a-4c30-ae6d-cb328f11febf tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.221323 Jul 02 21:49:44.133328 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3025/6082] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:43 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:45.153251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:45.154328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:45.162483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:45.163494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:45.173717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:45.174360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:45.175558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:45.175995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:45.323325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:45.331456 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f6df9657-6fe0-4fda-a1a1-1a21d932f95c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1362 microversion: 2.1 time: 0.179937 Jul 02 21:49:45.332052 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3058/6083] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:45 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:46.351863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:46.352512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:46.354941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:49:46.360932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:46.361393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:46.362168 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:46.362610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:46.496452 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:49:46.504255 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3c874338-c9fe-48ee-84a3-6f08638ad384 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1549 microversion: 2.1 time: 0.158097 Jul 02 21:49:46.504841 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3026/6084] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:49:46 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:49:46.521618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:49:46.522134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:49:46.528851 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:46.529316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:46.530086 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:46.530529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:46.609963 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-dfe482a4-d95f-4291-9351-9c409e21da03 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092396 Jul 02 21:49:46.610581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3059/6085] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:49:46 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:49:47.593094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-458ba46d-3ab9-4bcd-bf10-683f0efbfdd6 req-9a3914c5-8c3b-4cf0-827f-be37e9d64113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:49:47.602445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-458ba46d-3ab9-4bcd-bf10-683f0efbfdd6 req-9a3914c5-8c3b-4cf0-827f-be37e9d64113 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:49:47.602916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-458ba46d-3ab9-4bcd-bf10-683f0efbfdd6 req-9a3914c5-8c3b-4cf0-827f-be37e9d64113 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:49:47.614619 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-458ba46d-3ab9-4bcd-bf10-683f0efbfdd6 req-9a3914c5-8c3b-4cf0-827f-be37e9d64113 service nova] Creating event network-changed:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:49:47.619932 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-458ba46d-3ab9-4bcd-bf10-683f0efbfdd6 req-9a3914c5-8c3b-4cf0-827f-be37e9d64113 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Jul 02 21:49:47.620534 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3027/6086] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:50:58.224087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=11 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:50:58.225039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=54 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:50:58.230478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:50:58.231671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:50:58.240306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:50:58.240892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:50:58.241841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:50:58.242387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:50:58.272187 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:50:58.278173 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Old instance type m1.heat2, new instance type m1.heat {{(pid=131044) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 21:50:58.285085 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:50:58.285511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:50:58.285984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:50:58.286394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:50:58.286811 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:50:58.354479 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-102666cd-7ae6-4978-940d-b7ecffb8e990 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13/action" status: 202 len: 0 microversion: 2.1 time: 0.133195 Jul 02 21:50:58.355039 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3060/6087] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:50:58 2022] POST /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:50:58.361946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=13 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:50:58.362723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:50:58.367938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:50:58.368699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:50:58.376818 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:50:58.377729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:50:58.378832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:50:58.379451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:50:58.518680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:50:58.527356 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9defb49f-ead9-4bc9-bc26-fae23e97ce98 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1677 microversion: 2.1 time: 0.167588 Jul 02 21:50:58.527993 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3028/6088] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:50:58 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:50:59.549935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:50:59.550519 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:50:59.562549 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:50:59.563019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:50:59.563872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:50:59.564368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:50:59.703157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:50:59.712174 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-976072c2-f9b6-44c5-a8a1-738f0cc9f753 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1677 microversion: 2.1 time: 0.168909 Jul 02 21:50:59.713177 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3061/6089] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:50:59 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:00.734116 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:00.735182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:00.747339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:00.748129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:00.749417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:00.750145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:00.906343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:00.914996 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-05e855ab-4d31-49df-b305-9c2b0e3e17d5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.187767 Jul 02 21:51:00.915574 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3029/6090] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:00 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:01.936219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:01.937212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:01.949659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:01.950421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:01.951714 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:01.952497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:02.092228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:02.102593 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eb1721c2-c26d-4b00-af12-3f3af39cc570 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.172847 Jul 02 21:51:02.103295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3062/6091] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:01 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:03.120572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:03.121209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:03.128677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:03.129160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:03.129934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:03.130378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:03.269760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:03.277708 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e57d4654-0bc6-44d8-9cde-fde4097c689e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.161783 Jul 02 21:51:03.278288 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3030/6092] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:03 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:04.299351 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:04.300209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:04.309815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:04.310421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:04.311447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:04.312080 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:04.452107 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:04.459939 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4699311-dc06-4a60-bf42-9085696886e1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.167179 Jul 02 21:51:04.460549 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3063/6093] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:04 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:05.481888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:05.482916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:05.494736 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:05.495527 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:05.496876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:05.497625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:05.642945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:05.651224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5539d2b0-067e-447d-b916-7f20d338ff2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.176406 Jul 02 21:51:05.651788 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3031/6094] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:05 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:06.676960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:06.677927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:06.691538 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:06.691988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:06.693098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:06.693531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:06.830457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:06.840718 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bc4eece3-bc73-4059-8c1e-bbb59a30413d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.171830 Jul 02 21:51:06.841569 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3064/6095] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:06 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:07.859177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:07.859776 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:07.867675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:07.868165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:07.868961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:07.869408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:08.018182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:08.026298 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb62a465-894a-4790-8f0e-907617840184 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.171500 Jul 02 21:51:08.026894 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3032/6096] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:07 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:09.046164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:09.046863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:09.056830 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:09.057514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:09.058697 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:09.059279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:09.211824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:09.220002 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b3736651-ae58-4917-a32f-b91df92b5703 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.178544 Jul 02 21:51:09.220712 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3065/6097] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:09 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:10.237903 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:10.238561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:10.246233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:10.246699 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:10.247457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:10.247933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:10.383231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:10.391248 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f51bb64c-e330-4aeb-b769-6d04c75dd2c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.157497 Jul 02 21:51:10.391873 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3033/6098] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:10 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:51:11.412615 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:11.413203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:11.420771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:11.421227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:11.422007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:11.422445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:11.564325 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:11.575969 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6b99881c-db46-4433-bc8a-a7733ffbc5be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1682 microversion: 2.1 time: 0.167441 Jul 02 21:51:11.576790 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3066/6099] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:11 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:12.595268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:12.595866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:12.603377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:12.603844 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:12.604673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:12.605251 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:12.739164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:12.747063 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-85f09c60-471a-48b6-bcce-9a3adb3fce13 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1681 microversion: 2.1 time: 0.156033 Jul 02 21:51:12.747634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3034/6100] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:12 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:12.844845 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-22f0d1bd-417b-4a98-b01a-3c3db6d97188 req-c2fef3c4-6c1f-4490-b591-fa71f2208d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "name": "network-vif-unplugged", "status": "completed", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:12.856643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22f0d1bd-417b-4a98-b01a-3c3db6d97188 req-c2fef3c4-6c1f-4490-b591-fa71f2208d22 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:12.857264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-22f0d1bd-417b-4a98-b01a-3c3db6d97188 req-c2fef3c4-6c1f-4490-b591-fa71f2208d22 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:12.874117 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-22f0d1bd-417b-4a98-b01a-3c3db6d97188 req-c2fef3c4-6c1f-4490-b591-fa71f2208d22 service nova] Creating event network-vif-unplugged:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch2-master-1 Jul 02 21:51:12.879937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-22f0d1bd-417b-4a98-b01a-3c3db6d97188 req-c2fef3c4-6c1f-4490-b591-fa71f2208d22 service nova] Instance 0944121a-0260-4ae6-9e95-4044b0847b13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:51:12.891554 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-22f0d1bd-417b-4a98-b01a-3c3db6d97188 req-c2fef3c4-6c1f-4490-b591-fa71f2208d22 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050503 Jul 02 21:51:12.892565 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3067/6101] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:13.764686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:13.765240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:13.773669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:13.774615 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:13.775605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:13.776244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:13.924421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:13.932231 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9399d2d6-e573-4689-b6a2-76b4c8012f70 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1681 microversion: 2.1 time: 0.171583 Jul 02 21:51:13.932817 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3035/6102] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:13 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:14.914634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-567c9be8-3365-40da-8c7e-4ecff6df9303 req-e275342f-c860-4682-a483-e7812df30bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:14.924458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-567c9be8-3365-40da-8c7e-4ecff6df9303 req-e275342f-c860-4682-a483-e7812df30bfd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:14.924912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-567c9be8-3365-40da-8c7e-4ecff6df9303 req-e275342f-c860-4682-a483-e7812df30bfd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:14.937260 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-567c9be8-3365-40da-8c7e-4ecff6df9303 req-e275342f-c860-4682-a483-e7812df30bfd service nova] Creating event network-changed:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch2-master-1 Jul 02 21:51:14.943614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-567c9be8-3365-40da-8c7e-4ecff6df9303 req-e275342f-c860-4682-a483-e7812df30bfd service nova] Instance 0944121a-0260-4ae6-9e95-4044b0847b13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:51:14.950982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:14.951624 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:14.954658 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-567c9be8-3365-40da-8c7e-4ecff6df9303 req-e275342f-c860-4682-a483-e7812df30bfd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044916 Jul 02 21:51:14.955198 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3068/6103] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:14.958522 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:14.958992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:14.959790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:14.960279 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:15.183868 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:15.192263 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-eb6f71a0-dcf7-413a-8af1-616a2a8845bb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1679 microversion: 2.1 time: 0.245529 Jul 02 21:51:15.192859 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3036/6104] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:14 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:16.216098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:16.217327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:16.228255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.229957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.230460 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.231204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.379338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:16.390991 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1b8ff741-17bf-4941-a02a-e72e29e25981 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1676 microversion: 2.1 time: 0.183544 Jul 02 21:51:16.391932 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3069/6105] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:16 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:16.414376 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:16.414927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:16.422383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.422838 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.423631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.424103 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.464932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.465387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.466189 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.466641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.488063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:51:16.493509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for user 9d9fe7d5b9094981a3ee9ab8456cc467 and project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:51:16.613227 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ace9efe6-83e3-4aac-b2ff-03045852aade tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13/action" status: 202 len: 0 microversion: 2.1 time: 0.202615 Jul 02 21:51:16.613875 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3037/6106] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:51:16 2022] POST /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:51:16.622453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:16.623072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:16.629477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.629831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.630792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:16.631232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:16.769562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:16.778525 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6eaa5b9b-a072-4c77-9266-711f2eeec035 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.159998 Jul 02 21:51:16.779761 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3070/6107] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:16 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:17.801165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:17.801998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:17.812243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:17.812875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:17.813935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:17.814517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:17.953498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:17.961600 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-80581c2d-2aa4-410c-a76f-23506f53c562 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.167368 Jul 02 21:51:17.962193 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3038/6108] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:17 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:18.825503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9ca76ec7-0c2d-4ac8-8dab-b6f284d5c9b9 req-546570b5-f6e8-4472-9215-62b1d78c819c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "name": "network-vif-plugged", "status": "completed", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:18.836283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ca76ec7-0c2d-4ac8-8dab-b6f284d5c9b9 req-546570b5-f6e8-4472-9215-62b1d78c819c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:18.836814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ca76ec7-0c2d-4ac8-8dab-b6f284d5c9b9 req-546570b5-f6e8-4472-9215-62b1d78c819c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:18.851553 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9ca76ec7-0c2d-4ac8-8dab-b6f284d5c9b9 req-546570b5-f6e8-4472-9215-62b1d78c819c service nova] Creating event network-vif-plugged:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch2-master-1 Jul 02 21:51:18.858315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-9ca76ec7-0c2d-4ac8-8dab-b6f284d5c9b9 req-546570b5-f6e8-4472-9215-62b1d78c819c service nova] Instance 0944121a-0260-4ae6-9e95-4044b0847b13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:51:18.869844 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9ca76ec7-0c2d-4ac8-8dab-b6f284d5c9b9 req-546570b5-f6e8-4472-9215-62b1d78c819c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050021 Jul 02 21:51:18.870243 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3071/6109] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:18.979071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:18.979787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:18.987793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:18.988270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:18.989083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:18.989525 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:19.144324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:19.152751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ac7470a5-0c79-4265-a7c6-7333c35162c3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.177688 Jul 02 21:51:19.153345 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3039/6110] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:18 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:19.916451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1e6b9261-248a-408b-ab9d-80f36d9bcf74 req-560772c9-bf2d-4da6-8faf-27ac984a7746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "name": "network-vif-unplugged", "status": "completed", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:19.925779 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e6b9261-248a-408b-ab9d-80f36d9bcf74 req-560772c9-bf2d-4da6-8faf-27ac984a7746 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:19.926352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e6b9261-248a-408b-ab9d-80f36d9bcf74 req-560772c9-bf2d-4da6-8faf-27ac984a7746 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:19.938720 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1e6b9261-248a-408b-ab9d-80f36d9bcf74 req-560772c9-bf2d-4da6-8faf-27ac984a7746 service nova] Creating event network-vif-unplugged:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:51:19.945248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-1e6b9261-248a-408b-ab9d-80f36d9bcf74 req-560772c9-bf2d-4da6-8faf-27ac984a7746 service nova] Instance 0944121a-0260-4ae6-9e95-4044b0847b13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:51:19.956430 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1e6b9261-248a-408b-ab9d-80f36d9bcf74 req-560772c9-bf2d-4da6-8faf-27ac984a7746 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045576 Jul 02 21:51:19.957207 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3072/6111] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:20.229981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:20.230693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:20.237099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:20.237521 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:20.238340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:20.238908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:20.451889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:20.464690 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-45fee663-121f-4be2-b3f5-b920d23f7c25 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.297937 Jul 02 21:51:20.465283 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3040/6112] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:20 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:21.488561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:21.489399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:21.497477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:21.498014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:21.498929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:21.499448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:21.639141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:21.651361 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3ae83fbe-67bb-42cf-9874-ec28892504eb tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.170055 Jul 02 21:51:21.652282 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3073/6113] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:21 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:21.975854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e3f3fedf-3bfa-4018-a749-e583394fbd10 req-2a7f58fc-2cd2-4d35-a017-9f572e2155f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:21.985831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e3f3fedf-3bfa-4018-a749-e583394fbd10 req-2a7f58fc-2cd2-4d35-a017-9f572e2155f4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:21.986294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e3f3fedf-3bfa-4018-a749-e583394fbd10 req-2a7f58fc-2cd2-4d35-a017-9f572e2155f4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:21.998424 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e3f3fedf-3bfa-4018-a749-e583394fbd10 req-2a7f58fc-2cd2-4d35-a017-9f572e2155f4 service nova] Creating event network-changed:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:51:22.000971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:22.004631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-e3f3fedf-3bfa-4018-a749-e583394fbd10 req-2a7f58fc-2cd2-4d35-a017-9f572e2155f4 service nova] Instance 0944121a-0260-4ae6-9e95-4044b0847b13 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 21:51:22.015992 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e3f3fedf-3bfa-4018-a749-e583394fbd10 req-2a7f58fc-2cd2-4d35-a017-9f572e2155f4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044338 Jul 02 21:51:22.016605 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3041/6114] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:51:22.671127 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:22.671759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:22.679039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:22.679495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:22.680313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:22.680748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:22.819180 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:22.827327 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d4cc7a6-5f70-4182-a9b7-8a0d432c0a46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.160204 Jul 02 21:51:22.827887 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3074/6115] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:22 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:23.846661 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:23.848517 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:23.858512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:23.859091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:23.860311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:23.860910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:24.096888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:24.104906 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-68e59579-b558-4334-b8c7-5a44290a3b02 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1675 microversion: 2.1 time: 0.264139 Jul 02 21:51:24.105562 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3042/6116] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:23 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:25.126938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:25.127869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:25.139317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.139954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.141137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.141796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.289161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:25.297224 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-26c96832-3b75-4d25-9fd1-24b3356a7b50 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1668 microversion: 2.1 time: 0.177446 Jul 02 21:51:25.297815 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3075/6117] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:25 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1668 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:25.314026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:25.314655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:25.322308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.322780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.323580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.324026 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.462656 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:25.470789 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d97e88ee-9f2b-45e9-86cd-3538d1984e46 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1668 microversion: 2.1 time: 0.160814 Jul 02 21:51:25.471465 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3043/6118] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:25 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:25.487249 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:25.487872 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:25.494217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.494708 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.495476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.495918 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.514273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:25.627134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:25.635411 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-34d5c415-e272-45f4-b496-83a3171827ae tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1668 microversion: 2.1 time: 0.152109 Jul 02 21:51:25.635994 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3076/6119] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:25 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:51:25.652029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:25.652566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:25.659518 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.659988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.660853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.661531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.688566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:51:25.771000 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78730f16-53c2-4e29-9d91-78621c1a7f2b tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 204 len: 0 microversion: 2.1 time: 0.122406 Jul 02 21:51:25.771222 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3044/6120] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:51:25 2022] DELETE /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:51:25.780678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:25.781526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:25.788773 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.789230 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.790011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:25.790457 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:25.936715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:25.945494 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-738f24e9-1cc3-452d-b360-9156b850dfd4 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1674 microversion: 2.1 time: 0.169215 Jul 02 21:51:25.946138 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3077/6121] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:25 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:26.333794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d0322a3c-8bb3-4a56-a62b-f33ed66d9a1f req-c033670d-4e51-4956-9609-c4ba0a04d11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "name": "network-vif-plugged", "status": "completed", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:26.343811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d0322a3c-8bb3-4a56-a62b-f33ed66d9a1f req-c033670d-4e51-4956-9609-c4ba0a04d11a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:26.344295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d0322a3c-8bb3-4a56-a62b-f33ed66d9a1f req-c033670d-4e51-4956-9609-c4ba0a04d11a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:26.356568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d0322a3c-8bb3-4a56-a62b-f33ed66d9a1f req-c033670d-4e51-4956-9609-c4ba0a04d11a service nova] Creating event network-vif-plugged:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:51:26.361563 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d0322a3c-8bb3-4a56-a62b-f33ed66d9a1f req-c033670d-4e51-4956-9609-c4ba0a04d11a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Jul 02 21:51:26.362495 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3045/6122] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:26.965945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:26.966796 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:26.975624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:26.976092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:26.976856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:26.977296 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:27.115761 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:27.125948 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-233dafef-c446-49af-abc0-2320ccda0b37 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1674 microversion: 2.1 time: 0.165459 Jul 02 21:51:27.126779 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3078/6123] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:26 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:28.142076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:28.148620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:28.149345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:28.156620 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:28.157332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:28.158512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:28.159024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:28.187577 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-803fa2f1-efcb-48bc-b49b-bca449a8558f req-b76a496e-4d65-4d41-9bff-bb08568064c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0944121a-0260-4ae6-9e95-4044b0847b13", "name": "network-vif-deleted", "tag": "d45b10ce-22dd-42fc-a48e-964fa8de0a96"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:28.200864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-803fa2f1-efcb-48bc-b49b-bca449a8558f req-b76a496e-4d65-4d41-9bff-bb08568064c6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:28.201816 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-803fa2f1-efcb-48bc-b49b-bca449a8558f req-b76a496e-4d65-4d41-9bff-bb08568064c6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:28.220920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-803fa2f1-efcb-48bc-b49b-bca449a8558f req-b76a496e-4d65-4d41-9bff-bb08568064c6 service nova] Creating event network-vif-deleted:d45b10ce-22dd-42fc-a48e-964fa8de0a96 for instance 0944121a-0260-4ae6-9e95-4044b0847b13 on nch1-master-1 Jul 02 21:51:28.227932 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-803fa2f1-efcb-48bc-b49b-bca449a8558f req-b76a496e-4d65-4d41-9bff-bb08568064c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044601 Jul 02 21:51:28.228563 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3079/6124] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:28.239878 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:28.248531 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d21b7bba-af80-4923-bd04-e6fb0536d5d0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 200 len: 1607 microversion: 2.1 time: 0.107280 Jul 02 21:51:28.249116 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3046/6125] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:28 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 1607 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:29.267729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:29.268474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:29.270483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:29.276567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:29.277013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:29.277758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:29.278284 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:29.293148 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 HTTP/1.1 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '0944121a-0260-4ae6-9e95-4044b0847b13'} Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:51:29.294818 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-48048ecd-85ae-4362-90e1-906c691799be tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 404 len: 111 microversion: 2.1 time: 0.033856 Jul 02 21:51:29.299601 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3080/6126] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:29 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:51:29.313840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:29.314490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:29.317423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:29.323144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:29.323608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:29.324467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:29.324918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:29.339886 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 HTTP/1.1 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0944121a-0260-4ae6-9e95-4044b0847b13'} Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:51:29.341617 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ab1fefc8-0896-42bc-bdde-1ed4e85cd8f3 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 404 len: 111 microversion: 2.1 time: 0.033285 Jul 02 21:51:29.345621 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3047/6127] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:29 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:51:29.393692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1186892843", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "ec78456c-b341-4383-8e20-f5f1a92c4378"}], "security_groups": [{"name": "tempest-securitygroup--546487852"}], "key_name": "tempest-keypair-242631515", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:29.511402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] validate_networks() for [('ec78456c-b341-4383-8e20-f5f1a92c4378', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:51:29.930002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:51:29.930438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:51:29.930954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:51:29.931374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:51:29.931792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:51:29.942185 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:29.942636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:29.943471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:29.943896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:29.961390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:51:29.966989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Getting quotas for user 9d9fe7d5b9094981a3ee9ab8456cc467 and project 9b8a33f323614b27850f584b9600f12d. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:51:29.980349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:51:29.982682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:51:30.030281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db618884-7021-4712-b5a7-16d25d3967f1 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.640934 Jul 02 21:51:30.030964 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3081/6128] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:51:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:51:30.041604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2cf2b9d5-cc34-4cf9-b04a-134f43283d2a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:30.042223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2cf2b9d5-cc34-4cf9-b04a-134f43283d2a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:30.098617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2cf2b9d5-cc34-4cf9-b04a-134f43283d2a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:30.105701 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2cf2b9d5-cc34-4cf9-b04a-134f43283d2a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1238 microversion: 2.1 time: 0.068027 Jul 02 21:51:30.106296 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3048/6129] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:30 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:31.124744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:31.125658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:31.133184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:31.133641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:31.134435 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:31.134882 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:31.199302 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:31.207435 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b1e121d-b877-4e0c-a7be-1011192c8fa8 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1308 microversion: 2.1 time: 0.088330 Jul 02 21:51:31.208033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3082/6130] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:31 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1308 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:32.225058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:32.225708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:32.234748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:32.235174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:32.235969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:32.236711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:32.382731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:32.391168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5de3ac1-bb0e-4d07-95a5-96d3b40eb75c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1363 microversion: 2.1 time: 0.170142 Jul 02 21:51:32.392114 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3049/6131] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:32 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:32.821443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-a2ce479f-8692-425f-ad88-c3d806f380fc req-e32b68b0-0f5c-45ce-b451-a9eec387e9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aeaa5c-2509-4158-bbff-efd1f95a966d", "tag": "e00c7c85-f7b2-4b0c-9016-10ec7617afdf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:32.833911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a2ce479f-8692-425f-ad88-c3d806f380fc req-e32b68b0-0f5c-45ce-b451-a9eec387e9a6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:32.834454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-a2ce479f-8692-425f-ad88-c3d806f380fc req-e32b68b0-0f5c-45ce-b451-a9eec387e9a6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:32.855669 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-a2ce479f-8692-425f-ad88-c3d806f380fc req-e32b68b0-0f5c-45ce-b451-a9eec387e9a6 service nova] Creating event network-changed:e00c7c85-f7b2-4b0c-9016-10ec7617afdf for instance 47aeaa5c-2509-4158-bbff-efd1f95a966d on nch2-master-1 Jul 02 21:51:32.862689 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-a2ce479f-8692-425f-ad88-c3d806f380fc req-e32b68b0-0f5c-45ce-b451-a9eec387e9a6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046548 Jul 02 21:51:32.863439 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3083/6132] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:33.411421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:33.412202 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:33.420897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:33.421437 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:33.422386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:33.422904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:33.567001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:33.574984 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7c7e6f48-754d-42dd-bca2-4f41bc840b6a tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1363 microversion: 2.1 time: 0.168844 Jul 02 21:51:33.575564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3050/6133] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:33 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:34.595067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:34.595920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:34.603088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:34.603554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:34.604378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:34.604828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:34.748920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:34.757344 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9e4a9310-7b11-4a2a-b5e7-47511e5fdc8c tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1363 microversion: 2.1 time: 0.167755 Jul 02 21:51:34.758534 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3084/6134] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:34 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:35.779161 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:35.780139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:35.792577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:35.793334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:35.794602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:35.795331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:35.935956 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:35.944010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-34051e4b-cad8-4f29-b40f-24245b8ceea2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1363 microversion: 2.1 time: 0.171730 Jul 02 21:51:35.944632 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3051/6135] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:35 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:36.925011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8afb6118-9490-4370-9867-bc4bdabcd506 req-e4d080bd-7661-4b05-b114-b136137ffd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aeaa5c-2509-4158-bbff-efd1f95a966d", "name": "network-vif-plugged", "status": "completed", "tag": "e00c7c85-f7b2-4b0c-9016-10ec7617afdf"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:36.934592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8afb6118-9490-4370-9867-bc4bdabcd506 req-e4d080bd-7661-4b05-b114-b136137ffd02 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:36.935048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8afb6118-9490-4370-9867-bc4bdabcd506 req-e4d080bd-7661-4b05-b114-b136137ffd02 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:36.946865 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8afb6118-9490-4370-9867-bc4bdabcd506 req-e4d080bd-7661-4b05-b114-b136137ffd02 service nova] Creating event network-vif-plugged:e00c7c85-f7b2-4b0c-9016-10ec7617afdf for instance 47aeaa5c-2509-4158-bbff-efd1f95a966d on nch2-master-1 Jul 02 21:51:36.951653 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8afb6118-9490-4370-9867-bc4bdabcd506 req-e4d080bd-7661-4b05-b114-b136137ffd02 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030589 Jul 02 21:51:36.952303 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3085/6136] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:36.962322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:36.962954 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:36.970249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:36.970716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:36.971498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:36.971947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:37.113981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:37.122319 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-742cf854-c557-4dde-a30b-9cb55601e229 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1363 microversion: 2.1 time: 0.164174 Jul 02 21:51:37.122999 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3052/6137] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:36 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:38.142948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:38.143858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:38.152809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:38.153466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:38.154495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:38.155088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:38.303267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:38.311263 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b4e23142-3736-45dd-bbb5-6381b96fffc5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1363 microversion: 2.1 time: 0.175324 Jul 02 21:51:38.311822 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3086/6138] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:38 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:39.333707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:39.334510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:39.344380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:39.344999 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:39.346041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:39.346649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:39.484269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:51:39.492304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c0ca6d0b-b875-487a-9581-d1da826f76e0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1550 microversion: 2.1 time: 0.164680 Jul 02 21:51:39.492890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3053/6139] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:51:39 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1550 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:51:39.512776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:51:39.513306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:51:39.522511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:39.522972 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:39.523746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:39.524212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:39.608290 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47cc110a-e968-4d0a-8547-8b95bd104cb5 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101753 Jul 02 21:51:39.609137 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3087/6140] 10.222.0.43 () {58 vars in 1274 bytes} [Sat Jul 2 21:51:39 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:51:40.571575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-013473bb-6ca5-44e5-bb6b-f8bda79cbabc req-846d91e4-ecff-4893-8bbc-2204f31c107c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aeaa5c-2509-4158-bbff-efd1f95a966d", "tag": "e00c7c85-f7b2-4b0c-9016-10ec7617afdf"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:51:40.575303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:51:40.582683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-013473bb-6ca5-44e5-bb6b-f8bda79cbabc req-846d91e4-ecff-4893-8bbc-2204f31c107c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:51:40.583129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-013473bb-6ca5-44e5-bb6b-f8bda79cbabc req-846d91e4-ecff-4893-8bbc-2204f31c107c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:51:40.594598 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-013473bb-6ca5-44e5-bb6b-f8bda79cbabc req-846d91e4-ecff-4893-8bbc-2204f31c107c service nova] Creating event network-changed:e00c7c85-f7b2-4b0c-9016-10ec7617afdf for instance 47aeaa5c-2509-4158-bbff-efd1f95a966d on nch2-master-1 Jul 02 21:51:40.599842 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-013473bb-6ca5-44e5-bb6b-f8bda79cbabc req-846d91e4-ecff-4893-8bbc-2204f31c107c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032130 Jul 02 21:51:40.600565 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3054/6141] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:52:22.732379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:22.733168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:22.735990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:22.736973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=46 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:22.741917 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:22.742716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:22.751362 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:22.751818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:22.752628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:22.753063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:22.993630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:23.002405 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0468c2f8-72e9-4140-8757-36b329fe8219 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1669 microversion: 2.1 time: 0.270948 Jul 02 21:52:23.002984 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3088/6142] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:22 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:23.154533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=17 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:23.155337 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:23.159805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:23.160421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:23.168308 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:23.168719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:23.169486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:23.169972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:23.196798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:52:23.285591 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a999078c-2754-4aeb-98f3-f3cc1a909e0e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 204 len: 0 microversion: 2.1 time: 0.133033 Jul 02 21:52:23.286646 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3055/6143] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:52:23 2022] DELETE /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:52:23.295084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:23.295728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:23.302056 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:23.302515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:23.303301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:23.303743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:23.442662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:23.452631 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-465264c5-0dde-4522-be4a-146940052be2 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1675 microversion: 2.1 time: 0.161714 Jul 02 21:52:23.453119 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3089/6144] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:23 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:24.475254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:24.476489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:24.488145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:24.489037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:24.490342 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:24.491074 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:24.687306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:24.695627 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7a654bfd-25a7-4dfc-97d5-085928981f6d tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1675 microversion: 2.1 time: 0.227803 Jul 02 21:52:24.696250 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3056/6145] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:24 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:25.712703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:25.713357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:25.720450 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:25.720902 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:25.721662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:25.722094 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:25.789682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d9fe7d5b9094981a3ee9ab8456cc467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b8a33f323614b27850f584b9600f12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:25.797923 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-632fbaf5-2ee9-4720-aae2-852c44553d80 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 200 len: 1608 microversion: 2.1 time: 0.089000 Jul 02 21:52:25.807776 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3090/6146] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:25 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 1608 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:26.075707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0ef0549f-acbf-47c1-8eca-fea5a25d9ef7 req-9ee5f5a5-d333-4225-b939-57b82242043a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aeaa5c-2509-4158-bbff-efd1f95a966d", "name": "network-vif-deleted", "tag": "e00c7c85-f7b2-4b0c-9016-10ec7617afdf"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:26.088494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0ef0549f-acbf-47c1-8eca-fea5a25d9ef7 req-9ee5f5a5-d333-4225-b939-57b82242043a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.089065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0ef0549f-acbf-47c1-8eca-fea5a25d9ef7 req-9ee5f5a5-d333-4225-b939-57b82242043a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.103314 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0ef0549f-acbf-47c1-8eca-fea5a25d9ef7 req-9ee5f5a5-d333-4225-b939-57b82242043a service nova] Creating event network-vif-deleted:e00c7c85-f7b2-4b0c-9016-10ec7617afdf for instance 47aeaa5c-2509-4158-bbff-efd1f95a966d on nch2-master-1 Jul 02 21:52:26.108946 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0ef0549f-acbf-47c1-8eca-fea5a25d9ef7 req-9ee5f5a5-d333-4225-b939-57b82242043a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037828 Jul 02 21:52:26.109556 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3057/6147] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:52:26.815591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:26.816197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 47aeaa5c-2509-4158-bbff-efd1f95a966d] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:26.824696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.825164 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.825961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.826586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.843133 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance 47aeaa5c-2509-4158-bbff-efd1f95a966d could not be found. Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d HTTP/1.1 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 47aeaa5c-2509-4158-bbff-efd1f95a966d could not be found. Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '47aeaa5c-2509-4158-bbff-efd1f95a966d'} Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aeaa5c-2509-4158-bbff-efd1f95a966d could not be found. Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aeaa5c-2509-4158-bbff-efd1f95a966d could not be found. Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.845766 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aeaa5c-2509-4158-bbff-efd1f95a966d could not be found. Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance 47aeaa5c-2509-4158-bbff-efd1f95a966d could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-07c69888-4222-4ffc-a37b-3ab31cfdefd0 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d" status: 404 len: 111 microversion: 2.1 time: 0.036100 Jul 02 21:52:26.850815 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3091/6148] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:26 2022] GET /compute/v2.1/servers/47aeaa5c-2509-4158-bbff-efd1f95a966d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:52:26.858531 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:26.859577 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:26.867414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.867882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.868755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.869173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.893304 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 HTTP/1.1 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '0944121a-0260-4ae6-9e95-4044b0847b13'} Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:26.895052 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c609f0eb-4800-457f-a386-89219d54bff7 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 404 len: 111 microversion: 2.1 time: 0.043019 Jul 02 21:52:26.899153 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3058/6149] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:52:26 2022] DELETE /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:52:26.905603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:26.906232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: 0944121a-0260-4ae6-9e95-4044b0847b13] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:26.913050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.913627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.914478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.914992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.929852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 HTTP/1.1 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '0944121a-0260-4ae6-9e95-4044b0847b13'} Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.931428 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance 0944121a-0260-4ae6-9e95-4044b0847b13 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fd65b165-ec19-4e94-90fd-a5b8f847c6c9 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13" status: 404 len: 111 microversion: 2.1 time: 0.031467 Jul 02 21:52:26.935490 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3092/6150] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:26 2022] GET /compute/v2.1/servers/0944121a-0260-4ae6-9e95-4044b0847b13 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:52:26.941911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:26.942423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:26.949001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.949447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.950233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.950695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.965763 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 HTTP/1.1 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'd870cc8b-68d5-482c-98e0-6c44d2206fc6'} Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:26.967475 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:26.971387 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-75442b9a-630d-4aba-a274-e3219d2f0403 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 404 len: 111 microversion: 2.1 time: 0.030985 Jul 02 21:52:26.972589 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3059/6151] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:52:26 2022] DELETE /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 02 21:52:26.978267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:26.978982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: d870cc8b-68d5-482c-98e0-6c44d2206fc6] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:26.986774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.987226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:26.988264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:26.988887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:27.005249 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 HTTP/1.1 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'd870cc8b-68d5-482c-98e0-6c44d2206fc6'} Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:27.006812 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance d870cc8b-68d5-482c-98e0-6c44d2206fc6 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6972f9f1-50e2-4ab4-a2f1-e019df24d9ee tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6" status: 404 len: 111 microversion: 2.1 time: 0.034264 Jul 02 21:52:27.010881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3093/6152] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:26 2022] GET /compute/v2.1/servers/d870cc8b-68d5-482c-98e0-6c44d2206fc6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:52:27.017481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:27.018047 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:27.024784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:27.025239 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:27.026020 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:27.026501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:27.041604 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: request: DELETE /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca HTTP/1.1 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'a08bb4fd-d582-41b4-a50a-fa65a943b1ca'} Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:27.043297 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-01420612-d46c-4baf-a402-81bb4a51933e tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 404 len: 111 microversion: 2.1 time: 0.031314 Jul 02 21:52:27.049904 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3060/6153] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:52:27 2022] DELETE /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:52:27.056842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:27.057544 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [instance: a08bb4fd-d582-41b4-a50a-fa65a943b1ca] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:27.064308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:27.064767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:27.065578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:27.066070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:27.083286 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] HTTP exception thrown: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Request method failure captured: Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca HTTP/1.1 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwLyrNGlS_FStxc9_ZaXlLhgRrUkqgAM78eR1qL9U9Md3Vyh8Ygtv6ttoAJU4OxTR4DxEFVPxvSp8lWP3yrM_k5ytVtAH1bqZ-ijQvcuWJJkyAV0EVUa34mQ9Nh-uBA_e1AWZFhXHxOo5SYM_bPVxQJVkdW5oMrQjC0_VwWgMIoUxDJw Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9b8a33f323614b27850f584b9600f12d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9b8a33f323614b27850f584b9600f12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9b8a33f323614b27850f584b9600f12d"}]}] Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 9b8a33f323614b27850f584b9600f12d Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServerActionsTestJSON-115369639 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 9d9fe7d5b9094981a3ee9ab8456cc467 Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServerActionsTestJSON-115369639-project Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a08bb4fd-d582-41b4-a50a-fa65a943b1ca'} Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:52:27.085084 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Returning 404 to user: Instance a08bb4fd-d582-41b4-a50a-fa65a943b1ca could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bf1f33cf-a901-4d06-9661-4f6e0bbea783 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca" status: 404 len: 111 microversion: 2.1 time: 0.036653 Jul 02 21:52:27.089420 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3094/6154] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:27 2022] GET /compute/v2.1/servers/a08bb4fd-d582-41b4-a50a-fa65a943b1ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:52:27.095626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-23c4e6b4-faaf-4d7b-825b-f294f2d5bb33 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] Calling method '.version_select at 0x7fabd738a280>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:27.098784 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [None req-23c4e6b4-faaf-4d7b-825b-f294f2d5bb33 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [c96e68b1-4b7d-4d47-88b0-22db9fb8bf07] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 21:52:28.107981 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [None req-23c4e6b4-faaf-4d7b-825b-f294f2d5bb33 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] [c96e68b1-4b7d-4d47-88b0-22db9fb8bf07] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 34700. Jul 02 21:52:28.136209 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-23c4e6b4-faaf-4d7b-825b-f294f2d5bb33 tempest-ServerActionsTestJSON-115369639 tempest-ServerActionsTestJSON-115369639-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242631515" status: 202 len: 0 microversion: 2.1 time: 1.043175 Jul 02 21:52:28.137064 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3061/6155] 10.222.0.43 () {58 vars in 1217 bytes} [Sat Jul 2 21:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242631515 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:52:30.668663 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:52:30.669408 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:52:30.818922 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:52:30.819461 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 21:52:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:52:37.265545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=14 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:37.266383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=26 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:37.403561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-312100928", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "db0bb00d-4a04-4faa-8593-ce7a22b60f31"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:37.459178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] validate_networks() for [('db0bb00d-4a04-4faa-8593-ce7a22b60f31', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:52:37.850680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:52:37.851382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:52:37.852029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:52:37.852472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:52:37.852954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:52:37.863115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:37.864014 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:37.864848 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:37.865281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:37.883444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Getting quotas for project c721294324ba42ddabb84b33a06e03ee. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:52:37.889035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Getting quotas for user 6d35b509fd734cb1bbcc4fdd3b4c9def and project c721294324ba42ddabb84b33a06e03ee. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:52:37.901986 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:52:37.904441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:52:37.963125 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d1daee71-3ec0-4604-bf74-425f45718cf3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703140 Jul 02 21:52:37.963795 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3095/6156] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:52:37.971893 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:37.976306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-128feb1c-de35-41c4-b401-65319d930e28 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:37.976931 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-128feb1c-de35-41c4-b401-65319d930e28 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:38.058438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-128feb1c-de35-41c4-b401-65319d930e28 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:38.065601 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-128feb1c-de35-41c4-b401-65319d930e28 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1216 microversion: 2.1 time: 0.095456 Jul 02 21:52:38.069995 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3062/6157] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:37 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1216 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:39.087728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:39.088827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:39.097403 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:39.097647 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:39.098630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:39.099074 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:39.183414 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:39.191627 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9255017c-6424-471f-9698-789784a0c5f2 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1286 microversion: 2.1 time: 0.109067 Jul 02 21:52:39.192284 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3096/6158] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:39 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:40.212597 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:40.213427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:40.225737 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:40.226473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:40.227340 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:40.227846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:40.485227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:40.498751 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d38a20fa-8343-4baa-860e-a504cc85fe29 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1316 microversion: 2.1 time: 0.292614 Jul 02 21:52:40.499381 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3063/6159] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:40 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:40.843709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-de893720-a4fd-44eb-b0cb-84fefe263bb6 req-23ce79ea-3cce-442c-80bf-72a7b7b2abd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51a0ca13-be31-40f3-856f-4517bcf28da3", "tag": "5c04a1b1-4348-4942-a480-43b12d7a73a5"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:40.858865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-de893720-a4fd-44eb-b0cb-84fefe263bb6 req-23ce79ea-3cce-442c-80bf-72a7b7b2abd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:40.862098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-de893720-a4fd-44eb-b0cb-84fefe263bb6 req-23ce79ea-3cce-442c-80bf-72a7b7b2abd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:40.876980 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-de893720-a4fd-44eb-b0cb-84fefe263bb6 req-23ce79ea-3cce-442c-80bf-72a7b7b2abd8 service nova] Creating event network-changed:5c04a1b1-4348-4942-a480-43b12d7a73a5 for instance 51a0ca13-be31-40f3-856f-4517bcf28da3 on nch2-master-1 Jul 02 21:52:40.883362 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-de893720-a4fd-44eb-b0cb-84fefe263bb6 req-23ce79ea-3cce-442c-80bf-72a7b7b2abd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045305 Jul 02 21:52:40.884332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3097/6160] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:52:41.516626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:41.517413 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:41.525402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:41.525863 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:41.526692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:41.527107 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:41.669224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:41.677148 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4dcc0040-34f8-4867-ab3d-7684f7b68866 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1316 microversion: 2.1 time: 0.164804 Jul 02 21:52:41.677728 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3064/6161] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:41 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:42.695283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:42.695985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:42.704211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:42.704883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:42.705890 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:42.706323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:42.838713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:42.846974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7802d01-5d3d-46c1-b597-aa065715bd7a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1316 microversion: 2.1 time: 0.156010 Jul 02 21:52:42.847673 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3098/6162] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:42 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:43.868730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:43.869648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:43.878402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:43.878865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:43.879660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:43.880149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:44.018707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:44.026587 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a72a9c9-c2a8-417d-9103-e54bcf7aac5b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1316 microversion: 2.1 time: 0.164871 Jul 02 21:52:44.027187 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3065/6163] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:43 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:45.047063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:45.047693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:45.055292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:45.055749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:45.056567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:45.057009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:45.194340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:45.198617 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-e6f71267-824a-4a76-83d2-96545c67bc98 req-9ccd57e3-420f-442f-9d95-d0a05809f5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a0ca13-be31-40f3-856f-4517bcf28da3", "name": "network-vif-plugged", "status": "completed", "tag": "5c04a1b1-4348-4942-a480-43b12d7a73a5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:45.202722 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-96392d0f-5c99-4a5d-99a5-50c215b3e078 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1316 microversion: 2.1 time: 0.160826 Jul 02 21:52:45.203304 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3099/6164] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:45 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1316 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:45.218471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e6f71267-824a-4a76-83d2-96545c67bc98 req-9ccd57e3-420f-442f-9d95-d0a05809f5dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:45.218917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-e6f71267-824a-4a76-83d2-96545c67bc98 req-9ccd57e3-420f-442f-9d95-d0a05809f5dd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:45.230738 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-e6f71267-824a-4a76-83d2-96545c67bc98 req-9ccd57e3-420f-442f-9d95-d0a05809f5dd service nova] Creating event network-vif-plugged:5c04a1b1-4348-4942-a480-43b12d7a73a5 for instance 51a0ca13-be31-40f3-856f-4517bcf28da3 on nch2-master-1 Jul 02 21:52:45.236317 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-e6f71267-824a-4a76-83d2-96545c67bc98 req-9ccd57e3-420f-442f-9d95-d0a05809f5dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042112 Jul 02 21:52:45.237007 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3066/6165] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:52:46.222016 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:46.222623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:46.229663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:46.230161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:46.231000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:46.231481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:46.367169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:46.375678 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e0cac765-2589-4dff-9fa8-387a070ff417 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1316 microversion: 2.1 time: 0.158477 Jul 02 21:52:46.376298 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3100/6166] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:46 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:47.399723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:47.400585 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:47.409422 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:47.409880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:47.410660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:47.411302 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:47.556873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:47.566007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3a67ee66-975e-48d7-9a02-f8bb0aef9d67 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.173024 Jul 02 21:52:47.566590 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3067/6167] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:47 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:47.628843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1750071101", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "db0bb00d-4a04-4faa-8593-ce7a22b60f31"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:47.683328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] validate_networks() for [('db0bb00d-4a04-4faa-8593-ce7a22b60f31', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:52:47.873514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:47.895896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:48.112893 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:52:48.113329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:52:48.113812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:52:48.114233 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:52:48.114676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:52:48.124088 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:48.124567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:48.125374 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:48.125819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:48.142895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Getting quotas for project c721294324ba42ddabb84b33a06e03ee. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:52:48.148479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Getting quotas for user 6d35b509fd734cb1bbcc4fdd3b4c9def and project c721294324ba42ddabb84b33a06e03ee. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:52:48.161693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:52:48.164168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:52:48.211485 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-41bcadc5-8672-41d2-bb35-384fa184787b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586441 Jul 02 21:52:48.216415 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3101/6168] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:52:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:52:48.222973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6b42094b-3d2f-4f0d-829a-fb6538664d8a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:48.223604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6b42094b-3d2f-4f0d-829a-fb6538664d8a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:48.225831 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:48.282749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6b42094b-3d2f-4f0d-829a-fb6538664d8a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:48.291513 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6b42094b-3d2f-4f0d-829a-fb6538664d8a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1217 microversion: 2.1 time: 0.072744 Jul 02 21:52:48.292285 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3068/6169] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:48 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:49.316744 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:49.318158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:49.327936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:49.328721 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:49.329498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:49.329937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:49.436557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:49.444579 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5936b395-d75e-4088-9003-fcdb98b56ba1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1287 microversion: 2.1 time: 0.132091 Jul 02 21:52:49.445142 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3102/6170] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:49 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:50.462361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:50.463191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:50.471442 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:50.471975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:50.472854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:50.473402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:50.689902 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:50.698192 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-85ca1798-c677-42b8-a30b-3ed2a4160101 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.240038 Jul 02 21:52:50.699093 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3069/6171] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:50 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:51.069866 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0a343a87-51cc-4999-86b9-d7a403468095 req-d9494abc-af0c-4965-b490-ef0c588a2c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2", "tag": "e09faa1c-aeb1-418a-928b-78b477f4f24c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:51.098146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a343a87-51cc-4999-86b9-d7a403468095 req-d9494abc-af0c-4965-b490-ef0c588a2c38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:51.098628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0a343a87-51cc-4999-86b9-d7a403468095 req-d9494abc-af0c-4965-b490-ef0c588a2c38 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:51.111207 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0a343a87-51cc-4999-86b9-d7a403468095 req-d9494abc-af0c-4965-b490-ef0c588a2c38 service nova] Creating event network-changed:e09faa1c-aeb1-418a-928b-78b477f4f24c for instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 on nch1-master-1 Jul 02 21:52:51.116714 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0a343a87-51cc-4999-86b9-d7a403468095 req-d9494abc-af0c-4965-b490-ef0c588a2c38 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053554 Jul 02 21:52:51.117429 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3103/6172] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:52:51.719307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:51.720409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:51.732460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:51.733141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:51.733892 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:51.734334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:51.876494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:51.884638 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0e673838-bb00-4049-894a-f218f32bc762 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.172187 Jul 02 21:52:51.885212 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3070/6173] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:51 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:52.907800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:52.908662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:52.916599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:52.917131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:52.918064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:52.918552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:53.060609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:53.069855 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-92af4eba-fc8d-4c8b-bcd8-ca0eca6bf304 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.170230 Jul 02 21:52:53.070468 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3104/6174] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:52 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:54.091070 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:54.092373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:54.097241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:54.107924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:54.108445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:54.109242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:54.109693 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:54.253183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:54.261447 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78f415e5-9876-43df-8603-2f441489ea74 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.177096 Jul 02 21:52:54.262051 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3071/6175] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:54 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:55.279021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:55.279705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:55.287712 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:55.288192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:55.289126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:55.289559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:55.425802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:55.433838 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f7c0ad59-fe07-40cd-9bf7-1ece33bc2fa0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.158903 Jul 02 21:52:55.434425 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3105/6176] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:55 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:56.455427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:56.456486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:56.468481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:56.469237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:56.470523 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:56.471257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:56.631716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:56.639637 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c8127136-107f-45b8-9d56-5ba1ea7ca6b3 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.191144 Jul 02 21:52:56.640255 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3072/6177] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:56 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:56.731200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6ddf0356-9b47-4234-bfd3-73210371a700 req-95fdaac8-a0db-408f-a38e-27fd365946c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2", "name": "network-vif-plugged", "status": "completed", "tag": "e09faa1c-aeb1-418a-928b-78b477f4f24c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:52:56.740384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ddf0356-9b47-4234-bfd3-73210371a700 req-95fdaac8-a0db-408f-a38e-27fd365946c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:56.740831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6ddf0356-9b47-4234-bfd3-73210371a700 req-95fdaac8-a0db-408f-a38e-27fd365946c3 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:56.753029 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6ddf0356-9b47-4234-bfd3-73210371a700 req-95fdaac8-a0db-408f-a38e-27fd365946c3 service nova] Creating event network-vif-plugged:e09faa1c-aeb1-418a-928b-78b477f4f24c for instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 on nch1-master-1 Jul 02 21:52:56.757882 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6ddf0356-9b47-4234-bfd3-73210371a700 req-95fdaac8-a0db-408f-a38e-27fd365946c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 Jul 02 21:52:56.758449 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3106/6178] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:52:57.661486 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:57.662605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:57.673975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:57.674443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:57.675232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:57.675678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:57.816430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:57.827523 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d6b775c9-f52b-426b-87d2-0aceb7ce5399 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1317 microversion: 2.1 time: 0.173153 Jul 02 21:52:57.828137 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3073/6179] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:57 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:58.845927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:58.847153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:58.854483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:58.855664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:58.863889 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:58.864328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:58.865100 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:58.865547 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:58.997349 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:59.005468 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3bfe1218-d030-49c0-a548-fdac202dead1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1506 microversion: 2.1 time: 0.162839 Jul 02 21:52:59.006039 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3107/6180] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:58 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:52:59.021947 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:59.022473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:59.024468 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:52:59.031589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:59.032069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:59.032846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:59.033291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:59.062637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:52:59.141769 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f7390609-67e0-4ff9-bbe5-bc46c566e8dc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 204 len: 0 microversion: 2.1 time: 0.123224 Jul 02 21:52:59.142420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3074/6181] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:52:59 2022] DELETE /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:52:59.151453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:52:59.152089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:52:59.158958 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:59.159416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:59.160228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:52:59.160676 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:52:59.293587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:52:59.302381 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7f758554-feb8-4e48-90d0-15c370275def tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1512 microversion: 2.1 time: 0.155123 Jul 02 21:52:59.302997 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3108/6182] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:52:59 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:00.324889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:00.325601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:00.335285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:00.335911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:00.337138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:00.337741 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:00.495208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:00.503015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fb40cb08-db82-4a9b-a070-9776da44a35a tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1512 microversion: 2.1 time: 0.182611 Jul 02 21:53:00.503602 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3075/6183] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:00 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:01.192568 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6905dabd-2741-4202-b58e-216c2ac32911 req-89956bd8-abae-4975-a7c1-9e39318f0d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2", "name": "network-vif-deleted", "tag": "e09faa1c-aeb1-418a-928b-78b477f4f24c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:01.203505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6905dabd-2741-4202-b58e-216c2ac32911 req-89956bd8-abae-4975-a7c1-9e39318f0d8a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:01.203987 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6905dabd-2741-4202-b58e-216c2ac32911 req-89956bd8-abae-4975-a7c1-9e39318f0d8a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:01.216736 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6905dabd-2741-4202-b58e-216c2ac32911 req-89956bd8-abae-4975-a7c1-9e39318f0d8a service nova] Creating event network-vif-deleted:e09faa1c-aeb1-418a-928b-78b477f4f24c for instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 on nch1-master-1 Jul 02 21:53:01.222596 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6905dabd-2741-4202-b58e-216c2ac32911 req-89956bd8-abae-4975-a7c1-9e39318f0d8a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037560 Jul 02 21:53:01.223341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3109/6184] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:53:01.525411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:01.526681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:01.536142 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:01.536595 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:01.537370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:01.537811 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:01.569793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:01.570242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:01.570701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lazy-loading 'fault' on Instance uuid b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:53:01.612176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:01.619856 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1a679ab1-8f1f-4710-94f9-06dcb3703d44 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 200 len: 1307 microversion: 2.1 time: 0.101203 Jul 02 21:53:01.620458 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3076/6185] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:01 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:02.645008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:02.646159 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:02.657455 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:02.658213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:02.659506 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:02.660301 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:02.681678 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] HTTP exception thrown: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 HTTP/1.1 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2'} Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:02.683333 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 404 to user: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c28fcc51-de99-4510-8746-fc556dc10978 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 404 len: 111 microversion: 2.1 time: 0.048639 Jul 02 21:53:02.688146 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3110/6186] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:02 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:53:02.694515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:02.695150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:02.702911 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:02.703365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:02.704182 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:02.704631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:02.836364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:02.844537 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-28d86e03-23ec-4094-941c-bb304ed54be8 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.153968 Jul 02 21:53:02.845116 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3077/6187] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:02 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:02.861195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0a2e1b5-0d38-43c4-a13d-202f045ecc54 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:02.862229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f0a2e1b5-0d38-43c4-a13d-202f045ecc54 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: e49301e5-704f-43e4-9a29-dd4df137b33c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:02.867972 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-f0a2e1b5-0d38-43c4-a13d-202f045ecc54 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] HTTP exception thrown: Instance e49301e5-704f-43e4-9a29-dd4df137b33c could not be found. Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0a2e1b5-0d38-43c4-a13d-202f045ecc54 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/e49301e5-704f-43e4-9a29-dd4df137b33c/action HTTP/1.1 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 32 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: {"resize": {"flavorRef": "452"}} Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance e49301e5-704f-43e4-9a29-dd4df137b33c could not be found. Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'e49301e5-704f-43e4-9a29-dd4df137b33c', 'body': {'resize': {'flavorRef': '452'}}} Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e49301e5-704f-43e4-9a29-dd4df137b33c could not be found. Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:53:02.869564 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e49301e5-704f-43e4-9a29-dd4df137b33c could not be found. Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e49301e5-704f-43e4-9a29-dd4df137b33c could not be found. Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f0a2e1b5-0d38-43c4-a13d-202f045ecc54 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 404 to user: Instance e49301e5-704f-43e4-9a29-dd4df137b33c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f0a2e1b5-0d38-43c4-a13d-202f045ecc54 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "POST /compute/v2.1/servers/e49301e5-704f-43e4-9a29-dd4df137b33c/action" status: 404 len: 111 microversion: 2.1 time: 0.013797 Jul 02 21:53:02.873945 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3111/6188] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:53:02 2022] POST /compute/v2.1/servers/e49301e5-704f-43e4-9a29-dd4df137b33c/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:53:02.879746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:02.880393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:02.886888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:02.887348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:02.888141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:02.888564 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.026888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:03.035608 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-94fbb756-43c8-4545-8336-f14182d15675 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.159680 Jul 02 21:53:03.036217 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3078/6189] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:02 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:03.052742 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.053357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.060642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.061091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.061909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.062344 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.205448 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:03.213567 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-64db535e-c01a-4e5b-83e5-806aa6b93fc1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.164760 Jul 02 21:53:03.214150 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3112/6190] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:03 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:03.230366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "039a68bd-837a-4fac-92f5-d5628b4add9e"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:03.231284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.237745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.238197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.238979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.239416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.243665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:03.268967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:03.274643 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] HTTP exception thrown: Flavor 039a68bd-837a-4fac-92f5-d5628b4add9e could not be found. Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: request: POST /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3/action HTTP/1.1 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 65 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: {"resize": {"flavorRef": "039a68bd-837a-4fac-92f5-d5628b4add9e"}} Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: exception: Flavor 039a68bd-837a-4fac-92f5-d5628b4add9e could not be found. Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '51a0ca13-be31-40f3-856f-4517bcf28da3', 'body': {'resize': {'flavorRef': '039a68bd-837a-4fac-92f5-d5628b4add9e'}}} Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 02 21:53:03.276569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 039a68bd-837a-4fac-92f5-d5628b4add9e could not be found. Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 039a68bd-837a-4fac-92f5-d5628b4add9e could not be found. Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 039a68bd-837a-4fac-92f5-d5628b4add9e could not be found. Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 400 to user: Flavor 039a68bd-837a-4fac-92f5-d5628b4add9e could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dfba55f9-d534-4fb8-becf-ef9c510a80f0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "POST /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3/action" status: 400 len: 107 microversion: 2.1 time: 0.051776 Jul 02 21:53:03.281538 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3079/6191] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:53:03 2022] POST /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:53:03.287234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.287861 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.294257 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.294719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.295529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.295971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.445472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:03.461450 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-95d682a5-5c02-4a6d-8929-fd8593a21c14 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.177884 Jul 02 21:53:03.462339 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3113/6192] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:03 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:03.484183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.485146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.494906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.495641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.496890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.497574 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.651252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:03.660010 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e56bbf10-0fa8-48dc-962a-f69bb01b17d0 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.182582 Jul 02 21:53:03.660634 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3080/6193] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:03 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:03.676920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce7780a6-d097-4811-bfa2-7db516e8f639 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce7780a6-d097-4811-bfa2-7db516e8f639 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: request: POST /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3/action HTTP/1.1 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 29 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: {"resize": {"flavorRef": ""}} Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '51a0ca13-be31-40f3-856f-4517bcf28da3', 'body': {'resize': {'flavorRef': ''}}} Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise error Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi '' Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.679263 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce7780a6-d097-4811-bfa2-7db516e8f639 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce7780a6-d097-4811-bfa2-7db516e8f639 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "POST /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3/action" status: 400 len: 113 microversion: 2.1 time: 0.007798 Jul 02 21:53:03.683895 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3114/6194] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:53:03 2022] POST /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 02 21:53:03.688882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.689499 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.695998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.696602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.697247 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.697686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.842372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:03.854045 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-26f9386a-905a-4005-8d21-a606246e1979 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1506 microversion: 2.1 time: 0.168631 Jul 02 21:53:03.854818 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3081/6195] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:03 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:03.876254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.876756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.884240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.884695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.885487 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.885906 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.899675 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] HTTP exception thrown: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: request: DELETE /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 HTTP/1.1 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2'} Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:53:03.901324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 404 to user: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a39e4b69-33d9-4570-90d2-1a50b5ad5b86 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 404 len: 111 microversion: 2.1 time: 0.031352 Jul 02 21:53:03.905281 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3115/6196] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:53:03 2022] DELETE /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:53:03.911996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.912651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.919051 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.919507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.920391 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.920846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.934914 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] HTTP exception thrown: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 HTTP/1.1 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2'} Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:03.936676 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 404 to user: Instance b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9b88e5e8-ea05-4b8c-af0d-6e5ef6d709bc tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2" status: 404 len: 111 microversion: 2.1 time: 0.030221 Jul 02 21:53:03.941199 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3082/6197] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:03 2022] GET /compute/v2.1/servers/b13bbe92-5e1c-4d4c-8b96-35d717c8f7e2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:53:03.946658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:03.947166 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:03.953977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.954433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.955208 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:03.955655 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:03.981709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:53:04.062794 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36da2ad4-17c9-42a1-80b7-075073f7b820 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "DELETE /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 204 len: 0 microversion: 2.1 time: 0.119768 Jul 02 21:53:04.063346 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3116/6198] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:53:03 2022] DELETE /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 21:53:04.073037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:04.073694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:04.080535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:04.080989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:04.081757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:04.082256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:04.228763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:04.236604 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-719e7d6b-505e-44e2-bb0a-b19f992849bd tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1512 microversion: 2.1 time: 0.168553 Jul 02 21:53:04.237185 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3083/6199] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:04 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:05.256592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:05.257496 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:05.266375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:05.266835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:05.267625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:05.268083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:05.273297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:05.400763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:05.408983 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-db0a627f-d097-4e06-8b95-668055bc90f1 tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1512 microversion: 2.1 time: 0.157951 Jul 02 21:53:05.409568 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3117/6200] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:05 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:06.139887 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-120dbc5d-a3c2-4845-9d9a-c3f1170646a1 req-439f2456-aa4b-4416-8250-4bd07fb8bd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51a0ca13-be31-40f3-856f-4517bcf28da3", "name": "network-vif-deleted", "tag": "5c04a1b1-4348-4942-a480-43b12d7a73a5"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:06.149306 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-120dbc5d-a3c2-4845-9d9a-c3f1170646a1 req-439f2456-aa4b-4416-8250-4bd07fb8bd5c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:06.149756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-120dbc5d-a3c2-4845-9d9a-c3f1170646a1 req-439f2456-aa4b-4416-8250-4bd07fb8bd5c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:06.162189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-120dbc5d-a3c2-4845-9d9a-c3f1170646a1 req-439f2456-aa4b-4416-8250-4bd07fb8bd5c service nova] Creating event network-vif-deleted:5c04a1b1-4348-4942-a480-43b12d7a73a5 for instance 51a0ca13-be31-40f3-856f-4517bcf28da3 on nch2-master-1 Jul 02 21:53:06.173942 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-120dbc5d-a3c2-4845-9d9a-c3f1170646a1 req-439f2456-aa4b-4416-8250-4bd07fb8bd5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131265 Jul 02 21:53:06.174724 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3084/6201] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:53:06.427216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:06.427946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:06.437183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:06.437947 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:06.439182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:06.439960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:06.478443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:06.478903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:06.479390 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lazy-loading 'fault' on Instance uuid 51a0ca13-be31-40f3-856f-4517bcf28da3 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:53:06.523288 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d35b509fd734cb1bbcc4fdd3b4c9def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c721294324ba42ddabb84b33a06e03ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:06.531976 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1b30465-b3ca-479a-ad24-c6a76574556b tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 200 len: 1306 microversion: 2.1 time: 0.109258 Jul 02 21:53:06.532594 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3118/6202] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:06 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:07.556722 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:07.557875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] [instance: 51a0ca13-be31-40f3-856f-4517bcf28da3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:07.568775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:07.569560 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:07.570819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:07.571546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:07.588400 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] HTTP exception thrown: Instance 51a0ca13-be31-40f3-856f-4517bcf28da3 could not be found. Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Request method failure captured: Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 HTTP/1.1 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL4lUA4_9PW-mkPi-sro_IEYlMCMMVR9cM3lS9rjS95v13QZ40RT8aPwo4U47-5TdCs6pwHgbPJBNY1tKixsNcd99_-FV68FwquezOFigeZZg24lMwnqwwaYDJp7VAhTsuqD3uaApJQ2MxBDc4OJIFLUN-r94kKJCkE0OIuqyi-Px8Y Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c721294324ba42ddabb84b33a06e03ee", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c721294324ba42ddabb84b33a06e03ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c721294324ba42ddabb84b33a06e03ee"}]}] Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: c721294324ba42ddabb84b33a06e03ee Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-ServersNegativeTestJSON-720699851 Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 6d35b509fd734cb1bbcc4fdd3b4c9def Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-ServersNegativeTestJSON-720699851-project Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 51a0ca13-be31-40f3-856f-4517bcf28da3 could not be found. Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '51a0ca13-be31-40f3-856f-4517bcf28da3'} Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51a0ca13-be31-40f3-856f-4517bcf28da3 could not be found. Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51a0ca13-be31-40f3-856f-4517bcf28da3 could not be found. Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:53:07.590028 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51a0ca13-be31-40f3-856f-4517bcf28da3 could not be found. Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] Returning 404 to user: Instance 51a0ca13-be31-40f3-856f-4517bcf28da3 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-06f48cf4-3262-4bcd-b059-a1673487ae2c tempest-ServersNegativeTestJSON-720699851 tempest-ServersNegativeTestJSON-720699851-project] 10.222.0.43 "GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3" status: 404 len: 111 microversion: 2.1 time: 0.043670 Jul 02 21:53:07.594269 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3085/6203] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:07 2022] GET /compute/v2.1/servers/51a0ca13-be31-40f3-856f-4517bcf28da3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:53:47.804575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47b2a6d3-9b72-432f-8a6d-95b98b922640 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Action: 'create', calling method: .version_select at 0x7fabe4826430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-146194464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHiMGMIOF0j9TnUYmKkA6jfWG/H2uRwvlGr4rf1ovG+mwJrka4oymHHGVVGJu7PHJJXkRrQYWBIHyOj8Up/3xjd/4kogpLPOacLRLIi8kcGIpTo2dJHunTJNkt3BmzSPw=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:47.808946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:47.809669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:47.823948 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-47b2a6d3-9b72-432f-8a6d-95b98b922640 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:53:47.829417 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-47b2a6d3-9b72-432f-8a6d-95b98b922640 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for user 4e7c01edc3ee499f9e6aa1003dce77dc and project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:53:47.858902 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47b2a6d3-9b72-432f-8a6d-95b98b922640 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058738 Jul 02 21:53:47.859805 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3119/6204] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:53:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:53:47.910258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-203443171", "imageRef": "23a56322-ab67-44a9-9d85-22d4816b9760", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-146194464", "networks": [{"uuid": "2e64619b-718e-4793-8cac-0169e7524a96"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:47.917533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:47.918209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=26 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:47.965561 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] validate_networks() for [('2e64619b-718e-4793-8cac-0169e7524a96', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:53:48.836427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:53:48.836895 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:53:48.837381 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:53:48.837799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:53:48.838218 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:53:48.848084 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:48.848554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:48.849363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:48.849807 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:48.875370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:53:48.882348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for user 4e7c01edc3ee499f9e6aa1003dce77dc and project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:53:48.895754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:53:48.898095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23a56322-ab67-44a9-9d85-22d4816b9760',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:53:48.950113 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e2f90c4-a7c1-4be2-ba5c-4c0b6892265d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.044464 Jul 02 21:53:48.950801 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3086/6205] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:53:48.961031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2243c900-a4e1-4cb7-89b0-85e16c82ea93 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:48.961836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2243c900-a4e1-4cb7-89b0-85e16c82ea93 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:49.017041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2243c900-a4e1-4cb7-89b0-85e16c82ea93 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:49.024103 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2243c900-a4e1-4cb7-89b0-85e16c82ea93 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1257 microversion: 2.1 time: 0.067090 Jul 02 21:53:49.024821 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3120/6206] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:48 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:50.043605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:50.044245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:50.051974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:50.052496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:50.053276 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:50.053740 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:50.137231 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:50.145249 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7757f268-3110-4f1e-b285-84e581b0b379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1327 microversion: 2.1 time: 0.106932 Jul 02 21:53:50.145833 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3087/6207] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:50 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:51.163043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:51.163650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:51.177764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:51.178499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:51.179846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:51.180640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:51.324895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:51.334063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-53ef9991-3767-404d-9222-dbf760d3ae58 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.174869 Jul 02 21:53:51.334903 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3121/6208] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:51 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:52.352679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:52.354580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:52.362339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:52.362804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:52.363598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:52.364064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:52.509035 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:52.517663 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b2e83401-e599-4f50-a806-1d62c8a2430a tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.169507 Jul 02 21:53:52.519386 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3088/6209] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:52 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:53.536783 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:53.537534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:53.545404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:53.545857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:53.546646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:53.547078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:53.685203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:53.693913 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c14b2425-2055-4e5b-a775-98ec3fb0a4fe tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.161498 Jul 02 21:53:53.694861 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3122/6210] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:53 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:54.711213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:54.711880 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:54.720390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:54.720806 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:54.721590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:54.722252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:54.871380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:54.879612 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-81291a6f-847b-49c7-b5ce-ed6d92d51e15 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.172365 Jul 02 21:53:54.880235 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3089/6211] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:54 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:55.897410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:55.898035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:55.905943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:55.906440 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:55.907262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:55.907701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:56.049576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:56.058122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8405a26e-d579-4c19-b5f8-e62db4a3c3e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.164721 Jul 02 21:53:56.058716 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3123/6212] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:55 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:57.075833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:57.078210 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:57.088557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:57.089387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:57.090432 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:57.091080 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:57.257438 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:57.265687 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8fd9a7a1-2e29-42d4-894e-564e40985b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.194214 Jul 02 21:53:57.266481 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3090/6213] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:57 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:58.287627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:58.288681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:58.299308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:58.299765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:58.300599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:58.301043 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:58.444378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:58.455066 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-260aed0a-f893-4ca5-9f21-44c8fc37f08c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.174208 Jul 02 21:53:58.455644 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3124/6214] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:58 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:53:59.232420 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-d7413afd-80ca-499f-94af-34ea788805d3 req-21dd1cec-e24c-4e2c-b32f-9ba613764f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "223a9059-b787-449b-a318-3e460b0c4aff", "tag": "4105da2d-e1bf-4447-8c3d-18f2bbc1ab9e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:53:59.238244 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:59.239504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:59.245092 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d7413afd-80ca-499f-94af-34ea788805d3 req-21dd1cec-e24c-4e2c-b32f-9ba613764f4c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:59.245787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-d7413afd-80ca-499f-94af-34ea788805d3 req-21dd1cec-e24c-4e2c-b32f-9ba613764f4c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:59.259721 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-d7413afd-80ca-499f-94af-34ea788805d3 req-21dd1cec-e24c-4e2c-b32f-9ba613764f4c service nova] Creating event network-changed:4105da2d-e1bf-4447-8c3d-18f2bbc1ab9e for instance 223a9059-b787-449b-a318-3e460b0c4aff on nch2-master-1 Jul 02 21:53:59.266770 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-d7413afd-80ca-499f-94af-34ea788805d3 req-21dd1cec-e24c-4e2c-b32f-9ba613764f4c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037605 Jul 02 21:53:59.267437 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3091/6215] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:53:59.472527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:53:59.473199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:53:59.474946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:53:59.482338 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:59.482724 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:59.483513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:53:59.483956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:53:59.620063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:53:59.628247 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-06a4bcd1-54a9-415c-a7d1-4fbac7d8aab0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.159913 Jul 02 21:53:59.628827 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3125/6216] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:53:59 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:00.652132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:00.653165 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:00.664506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:00.665263 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:00.666534 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:00.667262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:00.808268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:00.816626 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6c7c76ff-7073-4169-874e-fafe5557e86d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.173390 Jul 02 21:54:00.817517 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3092/6217] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:00 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:01.839387 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:01.840579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:01.848511 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:01.849051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:01.849838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:01.850281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:01.988032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:01.996066 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d3ca7573-0b2c-4fa7-9764-f5b29cdc2a7b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.164206 Jul 02 21:54:01.996666 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3126/6218] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:01 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:03.017387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:03.018012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:03.025490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:03.025951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:03.026734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:03.027176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:03.167240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:03.178675 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd871858-6494-4569-a7c8-d12959cd9a9e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.167626 Jul 02 21:54:03.179465 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3093/6219] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:03 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:03.559813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-761019ba-f6f0-4c9c-a536-2abebe9dca07 req-e66b3bfa-3fbc-4355-b0ae-ffd679290685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223a9059-b787-449b-a318-3e460b0c4aff", "name": "network-vif-plugged", "status": "completed", "tag": "4105da2d-e1bf-4447-8c3d-18f2bbc1ab9e"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:03.570316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-761019ba-f6f0-4c9c-a536-2abebe9dca07 req-e66b3bfa-3fbc-4355-b0ae-ffd679290685 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:03.571046 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-761019ba-f6f0-4c9c-a536-2abebe9dca07 req-e66b3bfa-3fbc-4355-b0ae-ffd679290685 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:03.583888 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-761019ba-f6f0-4c9c-a536-2abebe9dca07 req-e66b3bfa-3fbc-4355-b0ae-ffd679290685 service nova] Creating event network-vif-plugged:4105da2d-e1bf-4447-8c3d-18f2bbc1ab9e for instance 223a9059-b787-449b-a318-3e460b0c4aff on nch2-master-1 Jul 02 21:54:03.588988 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-761019ba-f6f0-4c9c-a536-2abebe9dca07 req-e66b3bfa-3fbc-4355-b0ae-ffd679290685 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033059 Jul 02 21:54:03.589578 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3127/6220] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:04.204334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:04.205429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:04.213240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:04.213701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:04.214478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:04.214920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:04.356888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:04.365020 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9e4c8d70-8579-4235-a385-5ed50e89b38c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1357 microversion: 2.1 time: 0.167556 Jul 02 21:54:04.365645 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3094/6221] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:04 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:05.387436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:05.388553 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:05.401606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.402346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.403812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.405500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.542260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:05.550030 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88140b5e-8229-4f12-88ba-384fda8d4b33 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1546 microversion: 2.1 time: 0.169965 Jul 02 21:54:05.550608 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3128/6222] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:05 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:05.566482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:05.567138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:05.574996 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.575463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.576285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.576732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.712472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:05.720822 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3038a67a-a4ac-48e2-ba21-bbeccf54e882 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1546 microversion: 2.1 time: 0.158364 Jul 02 21:54:05.721435 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3095/6223] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:05 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:05.744055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:05.747352 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:05.748093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Searching by: {'deleted': False, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5'} {{(pid=131044) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:54:05.753699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.754148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.754937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.755370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.779875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.multi_cell_list [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131044) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:54:05.808403 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cc6b6fc0-2d41-4eed-8b22-10954ca3fb97 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069175 Jul 02 21:54:05.808976 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3129/6224] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:54:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:05.819625 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:05.820294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:05.826919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.827357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.828185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:05.828643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:05.962134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:05.970215 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-83bdd094-6624-4bf5-89ba-6cbcf7e4623e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1546 microversion: 2.1 time: 0.154575 Jul 02 21:54:05.970801 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3096/6225] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:05 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:07.492425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:07.492944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:07.500152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:07.500605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:07.501380 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:07.501824 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:07.526732 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:54:07.614776 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-68c01bec-76b9-401c-b1d5-a746b09476ce tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "DELETE /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 204 len: 0 microversion: 2.1 time: 0.125934 Jul 02 21:54:07.615332 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3130/6226] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:54:07 2022] DELETE /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:54:07.624783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:07.625408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:07.632768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:07.633230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:07.634012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:07.634463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:07.772377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:07.782266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-22bfdcd7-bf18-4506-b355-06f0d1b727e1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1552 microversion: 2.1 time: 0.161871 Jul 02 21:54:07.782890 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3097/6227] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:07 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:08.804635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:08.805333 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:08.812795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:08.813258 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:08.814035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:08.814469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:08.949271 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:08.957120 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d650f901-5e14-4e25-869a-f64a7bc971a1 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1552 microversion: 2.1 time: 0.159304 Jul 02 21:54:08.957675 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3131/6228] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:08 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:09.793729 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-b2f5f095-21d4-42de-b823-1359ba407911 req-78df9e2e-0317-4de8-a4f6-9fab8a4c4be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "223a9059-b787-449b-a318-3e460b0c4aff", "name": "network-vif-deleted", "tag": "4105da2d-e1bf-4447-8c3d-18f2bbc1ab9e"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:09.804167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b2f5f095-21d4-42de-b823-1359ba407911 req-78df9e2e-0317-4de8-a4f6-9fab8a4c4be9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:09.804619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-b2f5f095-21d4-42de-b823-1359ba407911 req-78df9e2e-0317-4de8-a4f6-9fab8a4c4be9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:09.816870 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-b2f5f095-21d4-42de-b823-1359ba407911 req-78df9e2e-0317-4de8-a4f6-9fab8a4c4be9 service nova] Creating event network-vif-deleted:4105da2d-e1bf-4447-8c3d-18f2bbc1ab9e for instance 223a9059-b787-449b-a318-3e460b0c4aff on nch2-master-1 Jul 02 21:54:09.822351 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-b2f5f095-21d4-42de-b823-1359ba407911 req-78df9e2e-0317-4de8-a4f6-9fab8a4c4be9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032370 Jul 02 21:54:09.822989 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3098/6229] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:09.975979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:09.976666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:09.984342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:09.984768 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:09.985556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:09.986002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:10.021160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:10.021531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:10.021992 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lazy-loading 'fault' on Instance uuid 223a9059-b787-449b-a318-3e460b0c4aff {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:54:10.063542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:10.071754 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f23fa902-170f-4c91-bebe-1fb5d5c81a92 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 200 len: 1347 microversion: 2.1 time: 0.099952 Jul 02 21:54:10.072360 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3132/6230] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:09 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:11.093463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:11.094212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 223a9059-b787-449b-a318-3e460b0c4aff] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:11.101175 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:11.101636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:11.102429 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:11.102872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:11.120399 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] HTTP exception thrown: Instance 223a9059-b787-449b-a318-3e460b0c4aff could not be found. Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Request method failure captured: Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff HTTP/1.1 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL5doRsDMmgrAAwbSftN-S7Hw92qjEw3p8c2tKRryrEUBsjxSXWcr7QRV9Hlxz9qyhvPr0g-Frvw_DDHU-bKRoC1D5uxfNOAPac43jnuFvZcf1C1Xw0Jjk-qavnRJCLhaDNMjCfS1w_H0btSGNkwyBuU-C_BO68FtZvHX28LqQEulFc Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 77b8740a1b5c40aa90dc3c6a72fed1f5 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestMinimumBasicScenario-1079782690 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b8740a1b5c40aa90dc3c6a72fed1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77b8740a1b5c40aa90dc3c6a72fed1f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b8740a1b5c40aa90dc3c6a72fed1f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77b8740a1b5c40aa90dc3c6a72fed1f5"}]}] Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestMinimumBasicScenario-1079782690 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 77b8740a1b5c40aa90dc3c6a72fed1f5 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1079782690 Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestMinimumBasicScenario-1079782690-project Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 4e7c01edc3ee499f9e6aa1003dce77dc Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestMinimumBasicScenario-1079782690-project Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 223a9059-b787-449b-a318-3e460b0c4aff could not be found. Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '223a9059-b787-449b-a318-3e460b0c4aff'} Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 223a9059-b787-449b-a318-3e460b0c4aff could not be found. Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 223a9059-b787-449b-a318-3e460b0c4aff could not be found. Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:54:11.122083 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 223a9059-b787-449b-a318-3e460b0c4aff could not be found. Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Returning 404 to user: Instance 223a9059-b787-449b-a318-3e460b0c4aff could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a20e51f-c722-49b5-ae09-e28d49613b98 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff" status: 404 len: 111 microversion: 2.1 time: 0.037354 Jul 02 21:54:11.126824 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3099/6231] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:11 2022] GET /compute/v2.1/servers/223a9059-b787-449b-a318-3e460b0c4aff => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:54:11.132935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ce864d9e-5a2a-4fe1-926c-136a2651bd2d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '.version_select at 0x7fabd777d3a0>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:11.159747 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ce864d9e-5a2a-4fe1-926c-136a2651bd2d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-146194464" status: 202 len: 0 microversion: 2.1 time: 0.030834 Jul 02 21:54:11.160385 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3133/6232] 10.222.0.43 () {58 vars in 1268 bytes} [Sat Jul 2 21:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-146194464 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:54:19.961091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9f5f1e10-57f6-4a01-9fb1-18766ec88bfc tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Action: 'create', calling method: .version_select at 0x7fabd71e15e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1553075656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAREqFQ7VrJCqlntcEM9swX2hB3ayJogVD80V/lO0qmui43IL5pw3Wdy9P6g88rn7LFwWUO4EexHT92UCy90INXVWyod+22TEiQudhT2lon6ldEBbKjf96R1uVsmrIbGxA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:19.965669 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:19.979011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9f5f1e10-57f6-4a01-9fb1-18766ec88bfc tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:54:19.984365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-9f5f1e10-57f6-4a01-9fb1-18766ec88bfc tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for user 4e7c01edc3ee499f9e6aa1003dce77dc and project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:54:20.011237 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9f5f1e10-57f6-4a01-9fb1-18766ec88bfc tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054264 Jul 02 21:54:20.011760 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3100/6233] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:54:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:20.060800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:20.065253 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1487536136", "imageRef": "6cd0d621-a083-4d97-8d6c-9356ca0884fa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1553075656", "networks": [{"uuid": "2e64619b-718e-4793-8cac-0169e7524a96"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:20.072643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:20.073272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:20.120015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] validate_networks() for [('2e64619b-718e-4793-8cac-0169e7524a96', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:54:20.522737 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:54:20.523160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:54:20.523634 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:54:20.524064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:54:20.524475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:54:20.539680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:20.539680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:20.540441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:20.540895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:20.563240 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:54:20.569124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Getting quotas for user 4e7c01edc3ee499f9e6aa1003dce77dc and project 77b8740a1b5c40aa90dc3c6a72fed1f5. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:54:20.587515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:54:20.590792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6cd0d621-a083-4d97-8d6c-9356ca0884fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:54:20.639250 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84279282-b125-4d53-99c3-31c291222539 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580264 Jul 02 21:54:20.640002 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3134/6234] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:54:20.650586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-af188487-b2e3-432d-95c0-81369a827ca4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:20.651300 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-af188487-b2e3-432d-95c0-81369a827ca4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:20.707269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-af188487-b2e3-432d-95c0-81369a827ca4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:20.715494 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-af188487-b2e3-432d-95c0-81369a827ca4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1259 microversion: 2.1 time: 0.069098 Jul 02 21:54:20.716092 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3101/6235] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:20 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1259 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:21.733367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:21.734674 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:21.742364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:21.743041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:21.743984 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:21.744609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:21.818401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:21.828429 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1d7af12d-eb03-4209-ac64-830f6f579ca3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1329 microversion: 2.1 time: 0.099904 Jul 02 21:54:21.838465 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3135/6236] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:21 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:22.846248 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:22.846848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:22.849686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=68 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:22.855515 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:22.855980 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:22.856778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:22.857223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:22.995414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:23.003213 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-85be301a-af0e-407e-a4ce-1a784bbc8814 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.161297 Jul 02 21:54:23.003818 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3102/6237] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:22 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:24.020210 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:24.020977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:24.028093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:24.028564 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:24.029854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:24.030292 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:24.183038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:24.192145 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ae804d6b-0f40-4e69-9075-d8782ff4ead3 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.175826 Jul 02 21:54:24.192746 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3136/6238] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:24 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:25.209352 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:25.209957 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:25.218087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:25.218591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:25.219403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:25.219846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:25.355897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:25.364225 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d42985da-1420-4939-83c1-49449dc7a379 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.158929 Jul 02 21:54:25.365443 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3103/6239] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:25 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:26.381792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:26.382449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:26.390561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:26.391022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:26.391814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:26.392285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:26.529954 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:26.537913 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a8cf3beb-19d2-40df-adab-242f46a66bc2 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.160923 Jul 02 21:54:26.538537 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3137/6240] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:26 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:27.554613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:27.555294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:27.562730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:27.563192 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:27.563975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:27.564444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:27.706506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:27.715041 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-843b877d-8e28-4330-9704-4e9fcf6cbed5 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.164580 Jul 02 21:54:27.725187 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3104/6241] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:27 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:28.732703 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:28.733350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:28.740662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:28.741122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:28.741897 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:28.742340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:28.886501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:28.898243 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fc6f13c5-de6c-45ca-86b2-48a12cd61606 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.169276 Jul 02 21:54:28.899798 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3138/6242] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:28 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:29.920368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:29.921318 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:29.931320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:29.931746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:29.932554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:29.932992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:30.073546 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:30.083762 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dc32e3e3-590c-4829-b08d-17b5e3c39efd tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.170099 Jul 02 21:54:30.084663 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3105/6243] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:29 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:30.998098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1418c5a5-b721-4c64-a16b-f8697c1283c2 req-539ee889-31da-4832-8735-182e58a07927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fcf35c1-643e-4ed9-a0aa-67580369d3a5", "tag": "39f059d7-0775-408a-9add-936bc07aed23"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:31.010786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:31.012678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:31.014814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1418c5a5-b721-4c64-a16b-f8697c1283c2 req-539ee889-31da-4832-8735-182e58a07927 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:31.015378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1418c5a5-b721-4c64-a16b-f8697c1283c2 req-539ee889-31da-4832-8735-182e58a07927 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:31.029897 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1418c5a5-b721-4c64-a16b-f8697c1283c2 req-539ee889-31da-4832-8735-182e58a07927 service nova] Creating event network-changed:39f059d7-0775-408a-9add-936bc07aed23 for instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 on nch2-master-1 Jul 02 21:54:31.035716 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1418c5a5-b721-4c64-a16b-f8697c1283c2 req-539ee889-31da-4832-8735-182e58a07927 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047329 Jul 02 21:54:31.036548 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3139/6244] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:31.103056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:31.103685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:31.106935 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:31.112033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:31.112478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:31.113259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:31.113704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:31.252732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:31.260460 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7236b63a-2bf0-4161-9c24-cb69d2b79b8d tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.161417 Jul 02 21:54:31.260981 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3106/6245] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:31 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:32.284424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:32.285589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:32.293194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:32.293643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:32.294410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:32.294844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:32.432001 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:32.439740 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5e1fc829-2d55-45bc-8af3-b5f9d1e17748 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.164447 Jul 02 21:54:32.440347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3140/6246] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:32 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:33.457488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:33.458095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:33.465861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:33.466322 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:33.467109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:33.467554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:33.600369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:33.610588 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-957f8864-789e-438a-a600-d7dd417282d7 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.156790 Jul 02 21:54:33.611396 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3107/6247] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:33 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:34.632749 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:34.633396 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:34.640832 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:34.641285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:34.642057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:34.642497 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:34.779715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:34.787870 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8865cb1-5171-4fdb-bdf4-62c5ac7549e0 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.161840 Jul 02 21:54:34.788491 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3141/6248] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:34 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:54:35.806414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:35.806992 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:35.814717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:35.815212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:35.816007 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:35.816487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:35.955657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:35.963927 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1dffe16a-9717-4ea3-b76b-d8a1532b2754 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.161734 Jul 02 21:54:35.964525 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3108/6249] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:35 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:36.986809 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:36.987745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:37.000067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:37.000840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:37.002183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:37.002990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:37.142646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:37.150815 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7ed6c35-be2f-4cf5-8f9c-88b9fe598924 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.170713 Jul 02 21:54:37.151373 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3142/6250] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:36 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:37.839254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-7ee4c57f-4891-4205-935e-70a56a3cb45c req-63860473-299a-431f-93d5-a2c980331a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf35c1-643e-4ed9-a0aa-67580369d3a5", "name": "network-vif-plugged", "status": "completed", "tag": "39f059d7-0775-408a-9add-936bc07aed23"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:37.847742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7ee4c57f-4891-4205-935e-70a56a3cb45c req-63860473-299a-431f-93d5-a2c980331a2c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:37.848242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-7ee4c57f-4891-4205-935e-70a56a3cb45c req-63860473-299a-431f-93d5-a2c980331a2c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:37.859555 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-7ee4c57f-4891-4205-935e-70a56a3cb45c req-63860473-299a-431f-93d5-a2c980331a2c service nova] Creating event network-vif-plugged:39f059d7-0775-408a-9add-936bc07aed23 for instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 on nch2-master-1 Jul 02 21:54:37.864767 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-7ee4c57f-4891-4205-935e-70a56a3cb45c req-63860473-299a-431f-93d5-a2c980331a2c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160537 Jul 02 21:54:37.865344 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3109/6251] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:38.172814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:38.173856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:38.185620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:38.186339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:38.187620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:38.188459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:38.324072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:38.332063 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4e69f910-3a59-4f88-87d0-7578d54303ca tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1359 microversion: 2.1 time: 0.165854 Jul 02 21:54:38.332663 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3143/6252] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:38 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:39.355463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:39.356086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:39.363128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.363586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.364446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.364889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.511897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:39.519810 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-9664fd49-2fc3-4807-a88f-1430806814f9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1547 microversion: 2.1 time: 0.169683 Jul 02 21:54:39.520447 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3110/6253] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:39 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:39.536584 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:39.537196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:39.544616 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.545061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.545833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.546265 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.687304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:39.699218 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0a64562b-9612-4aa6-8ce6-4464f96f2f4e tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1547 microversion: 2.1 time: 0.166291 Jul 02 21:54:39.700366 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3144/6254] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:39 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:39.715849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:39.719170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:39.719967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Searching by: {'deleted': False, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5'} {{(pid=131045) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 02 21:54:39.725785 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.726209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.727005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.727439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.751778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.multi_cell_list [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131045) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 02 21:54:39.779223 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-118c0c8c-6eb9-451a-879f-0520f8096938 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066943 Jul 02 21:54:39.779805 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3111/6255] 10.222.0.43 () {58 vars in 1124 bytes} [Sat Jul 2 21:54:39 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:39.790642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:39.791394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:39.797808 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.798304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.799078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:39.799520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:39.949022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:39.957395 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b54bf403-f71e-4ff3-bcc6-39da91530bae tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1547 microversion: 2.1 time: 0.170731 Jul 02 21:54:39.957976 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3145/6256] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:39 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:41.456167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:41.456681 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:41.463981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:41.464483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:41.465262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:41.465706 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:41.490932 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:54:41.574450 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-af934622-f4f8-4e2c-9778-273a53e894a9 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 204 len: 0 microversion: 2.1 time: 0.122075 Jul 02 21:54:41.575256 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3112/6257] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:54:41 2022] DELETE /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:54:41.583901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:41.584574 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:41.592688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:41.593479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:41.594839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:41.595285 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:41.744416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:41.752620 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-11f373bc-e733-4958-bc6f-c602110ee18b tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1553 microversion: 2.1 time: 0.172678 Jul 02 21:54:41.753199 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3146/6258] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:41 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:42.772331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:42.773135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:42.782504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:42.783049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:42.783974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:42.784542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:42.923475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:42.931877 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e14cfcd2-3827-4d68-baa4-edb6acbe60e4 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1553 microversion: 2.1 time: 0.164866 Jul 02 21:54:42.932514 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3113/6259] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:42 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:43.475935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-75fc2fad-3b87-44e5-bc3f-7ab30051ddf3 req-623fff75-0441-441f-a388-53cba76a409e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fcf35c1-643e-4ed9-a0aa-67580369d3a5", "name": "network-vif-deleted", "tag": "39f059d7-0775-408a-9add-936bc07aed23"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:43.488332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75fc2fad-3b87-44e5-bc3f-7ab30051ddf3 req-623fff75-0441-441f-a388-53cba76a409e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:43.488332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-75fc2fad-3b87-44e5-bc3f-7ab30051ddf3 req-623fff75-0441-441f-a388-53cba76a409e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:43.500355 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-75fc2fad-3b87-44e5-bc3f-7ab30051ddf3 req-623fff75-0441-441f-a388-53cba76a409e service nova] Creating event network-vif-deleted:39f059d7-0775-408a-9add-936bc07aed23 for instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 on nch2-master-1 Jul 02 21:54:43.505914 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-75fc2fad-3b87-44e5-bc3f-7ab30051ddf3 req-623fff75-0441-441f-a388-53cba76a409e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 Jul 02 21:54:43.506589 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3147/6260] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:54:43.950203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:43.950821 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:43.958260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:43.958708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:43.959481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:43.959917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:43.994029 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:43.994671 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:43.995164 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lazy-loading 'fault' on Instance uuid 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:54:44.039101 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7c01edc3ee499f9e6aa1003dce77dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77b8740a1b5c40aa90dc3c6a72fed1f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:54:44.047168 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-287130f5-b0ce-4738-afbe-764d4d79d57c tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 200 len: 1349 microversion: 2.1 time: 0.100929 Jul 02 21:54:44.048274 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3114/6261] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:43 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:54:45.072402 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:45.073522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] [instance: 0fcf35c1-643e-4ed9-a0aa-67580369d3a5] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:54:45.080518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:45.080981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:45.081770 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:54:45.082212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:54:45.096643 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] HTTP exception thrown: Instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 could not be found. Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Request method failure captured: Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 HTTP/1.1 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL5doRsDMmgrAAwbSftN-S7Hw92qjEw3p8c2tKRryrEUBsjxSXWcr7QRV9Hlxz9qyhvPr0g-Frvw_DDHU-bKRoC1D5uxfNOAPac43jnuFvZcf1C1Xw0Jjk-qavnRJCLhaDNMjCfS1w_H0btSGNkwyBuU-C_BO68FtZvHX28LqQEulFc Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 77b8740a1b5c40aa90dc3c6a72fed1f5 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestMinimumBasicScenario-1079782690 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b8740a1b5c40aa90dc3c6a72fed1f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_77b8740a1b5c40aa90dc3c6a72fed1f5", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/77b8740a1b5c40aa90dc3c6a72fed1f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/77b8740a1b5c40aa90dc3c6a72fed1f5"}]}] Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestMinimumBasicScenario-1079782690 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 77b8740a1b5c40aa90dc3c6a72fed1f5 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1079782690 Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestMinimumBasicScenario-1079782690-project Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 4e7c01edc3ee499f9e6aa1003dce77dc Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestMinimumBasicScenario-1079782690-project Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 could not be found. Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '0fcf35c1-643e-4ed9-a0aa-67580369d3a5'} Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 could not be found. Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 could not be found. Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:54:45.098324 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 could not be found. Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Returning 404 to user: Instance 0fcf35c1-643e-4ed9-a0aa-67580369d3a5 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9a2b87c5-4757-4953-9c1a-69d0fe593624 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5" status: 404 len: 111 microversion: 2.1 time: 0.036226 Jul 02 21:54:45.103214 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3148/6262] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:54:45 2022] GET /compute/v2.1/servers/0fcf35c1-643e-4ed9-a0aa-67580369d3a5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:54:45.108941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0c29f392-5316-4b18-a90b-def3a43d2180 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] Calling method '.version_select at 0x7fabd73a4040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:54:45.129511 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0c29f392-5316-4b18-a90b-def3a43d2180 tempest-TestMinimumBasicScenario-1079782690 tempest-TestMinimumBasicScenario-1079782690-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1553075656" status: 202 len: 0 microversion: 2.1 time: 0.024567 Jul 02 21:54:45.130262 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3115/6263] 10.222.0.43 () {58 vars in 1271 bytes} [Sat Jul 2 21:54:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1553075656 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:54:54.272924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a65c1e6-644a-4fb4-b80f-591449728976 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: .version_select at 0x7fabe409da60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1244094790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl5kXZqOrHUgsOmj6MGxJvSOgTwlaG7wjavQQ8rWCwy35ASHbIyhdkLeitOPUoOsYBlOBAmeTvg7s8YKZ46MiQGxyYRNtyakDlqB36tDqe9QusmpChOGt+ak9gJkT3v5Q=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:54:54.277031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:54:54.289717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4a65c1e6-644a-4fb4-b80f-591449728976 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:54:54.294920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-4a65c1e6-644a-4fb4-b80f-591449728976 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:54:54.320423 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a65c1e6-644a-4fb4-b80f-591449728976 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.228991 Jul 02 21:54:54.321026 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3149/6264] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:54:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:55:00.139284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:00.140711 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:00.141365 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:00.145443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1036222390", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "9dd6208c-de8f-4e04-b437-0f62e709dce5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1244094790", "security_groups": [{"name": "tempest-secgroup-smoke-1424060464"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:55:00.260751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] validate_networks() for [('9dd6208c-de8f-4e04-b437-0f62e709dce5', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:55:00.733339 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:55:00.733767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:55:00.734245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:55:00.734692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:55:00.735127 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:55:00.745173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:00.745934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:00.746866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:00.747377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:00.765827 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:55:00.772190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:55:00.785719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:55:00.788028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:55:00.834163 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-de515565-c54d-4457-978f-bd3933fe21f3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.696793 Jul 02 21:55:00.835134 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3116/6265] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:55:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:55:00.842193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=74 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:00.847929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6631ac64-5496-4b5e-bf2b-3313337954aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:00.848946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6631ac64-5496-4b5e-bf2b-3313337954aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:00.920384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6631ac64-5496-4b5e-bf2b-3313337954aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:00.932254 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6631ac64-5496-4b5e-bf2b-3313337954aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1267 microversion: 2.1 time: 0.090579 Jul 02 21:55:00.933159 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3150/6266] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:00 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:01.950249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:01.950875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:01.960177 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:01.960756 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:01.961715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:01.962324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:02.047347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:02.055927 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e68c8e37-5c01-48ed-9517-7d49f2b0b081 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1319 microversion: 2.1 time: 0.110222 Jul 02 21:55:02.056456 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3117/6267] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:01 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1319 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:03.073990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:03.074650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:03.083629 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:03.084104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:03.085411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:03.086061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:03.335384 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:03.343915 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8286bbd3-9ee9-49cc-bc4c-740d123ebb20 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.274094 Jul 02 21:55:03.345295 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3151/6268] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:03 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:04.038226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-77d02631-018a-481c-a5e8-0829d2e68974 req-7588893f-f4f1-417a-9559-aabaebc0678a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15e9840-2023-47f8-a966-14dec85da58b", "tag": "e047cdfb-9c26-4e19-8710-2cda4d5d8de6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:55:04.049404 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-77d02631-018a-481c-a5e8-0829d2e68974 req-7588893f-f4f1-417a-9559-aabaebc0678a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:04.049921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-77d02631-018a-481c-a5e8-0829d2e68974 req-7588893f-f4f1-417a-9559-aabaebc0678a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:04.062930 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-77d02631-018a-481c-a5e8-0829d2e68974 req-7588893f-f4f1-417a-9559-aabaebc0678a service nova] Creating event network-changed:e047cdfb-9c26-4e19-8710-2cda4d5d8de6 for instance e15e9840-2023-47f8-a966-14dec85da58b on nch1-master-1 Jul 02 21:55:04.068559 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-77d02631-018a-481c-a5e8-0829d2e68974 req-7588893f-f4f1-417a-9559-aabaebc0678a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145801 Jul 02 21:55:04.069170 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3118/6269] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:55:04.362527 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:04.363153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:04.370572 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:04.371026 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:04.371852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:04.372472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:04.518219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:04.525964 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f347208f-4c38-4f3c-a0ea-6996254ea60e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.168095 Jul 02 21:55:04.526544 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3152/6270] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:04 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:05.550345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:05.551503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:05.560569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:05.561024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:05.561799 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:05.562237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:05.695601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:05.703539 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ebe18aaf-df21-4a3c-a909-17133f85b0f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.161904 Jul 02 21:55:05.704157 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3119/6271] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:05 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:06.720884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:06.721518 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:06.729091 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:06.729622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:06.730418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:06.730859 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:06.913246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:06.921482 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-20a5ac63-f701-41da-9ec8-fefc66e5fc6e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.204572 Jul 02 21:55:06.922315 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3153/6272] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:06 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:07.943237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:07.944353 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:07.956466 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:07.957241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:07.958570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:07.959354 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:08.104167 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:08.111958 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-58922d3b-d853-45fd-8af7-3b47de76ef2e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.175561 Jul 02 21:55:08.112580 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3120/6273] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:07 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:09.128682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:09.129262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:09.136628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:09.137190 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:09.137981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:09.138422 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:09.173309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-a086f758-c73d-4a1e-a2dc-2f77b4b9ec12 req-11831906-60b4-42f7-96e5-0a9e7b21ec7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15e9840-2023-47f8-a966-14dec85da58b", "name": "network-vif-plugged", "status": "completed", "tag": "e047cdfb-9c26-4e19-8710-2cda4d5d8de6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:55:09.182373 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a086f758-c73d-4a1e-a2dc-2f77b4b9ec12 req-11831906-60b4-42f7-96e5-0a9e7b21ec7e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:09.182939 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-a086f758-c73d-4a1e-a2dc-2f77b4b9ec12 req-11831906-60b4-42f7-96e5-0a9e7b21ec7e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:09.195383 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-a086f758-c73d-4a1e-a2dc-2f77b4b9ec12 req-11831906-60b4-42f7-96e5-0a9e7b21ec7e service nova] Creating event network-vif-plugged:e047cdfb-9c26-4e19-8710-2cda4d5d8de6 for instance e15e9840-2023-47f8-a966-14dec85da58b on nch1-master-1 Jul 02 21:55:09.200878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-a086f758-c73d-4a1e-a2dc-2f77b4b9ec12 req-11831906-60b4-42f7-96e5-0a9e7b21ec7e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031495 Jul 02 21:55:09.201564 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3121/6274] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:55:09.273843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:09.282057 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7716f04d-7536-4c7b-be7a-f7df34c82a99 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.157409 Jul 02 21:55:09.282653 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3154/6275] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:09 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:10.300866 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:10.301602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:10.308557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:10.309017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:10.309796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:10.310241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:10.447552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:10.455691 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-883e7373-27c2-4cb2-bd49-05dc8030e04f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1393 microversion: 2.1 time: 0.160164 Jul 02 21:55:10.456326 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3122/6276] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:10 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:11.477635 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:11.478665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:11.482994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:11.493800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:11.494566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:11.495839 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:11.496627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:11.645328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:11.653942 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a0fc444f-1071-4205-a1cb-f6857c6f2640 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1564 microversion: 2.1 time: 0.183107 Jul 02 21:55:11.654581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3155/6277] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:11 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1564 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:11.670692 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:11.671445 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:11.673542 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:11.674225 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:11.682158 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:11.682619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:11.683415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:11.683859 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:11.830411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:11.838436 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cbee2624-79cd-4635-acff-e88bef883744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1564 microversion: 2.1 time: 0.171774 Jul 02 21:55:11.839020 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3123/6278] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:11 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:13.965272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4c673df5-c3f5-4007-81e1-4df2848ea264 req-89e14362-a137-410c-a125-f052a1931d28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15e9840-2023-47f8-a966-14dec85da58b", "tag": "e047cdfb-9c26-4e19-8710-2cda4d5d8de6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:55:13.968993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:55:13.969690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:13.983736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:13.984261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:13.985060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:13.985501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:13.987301 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4c673df5-c3f5-4007-81e1-4df2848ea264 req-89e14362-a137-410c-a125-f052a1931d28 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:13.987873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4c673df5-c3f5-4007-81e1-4df2848ea264 req-89e14362-a137-410c-a125-f052a1931d28 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:14.000104 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4c673df5-c3f5-4007-81e1-4df2848ea264 req-89e14362-a137-410c-a125-f052a1931d28 service nova] Creating event network-changed:e047cdfb-9c26-4e19-8710-2cda4d5d8de6 for instance e15e9840-2023-47f8-a966-14dec85da58b on nch1-master-1 Jul 02 21:55:14.005663 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4c673df5-c3f5-4007-81e1-4df2848ea264 req-89e14362-a137-410c-a125-f052a1931d28 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044249 Jul 02 21:55:14.006702 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3124/6279] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:55:14.208513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:55:14.216557 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-58b58c5b-554d-4671-99bd-f163f0c5b7eb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1564 microversion: 2.1 time: 0.258182 Jul 02 21:55:14.217470 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3156/6280] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:55:13 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1564 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:55:47.576190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:47.577065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=38 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:55:47.581872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:55:47.582936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:55:47.591123 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:47.591588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:47.592469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:55:47.592916 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:55:47.660419 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1933afb4-2960-4112-9f27-7993a5e6f499 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action" status: 200 len: 24576 microversion: 2.1 time: 0.086279 Jul 02 21:55:47.661082 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3125/6281] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:55:47 2022] POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action => generated 24576 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:56:26.772928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:26.774047 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=36 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:26.780977 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:26.781867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:26.792528 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:26.793232 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:26.794011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:26.794454 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:26.864144 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c62e571-4ff4-4fbc-a835-a176f25cb98f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action" status: 202 len: 0 microversion: 2.1 time: 0.094868 Jul 02 21:56:26.864783 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3157/6282] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:56:26 2022] POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:56:26.875117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:26.875884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:26.878604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:26.879380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:26.885782 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:26.886242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:26.887069 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:26.887512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:27.025105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:27.033532 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-576e7cb4-0192-41f5-be80-c06725f16fd1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1688 microversion: 2.1 time: 0.163176 Jul 02 21:56:27.034081 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3126/6283] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:26 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:28.058169 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:28.059330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:28.070245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:28.071007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:28.072083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:28.072548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:28.215901 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:28.223808 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4499b20f-b36c-4df8-b8fe-27b67ab68ed0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1668 microversion: 2.1 time: 0.174563 Jul 02 21:56:28.224423 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3158/6284] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:28 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:29.320876 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:29.322268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:29.335824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:29.336616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:29.337751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:29.338409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:29.411805 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c5cc7bfd-8eb2-4148-8fd7-4ddf02f5b1d5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action" status: 200 len: 32640 microversion: 2.1 time: 0.097052 Jul 02 21:56:29.412906 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3127/6285] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:56:29 2022] POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action => generated 32640 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:56:29.431057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:29.431611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:29.439129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:29.439606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:29.440447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:29.440887 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:29.510774 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4c4de9fb-2bd3-4115-821c-bf3423f99a0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action" status: 202 len: 0 microversion: 2.1 time: 0.086405 Jul 02 21:56:29.511388 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3159/6286] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:56:29 2022] POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:56:29.520436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:29.521241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:29.529328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:29.530178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:29.531511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:29.531633 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:29.671993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:29.679966 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-054d1b58-0743-40b5-8695-404a9850329e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1675 microversion: 2.1 time: 0.163897 Jul 02 21:56:29.680590 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3128/6287] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:29 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:30.701930 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:30.702618 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:30.712630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:30.713236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:30.714015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:30.714619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:30.874425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:30.882805 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4128fb06-1910-447e-b40c-3fbab62de1f2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1683 microversion: 2.1 time: 0.187902 Jul 02 21:56:30.883365 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3160/6288] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:30 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:30.977358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:30.978364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:30.987771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:30.988223 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:30.989054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:30.989509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:31.057679 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3ac1c2f9-aa6e-4bec-9a9f-3a6c2f0416a3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action" status: 200 len: 38366 microversion: 2.1 time: 0.083491 Jul 02 21:56:31.058642 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3129/6289] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:56:30 2022] POST /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b/action => generated 38366 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:56:32.119447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:32.120137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:32.122170 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-722ee287-0243-4cf2-bcfa-1d5954c3522a req-d49a722e-2760-4d7d-94c5-1b117408a9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e15e9840-2023-47f8-a966-14dec85da58b", "tag": "e047cdfb-9c26-4e19-8710-2cda4d5d8de6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:32.128022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:32.128612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:32.129473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:32.129970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:32.132415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-722ee287-0243-4cf2-bcfa-1d5954c3522a req-d49a722e-2760-4d7d-94c5-1b117408a9f9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:32.133004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-722ee287-0243-4cf2-bcfa-1d5954c3522a req-d49a722e-2760-4d7d-94c5-1b117408a9f9 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:32.145561 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-722ee287-0243-4cf2-bcfa-1d5954c3522a req-d49a722e-2760-4d7d-94c5-1b117408a9f9 service nova] Creating event network-changed:e047cdfb-9c26-4e19-8710-2cda4d5d8de6 for instance e15e9840-2023-47f8-a966-14dec85da58b on nch1-master-1 Jul 02 21:56:32.150572 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-722ee287-0243-4cf2-bcfa-1d5954c3522a req-d49a722e-2760-4d7d-94c5-1b117408a9f9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032805 Jul 02 21:56:32.151183 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3130/6290] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:56:32.163024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:56:32.251731 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-05bc0d6d-c266-4ae0-b548-1c4b9c7643e6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 204 len: 0 microversion: 2.1 time: 0.135927 Jul 02 21:56:32.253350 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3161/6291] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:56:32 2022] DELETE /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:56:32.266283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:32.266283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:32.271173 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:32.271747 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:32.272587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:32.273024 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:32.437909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:32.446099 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-728d1a24-62b8-4321-80f8-51c7705607c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1689 microversion: 2.1 time: 0.187828 Jul 02 21:56:32.446725 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3131/6292] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:32 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:56:33.464802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:33.465498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:33.473144 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:33.473602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:33.474404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:33.474838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:33.718705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:33.726613 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-367ea8c1-4774-4a2b-b955-54be87eae9b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1689 microversion: 2.1 time: 0.266302 Jul 02 21:56:33.727234 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3162/6293] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:33 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1689 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:34.524137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-db6421ab-e361-4cdc-ba35-08df09eed102 req-2d437993-d31c-4627-822c-d07603a2e4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e15e9840-2023-47f8-a966-14dec85da58b", "name": "network-vif-deleted", "tag": "e047cdfb-9c26-4e19-8710-2cda4d5d8de6"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:34.533872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-db6421ab-e361-4cdc-ba35-08df09eed102 req-2d437993-d31c-4627-822c-d07603a2e4e8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:34.534243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-db6421ab-e361-4cdc-ba35-08df09eed102 req-2d437993-d31c-4627-822c-d07603a2e4e8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:34.548640 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-db6421ab-e361-4cdc-ba35-08df09eed102 req-2d437993-d31c-4627-822c-d07603a2e4e8 service nova] Creating event network-vif-deleted:e047cdfb-9c26-4e19-8710-2cda4d5d8de6 for instance e15e9840-2023-47f8-a966-14dec85da58b on nch1-master-1 Jul 02 21:56:34.553909 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-db6421ab-e361-4cdc-ba35-08df09eed102 req-2d437993-d31c-4627-822c-d07603a2e4e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Jul 02 21:56:34.554715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3132/6294] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:56:34.750154 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:34.750774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:34.758427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:34.758874 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:34.759633 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:34.760081 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:34.795308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:34.795765 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:34.796266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lazy-loading 'fault' on Instance uuid e15e9840-2023-47f8-a966-14dec85da58b {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:56:34.843797 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:34.852498 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b77231a-b04e-431e-94d6-5d78cd2bbabb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 200 len: 1357 microversion: 2.1 time: 0.108614 Jul 02 21:56:34.853177 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3163/6295] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:34 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 1357 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:35.876731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:35.877884 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: e15e9840-2023-47f8-a966-14dec85da58b] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:35.887649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:35.888135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:35.888912 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:35.889347 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:35.903187 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] HTTP exception thrown: Instance e15e9840-2023-47f8-a966-14dec85da58b could not be found. Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Request method failure captured: Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b HTTP/1.1 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL6tpCjuH7KYH-WO_MlpiJjIbEOWaPso_nwkhdFxw27FVMz2MGxJd93xMBcPAFMEEtAFvJkbH4UkDThBOSvwssleoJ7w1BHxPBcdPOcxYh2C_OyqlKwQcwSzx1VIH7NBDBK4eFNDy9a09RF50rSySD1J9CQoIbWdpfFyqTBAzOHKIWE Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339472a22c2447d4a8174ce682d2e2ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339472a22c2447d4a8174ce682d2e2ed"}]}] Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54f87aa5ec014141901ea0c2f1994cde Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance e15e9840-2023-47f8-a966-14dec85da58b could not be found. Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': 'e15e9840-2023-47f8-a966-14dec85da58b'} Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e15e9840-2023-47f8-a966-14dec85da58b could not be found. Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e15e9840-2023-47f8-a966-14dec85da58b could not be found. Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:56:35.904864 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e15e9840-2023-47f8-a966-14dec85da58b could not be found. Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Returning 404 to user: Instance e15e9840-2023-47f8-a966-14dec85da58b could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-009a4047-6f16-4f5e-afb2-d8e75affbc6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b" status: 404 len: 111 microversion: 2.1 time: 0.038640 Jul 02 21:56:35.909667 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3133/6296] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:35 2022] GET /compute/v2.1/servers/e15e9840-2023-47f8-a966-14dec85da58b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:56:39.283960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8e38a20c-998d-46db-aa49-959aa01503d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '.version_select at 0x7fabe468e670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:39.306803 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8e38a20c-998d-46db-aa49-959aa01503d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1244094790" status: 202 len: 0 microversion: 2.1 time: 0.027207 Jul 02 21:56:39.307416 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3164/6297] 10.222.0.43 () {58 vars in 1283 bytes} [Sat Jul 2 21:56:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1244094790 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:56:39.335139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ceca50b1-34b5-4506-ba89-ed3ca2021362 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: .version_select at 0x7fabd74ea820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2104401188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtVJcTysAZxsYgvvnpfXWhTZj6odBNbWPZK57ATOIiI+58A3lLFoOFKlhHCTHBY73Wpc8hz+QEL+AxtjI6ganLCmkO3106uB23PifBVbfT+eZGJswwYDiY3ZvYC4GXQmA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:39.356760 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ceca50b1-34b5-4506-ba89-ed3ca2021362 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:56:39.363297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-ceca50b1-34b5-4506-ba89-ed3ca2021362 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:56:39.389568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ceca50b1-34b5-4506-ba89-ed3ca2021362 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060336 Jul 02 21:56:39.390235 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3134/6298] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:56:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:56:45.265028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:45.269639 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-242087052", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "d65e59e1-b31c-46e0-9aea-3bbeb988ca70"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2104401188", "security_groups": [{"name": "tempest-secgroup-smoke-898973402"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:45.385395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] validate_networks() for [('d65e59e1-b31c-46e0-9aea-3bbeb988ca70', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:56:45.853236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:56:45.853943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:56:45.854424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:56:45.855020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:56:45.855594 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:56:45.866689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:45.867147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:45.867961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:45.868433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:45.893174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:56:45.899807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:56:45.921561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:56:45.923960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:56:45.973864 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [e5490d12-85bc-4712-90e5-ffbfc48e13c3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 21:56:46.982387 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [e5490d12-85bc-4712-90e5-ffbfc48e13c3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 35842. Jul 02 21:56:46.996094 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7c25c379-c4fb-4de9-9a15-a2f3aa277454 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.732755 Jul 02 21:56:47.001245 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3165/6299] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:56:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 02 21:56:47.015587 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d33268ea-6ba9-4d2b-b131-97494e645f3e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:47.016961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d33268ea-6ba9-4d2b-b131-97494e645f3e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:47.020733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=32 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:47.102261 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d33268ea-6ba9-4d2b-b131-97494e645f3e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:47.109664 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d33268ea-6ba9-4d2b-b131-97494e645f3e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1266 microversion: 2.1 time: 0.098955 Jul 02 21:56:47.110755 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3135/6300] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:47 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:48.128978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:48.129610 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:48.136747 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:48.137196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:48.137981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:48.138420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:48.206281 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:48.216281 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb7b9131-05f5-47e9-a808-8eb5718283bd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1318 microversion: 2.1 time: 0.092126 Jul 02 21:56:48.218234 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3166/6301] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:48 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:49.235199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:49.235731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:49.242986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:49.243453 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:49.244436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:49.244919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:49.322128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:49.330224 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5b26597b-faee-44fd-8f1c-b6295e734ea6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1324 microversion: 2.1 time: 0.099145 Jul 02 21:56:49.330827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3136/6302] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:49 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1324 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:50.138719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9ba9db45-1735-4d13-b901-34bc8dc1ad14 req-3dc0b7ed-1d75-454c-accf-420cf1c922cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82be284f-d1ec-430f-a624-c0d1d3ddfff1", "tag": "62eed388-876e-49e4-9fe9-305de5288b1c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:50.148935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ba9db45-1735-4d13-b901-34bc8dc1ad14 req-3dc0b7ed-1d75-454c-accf-420cf1c922cd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:50.149623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ba9db45-1735-4d13-b901-34bc8dc1ad14 req-3dc0b7ed-1d75-454c-accf-420cf1c922cd service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:50.163683 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9ba9db45-1735-4d13-b901-34bc8dc1ad14 req-3dc0b7ed-1d75-454c-accf-420cf1c922cd service nova] Creating event network-changed:62eed388-876e-49e4-9fe9-305de5288b1c for instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 on nch1-master-1 Jul 02 21:56:50.169247 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9ba9db45-1735-4d13-b901-34bc8dc1ad14 req-3dc0b7ed-1d75-454c-accf-420cf1c922cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036389 Jul 02 21:56:50.170288 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3167/6303] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:56:50.347049 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:50.347778 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:50.355136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:50.355599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:50.356456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:50.356901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:50.569568 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:50.577831 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-023d657a-b700-458e-82f2-3f1e9fa6cf89 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.234822 Jul 02 21:56:50.578429 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3137/6304] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:50 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:51.601012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:51.602178 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:51.609911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:51.610367 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:51.611150 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:51.611589 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:51.755330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:51.763473 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-60dd1f2d-e8c4-4918-95bc-bcd383e6bf15 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.171082 Jul 02 21:56:51.764054 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3168/6305] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:51 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:52.785136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:52.785976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:52.795548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:52.796028 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:52.796820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:52.797252 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:53.018205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:53.026787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c72afc5b-54ac-4d50-8bb6-5b1c35ee3be4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.248733 Jul 02 21:56:53.027457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3138/6306] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:52 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:54.048252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:54.049227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:54.059750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:54.060242 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:54.061022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:54.061459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:54.204172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:54.212250 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1594c4de-8089-417d-b81e-88ab127eb130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.170896 Jul 02 21:56:54.212831 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3169/6307] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:54 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:55.231658 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:55.232355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:55.239734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:55.240224 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:55.241016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:55.241461 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:55.375998 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:55.383824 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64451edf-1d70-4852-bbbc-e2ec45054b76 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.157552 Jul 02 21:56:55.384411 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3139/6308] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:55 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:56.403936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:56.404566 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:56.407971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:56.408692 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:56.416358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:56.417022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:56.417904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:56.418567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:56.558272 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:56.567936 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-531b4146-59a8-484d-903b-ce9bf6c87357 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.169217 Jul 02 21:56:56.568577 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3170/6309] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:56 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:57.585194 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:57.585813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:57.590052 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:57.590955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:57.595739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:57.596233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:57.597030 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:57.597476 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:57.614758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-242f054a-47a3-4998-8774-891af51dde40 req-8a7cf501-a2c6-4376-9496-d2cb7c70cd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82be284f-d1ec-430f-a624-c0d1d3ddfff1", "name": "network-vif-plugged", "status": "completed", "tag": "62eed388-876e-49e4-9fe9-305de5288b1c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:56:57.619994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:56:57.627575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-242f054a-47a3-4998-8774-891af51dde40 req-8a7cf501-a2c6-4376-9496-d2cb7c70cd4d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:57.628024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-242f054a-47a3-4998-8774-891af51dde40 req-8a7cf501-a2c6-4376-9496-d2cb7c70cd4d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:57.641249 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-242f054a-47a3-4998-8774-891af51dde40 req-8a7cf501-a2c6-4376-9496-d2cb7c70cd4d service nova] Creating event network-vif-plugged:62eed388-876e-49e4-9fe9-305de5288b1c for instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 on nch1-master-1 Jul 02 21:56:57.646434 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-242f054a-47a3-4998-8774-891af51dde40 req-8a7cf501-a2c6-4376-9496-d2cb7c70cd4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035911 Jul 02 21:56:57.647315 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3171/6310] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:56:57.754594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:57.762899 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2eed12f9-e759-40da-b0f1-ec17c5f22bc3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.181795 Jul 02 21:56:57.763740 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3140/6311] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:57 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:58.784666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:58.785558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:58.795960 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:58.796486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:58.797269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:58.797715 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:58.943087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:56:58.951283 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3de4feee-2464-4f5c-bebd-cad14d86f744 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1391 microversion: 2.1 time: 0.173180 Jul 02 21:56:58.951871 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3172/6312] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:58 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:56:59.972987 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:56:59.973598 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:56:59.981512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:59.981991 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:56:59.982813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:56:59.983282 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:00.129604 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:57:00.137460 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-62587025-f007-4fba-ab99-ce82568dc3d7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1564 microversion: 2.1 time: 0.168791 Jul 02 21:57:00.138035 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3141/6313] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:56:59 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:57:00.154068 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:57:00.154728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:57:00.162286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:00.162748 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:00.163516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:00.163952 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:00.295841 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:57:00.304075 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56018579-e76a-497e-81c0-c02e43dacb3d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1564 microversion: 2.1 time: 0.154024 Jul 02 21:57:00.304864 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3173/6314] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:57:00 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:57:01.960648 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:57:01.961270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:57:01.963720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-0cf0c173-6636-4c2f-9422-feea5ada5245 req-ec9985c9-027f-4c21-973a-3e4f85c731fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82be284f-d1ec-430f-a624-c0d1d3ddfff1", "tag": "62eed388-876e-49e4-9fe9-305de5288b1c"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:57:01.969234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:01.969885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:01.970789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:01.971327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:01.972664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0cf0c173-6636-4c2f-9422-feea5ada5245 req-ec9985c9-027f-4c21-973a-3e4f85c731fe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:01.973224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-0cf0c173-6636-4c2f-9422-feea5ada5245 req-ec9985c9-027f-4c21-973a-3e4f85c731fe service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:01.984734 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-0cf0c173-6636-4c2f-9422-feea5ada5245 req-ec9985c9-027f-4c21-973a-3e4f85c731fe service nova] Creating event network-changed:62eed388-876e-49e4-9fe9-305de5288b1c for instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 on nch1-master-1 Jul 02 21:57:01.989964 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-0cf0c173-6636-4c2f-9422-feea5ada5245 req-ec9985c9-027f-4c21-973a-3e4f85c731fe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029837 Jul 02 21:57:01.992210 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3174/6315] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 21:57:02.210751 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:57:02.219065 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-195b281f-fcc3-4965-8fe8-02fa7205706f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1564 microversion: 2.1 time: 0.262522 Jul 02 21:57:02.219621 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3142/6316] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:57:01 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1564 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:57:30.679644 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 21:57:30.680436 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 21:57:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 21:57:35.545297 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:57:35.546689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:57:35.549077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=7 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:57:35.549736 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=44 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:57:35.556500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:35.557021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:35.557910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:57:35.558355 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:57:35.628697 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2939580c-6c05-4ef2-82e6-fdf25a22ece9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1/action" status: 200 len: 24571 microversion: 2.1 time: 0.090986 Jul 02 21:57:35.629341 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3175/6317] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:57:35 2022] POST /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:58:14.647014 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=5 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:58:14.648129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=42 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:58:14.654031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:58:14.655039 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:14.662754 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:14.663212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:14.663978 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:14.664473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:14.745818 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a246ef9-c508-4c5f-8123-03384df74249 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1/action" status: 202 len: 0 microversion: 2.1 time: 0.102075 Jul 02 21:58:14.748084 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3143/6318] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:58:14 2022] POST /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 21:58:14.755659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:14.756433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:14.759269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:58:14.759936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:58:14.765397 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:14.766117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:14.766642 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:14.767051 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:15.040814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:15.049214 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2df3e451-905d-45df-90bc-5301b526abf2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1674 microversion: 2.1 time: 0.297777 Jul 02 21:58:15.050030 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3176/6319] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:14 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1674 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:16.073988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:16.075104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:16.086146 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:16.086906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:16.088054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:16.088520 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:16.287530 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:16.295890 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-03249c6a-f9d1-41cb-b79f-fae1cb8f83ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.230193 Jul 02 21:58:16.296508 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3144/6320] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:16 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:17.318033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:17.319108 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:17.330356 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:17.331120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:17.332463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:17.333207 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:17.478562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:17.488375 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b7be4b44-bece-4233-a70d-0ef247147e42 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.176398 Jul 02 21:58:17.489157 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3177/6321] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:17 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:18.511085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:18.511682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:18.519504 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:18.519958 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:18.520762 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:18.521195 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:18.659849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:18.668757 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2d324bcc-c6ee-4173-81ab-0fd08a63fdb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.163476 Jul 02 21:58:18.669354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3145/6322] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:18 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:19.688559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:19.689197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:19.699858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:19.701619 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:19.702982 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:19.703720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:19.861438 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:19.873182 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-986c9f20-ae38-4381-81be-ae86bd05c6aa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.189958 Jul 02 21:58:19.874859 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3178/6323] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:19 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:20.895449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:20.896362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:20.908267 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:20.909044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:20.910411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:20.911153 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:21.055690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:21.063722 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e49e23f4-bb5a-428c-bb42-e1cc1c57d2ce tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.175232 Jul 02 21:58:21.064336 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3146/6324] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:20 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:22.084345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:22.085134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:22.093728 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:22.094184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:22.094975 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:22.095658 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:22.230174 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:22.238614 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a221ea01-17cb-4bd0-b664-264539d52a65 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.159923 Jul 02 21:58:22.239195 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3179/6325] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:22 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:23.260704 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:23.261478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:23.270716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:23.271295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:23.272313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:23.272875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:23.415268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:23.429156 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e344baff-41b6-4fe6-974a-be9582cebe4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.174639 Jul 02 21:58:23.429974 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3147/6326] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:23 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:24.451716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:24.452376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:24.459837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:24.460321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:24.461104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:24.461554 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:24.598343 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:24.607202 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-94ddfa23-83f8-4b6b-990c-9b66440c4d6f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.159613 Jul 02 21:58:24.607786 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3180/6327] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:24 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:25.629087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:25.630234 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:25.642366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:25.643131 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:25.644532 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:25.645268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:25.786076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:25.798618 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d46a6ba7-94b9-49cc-9154-488806e7da21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.176013 Jul 02 21:58:25.799389 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3148/6328] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:25 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:26.820877 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:26.821735 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:26.829622 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:26.830082 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:26.830852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:26.831290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:26.969399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:26.979289 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b29b8436-c7d5-4bca-966c-44f5710008bb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.165366 Jul 02 21:58:26.979965 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3181/6329] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:26 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:28.000562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:28.001526 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:28.013627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:28.014399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:28.015695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:28.016496 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:28.163665 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:28.172727 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-789b2113-de78-4cd2-9034-29a29847fd9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.179039 Jul 02 21:58:28.173311 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3149/6330] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:27 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:29.197759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:29.198350 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:29.206044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:29.206499 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:29.207262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:29.207693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:29.352660 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:29.360536 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-692a097a-accb-47a4-aef2-dd02cc3a9f35 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.172008 Jul 02 21:58:29.361091 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3182/6331] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:29 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:30.379198 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:30.379839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:30.386686 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:30.387144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:30.387925 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:30.388393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:30.520363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:30.528340 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd64a7f1-885a-4f4d-a91a-d2a287d25280 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1679 microversion: 2.1 time: 0.152990 Jul 02 21:58:30.528942 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3150/6332] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:30 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:58:31.549579 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:58:31.550542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:58:31.559920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:31.560388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:31.561158 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:58:31.561607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:58:31.696895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:58:31.708809 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2fc7f4f8-3646-4d12-a034-75375f2d47c5 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1682 microversion: 2.1 time: 0.165694 Jul 02 21:58:31.709568 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3183/6333] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:58:31 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:05.967743 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:05.968724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:05.970960 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:05.971636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:05.978227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:05.978610 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:05.979397 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:05.979846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:06.052981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-352a4f94-0e98-433f-942f-b06820882a4a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1/action" status: 200 len: 69040 microversion: 2.1 time: 0.089392 Jul 02 21:59:06.053641 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3151/6334] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 21:59:05 2022] POST /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1/action => generated 69040 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 21:59:30.033558 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:30.034106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:30.037012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-bb306026-6086-4e72-bf36-a69eab5697c0 req-12fdd1dd-93dd-462f-82c4-132a581cbd3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82be284f-d1ec-430f-a624-c0d1d3ddfff1", "tag": "62eed388-876e-49e4-9fe9-305de5288b1c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:30.037467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=16 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:30.038160 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=48 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:30.042559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:30.043065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:30.043896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:30.044180 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:30.044395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:30.045232 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:30.054290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bb306026-6086-4e72-bf36-a69eab5697c0 req-12fdd1dd-93dd-462f-82c4-132a581cbd3a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:30.054764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-bb306026-6086-4e72-bf36-a69eab5697c0 req-12fdd1dd-93dd-462f-82c4-132a581cbd3a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:30.067083 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-bb306026-6086-4e72-bf36-a69eab5697c0 req-12fdd1dd-93dd-462f-82c4-132a581cbd3a service nova] Creating event network-changed:62eed388-876e-49e4-9fe9-305de5288b1c for instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 on nch1-master-1 Jul 02 21:59:30.071990 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 21:59:30.072558 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-bb306026-6086-4e72-bf36-a69eab5697c0 req-12fdd1dd-93dd-462f-82c4-132a581cbd3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040459 Jul 02 21:59:30.073167 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3152/6335] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:59:30.157709 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-478927c9-e199-4e56-b196-9beec1d2b7ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 204 len: 0 microversion: 2.1 time: 0.128093 Jul 02 21:59:30.158306 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3184/6336] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 21:59:30 2022] DELETE /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 21:59:30.169994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:30.170997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:30.178235 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:30.178696 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:30.179487 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:30.179963 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:30.490668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:30.498853 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-93fe78e4-2ab9-4ab6-8e35-7830b5eea83e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1688 microversion: 2.1 time: 0.333795 Jul 02 21:59:30.499690 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3153/6337] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:30 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1688 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:31.523353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:31.524070 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:31.531833 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:31.532353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:31.533141 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:31.533585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:31.805479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:31.816917 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ed25f06-31de-4d9c-a58b-645933780d9d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1688 microversion: 2.1 time: 0.300335 Jul 02 21:59:31.817672 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3185/6338] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:31 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1688 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:32.477886 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-cecebdd4-1957-4e54-8409-acb18458e171 req-05d21491-6d72-4f8e-a667-12872a1423b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82be284f-d1ec-430f-a624-c0d1d3ddfff1", "name": "network-vif-deleted", "tag": "62eed388-876e-49e4-9fe9-305de5288b1c"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:32.487789 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-cecebdd4-1957-4e54-8409-acb18458e171 req-05d21491-6d72-4f8e-a667-12872a1423b8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:32.488268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-cecebdd4-1957-4e54-8409-acb18458e171 req-05d21491-6d72-4f8e-a667-12872a1423b8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:32.499083 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-cecebdd4-1957-4e54-8409-acb18458e171 req-05d21491-6d72-4f8e-a667-12872a1423b8 service nova] Creating event network-vif-deleted:62eed388-876e-49e4-9fe9-305de5288b1c for instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 on nch1-master-1 Jul 02 21:59:32.504640 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-cecebdd4-1957-4e54-8409-acb18458e171 req-05d21491-6d72-4f8e-a667-12872a1423b8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080437 Jul 02 21:59:32.505581 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3154/6339] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:59:32.836479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:32.837145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:32.844477 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:32.844999 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:32.845963 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:32.846451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:32.881425 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:32.881805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:32.882267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.objects.instance [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lazy-loading 'fault' on Instance uuid 82be284f-d1ec-430f-a624-c0d1d3ddfff1 {{(pid=131044) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 21:59:32.926914 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:32.934122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-21e46061-40dd-4ff4-a805-831d507ebb23 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 200 len: 1356 microversion: 2.1 time: 0.101696 Jul 02 21:59:32.934699 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3186/6340] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:32 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:33.954974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:33.955763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 82be284f-d1ec-430f-a624-c0d1d3ddfff1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:33.963540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:33.964063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:33.964929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:33.965421 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:33.980926 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] HTTP exception thrown: Instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 could not be found. Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Request method failure captured: Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 HTTP/1.1 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL6tpCjuH7KYH-WO_MlpiJjIbEOWaPso_nwkhdFxw27FVMz2MGxJd93xMBcPAFMEEtAFvJkbH4UkDThBOSvwssleoJ7w1BHxPBcdPOcxYh2C_OyqlKwQcwSzx1VIH7NBDBK4eFNDy9a09RF50rSySD1J9CQoIbWdpfFyqTBAzOHKIWE Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339472a22c2447d4a8174ce682d2e2ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339472a22c2447d4a8174ce682d2e2ed"}]}] Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54f87aa5ec014141901ea0c2f1994cde Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 could not be found. Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '82be284f-d1ec-430f-a624-c0d1d3ddfff1'} Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 could not be found. Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 could not be found. Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 21:59:33.982569 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 could not be found. Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Returning 404 to user: Instance 82be284f-d1ec-430f-a624-c0d1d3ddfff1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-116d4228-d6aa-450e-8351-ffb0beb1ab48 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1" status: 404 len: 111 microversion: 2.1 time: 0.035162 Jul 02 21:59:33.986813 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3155/6341] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:33 2022] GET /compute/v2.1/servers/82be284f-d1ec-430f-a624-c0d1d3ddfff1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 21:59:37.373895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9dcf4e0-4311-459c-ac13-b8b748f25426 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '.version_select at 0x7fabd785e700>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:37.395964 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9dcf4e0-4311-459c-ac13-b8b748f25426 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2104401188" status: 202 len: 0 microversion: 2.1 time: 0.025893 Jul 02 21:59:37.396777 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3187/6342] 10.222.0.43 () {58 vars in 1283 bytes} [Sat Jul 2 21:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2104401188 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 21:59:37.422873 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0375a65c-9a1e-4280-82d5-1709d0a2796a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: .version_select at 0x7fabe490b040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-164873153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXFoiJKnXwk5eWr1Yw3Wy0lLWvjTeWTsNpQUdPctY/cwWhiY0IypCq3YQbiHXQOc3xwzLxLj8rZH8M8BOk7RWboRsVn52qKuM+aEMu9QwTbklHBmE8TEwPxjSyDiR8DiA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:37.438553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0375a65c-9a1e-4280-82d5-1709d0a2796a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:59:37.445904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-0375a65c-9a1e-4280-82d5-1709d0a2796a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:59:37.476185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0375a65c-9a1e-4280-82d5-1709d0a2796a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.057086 Jul 02 21:59:37.477052 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3156/6343] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 21:59:37 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:59:43.345243 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:43.350283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-301200771", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "9dada44a-6acb-4cb0-bf33-996cc76e2ab5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-164873153", "security_groups": [{"name": "tempest-secgroup-smoke-1563036470"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:43.473295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] validate_networks() for [('9dada44a-6acb-4cb0-bf33-996cc76e2ab5', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 21:59:43.887104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 21:59:43.887552 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 21:59:43.888031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 21:59:43.888462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 21:59:43.888885 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 21:59:43.898662 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:43.899717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:43.900598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:43.900985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:43.923148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 21:59:43.928981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 21:59:43.942814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 21:59:43.946221 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 21:59:43.991583 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-76a10807-c727-4943-b2f3-86148097995c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.648449 Jul 02 21:59:43.992324 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3188/6344] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 21:59:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 21:59:44.000408 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=12 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:44.005707 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ec4c4389-513d-4ba8-9ea6-288e8faa6722 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:44.006405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ec4c4389-513d-4ba8-9ea6-288e8faa6722 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:44.073909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ec4c4389-513d-4ba8-9ea6-288e8faa6722 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:44.087136 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ec4c4389-513d-4ba8-9ea6-288e8faa6722 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1265 microversion: 2.1 time: 0.088652 Jul 02 21:59:44.088068 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3157/6345] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:43 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 21:59:45.107035 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:45.108764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:45.116586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:45.117437 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:45.118764 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:45.119420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:45.200503 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:45.209600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-66aae6c6-5fc1-4aaf-8507-5d531557fa2a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1335 microversion: 2.1 time: 0.108096 Jul 02 21:59:45.210770 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3189/6346] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:45 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1335 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:46.228249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:46.229032 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:46.236411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:46.236875 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:46.237672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:46.238120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:46.400380 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:46.409166 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5d7715f6-da1e-4642-8568-9be8292d9071 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.184808 Jul 02 21:59:46.409764 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3158/6347] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:46 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:46.749531 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-e74f8c73-9864-41ff-b648-4480bf825702 req-03e79a36-5624-4c11-9f42-413674254298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:46.761985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e74f8c73-9864-41ff-b648-4480bf825702 req-03e79a36-5624-4c11-9f42-413674254298 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:46.762548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-e74f8c73-9864-41ff-b648-4480bf825702 req-03e79a36-5624-4c11-9f42-413674254298 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:46.776747 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-e74f8c73-9864-41ff-b648-4480bf825702 req-03e79a36-5624-4c11-9f42-413674254298 service nova] Creating event network-changed:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch1-master-1 Jul 02 21:59:46.782562 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-e74f8c73-9864-41ff-b648-4480bf825702 req-03e79a36-5624-4c11-9f42-413674254298 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037786 Jul 02 21:59:46.783675 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3190/6348] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:59:47.427237 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:47.427865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:47.435643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:47.436096 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:47.436888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:47.437303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:47.578543 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:47.586558 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4abf8a89-9639-45e0-b291-95bf1de69a44 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.163393 Jul 02 21:59:47.587123 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3159/6349] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:47 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:48.604650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:48.605359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:48.612420 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:48.612879 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:48.613653 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:48.614379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:48.752699 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:48.760527 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a1543871-b84a-4f89-b27f-c6dcd9ff5530 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.160998 Jul 02 21:59:48.761038 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3191/6350] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:48 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:49.780631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:49.781222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:49.792478 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:49.793119 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:49.794304 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:49.794934 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:49.935683 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:49.944015 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd208f2e-6d56-4c34-a024-dd9c046750ee tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.169765 Jul 02 21:59:49.944626 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3160/6351] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:49 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:50.965415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:50.966441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:50.974114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:50.974565 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:50.975353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:50.975791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:51.118613 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:51.126538 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e8abaa38-ae50-45be-bd01-929de09166dd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.167837 Jul 02 21:59:51.127122 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3192/6352] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:50 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:52.148132 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:52.149181 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:52.159010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:52.159469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:52.160291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:52.160733 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:52.306465 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:52.314669 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-62cc7fbb-35e4-469e-b430-c5c1a9eb673f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.173107 Jul 02 21:59:52.315254 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3161/6353] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:52 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:53.398802 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:53.399508 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:53.406152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:53.406595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:53.407358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:53.407794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:53.545104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:53.553033 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d138d1ce-ea0e-4445-859c-98a5873ec8a0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.223519 Jul 02 21:59:53.553621 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3193/6354] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:53 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:54.570312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:54.571264 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:54.575324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:54.575474 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:54.576368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:59:54.580278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:54.580757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:54.582428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:54.583159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:54.641220 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9256042f-535a-43cf-8aac-8c260d28c997 req-a90aa490-211d-46be-8cfe-c1fd7bcee4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "name": "network-vif-plugged", "status": "completed", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:54.651063 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9256042f-535a-43cf-8aac-8c260d28c997 req-a90aa490-211d-46be-8cfe-c1fd7bcee4fc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:54.651516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9256042f-535a-43cf-8aac-8c260d28c997 req-a90aa490-211d-46be-8cfe-c1fd7bcee4fc service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:54.666887 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9256042f-535a-43cf-8aac-8c260d28c997 req-a90aa490-211d-46be-8cfe-c1fd7bcee4fc service nova] Creating event network-vif-plugged:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch1-master-1 Jul 02 21:59:54.672413 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9256042f-535a-43cf-8aac-8c260d28c997 req-a90aa490-211d-46be-8cfe-c1fd7bcee4fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101788 Jul 02 21:59:54.673122 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3194/6355] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:59:54.735357 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:54.743341 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63096751-d5b4-4246-9ab2-e71160bd1d01 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.177364 Jul 02 21:59:54.743954 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3162/6356] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:54 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:55.765713 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:55.766415 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:55.773316 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:55.773763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:55.774526 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:55.774965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:55.920495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:55.931424 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-46b89dcf-deed-43ef-87ac-5b836dee0039 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1391 microversion: 2.1 time: 0.173961 Jul 02 21:59:55.932205 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3195/6357] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:55 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:56.954105 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:56.955136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:56.967428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:56.968265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:56.969257 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:56.969701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:57.108405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:57.116463 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-da45a2a7-46be-42c1-8079-9ef539cee456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1562 microversion: 2.1 time: 0.169003 Jul 02 21:59:57.117049 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3163/6358] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:56 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:57.132953 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:57.133571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:57.141216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:57.141669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:57.142447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:57.142894 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:57.283966 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:57.291855 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b84873b-08a6-41ee-999d-7a9c7551a4fd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1562 microversion: 2.1 time: 0.162873 Jul 02 21:59:57.292881 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3196/6359] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:57 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 21:59:58.989634 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 21:59:58.991056 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 21:59:58.991970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9ddfa485-5bf1-4537-838a-b23042d8532a req-56490820-eee6-4a4c-b124-38cb981c3ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 21:59:58.999849 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:59.000820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:59.001870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:59.002382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ddfa485-5bf1-4537-838a-b23042d8532a req-56490820-eee6-4a4c-b124-38cb981c3ea0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 21:59:59.002767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:59.002883 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9ddfa485-5bf1-4537-838a-b23042d8532a req-56490820-eee6-4a4c-b124-38cb981c3ea0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 21:59:59.015239 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9ddfa485-5bf1-4537-838a-b23042d8532a req-56490820-eee6-4a4c-b124-38cb981c3ea0 service nova] Creating event network-changed:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch1-master-1 Jul 02 21:59:59.020791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9ddfa485-5bf1-4537-838a-b23042d8532a req-56490820-eee6-4a4c-b124-38cb981c3ea0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032586 Jul 02 21:59:59.021908 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3197/6360] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 21:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 21:59:59.152268 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 21:59:59.161139 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e1d36983-19c4-44c7-ab12-c3685c23f1dc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1562 microversion: 2.1 time: 0.175686 Jul 02 21:59:59.163157 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3164/6361] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 21:59:58 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:00:32.523575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:00:32.525244 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:00:32.528231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:00:32.528915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=44 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:00:32.538276 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:00:32.538722 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:00:32.539495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:00:32.539932 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:00:32.608234 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b8502586-90ae-4824-bfd1-a91b6653bf6c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action" status: 200 len: 24569 microversion: 2.1 time: 0.091655 Jul 02 22:00:32.608926 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3198/6362] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:00:32 2022] POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action => generated 24569 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:00:50.689458 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:00:50.690261 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:00:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:01:03.068882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:03.070072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=42 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:03.076915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:03.078502 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:03.096368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:03.097955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:03.098927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:03.099475 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:03.221085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:03.231288 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Old instance type m1.heat2, new instance type m1.heat {{(pid=131045) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 02 22:01:03.238336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 22:01:03.238771 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 22:01:03.239265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 22:01:03.239688 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 22:01:03.240143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 22:01:03.308639 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f9dd90d7-4d87-451f-955d-59b6d4cc2130 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action" status: 202 len: 0 microversion: 2.1 time: 0.243069 Jul 02 22:01:03.309454 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3165/6363] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:01:03 2022] POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:01:03.318472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:03.319236 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:03.321973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:03.322828 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:03.332223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:03.332677 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:03.333456 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:03.333962 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:03.480432 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:03.488782 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9096d066-0110-4e59-9852-98003e2998ab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1689 microversion: 2.1 time: 0.174534 Jul 02 22:01:03.489366 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3199/6364] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:03 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:04.510920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:04.512494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:04.523309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:04.523915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:04.524975 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:04.525676 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:04.664812 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:04.673249 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad975d11-7353-4e85-9dd9-85771ef5246c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1689 microversion: 2.1 time: 0.170427 Jul 02 22:01:04.673836 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3166/6365] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:04 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:05.692030 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:05.692707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:05.700562 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:05.701027 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:05.701805 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:05.702245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:05.841298 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:05.849635 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-30512b0a-85e5-429f-9cf8-dbf4badf486f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.161649 Jul 02 22:01:05.850235 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3200/6366] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:05 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:06.869441 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:06.870290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:06.880178 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:06.880562 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:06.881345 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:06.881788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:07.023464 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:07.031816 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-32de3846-6765-4e08-8bdb-cf4bd83f3907 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.167958 Jul 02 22:01:07.032439 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3167/6367] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:06 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:08.053342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:08.053981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:08.061707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:08.062168 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:08.062951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:08.063393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:08.207800 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:08.219206 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2c367df6-650e-4acc-b264-d6571ecd22ef tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.171708 Jul 02 22:01:08.219913 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3201/6368] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:08 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:09.241269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:09.242295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:09.254006 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:09.254989 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:09.255783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:09.256270 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:09.403062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:09.414754 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6c9bdca9-9e20-4746-b1ff-ff6263fe3d00 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.179839 Jul 02 22:01:09.415517 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3168/6369] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:09 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:10.436985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:10.437981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:10.450295 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:10.450790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:10.451578 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:10.452057 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:10.605924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:10.613964 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eed96009-38b9-4bf3-938f-35df2f545f52 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.183630 Jul 02 22:01:10.614554 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3202/6370] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:10 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:11.636013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:11.637094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:11.648570 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:11.649065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:11.649941 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:11.650362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:11.791738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:11.800300 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4a7c6a0b-0485-4383-adc8-2ad17539beca tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.171109 Jul 02 22:01:11.800891 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3169/6371] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:11 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:12.819114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:12.819850 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:12.828951 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:12.829516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:12.830495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:12.831050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:12.972720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:12.980837 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e22109c0-4ef8-4248-9fac-8fb7aa2b7371 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.166783 Jul 02 22:01:12.981418 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3203/6372] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:12 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:13.998682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:13.999286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:14.007396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:14.007860 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:14.008679 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:14.009121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:14.148742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:14.156869 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-aad13317-125b-4441-92cb-b9dd93cb0493 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.162230 Jul 02 22:01:14.157420 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3170/6373] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:13 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:15.179443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:15.180504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:15.192723 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:15.193394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:15.194172 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:15.194609 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:15.332944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:15.344799 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-bd3d7bf1-4337-4070-9a7b-54edc1eac74c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.171523 Jul 02 22:01:15.345637 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3204/6374] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:15 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:16.368284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:16.369134 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:16.380222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:16.381139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:16.381920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:16.382363 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:16.522843 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:16.531165 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-48ac3978-a4d7-4d63-b446-0f08dbd76a77 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1694 microversion: 2.1 time: 0.169672 Jul 02 22:01:16.531748 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3171/6375] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:16 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:17.549102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:17.549729 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:17.557031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:17.557481 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:17.558264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:17.558702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:17.701936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:17.709733 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74d4ea61-d548-4a06-af97-b7271fa285ac tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1693 microversion: 2.1 time: 0.164933 Jul 02 22:01:17.710310 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3205/6376] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:17 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:17.979236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-23c11e38-8993-47ff-ae97-8af986845c60 req-283d454c-6a2b-47dc-87ff-04a8b7679fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "name": "network-vif-unplugged", "status": "completed", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:17.989138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-23c11e38-8993-47ff-ae97-8af986845c60 req-283d454c-6a2b-47dc-87ff-04a8b7679fe8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:17.989601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-23c11e38-8993-47ff-ae97-8af986845c60 req-283d454c-6a2b-47dc-87ff-04a8b7679fe8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:18.002739 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-23c11e38-8993-47ff-ae97-8af986845c60 req-283d454c-6a2b-47dc-87ff-04a8b7679fe8 service nova] Creating event network-vif-unplugged:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch2-master-1 Jul 02 22:01:18.008768 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [req-23c11e38-8993-47ff-ae97-8af986845c60 req-283d454c-6a2b-47dc-87ff-04a8b7679fe8 service nova] Instance a88b3b25-7fc3-4171-8542-023749058020 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131045) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 22:01:18.020185 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-23c11e38-8993-47ff-ae97-8af986845c60 req-283d454c-6a2b-47dc-87ff-04a8b7679fe8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044802 Jul 02 22:01:18.020882 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3172/6377] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:01:18.733329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:18.734255 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:18.742789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:18.743245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:18.744024 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:18.744504 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:18.883193 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:18.891154 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-63504efe-81af-4a71-bd8e-320518061a29 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1693 microversion: 2.1 time: 0.164396 Jul 02 22:01:18.891732 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3206/6378] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:18 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:19.910474 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:19.911208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:19.918087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:19.918580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:19.919361 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:19.919808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:20.038323 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-b4a12f66-e8b3-4ba5-8b7c-c5802ada4a48 req-5e807143-b898-481d-b001-7043e894a4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:20.048557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b4a12f66-e8b3-4ba5-8b7c-c5802ada4a48 req-5e807143-b898-481d-b001-7043e894a4f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:20.049004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-b4a12f66-e8b3-4ba5-8b7c-c5802ada4a48 req-5e807143-b898-481d-b001-7043e894a4f0 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:20.056087 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:20.061454 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-b4a12f66-e8b3-4ba5-8b7c-c5802ada4a48 req-5e807143-b898-481d-b001-7043e894a4f0 service nova] Creating event network-changed:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch2-master-1 Jul 02 22:01:20.064241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6eaab0e6-4f89-4a6f-9d01-85fd470754e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1691 microversion: 2.1 time: 0.159001 Jul 02 22:01:20.064831 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3173/6379] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:19 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:20.067475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [req-b4a12f66-e8b3-4ba5-8b7c-c5802ada4a48 req-5e807143-b898-481d-b001-7043e894a4f0 service nova] Instance a88b3b25-7fc3-4171-8542-023749058020 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=131044) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 02 22:01:20.081422 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-b4a12f66-e8b3-4ba5-8b7c-c5802ada4a48 req-5e807143-b898-481d-b001-7043e894a4f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046924 Jul 02 22:01:20.082033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3207/6380] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:01:21.085233 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:21.085982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:21.093401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.094094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.095085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.096319 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.239031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:21.247196 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c4c42d61-57a8-4b57-93f1-9fccb0edf7fa tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1688 microversion: 2.1 time: 0.166096 Jul 02 22:01:21.247761 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3174/6381] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:21 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:21.265321 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:21.265957 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:21.273353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.273807 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.274603 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.275041 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.335199 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-df327a16-ed8c-4a01-a881-6790c6f9b210 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action" status: 204 len: 0 microversion: 2.1 time: 0.074989 Jul 02 22:01:21.336075 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3208/6382] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:01:21 2022] POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 02 22:01:21.344062 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:21.344703 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:21.350964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.351605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.352236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.352720 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.503329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:21.513270 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e5a70dde-0743-417b-a84a-7506eb415456 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1688 microversion: 2.1 time: 0.173118 Jul 02 22:01:21.524289 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3175/6383] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:21 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:21.531393 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:21.532357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:21.539052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.539498 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.540493 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:21.540928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:21.685612 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:21.693805 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2790a5f7-76a6-4a19-a1d8-3f70fb06738a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1688 microversion: 2.1 time: 0.166806 Jul 02 22:01:21.694404 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3209/6384] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:21 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:22.711125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:22.711766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:22.718988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:22.719458 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:22.720269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:22.720715 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:22.859734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:22.866786 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6430fd54-909f-4d9a-870b-f5d0ddce1a84 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1680 microversion: 2.1 time: 0.159714 Jul 02 22:01:22.867366 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3176/6385] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:22 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:01:23.484444 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6500547f-b360-4e57-b75c-83d7f115c780 req-0051557c-4b74-4a66-85b7-0190541bb8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "name": "network-vif-plugged", "status": "completed", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:23.494304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6500547f-b360-4e57-b75c-83d7f115c780 req-0051557c-4b74-4a66-85b7-0190541bb8a5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:23.494756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6500547f-b360-4e57-b75c-83d7f115c780 req-0051557c-4b74-4a66-85b7-0190541bb8a5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:23.506529 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6500547f-b360-4e57-b75c-83d7f115c780 req-0051557c-4b74-4a66-85b7-0190541bb8a5 service nova] Creating event network-vif-plugged:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch2-master-1 Jul 02 22:01:23.511840 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6500547f-b360-4e57-b75c-83d7f115c780 req-0051557c-4b74-4a66-85b7-0190541bb8a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031356 Jul 02 22:01:23.512744 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3210/6386] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:01:47.073011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:47.074001 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:47.076643 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=28 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:47.077329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:47.083326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:47.083787 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:47.084673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:47.085121 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:47.146902 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-30336ad6-f693-43fc-bc39-85399ab2922c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action" status: 200 len: 24576 microversion: 2.1 time: 0.077346 Jul 02 22:01:47.147635 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3177/6387] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:01:47 2022] POST /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020/action => generated 24576 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:01:59.006602 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=24 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:59.007260 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:59.012627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:59.013854 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:59.021837 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:59.022263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:59.023291 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:59.023908 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:59.051177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 22:01:59.053891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:59.055467 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:01:59.119295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-0bf81cfe-bd4f-417b-9d12-470f40d58166 req-93ef6a5e-5c28-4e34-a96f-c049cb97ab08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:01:59.133229 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0bf81cfe-bd4f-417b-9d12-470f40d58166 req-93ef6a5e-5c28-4e34-a96f-c049cb97ab08 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:59.133758 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-0bf81cfe-bd4f-417b-9d12-470f40d58166 req-93ef6a5e-5c28-4e34-a96f-c049cb97ab08 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:59.147241 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-0bf81cfe-bd4f-417b-9d12-470f40d58166 req-93ef6a5e-5c28-4e34-a96f-c049cb97ab08 service nova] Creating event network-changed:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch2-master-1 Jul 02 22:01:59.150605 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5bfab850-49cd-45e6-afe0-1e5e563b6dff tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 204 len: 0 microversion: 2.1 time: 0.146469 Jul 02 22:01:59.151532 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3211/6388] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 22:01:59 2022] DELETE /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 22:01:59.155067 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-0bf81cfe-bd4f-417b-9d12-470f40d58166 req-93ef6a5e-5c28-4e34-a96f-c049cb97ab08 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106537 Jul 02 22:01:59.156180 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3178/6389] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:01:59.161157 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:01:59.162008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:01:59.168275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:59.168795 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:59.169625 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:01:59.170115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:01:59.304806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:01:59.312875 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c353515-03f7-4d93-a4e4-f129adb3dfb0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1686 microversion: 2.1 time: 0.156461 Jul 02 22:01:59.313579 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3212/6390] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:01:59 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:00.336054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:00.336824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:00.346265 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:00.346732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:00.347718 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:00.348197 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:00.499424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:00.507394 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-bc9c9048-0767-4d98-b023-6d37ad052fd4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1686 microversion: 2.1 time: 0.178574 Jul 02 22:02:00.507988 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3179/6391] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:00 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1686 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:01.170395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-faf4ae48-f0d6-4085-9f15-9716b055fb0b req-02a8c6d0-73c4-4728-9154-5636d62c2f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a88b3b25-7fc3-4171-8542-023749058020", "name": "network-vif-deleted", "tag": "268af2f5-559a-43e6-b6fc-bb2415184037"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:02:01.180219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-faf4ae48-f0d6-4085-9f15-9716b055fb0b req-02a8c6d0-73c4-4728-9154-5636d62c2f6b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:01.180666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-faf4ae48-f0d6-4085-9f15-9716b055fb0b req-02a8c6d0-73c4-4728-9154-5636d62c2f6b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:01.191974 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-faf4ae48-f0d6-4085-9f15-9716b055fb0b req-02a8c6d0-73c4-4728-9154-5636d62c2f6b service nova] Creating event network-vif-deleted:268af2f5-559a-43e6-b6fc-bb2415184037 for instance a88b3b25-7fc3-4171-8542-023749058020 on nch2-master-1 Jul 02 22:02:01.197135 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-faf4ae48-f0d6-4085-9f15-9716b055fb0b req-02a8c6d0-73c4-4728-9154-5636d62c2f6b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030722 Jul 02 22:02:01.198067 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3213/6392] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:02:01.525372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:01.526840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:01.534591 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:01.535137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:01.536055 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:01.536726 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:01.572555 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:01.573193 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:01.573666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lazy-loading 'fault' on Instance uuid a88b3b25-7fc3-4171-8542-023749058020 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 22:02:01.620460 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:01.628475 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-4ef5d12f-c608-4f55-89fc-7990e4bca0cf tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 200 len: 1355 microversion: 2.1 time: 0.107143 Jul 02 22:02:01.629138 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3180/6393] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:01 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 1355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:02.653167 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:02.654306 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: a88b3b25-7fc3-4171-8542-023749058020] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:02.664580 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:02.665029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:02.665791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:02.666224 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:02.680286 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] HTTP exception thrown: Instance a88b3b25-7fc3-4171-8542-023749058020 could not be found. Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Request method failure captured: Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 HTTP/1.1 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL6tpCjuH7KYH-WO_MlpiJjIbEOWaPso_nwkhdFxw27FVMz2MGxJd93xMBcPAFMEEtAFvJkbH4UkDThBOSvwssleoJ7w1BHxPBcdPOcxYh2C_OyqlKwQcwSzx1VIH7NBDBK4eFNDy9a09RF50rSySD1J9CQoIbWdpfFyqTBAzOHKIWE Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339472a22c2447d4a8174ce682d2e2ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339472a22c2447d4a8174ce682d2e2ed"}]}] Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 54f87aa5ec014141901ea0c2f1994cde Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance a88b3b25-7fc3-4171-8542-023749058020 could not be found. Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': 'a88b3b25-7fc3-4171-8542-023749058020'} Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a88b3b25-7fc3-4171-8542-023749058020 could not be found. Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a88b3b25-7fc3-4171-8542-023749058020 could not be found. Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:02:02.681980 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a88b3b25-7fc3-4171-8542-023749058020 could not be found. Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Returning 404 to user: Instance a88b3b25-7fc3-4171-8542-023749058020 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-772ca0c9-8c74-4211-b640-8fadfc50d711 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020" status: 404 len: 111 microversion: 2.1 time: 0.038950 Jul 02 22:02:02.686843 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3214/6394] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:02 2022] GET /compute/v2.1/servers/a88b3b25-7fc3-4171-8542-023749058020 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 22:02:06.397228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-efc39b5a-75e3-4d65-9865-ecb90a17ebf6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '.version_select at 0x7fabd7371c10>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:06.428968 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-efc39b5a-75e3-4d65-9865-ecb90a17ebf6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-164873153" status: 202 len: 0 microversion: 2.1 time: 0.035602 Jul 02 22:02:06.429590 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3181/6395] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 22:02:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-164873153 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:02:06.451858 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1899ea07-9386-4bdc-b2ce-9f5f411cbc21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: .version_select at 0x7fabd785eaf0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-415667810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJ1ItA86VEnlClW1VDMnLiISNlRy5QnI1UY9IOwtTU+iCYKmVNgTPwyfS3qZDZg5h94fGL871P1ar7woOEA3e3P+KwzjBjTXbrtRigb+eK5bhGU25pzZEJ0YWmnssQOXA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:02:06.470931 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1899ea07-9386-4bdc-b2ce-9f5f411cbc21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:02:06.476216 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-1899ea07-9386-4bdc-b2ce-9f5f411cbc21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:02:06.502018 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1899ea07-9386-4bdc-b2ce-9f5f411cbc21 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054208 Jul 02 22:02:06.502708 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3215/6396] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 22:02:06 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:02:12.028285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:12.032667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1615498657", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "00d07be5-7e54-466f-9a1e-fb193dbe51a8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-415667810", "security_groups": [{"name": "tempest-secgroup-smoke-1268771330"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:02:12.149725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] validate_networks() for [('00d07be5-7e54-466f-9a1e-fb193dbe51a8', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 22:02:12.570755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 22:02:12.571250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 22:02:12.571888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 22:02:12.572399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 22:02:12.573076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 22:02:12.590820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:12.591395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:12.592310 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:12.593017 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:12.616227 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:02:12.621702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:02:12.635272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 22:02:12.637682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 22:02:12.688731 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b666b9ae-8515-44f5-88af-f7f690cee7e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.662409 Jul 02 22:02:12.689428 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3182/6397] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 22:02:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 22:02:12.697943 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:12.702631 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7250d326-8b6a-4050-9538-d911389d09e4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:12.703245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7250d326-8b6a-4050-9538-d911389d09e4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:12.829309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7250d326-8b6a-4050-9538-d911389d09e4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:12.836989 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7250d326-8b6a-4050-9538-d911389d09e4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1266 microversion: 2.1 time: 0.141163 Jul 02 22:02:12.843241 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3216/6398] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:12 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:13.862926 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:13.864253 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:13.876767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:13.877549 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:13.878852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:13.879493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:14.008680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:14.024961 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-203ead83-ecd0-42a5-8f83-fa8b81e451cc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1318 microversion: 2.1 time: 0.166001 Jul 02 22:02:14.025732 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3183/6399] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:13 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:15.045978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:15.046683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:15.056604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:15.057778 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:15.060628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:15.062946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:15.237433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:15.252078 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d07b3616-1386-481d-bef7-b3e37d4893d3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.210376 Jul 02 22:02:15.253213 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3217/6400] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:15 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:15.711110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2c2cd935-1f7c-49d2-86ac-f4e00d0604ae req-cc0a500b-4b16-48a5-a323-fe86af58cade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485d8045-10f5-4d6d-8c9b-31467a430984", "tag": "332764a2-9bfe-4fd3-ba8c-7d4cb4b12267"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:02:15.737507 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2c2cd935-1f7c-49d2-86ac-f4e00d0604ae req-cc0a500b-4b16-48a5-a323-fe86af58cade service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:15.737890 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2c2cd935-1f7c-49d2-86ac-f4e00d0604ae req-cc0a500b-4b16-48a5-a323-fe86af58cade service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:15.753157 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2c2cd935-1f7c-49d2-86ac-f4e00d0604ae req-cc0a500b-4b16-48a5-a323-fe86af58cade service nova] Creating event network-changed:332764a2-9bfe-4fd3-ba8c-7d4cb4b12267 for instance 485d8045-10f5-4d6d-8c9b-31467a430984 on nch1-master-1 Jul 02 22:02:15.760912 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2c2cd935-1f7c-49d2-86ac-f4e00d0604ae req-cc0a500b-4b16-48a5-a323-fe86af58cade service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059038 Jul 02 22:02:15.762126 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3184/6401] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:02:16.271153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:16.271753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:16.278743 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:16.279203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:16.279979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:16.280463 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:16.418970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:16.427661 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b1eafce5-90fc-46c4-ac82-648ec6c5bb67 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.160583 Jul 02 22:02:16.428273 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3218/6402] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:16 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:17.444828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:17.445608 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:17.453256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:17.453708 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:17.454576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:17.454922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:17.610936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:17.619013 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5f4a1fbe-11b8-4a46-8b4f-686d814d6237 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.178615 Jul 02 22:02:17.619594 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3185/6403] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:17 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:18.637401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:18.637976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:18.645264 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:18.645717 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:18.646483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:18.646922 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:18.785706 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:18.793664 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e4423cbe-ef14-4126-b374-3a766dfec14f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.160325 Jul 02 22:02:18.794240 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3219/6404] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:18 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:19.815694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:19.816702 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:19.829290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:19.830065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:19.831425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:19.832209 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:19.979927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:19.987674 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-09d94c76-d6ea-4667-895b-33239169b332 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.178747 Jul 02 22:02:19.988261 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3186/6405] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:19 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:21.004904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:21.005516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:21.012442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:21.012896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:21.013667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:21.014104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:21.157502 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:21.165437 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1176b99e-af39-4383-b768-07b6d1f4f124 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.164471 Jul 02 22:02:21.166057 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3220/6406] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:20 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:22.189940 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:22.190955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:22.200328 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:22.200788 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:22.201551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:22.202005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:22.343589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:22.353094 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b2374626-62a7-4a80-b6e2-455ca94b2c1f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.169941 Jul 02 22:02:22.353716 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3187/6407] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:22 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:23.199064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-4102fc6e-95d5-4314-b842-21701514f27b req-e569d7f2-86c4-4312-bc97-ddcfb15a9b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485d8045-10f5-4d6d-8c9b-31467a430984", "name": "network-vif-plugged", "status": "completed", "tag": "332764a2-9bfe-4fd3-ba8c-7d4cb4b12267"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:02:23.207048 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:23.211007 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4102fc6e-95d5-4314-b842-21701514f27b req-e569d7f2-86c4-4312-bc97-ddcfb15a9b9c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:23.211575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-4102fc6e-95d5-4314-b842-21701514f27b req-e569d7f2-86c4-4312-bc97-ddcfb15a9b9c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:23.223126 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-4102fc6e-95d5-4314-b842-21701514f27b req-e569d7f2-86c4-4312-bc97-ddcfb15a9b9c service nova] Creating event network-vif-plugged:332764a2-9bfe-4fd3-ba8c-7d4cb4b12267 for instance 485d8045-10f5-4d6d-8c9b-31467a430984 on nch1-master-1 Jul 02 22:02:23.228231 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-4102fc6e-95d5-4314-b842-21701514f27b req-e569d7f2-86c4-4312-bc97-ddcfb15a9b9c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033422 Jul 02 22:02:23.228864 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3221/6408] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:02:23.370885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:23.371509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:23.373619 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:23.374579 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:02:23.382431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:23.382894 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:23.386115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:23.386566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:23.527135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:23.534882 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0ce1baff-9335-4574-b16a-9dad3045d4c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.168200 Jul 02 22:02:23.535442 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3188/6409] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:23 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:24.559013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:24.560181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:24.571076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:24.571556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:24.572368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:24.572810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:24.714593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:24.722594 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-80a190a9-5c4e-4350-b7a2-740fbaac3e06 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1392 microversion: 2.1 time: 0.172411 Jul 02 22:02:24.723192 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3222/6410] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:24 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:25.743779 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:25.744402 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:25.751828 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:25.752316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:25.753085 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:25.753524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:25.900027 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:25.910733 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-11c5ffe7-0814-40d6-b76e-0df14f29dbcd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1565 microversion: 2.1 time: 0.173076 Jul 02 22:02:25.911538 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3189/6411] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:25 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1565 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:25.928153 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:25.928787 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:25.936269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:25.936739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:25.937515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:25.937961 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:26.085421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:26.094090 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d0ce29ad-df5a-43ed-b95e-5500af211668 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1565 microversion: 2.1 time: 0.169852 Jul 02 22:02:26.094581 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3223/6412] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:25 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:27.743785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-54c89c73-0a83-4140-ab1c-c096a208835d req-c1c6ddf3-dfc2-40b4-936a-2da2b8d9b71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485d8045-10f5-4d6d-8c9b-31467a430984", "tag": "332764a2-9bfe-4fd3-ba8c-7d4cb4b12267"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:02:27.747717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:02:27.750129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:02:27.764088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:27.764548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:27.765370 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:27.765816 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:27.767199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54c89c73-0a83-4140-ab1c-c096a208835d req-c1c6ddf3-dfc2-40b4-936a-2da2b8d9b71a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:02:27.767670 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-54c89c73-0a83-4140-ab1c-c096a208835d req-c1c6ddf3-dfc2-40b4-936a-2da2b8d9b71a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:02:27.780270 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-54c89c73-0a83-4140-ab1c-c096a208835d req-c1c6ddf3-dfc2-40b4-936a-2da2b8d9b71a service nova] Creating event network-changed:332764a2-9bfe-4fd3-ba8c-7d4cb4b12267 for instance 485d8045-10f5-4d6d-8c9b-31467a430984 on nch1-master-1 Jul 02 22:02:27.785564 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-54c89c73-0a83-4140-ab1c-c096a208835d req-c1c6ddf3-dfc2-40b4-936a-2da2b8d9b71a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045681 Jul 02 22:02:27.786355 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3224/6413] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:02:27.907840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:02:27.915759 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-78ae64c7-a56d-4d56-ba8f-f9e7cd1cc4d4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1565 microversion: 2.1 time: 0.177908 Jul 02 22:02:27.916457 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3190/6414] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:02:27 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:02:30.903079 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:02:30.903708 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:02:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:03:01.237175 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:03:01.239395 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=40 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:03:01.246949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:03:01.247985 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:01.257651 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:01.258044 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:01.258819 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:01.259262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:01.325122 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6ac9b5ca-aa76-4464-817f-3963d8fb9c26 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action" status: 200 len: 24563 microversion: 2.1 time: 0.089893 Jul 02 22:03:01.325923 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3225/6415] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:03:01 2022] POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action => generated 24563 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:03:31.768416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:03:31.769981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=46 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:03:31.777057 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2048436c-9467-4373-8728-cddc871a218a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:03:31.788150 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2048436c-9467-4373-8728-cddc871a218a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:31.788921 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2048436c-9467-4373-8728-cddc871a218a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:31.814774 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2048436c-9467-4373-8728-cddc871a218a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Going to try to stop instance {{(pid=131045) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 02 22:03:31.859737 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2048436c-9467-4373-8728-cddc871a218a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action" status: 202 len: 0 microversion: 2.1 time: 0.094560 Jul 02 22:03:31.860580 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3191/6416] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:03:31 2022] POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:03:31.869269 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:31.870052 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:31.872803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:03:31.873466 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:03:31.880066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:31.880522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:31.881326 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:31.881782 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:32.020542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:32.028907 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cfd4a620-35e0-4d8f-9ecb-4f63ef7012b2 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.163939 Jul 02 22:03:32.029492 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3226/6417] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:31 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:33.052327 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:33.052979 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:33.063044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:33.063767 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:33.065058 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:33.065684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:33.218159 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:33.226438 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a3ca3235-bf42-4c2e-b023-edb00f288ebd tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.182410 Jul 02 22:03:33.227018 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3192/6418] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:33 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:34.248896 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:34.249929 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:34.261806 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:34.262555 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:34.263818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:34.264614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:34.408033 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:34.416114 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-362cc959-88c6-4217-8081-3ca760bda935 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.173996 Jul 02 22:03:34.416689 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3227/6419] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:34 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:35.438488 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:35.439512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:35.447976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:35.448493 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:35.449320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:35.449790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:35.590982 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:35.599391 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-18293314-f817-4f32-b66e-f3cf0736e072 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.167649 Jul 02 22:03:35.599972 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3193/6420] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:35 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:36.621315 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:36.622353 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:36.633813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:36.634599 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:36.635878 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:36.636667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:36.775472 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:36.789452 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ceed9b24-bda3-4788-8856-87660fc3b044 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.174622 Jul 02 22:03:36.790071 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3228/6421] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:36 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 22:03:37.811258 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:37.812266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:37.821355 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:37.821819 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:37.822602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:37.823054 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:37.972394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:37.980981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-893042a6-435b-4fab-a968-1976bce5358e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.176316 Jul 02 22:03:37.981621 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3194/6422] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:37 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:39.003062 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:39.003993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:39.015959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:39.016789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:39.018066 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:39.018801 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:39.153267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:39.161223 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7d95afd7-a1c7-446a-802f-1992642470c6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.164957 Jul 02 22:03:39.161795 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3229/6423] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:38 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:40.188820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:40.189808 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:40.197835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:40.198307 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:40.199088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:40.199528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:40.339122 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:40.347192 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cf8f1b53-dbcc-4f65-901d-7531820e8ba3 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.165154 Jul 02 22:03:40.347775 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3195/6424] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:40 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:41.365251 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:41.365853 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:41.373738 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:41.374203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:41.374989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:41.375431 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:41.514838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:41.522701 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-183ab625-c405-48f8-b82a-639bd59806fc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.161765 Jul 02 22:03:41.523290 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3230/6425] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:41 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:42.548670 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:42.549630 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:42.559163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:42.559644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:42.560545 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:42.561242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:42.719275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:42.727568 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-6bccbee9-2a57-48a1-8a27-d2e3881bdffc tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.185617 Jul 02 22:03:42.728194 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3196/6426] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:42 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:43.749200 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:43.750279 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:43.759358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:43.759818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:43.760638 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:43.761077 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:43.901740 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:43.910352 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad462d02-8458-4761-9f3d-25c9f2e32234 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.167587 Jul 02 22:03:43.910990 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3231/6427] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:43 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:44.928296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:44.928919 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:44.936451 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:44.936908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:44.937680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:44.938120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:45.076459 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:45.084610 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-955de822-d859-400b-b27a-2621775d8557 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.160843 Jul 02 22:03:45.085196 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3197/6428] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:44 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:46.104009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:46.104675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:46.111720 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:46.112214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:46.112983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:46.113430 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:46.253646 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:46.261518 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-54603319-b3c5-454a-9731-9e05c02234ed tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1694 microversion: 2.1 time: 0.161665 Jul 02 22:03:46.262094 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3232/6429] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:46 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:47.279215 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:47.279790 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:47.287479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:47.288009 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:47.288791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:47.289259 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:47.435791 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:47.443677 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e69c0ee1-b947-4dae-aa0d-ca6b147313f9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1671 microversion: 2.1 time: 0.168570 Jul 02 22:03:47.444301 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3198/6430] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:47 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:48.539632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:03:48.541211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:48.553227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:48.553688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:48.554473 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:48.554915 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:48.612864 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f5323973-4418-4682-b081-4c2439f168be tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action" status: 200 len: 35739 microversion: 2.1 time: 0.079741 Jul 02 22:03:48.613494 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3233/6431] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:03:48 2022] POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action => generated 35739 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:03:48.625104 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e7b369e0-e353-4db4-9b06-a4c651fcfb5b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:03:48.632657 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7b369e0-e353-4db4-9b06-a4c651fcfb5b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:48.633099 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e7b369e0-e353-4db4-9b06-a4c651fcfb5b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:48.656296 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e7b369e0-e353-4db4-9b06-a4c651fcfb5b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Going to try to start instance {{(pid=131045) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 02 22:03:48.705069 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e7b369e0-e353-4db4-9b06-a4c651fcfb5b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action" status: 202 len: 0 microversion: 2.1 time: 0.083857 Jul 02 22:03:48.706726 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3199/6432] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:03:48 2022] POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:03:48.715753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:48.716514 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:48.723921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:48.727032 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:48.728467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:48.728996 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:48.879194 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:48.887140 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3eecde8d-5fe6-4be8-8110-ebdd8a05604b tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1680 microversion: 2.1 time: 0.175821 Jul 02 22:03:48.887724 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3234/6433] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:48 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 22:03:49.905832 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:49.906553 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:49.914557 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:49.915016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:49.915802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:49.916281 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:50.061985 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:50.070265 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-64ad3b39-9a12-4bb5-81a6-86899ecf47af tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1680 microversion: 2.1 time: 0.168867 Jul 02 22:03:50.072365 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3200/6434] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:49 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:03:51.091605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:03:51.092701 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:03:51.103040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:51.103483 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:51.104408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:03:51.104856 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:03:51.249593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:03:51.257708 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f68bc9a9-be3b-404b-8506-dd48fb68dbcb tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1684 microversion: 2.1 time: 0.173065 Jul 02 22:03:51.258286 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3235/6435] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:03:51 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:04:23.514695 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:04:23.515668 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:04:23.518275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=20 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:23.518951 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:23.525431 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:23.525897 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:23.526678 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:23.527128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:23.607057 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7ff7ad21-bab1-4fee-a9d9-bc7f71c8feb6 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action" status: 200 len: 60298 microversion: 2.1 time: 0.096307 Jul 02 22:04:23.608133 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3201/6436] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:04:23 2022] POST /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984/action => generated 60298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:04:47.572254 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:04:47.572857 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:04:47.575318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=20 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:47.575481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-44209243-c424-4763-8319-2939883d3db8 req-87bfd31f-5973-4aa2-9cae-3376bb2973d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "485d8045-10f5-4d6d-8c9b-31467a430984", "tag": "332764a2-9bfe-4fd3-ba8c-7d4cb4b12267"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:04:47.576447 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=58 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:47.580759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:47.581427 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=4 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:04:47.582089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:47.582530 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:47.583311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:47.583814 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:47.594135 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-44209243-c424-4763-8319-2939883d3db8 req-87bfd31f-5973-4aa2-9cae-3376bb2973d4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:47.594369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-44209243-c424-4763-8319-2939883d3db8 req-87bfd31f-5973-4aa2-9cae-3376bb2973d4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:47.606044 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-44209243-c424-4763-8319-2939883d3db8 req-87bfd31f-5973-4aa2-9cae-3376bb2973d4 service nova] Creating event network-changed:332764a2-9bfe-4fd3-ba8c-7d4cb4b12267 for instance 485d8045-10f5-4d6d-8c9b-31467a430984 on nch1-master-1 Jul 02 22:04:47.611059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 22:04:47.611418 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-44209243-c424-4763-8319-2939883d3db8 req-87bfd31f-5973-4aa2-9cae-3376bb2973d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040655 Jul 02 22:04:47.612109 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3202/6437] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:04:47.707545 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7996eda6-5e7e-4d91-901c-72070e180309 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 204 len: 0 microversion: 2.1 time: 0.139042 Jul 02 22:04:47.711569 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3236/6438] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 22:04:47 2022] DELETE /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 22:04:47.719482 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:04:47.720275 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:04:47.729332 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:47.729781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:47.730701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:47.731112 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:47.931755 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:04:47.939793 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-95a76daa-e3a6-4234-a1c1-c190a9ec9735 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1690 microversion: 2.1 time: 0.226084 Jul 02 22:04:47.940409 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3203/6439] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:04:47 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1690 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:04:48.959266 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:04:48.961050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:04:48.969042 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:48.969513 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:48.970304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:48.970746 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:49.159910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:04:49.168787 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-189200e3-5f47-42de-85cf-e3db697e8437 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1690 microversion: 2.1 time: 0.214541 Jul 02 22:04:49.169659 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3237/6440] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:04:48 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1690 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:04:50.187976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:04:50.188646 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:04:50.196013 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:50.196510 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:50.197298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:50.197748 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:50.352576 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:04:50.361266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-09868838-632a-4aee-883a-cc5d2ba20da8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 200 len: 1571 microversion: 2.1 time: 0.177201 Jul 02 22:04:50.362319 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3204/6441] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:04:50 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:04:50.547273 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9a67a936-28da-453e-95b8-f8c64c010aef req-3a31bf2c-dbec-4c31-9268-18e284134a94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "485d8045-10f5-4d6d-8c9b-31467a430984", "name": "network-vif-deleted", "tag": "332764a2-9bfe-4fd3-ba8c-7d4cb4b12267"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:04:50.557010 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a67a936-28da-453e-95b8-f8c64c010aef req-3a31bf2c-dbec-4c31-9268-18e284134a94 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:50.557716 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9a67a936-28da-453e-95b8-f8c64c010aef req-3a31bf2c-dbec-4c31-9268-18e284134a94 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:50.569615 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9a67a936-28da-453e-95b8-f8c64c010aef req-3a31bf2c-dbec-4c31-9268-18e284134a94 service nova] Creating event network-vif-deleted:332764a2-9bfe-4fd3-ba8c-7d4cb4b12267 for instance 485d8045-10f5-4d6d-8c9b-31467a430984 on nch1-master-1 Jul 02 22:04:50.575705 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9a67a936-28da-453e-95b8-f8c64c010aef req-3a31bf2c-dbec-4c31-9268-18e284134a94 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089547 Jul 02 22:04:50.576760 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3238/6442] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:04:51.379448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:04:51.380015 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 485d8045-10f5-4d6d-8c9b-31467a430984] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:04:51.387405 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:51.387864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:51.388684 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:04:51.389151 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:04:51.403084 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] HTTP exception thrown: Instance 485d8045-10f5-4d6d-8c9b-31467a430984 could not be found. Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Request method failure captured: Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 HTTP/1.1 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwL6tpCjuH7KYH-WO_MlpiJjIbEOWaPso_nwkhdFxw27FVMz2MGxJd93xMBcPAFMEEtAFvJkbH4UkDThBOSvwssleoJ7w1BHxPBcdPOcxYh2C_OyqlKwQcwSzx1VIH7NBDBK4eFNDy9a09RF50rSySD1J9CQoIbWdpfFyqTBAzOHKIWE Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339472a22c2447d4a8174ce682d2e2ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339472a22c2447d4a8174ce682d2e2ed"}]}] Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: 54f87aa5ec014141901ea0c2f1994cde Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 485d8045-10f5-4d6d-8c9b-31467a430984 could not be found. Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '485d8045-10f5-4d6d-8c9b-31467a430984'} Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 485d8045-10f5-4d6d-8c9b-31467a430984 could not be found. Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 485d8045-10f5-4d6d-8c9b-31467a430984 could not be found. Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:04:51.404901 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 485d8045-10f5-4d6d-8c9b-31467a430984 could not be found. Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Returning 404 to user: Instance 485d8045-10f5-4d6d-8c9b-31467a430984 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0f656e85-94bb-4358-941f-fc8898baf62a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984" status: 404 len: 111 microversion: 2.1 time: 0.030979 Jul 02 22:04:51.409541 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3205/6443] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:04:51 2022] GET /compute/v2.1/servers/485d8045-10f5-4d6d-8c9b-31467a430984 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 22:04:54.504559 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c7583753-3210-4d2a-bae2-9d3dd749a331 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '.version_select at 0x7fabd76fb670>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:04:54.526181 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c7583753-3210-4d2a-bae2-9d3dd749a331 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-415667810" status: 202 len: 0 microversion: 2.1 time: 0.028746 Jul 02 22:04:54.526842 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3239/6444] 10.222.0.43 () {58 vars in 1280 bytes} [Sat Jul 2 22:04:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-415667810 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:04:54.559649 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-237eab48-b404-4d6c-8092-da777fe50f34 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: .version_select at 0x7fabe46d3e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2140623692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBICTtuT7uFGtXIlfl1uwwplHSUqGoCYRfRiNLkEwkqLA5X5hE4Uq1R1eSA6x3pAIwhiKIs1QxnCQSE+4N50p5J6o1/+LV0P6MNP0QRYs+k+vwOMLy6I9vTGKn8/RfhHdBA=="}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:04:54.575398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-237eab48-b404-4d6c-8092-da777fe50f34 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:04:54.581575 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-237eab48-b404-4d6c-8092-da777fe50f34 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'key_pairs'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:04:54.605990 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-237eab48-b404-4d6c-8092-da777fe50f34 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050546 Jul 02 22:04:54.606611 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3206/6445] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 22:04:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 22:05:00.383847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1492466591", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "networks": [{"uuid": "fe9458e0-fc6b-4501-8c84-dbd72c61a1dd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2140623692", "security_groups": [{"name": "tempest-secgroup-smoke-787656112"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:05:00.522133 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] validate_networks() for [('fe9458e0-fc6b-4501-8c84-dbd72c61a1dd', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 22:05:00.569784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:01.098378 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 22:05:01.098804 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 22:05:01.099283 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 22:05:01.099696 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 22:05:01.100140 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 22:05:01.109364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:01.109812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:01.110617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:01.111053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:01.131392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:05:01.136694 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Getting quotas for user 54f87aa5ec014141901ea0c2f1994cde and project 339472a22c2447d4a8174ce682d2e2ed. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:05:01.149305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 22:05:01.151725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 22:05:01.201992 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-9cfd3c59-c3ec-443c-b966-8d4ba39b9fb4 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.823182 Jul 02 22:05:01.202667 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3240/6446] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 22:05:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 22:05:01.214128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a5b3cae-26c0-4950-a0c3-eacf794e08a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:01.215366 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a5b3cae-26c0-4950-a0c3-eacf794e08a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:01.270864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a5b3cae-26c0-4950-a0c3-eacf794e08a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:01.281092 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a5b3cae-26c0-4950-a0c3-eacf794e08a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1267 microversion: 2.1 time: 0.071908 Jul 02 22:05:01.281667 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3207/6447] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:01 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:02.299348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:02.300680 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:02.311182 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:02.311586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:02.312421 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:02.312862 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:02.394561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:02.402687 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-56dfde9c-f0b2-4325-b191-98c15dc7512c tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1327 microversion: 2.1 time: 0.108174 Jul 02 22:05:02.403869 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3241/6448] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:02 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:03.420891 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:03.421541 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:03.427942 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=16 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:03.431552 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:03.432016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:03.432847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:03.433294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:03.602605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:03.613073 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-40912996-7026-4b83-8daf-76df9cb597e0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.196058 Jul 02 22:05:03.613991 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3208/6449] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:03 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:04.015418 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-68e4467d-aa27-4d33-aaf4-220443a710fe req-83e63a73-154b-4936-9684-6e4b4d49107a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b73b7f6-85f0-4756-94cf-6a929659c84c", "tag": "ecfcac0e-afa7-409f-95e5-393053bc2953"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:05:04.030719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-68e4467d-aa27-4d33-aaf4-220443a710fe req-83e63a73-154b-4936-9684-6e4b4d49107a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:04.031093 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-68e4467d-aa27-4d33-aaf4-220443a710fe req-83e63a73-154b-4936-9684-6e4b4d49107a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:04.050707 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-68e4467d-aa27-4d33-aaf4-220443a710fe req-83e63a73-154b-4936-9684-6e4b4d49107a service nova] Creating event network-changed:ecfcac0e-afa7-409f-95e5-393053bc2953 for instance 9b73b7f6-85f0-4756-94cf-6a929659c84c on nch1-master-1 Jul 02 22:05:04.057294 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-68e4467d-aa27-4d33-aaf4-220443a710fe req-83e63a73-154b-4936-9684-6e4b4d49107a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045834 Jul 02 22:05:04.058230 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3242/6450] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:05:04.631294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:04.631841 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:04.639418 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:04.639864 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:04.640724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:04.641166 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:04.772794 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:04.780643 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-68a88307-5b15-4908-8a3b-f2c54a87c2b8 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.153520 Jul 02 22:05:04.781230 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3209/6451] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:04 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:05.803884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:05.805099 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:05.813869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:05.814332 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:05.815115 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:05.815556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:05.958067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:05.965937 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-08ba57ad-6baf-46ab-9020-d5fae3569918 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.171028 Jul 02 22:05:05.966610 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3243/6452] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:05 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:06.988513 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:06.989154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:06.998124 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:06.998691 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:06.999857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:07.000444 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:07.150115 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:07.158418 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2bdfe7ae-260e-4f16-b075-31f4f8893ace tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.174058 Jul 02 22:05:07.159049 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3210/6453] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:06 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:08.175623 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:08.176305 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:08.184675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:08.185142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:08.185912 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:08.186339 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:08.321018 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:08.329634 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-93fd9792-7cf8-48a5-ba9f-51506355ac0a tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.158043 Jul 02 22:05:08.330241 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3244/6454] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:08 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:09.349869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:09.350566 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:09.362144 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:09.363283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:09.364689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:09.365303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:09.523822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:09.531718 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7111d1f0-7d48-4e8c-b2e0-83e312cca686 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.187456 Jul 02 22:05:09.532340 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3211/6455] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:09 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:10.340238 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-def58203-e43f-4670-830a-d9138250366c req-a13debdd-5a23-4ee4-9081-e6a516d9a37e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b73b7f6-85f0-4756-94cf-6a929659c84c", "name": "network-vif-plugged", "status": "completed", "tag": "ecfcac0e-afa7-409f-95e5-393053bc2953"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:05:10.348689 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-def58203-e43f-4670-830a-d9138250366c req-a13debdd-5a23-4ee4-9081-e6a516d9a37e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:10.349134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-def58203-e43f-4670-830a-d9138250366c req-a13debdd-5a23-4ee4-9081-e6a516d9a37e service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:10.360540 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-def58203-e43f-4670-830a-d9138250366c req-a13debdd-5a23-4ee4-9081-e6a516d9a37e service nova] Creating event network-vif-plugged:ecfcac0e-afa7-409f-95e5-393053bc2953 for instance 9b73b7f6-85f0-4756-94cf-6a929659c84c on nch1-master-1 Jul 02 22:05:10.365687 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-def58203-e43f-4670-830a-d9138250366c req-a13debdd-5a23-4ee4-9081-e6a516d9a37e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156376 Jul 02 22:05:10.366242 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3245/6456] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:05:10.549331 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:10.549920 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:10.557810 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:10.558336 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:10.559183 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:10.559627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:10.696829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:10.705126 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3f653c0-bd6e-4246-bf2f-a46afc23df85 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.159833 Jul 02 22:05:10.706579 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3212/6457] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:10 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:11.720759 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:11.721608 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:11.727040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:11.728060 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:11.735593 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:11.736064 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:11.736849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:11.737286 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:11.879827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:11.888092 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1e4aaaec-f2de-4d3d-a52e-c6091d30400d tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1392 microversion: 2.1 time: 0.168339 Jul 02 22:05:11.888733 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3246/6458] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:11 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:12.909426 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:12.910506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:12.913626 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:12.922888 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:12.923348 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:12.924169 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:12.924618 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:13.065724 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:13.074133 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-02cb63af-ad4c-4601-828e-cad894126de1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1565 microversion: 2.1 time: 0.171506 Jul 02 22:05:13.074729 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3213/6459] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:12 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1565 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:13.090820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:13.091678 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:13.099229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:13.099686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:13.100501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:13.100935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:13.248535 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:13.256645 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-40568be9-f40f-4d1a-9c4f-b8cf8a1763c0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1565 microversion: 2.1 time: 0.169887 Jul 02 22:05:13.257240 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3247/6460] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:13 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:15.248607 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:05:15.249236 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:15.250181 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-43e07712-d897-4900-a2fc-cb550328ab0e req-966889ee-b210-4c43-a7d6-cdd3e3dbbfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b73b7f6-85f0-4756-94cf-6a929659c84c", "tag": "ecfcac0e-afa7-409f-95e5-393053bc2953"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:05:15.255907 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:15.256666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:15.257456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:15.257900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:15.259989 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43e07712-d897-4900-a2fc-cb550328ab0e req-966889ee-b210-4c43-a7d6-cdd3e3dbbfa7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:15.260485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-43e07712-d897-4900-a2fc-cb550328ab0e req-966889ee-b210-4c43-a7d6-cdd3e3dbbfa7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:15.272577 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-43e07712-d897-4900-a2fc-cb550328ab0e req-966889ee-b210-4c43-a7d6-cdd3e3dbbfa7 service nova] Creating event network-changed:ecfcac0e-afa7-409f-95e5-393053bc2953 for instance 9b73b7f6-85f0-4756-94cf-6a929659c84c on nch1-master-1 Jul 02 22:05:15.278392 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-43e07712-d897-4900-a2fc-cb550328ab0e req-966889ee-b210-4c43-a7d6-cdd3e3dbbfa7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031901 Jul 02 22:05:15.279349 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3248/6461] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:05:15.400274 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:05:15.409635 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-169dacf0-e1e5-4ff4-8ba1-ba2a2f5264a9 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1565 microversion: 2.1 time: 0.165899 Jul 02 22:05:15.410436 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3214/6462] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:05:15 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:05:46.738433 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:46.739202 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=38 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:05:46.744161 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:05:46.745201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:05:46.752909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:46.753375 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:46.754217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:05:46.754659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:05:46.819966 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2d7d9590-5700-4b38-9992-c1363d8fe5e1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action" status: 200 len: 24573 microversion: 2.1 time: 0.084887 Jul 02 22:05:46.820661 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3249/6463] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:05:46 2022] POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:06:25.920627 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:25.921435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=42 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:25.926174 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:25.926725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:25.934685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:25.935188 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:25.936004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:25.936501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:25.961110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lazy-loading 'flavor' on Instance uuid 9b73b7f6-85f0-4756-94cf-6a929659c84c {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 22:06:26.033837 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3e255901-c5aa-4f40-99a5-31005775e12e tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action" status: 202 len: 0 microversion: 2.1 time: 0.116091 Jul 02 22:06:26.034489 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3215/6464] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:06:25 2022] POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:06:26.043426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:26.044162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:26.047003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:26.047791 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:26.055643 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:26.056110 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:26.056892 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:26.057329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:26.198630 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:26.207906 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-750fb13f-08e2-42bb-8fab-0a047b7bfb70 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1692 microversion: 2.1 time: 0.168855 Jul 02 22:06:26.208513 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3250/6465] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:26 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1692 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:27.231473 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:27.232581 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:27.239659 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:27.240154 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:27.240929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:27.241368 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:27.386605 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:27.394780 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b3c9e95c-6d49-4d0b-b209-2de21d1b16d0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1692 microversion: 2.1 time: 0.171335 Jul 02 22:06:27.395354 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3216/6466] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:27 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:28.417129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:28.418192 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:28.428205 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:28.429122 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:28.430072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:28.430525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:28.565015 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:28.573339 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3c1b4ec7-38b3-4b92-9cd6-fc01367df02f tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1675 microversion: 2.1 time: 0.163135 Jul 02 22:06:28.573878 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3251/6467] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:28 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:29.670723 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:29.672313 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:29.684738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:29.685512 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:29.686804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:29.687483 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:29.756503 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a4251842-3fa9-4bea-a740-3b6a29214d98 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action" status: 200 len: 38385 microversion: 2.1 time: 0.091910 Jul 02 22:06:29.757526 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3217/6468] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:06:29 2022] POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action => generated 38385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:06:29.776673 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:29.777803 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:29.786852 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:29.787342 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:29.788156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:29.788598 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:29.864374 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4982697c-f0f3-4614-8ef2-d1ae37162946 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action" status: 202 len: 0 microversion: 2.1 time: 0.094101 Jul 02 22:06:29.865215 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3252/6469] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:06:29 2022] POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:06:29.874395 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:29.875212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:29.882320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:29.882835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:29.883573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:29.884382 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:30.026034 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:30.033917 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-909bbddf-5b13-4637-aa60-5cedab9cae51 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1681 microversion: 2.1 time: 0.163838 Jul 02 22:06:30.034702 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3218/6470] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:29 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:31.052898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:31.053869 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:31.060693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:31.061145 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:31.061924 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:31.062409 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:31.199357 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:31.210915 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-37d92425-e5e9-4b35-bbd1-082fb8ca87ad tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1681 microversion: 2.1 time: 0.163022 Jul 02 22:06:31.211650 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3253/6471] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:31 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:32.234802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:32.235494 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:32.243861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:32.244399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:32.245292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:32.245783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:32.383728 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:32.391767 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-023b8894-e442-4164-98c2-1e1f878ccb19 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1684 microversion: 2.1 time: 0.163450 Jul 02 22:06:32.392370 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3219/6472] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:32 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:32.484500 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:32.485453 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:32.492792 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:32.493225 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:32.494050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:32.494510 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:32.552728 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7dd99f57-c3e7-4172-84c3-a838d03751db tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action" status: 200 len: 38385 microversion: 2.1 time: 0.072153 Jul 02 22:06:32.553693 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3254/6473] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:06:32 2022] POST /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c/action => generated 38385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 02 22:06:33.599222 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:33.600424 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:33.601436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d8c9ef41-86e0-4247-8943-63f3aa616097 req-a07f1721-b8e0-42f2-8d4f-6b29af50efd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b73b7f6-85f0-4756-94cf-6a929659c84c", "tag": "ecfcac0e-afa7-409f-95e5-393053bc2953"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:33.607749 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:33.608249 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:33.609125 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:33.609573 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:33.612212 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8c9ef41-86e0-4247-8943-63f3aa616097 req-a07f1721-b8e0-42f2-8d4f-6b29af50efd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:33.612664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d8c9ef41-86e0-4247-8943-63f3aa616097 req-a07f1721-b8e0-42f2-8d4f-6b29af50efd8 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:33.624711 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d8c9ef41-86e0-4247-8943-63f3aa616097 req-a07f1721-b8e0-42f2-8d4f-6b29af50efd8 service nova] Creating event network-changed:ecfcac0e-afa7-409f-95e5-393053bc2953 for instance 9b73b7f6-85f0-4756-94cf-6a929659c84c on nch1-master-1 Jul 02 22:06:33.629933 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d8c9ef41-86e0-4247-8943-63f3aa616097 req-a07f1721-b8e0-42f2-8d4f-6b29af50efd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033402 Jul 02 22:06:33.630556 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3255/6474] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:06:33.637697 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 22:06:33.723775 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e2716708-7e53-4a20-b6df-0af628ba86a7 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 204 len: 0 microversion: 2.1 time: 0.128834 Jul 02 22:06:33.724436 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3220/6475] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 22:06:33 2022] DELETE /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 22:06:33.734002 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:33.734707 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:33.741120 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:33.741571 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:33.742348 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:33.742785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:33.878900 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:33.886791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f33042f6-e61c-46c6-9162-f9fcf24979ea tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1690 microversion: 2.1 time: 0.157686 Jul 02 22:06:33.887382 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3256/6476] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:33 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:34.906185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:34.906904 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:34.914199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:34.914660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:34.915428 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:34.915865 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:35.079311 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:35.087352 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fe4a552-91a5-4d89-9ded-6b7b079ea1a1 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1690 microversion: 2.1 time: 0.185647 Jul 02 22:06:35.087938 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3221/6477] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:34 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1690 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:36.102983 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-d5cb1cf8-a5e7-4353-bbdd-b8473d35b1e7 req-be2e219f-2539-48b6-a458-8cfb890fcbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b73b7f6-85f0-4756-94cf-6a929659c84c", "name": "network-vif-deleted", "tag": "ecfcac0e-afa7-409f-95e5-393053bc2953"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:36.105212 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:36.105836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:36.113286 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:36.113717 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:36.114267 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d5cb1cf8-a5e7-4353-bbdd-b8473d35b1e7 req-be2e219f-2539-48b6-a458-8cfb890fcbf6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:36.114529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:36.114695 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-d5cb1cf8-a5e7-4353-bbdd-b8473d35b1e7 req-be2e219f-2539-48b6-a458-8cfb890fcbf6 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:36.115044 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:36.129999 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-d5cb1cf8-a5e7-4353-bbdd-b8473d35b1e7 req-be2e219f-2539-48b6-a458-8cfb890fcbf6 service nova] Creating event network-vif-deleted:ecfcac0e-afa7-409f-95e5-393053bc2953 for instance 9b73b7f6-85f0-4756-94cf-6a929659c84c on nch1-master-1 Jul 02 22:06:36.136259 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-d5cb1cf8-a5e7-4353-bbdd-b8473d35b1e7 req-be2e219f-2539-48b6-a458-8cfb890fcbf6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Jul 02 22:06:36.136877 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3257/6478] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:06:36.182147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54f87aa5ec014141901ea0c2f1994cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '339472a22c2447d4a8174ce682d2e2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:36.190017 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b48a45cf-5cd2-476b-b364-e9cf7c0c2ad0 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 200 len: 1504 microversion: 2.1 time: 0.088949 Jul 02 22:06:36.190652 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3222/6479] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:36 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 1504 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:37.214059 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:37.215217 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] [instance: 9b73b7f6-85f0-4756-94cf-6a929659c84c] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:37.224114 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:37.224573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:37.225345 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:37.225788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:37.243852 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] HTTP exception thrown: Instance 9b73b7f6-85f0-4756-94cf-6a929659c84c could not be found. Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Request method failure captured: Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c HTTP/1.1 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwL6tpCjuH7KYH-WO_MlpiJjIbEOWaPso_nwkhdFxw27FVMz2MGxJd93xMBcPAFMEEtAFvJkbH4UkDThBOSvwssleoJ7w1BHxPBcdPOcxYh2C_OyqlKwQcwSzx1VIH7NBDBK4eFNDy9a09RF50rSySD1J9CQoIbWdpfFyqTBAzOHKIWE Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_339472a22c2447d4a8174ce682d2e2ed", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/339472a22c2447d4a8174ce682d2e2ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/339472a22c2447d4a8174ce682d2e2ed"}]}] Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 339472a22c2447d4a8174ce682d2e2ed Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-186308505 Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 54f87aa5ec014141901ea0c2f1994cde Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestNetworkAdvancedServerOps-186308505-project Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 9b73b7f6-85f0-4756-94cf-6a929659c84c could not be found. Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '9b73b7f6-85f0-4756-94cf-6a929659c84c'} Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b73b7f6-85f0-4756-94cf-6a929659c84c could not be found. Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b73b7f6-85f0-4756-94cf-6a929659c84c could not be found. Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:06:37.246443 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b73b7f6-85f0-4756-94cf-6a929659c84c could not be found. Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Returning 404 to user: Instance 9b73b7f6-85f0-4756-94cf-6a929659c84c could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-1289deba-e600-4a6f-92db-1207fc520c37 tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c" status: 404 len: 111 microversion: 2.1 time: 0.041142 Jul 02 22:06:37.251590 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3258/6480] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:37 2022] GET /compute/v2.1/servers/9b73b7f6-85f0-4756-94cf-6a929659c84c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 22:06:40.606446 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c3e2862d-8691-4ede-a413-845d263d9bab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] Calling method '.version_select at 0x7fabe48f1670>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:40.627377 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c3e2862d-8691-4ede-a413-845d263d9bab tempest-TestNetworkAdvancedServerOps-186308505 tempest-TestNetworkAdvancedServerOps-186308505-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2140623692" status: 202 len: 0 microversion: 2.1 time: 0.029445 Jul 02 22:06:40.627975 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3223/6481] 10.222.0.43 () {58 vars in 1283 bytes} [Sat Jul 2 22:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2140623692 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:06:52.267675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=18 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:52.269582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:52.479650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7beee305-9c01-419d-ab41-8465180130c6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Action: 'create', calling method: .version_select at 0x7fabe41418b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-206899934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYq1GIBqGuLwx1aP/8N0uz75kgUlHNfEX+lcgks/CSgOJeLvQ1u1bWnvJG9Vgi6VyI7Qt5OyGrlWgDXJ71xGOQccRFhtEM0ZrVIE8Qag49BPjqUxWTNYfkwHCwVQtebQA=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:52.494416 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7beee305-9c01-419d-ab41-8465180130c6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Getting quotas for project cba9051146cc4baa8e9ad5b1773bd2d4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:06:52.500667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-7beee305-9c01-419d-ab41-8465180130c6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Getting quotas for user 5fdbc9c99f204d0bbb5f03771f5ff453 and project cba9051146cc4baa8e9ad5b1773bd2d4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:06:52.527947 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7beee305-9c01-419d-ab41-8465180130c6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.273999 Jul 02 22:06:52.528693 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3259/6482] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 22:06:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:06:53.560988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:53.561757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:06:53.566110 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1964220371", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-206899934", "security_groups": [{"name": "tempest-secgroup-smoke-1292547252"}], "networks": [{"uuid": "5abd36e5-4c07-4847-b5fb-8ae1eebaf3e7"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:53.678369 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] validate_networks() for [('5abd36e5-4c07-4847-b5fb-8ae1eebaf3e7', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 22:06:54.171411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 22:06:54.171846 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 22:06:54.172372 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 22:06:54.172796 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 22:06:54.173216 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 22:06:54.183469 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:54.183945 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:54.184797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:54.185242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:54.202882 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Getting quotas for project cba9051146cc4baa8e9ad5b1773bd2d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:06:54.208554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Getting quotas for user 5fdbc9c99f204d0bbb5f03771f5ff453 and project cba9051146cc4baa8e9ad5b1773bd2d4. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:06:54.221655 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 22:06:54.223909 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 22:06:54.270296 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [82deb99d-82fa-45c3-9319-3e0e3d9f2e00] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:06:55.279810 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [82deb99d-82fa-45c3-9319-3e0e3d9f2e00] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 36972. Jul 02 22:06:55.284929 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f8f9de95-5a5c-4a6e-8bab-9ab332c616b0 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.725853 Jul 02 22:06:55.287215 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3224/6483] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 22:06:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 22:06:55.296831 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5c648ac8-4280-4db8-9916-fa24db12fd01 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:55.297445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5c648ac8-4280-4db8-9916-fa24db12fd01 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:55.360486 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5c648ac8-4280-4db8-9916-fa24db12fd01 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:55.367719 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5c648ac8-4280-4db8-9916-fa24db12fd01 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1246 microversion: 2.1 time: 0.076030 Jul 02 22:06:55.372456 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3260/6484] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:55 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1246 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:56.387415 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:56.388725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:56.399205 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:56.399918 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:56.401885 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:56.402409 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:56.504506 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:56.513287 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fc4d1367-ec24-4472-aef5-85e4065e612a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1306 microversion: 2.1 time: 0.130498 Jul 02 22:06:56.514181 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3225/6485] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:56 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:57.531061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:57.531790 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:57.538997 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:57.539516 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:57.540318 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:57.540750 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:57.688501 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:57.704797 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5cf67202-f09b-48b4-8cda-35d09c4ac4b2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.177772 Jul 02 22:06:57.708081 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3261/6486] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:57 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:58.188448 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-f74689cf-80fb-41fd-9a23-026c89579766 req-cb836399-4448-4824-b9fc-eb56c2785860 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:06:58.200086 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f74689cf-80fb-41fd-9a23-026c89579766 req-cb836399-4448-4824-b9fc-eb56c2785860 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:58.200910 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-f74689cf-80fb-41fd-9a23-026c89579766 req-cb836399-4448-4824-b9fc-eb56c2785860 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:58.219763 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-f74689cf-80fb-41fd-9a23-026c89579766 req-cb836399-4448-4824-b9fc-eb56c2785860 service nova] Creating event network-changed:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:06:58.225338 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-f74689cf-80fb-41fd-9a23-026c89579766 req-cb836399-4448-4824-b9fc-eb56c2785860 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041620 Jul 02 22:06:58.226524 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3226/6487] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:06:58.724895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:58.725509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:58.732949 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:58.733406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:58.734299 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:58.734739 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:58.875039 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:06:58.883015 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b617e181-ecfd-45b6-8adb-85f3153f877c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.162165 Jul 02 22:06:58.883543 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3262/6488] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:58 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:06:59.906387 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:06:59.907090 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:06:59.913973 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:59.914462 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:06:59.915271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:06:59.915719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:00.058324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:00.069945 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f23b6c46-625c-4a92-adc6-8703ff9e2993 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.171727 Jul 02 22:07:00.070857 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3227/6489] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:06:59 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:01.088426 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:01.089128 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:01.097576 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:01.098126 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:01.098971 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:01.099627 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:01.241786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:01.249917 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-74f01e2b-57cf-4628-a639-391961e05ed3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.166335 Jul 02 22:07:01.250511 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3263/6490] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:01 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:02.267221 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:02.267802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:02.275509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:02.275976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:02.276798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:02.277243 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:02.409583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:02.417432 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c1c7d0b3-2481-4ee4-b599-29925a1e9748 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.154263 Jul 02 22:07:02.417979 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3228/6491] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:02 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:03.435022 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:03.436329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:03.443551 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:03.444003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:03.444810 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:03.445278 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:03.584458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:03.595874 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ad1f1a2f-4c59-45f5-a4e6-534db5e1a53c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.164819 Jul 02 22:07:03.596467 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3264/6492] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:03 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:04.613869 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:04.614490 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:04.617455 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:04.618136 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:04.624922 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:04.625414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:04.626320 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:04.626775 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:04.764955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:04.773137 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b0e48325-bb84-4e9f-87c6-3093f974b2a6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.163520 Jul 02 22:07:04.773720 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3229/6493] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:04 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:04.824911 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-1e085266-d1eb-41c8-9d64-132b25f79abd req-662f7b04-ec50-4fad-872e-55ea5111e583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "name": "network-vif-plugged", "status": "completed", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:07:04.834903 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e085266-d1eb-41c8-9d64-132b25f79abd req-662f7b04-ec50-4fad-872e-55ea5111e583 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:04.835359 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-1e085266-d1eb-41c8-9d64-132b25f79abd req-662f7b04-ec50-4fad-872e-55ea5111e583 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:04.847775 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-1e085266-d1eb-41c8-9d64-132b25f79abd req-662f7b04-ec50-4fad-872e-55ea5111e583 service nova] Creating event network-vif-plugged:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:07:04.852880 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-1e085266-d1eb-41c8-9d64-132b25f79abd req-662f7b04-ec50-4fad-872e-55ea5111e583 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032841 Jul 02 22:07:04.853819 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3265/6494] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:07:05.793974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:05.795010 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:05.807269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:05.808097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:05.809377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:05.810162 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:05.960245 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:05.968350 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f647a816-bbc7-409e-b639-a3e465507a49 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1372 microversion: 2.1 time: 0.180944 Jul 02 22:07:05.968827 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3230/6495] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:05 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:06.988376 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:06.989125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:06.991148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:07:06.998106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:06.998569 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:06.999312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:06.999774 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:07.139017 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:07.147155 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-160e0324-59ea-447d-830d-7a7e43e37704 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1555 microversion: 2.1 time: 0.164460 Jul 02 22:07:07.147866 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3266/6496] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:06 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:07.163824 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:07:07.164479 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:07:07.171709 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:07.172206 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:07.172976 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:07.173417 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:07.308685 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:07:07.318573 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dd41160e-5d78-4564-809b-e064b11439d1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1555 microversion: 2.1 time: 0.158711 Jul 02 22:07:07.319151 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3231/6497] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:07:07 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:07:09.062331 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-9599f4b6-3eed-4bd0-9880-63dee8242704 req-8f3e0b71-0d22-406f-8347-ed8b850d4b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:07:09.072247 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9599f4b6-3eed-4bd0-9880-63dee8242704 req-8f3e0b71-0d22-406f-8347-ed8b850d4b0c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:07:09.072725 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-9599f4b6-3eed-4bd0-9880-63dee8242704 req-8f3e0b71-0d22-406f-8347-ed8b850d4b0c service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:07:09.086060 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-9599f4b6-3eed-4bd0-9880-63dee8242704 req-8f3e0b71-0d22-406f-8347-ed8b850d4b0c service nova] Creating event network-changed:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:07:09.091167 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-9599f4b6-3eed-4bd0-9880-63dee8242704 req-8f3e0b71-0d22-406f-8347-ed8b850d4b0c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032665 Jul 02 22:07:09.092353 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3267/6498] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:07:30.915545 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:07:30.916280 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:07:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:09:23.856848 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:09:23.857941 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:09:35.650111 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:09:35.651131 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:09:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:09:38.860284 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0110b08e-b0dd-476d-bbab-ad64d125228e] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 22:09:38.862247 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [-] [35662bbb-83f2-4e2a-9c02-91311131c30d] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 22:09:38.863156 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:09:38.864338 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=40 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:09:38.871675 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:09:38.872660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:38.883738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:38.884220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:38.884994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:38.885425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:38.908908 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lazy-loading 'flavor' on Instance uuid 2ac1be23-9308-4f52-b317-0bdcf55325c3 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 22:09:39.175497 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fd1a804b-ed68-4c97-9148-5c3de8baf498 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "POST /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3/action" status: 202 len: 0 microversion: 2.1 time: 0.318356 Jul 02 22:09:39.176240 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3232/6499] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:09:38 2022] POST /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:09:39.183353 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:09:39.184223 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:09:39.184812 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:09:39.185600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=34 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:09:39.190263 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:39.190979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:39.199604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:39.200076 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:39.200865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:39.201411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:39.346246 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:39.354455 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-5afa8de3-4b23-49cc-9959-ce09ea86d0c5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.173038 Jul 02 22:09:39.355033 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3268/6500] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:39 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:40.375567 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:40.376185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:40.384213 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:40.384667 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:40.385439 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:40.385874 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:40.392662 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] [35662bbb-83f2-4e2a-9c02-91311131c30d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37096. Jul 02 22:09:40.393477 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] [0110b08e-b0dd-476d-bbab-ad64d125228e] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37094. Jul 02 22:09:40.521948 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:40.530189 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-58467de5-190a-44ec-bdd8-a9c06665036a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.161133 Jul 02 22:09:40.530739 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3233/6501] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:40 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:41.552104 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:41.553055 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:41.573234 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:41.573998 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:41.575358 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:41.576117 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:41.580687 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37100. Jul 02 22:09:41.584358 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37102. Jul 02 22:09:41.732368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:41.744787 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cd1f3b72-109e-4fc1-b0ea-d9c7f95c2880 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.199134 Jul 02 22:09:41.745403 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3269/6502] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:41 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:42.765220 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:42.766836 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:42.774536 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:42.774994 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:42.775784 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:42.776260 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:42.916955 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:42.925444 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f5601d2e-2bca-4c91-8da3-0906c5a3d254 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.165036 Jul 02 22:09:42.926105 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3234/6503] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:42 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:43.949978 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:43.950969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:43.963228 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:43.964105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:43.965671 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:43.966408 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:44.111868 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:44.119729 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c2ee6da3-41a3-4681-aaa3-0d7cab983b63 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.176372 Jul 02 22:09:44.120361 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3270/6504] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:43 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:45.139739 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:45.140423 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:45.148386 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:45.148839 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:45.149614 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:45.150059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:45.299611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:45.311459 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-3a8a058d-f799-44e3-b983-0b17a98570cb tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.176573 Jul 02 22:09:45.312263 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3235/6505] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:45 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:46.333756 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:46.334600 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:46.345976 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:46.346434 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:46.347213 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:46.347657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:46.492013 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:46.504381 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-520885a2-1c26-4a82-ad78-36e630e596fc tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.176953 Jul 02 22:09:46.505227 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3271/6506] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:46 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:47.532362 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:47.533254 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:47.541003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:47.541463 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:47.542241 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:47.542677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:47.766398 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:47.779981 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cd829520-5916-42ad-84fb-ca084d2fbc52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.254779 Jul 02 22:09:47.780905 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3236/6507] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:47 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:48.801162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:48.801763 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:48.810147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:48.810657 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:48.811557 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:48.812009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:49.025522 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:49.033949 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-cb578465-d337-4e19-8584-4ffe1f69000a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.236928 Jul 02 22:09:49.034537 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3272/6508] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:48 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:50.054025 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:50.054777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:50.063539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:50.064095 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:50.064981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:50.065425 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:50.210968 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:50.219028 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-63cfd5a9-e61b-4ca4-afd0-7b62f191d68a tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.169409 Jul 02 22:09:50.219615 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3237/6509] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:50 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:51.240684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:51.241517 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:51.253591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:51.254341 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:51.255607 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:51.256383 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:51.405730 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:51.413784 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b9001a19-89c3-4fe9-8c87-08ce21aa31af tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1701 microversion: 2.1 time: 0.180012 Jul 02 22:09:51.414361 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3273/6510] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:51 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1701 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:52.435974 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:52.437133 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:52.449641 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:52.450411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:52.451690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:52.452489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:52.591714 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:52.603669 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-c0f9e9eb-61b5-49fd-bad7-bd2e872ed201 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1701 microversion: 2.1 time: 0.174350 Jul 02 22:09:52.604574 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3238/6511] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:52 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1701 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:53.621818 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:53.622404 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:53.630719 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:53.631177 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:53.631956 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:53.632509 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:53.772328 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:53.780382 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b52ffcec-d903-4398-98c9-eca25b15b6f6 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1701 microversion: 2.1 time: 0.163142 Jul 02 22:09:53.781039 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3274/6512] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:53 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1701 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:54.801701 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:54.802377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:54.811694 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:54.812272 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:54.813141 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:54.813798 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:54.961147 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:54.969132 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d53e8c61-2d54-425c-b6cd-cedf2b369868 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1701 microversion: 2.1 time: 0.173710 Jul 02 22:09:54.969715 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3239/6513] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:54 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1701 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:55.459469 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-72d59749-2b15-41d0-be5a-bf317b2e7b51 req-dac7d57a-123a-4820-83a5-92efbce63906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "name": "network-vif-plugged", "status": "completed", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:09:55.469785 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72d59749-2b15-41d0-be5a-bf317b2e7b51 req-dac7d57a-123a-4820-83a5-92efbce63906 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:55.470245 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-72d59749-2b15-41d0-be5a-bf317b2e7b51 req-dac7d57a-123a-4820-83a5-92efbce63906 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:55.482150 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-72d59749-2b15-41d0-be5a-bf317b2e7b51 req-dac7d57a-123a-4820-83a5-92efbce63906 service nova] Creating event network-vif-plugged:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:09:55.488920 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-72d59749-2b15-41d0-be5a-bf317b2e7b51 req-dac7d57a-123a-4820-83a5-92efbce63906 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Jul 02 22:09:55.489524 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3275/6514] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:09:55.988443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:55.989211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:55.998208 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:55.998769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:55.999731 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:56.000334 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:56.139503 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:56.149059 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ff9118a9-8de4-475e-a9fb-59433797d8c2 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1701 microversion: 2.1 time: 0.165843 Jul 02 22:09:56.149636 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3240/6515] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:55 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1701 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:57.167991 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:57.169223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:57.175959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:57.176462 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:57.177327 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:57.177648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:57.316539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:57.324493 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6bce011e-d5f6-49e1-8ae7-343d0e91e10f tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.161744 Jul 02 22:09:57.325091 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3276/6516] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:57 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:58.343211 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:58.346447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:58.354294 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:58.354757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:58.355550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:58.356120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:58.508524 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:58.516675 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dee2a978-72f5-4b89-97e5-1f227fb3792c tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.177544 Jul 02 22:09:58.517474 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3241/6517] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:58 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:09:59.536183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:09:59.537087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:09:59.551065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:59.552109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:59.554204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:09:59.555050 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:09:59.720124 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:09:59.728926 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d9a3d824-ed7f-4434-a665-326b44671325 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.198193 Jul 02 22:09:59.729627 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3277/6518] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:09:59 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:00.746653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:00.748443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:00.755977 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:00.756535 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:00.757379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:00.758023 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:00.920677 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:00.929181 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-7484f786-425d-4768-9cab-7df893c077c1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.186523 Jul 02 22:10:00.929774 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3242/6519] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:00 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:01.947223 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:01.947793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:01.955543 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:01.955994 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:01.956867 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:01.957308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:02.117813 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:02.125347 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-2ec650db-5901-4375-a9ef-aa88d6177022 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.182214 Jul 02 22:10:02.126894 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3278/6520] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:01 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:03.143744 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:03.144394 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:03.154988 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:03.155457 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:03.156278 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:03.156725 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:03.309383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:03.318398 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-706fb9a9-cd14-48e2-8dac-b955106ae2fd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.178630 Jul 02 22:10:03.318995 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3243/6521] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:03 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:04.335583 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:04.336938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:04.347388 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:04.355479 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:04.356793 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:04.357439 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:04.507827 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:04.516019 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-e66a99d3-e265-468c-a5af-29b657497d39 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.184976 Jul 02 22:10:04.516953 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3279/6522] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:04 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:05.533680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:05.534290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:05.541927 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:05.542653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:05.543673 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:05.544333 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:05.683969 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:05.692675 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-fa28dc5b-7f59-41f2-945a-90bc7a0af7a5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1696 microversion: 2.1 time: 0.162879 Jul 02 22:10:05.693293 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3244/6523] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:05 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:06.711248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:06.711840 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:06.719125 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:06.719582 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:06.720394 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:06.720847 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:06.852360 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:06.860791 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-44c01b57-0815-4f92-9bc8-b560573a4a52 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1678 microversion: 2.1 time: 0.153959 Jul 02 22:10:06.861347 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3280/6524] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:06 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:07.884375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:07.885139 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:07.894316 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:07.894889 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:07.895857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:07.896449 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:08.042137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:08.051914 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-cb8d83fd-973a-4dca-b8ff-ad011c7f81e7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1678 microversion: 2.1 time: 0.172860 Jul 02 22:10:08.052568 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3245/6525] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:07 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:09.070061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:09.070682 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:09.077973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:09.078427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:09.079214 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:09.079650 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:09.215534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:09.217937 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=79 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:09.224855 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-785a6095-811f-4b24-aa89-e5f3f81dfda7 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1681 microversion: 2.1 time: 0.158786 Jul 02 22:10:09.225437 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3281/6526] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:09 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:09.241766 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:10:09.242269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:09.245091 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=29 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:09.250645 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:09.251411 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:09.252242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:09.252689 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:09.255687 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:09.349878 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-830c6518-a881-44d0-8517-489bd90ba998 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "POST /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3/action" status: 202 len: 0 microversion: 2.1 time: 0.111916 Jul 02 22:10:09.350693 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3246/6527] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:10:09 2022] POST /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:10:09.358909 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:09.359570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:09.363038 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=29 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:10:09.367204 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:09.367973 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:09.368875 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:09.369405 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:09.513031 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:09.521578 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-97e0258d-0534-4477-a848-3f921fd64f76 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1689 microversion: 2.1 time: 0.166670 Jul 02 22:10:09.522251 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3282/6528] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:09 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:10.539379 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:10.540003 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:10.546780 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:10.547240 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:10.548016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:10.548495 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:10.695303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:10.703334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e68bdd7b-c5ba-445a-9f54-d51d0403bcbd tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.168223 Jul 02 22:10:10.703914 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3247/6529] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:10 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:11.563561 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-fd7b433d-dd07-4476-b7af-6a1b7db37598 req-3355d26e-f35d-44f3-a9c5-414d890c8dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "name": "network-vif-unplugged", "status": "completed", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:10:11.572222 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fd7b433d-dd07-4476-b7af-6a1b7db37598 req-3355d26e-f35d-44f3-a9c5-414d890c8dd7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:11.572667 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-fd7b433d-dd07-4476-b7af-6a1b7db37598 req-3355d26e-f35d-44f3-a9c5-414d890c8dd7 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:11.589828 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-fd7b433d-dd07-4476-b7af-6a1b7db37598 req-3355d26e-f35d-44f3-a9c5-414d890c8dd7 service nova] Creating event network-vif-unplugged:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:10:11.595377 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-fd7b433d-dd07-4476-b7af-6a1b7db37598 req-3355d26e-f35d-44f3-a9c5-414d890c8dd7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108726 Jul 02 22:10:11.596073 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3283/6530] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:10:11.722854 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:11.723516 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:11.731120 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:11.731804 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:11.732786 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:11.733374 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:11.887870 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:11.896660 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ea63e9bf-b489-477d-bd9a-b47dc41205aa tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.177587 Jul 02 22:10:11.897315 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3248/6531] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:11 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:12.919683 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:12.920659 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:12.927523 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:12.927969 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:12.928771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:12.929209 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:13.084379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:13.093565 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ed9e57bb-7205-4976-a645-91e90aac696e tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.179723 Jul 02 22:10:13.094169 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3284/6532] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:12 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:14.110971 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:14.111588 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:14.118852 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:14.121149 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:14.121993 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:14.122436 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:14.276680 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:14.285754 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f18c4492-864d-4a4a-8667-bfcbf89683da tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.178634 Jul 02 22:10:14.286873 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3249/6533] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:14 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:15.303652 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:15.304304 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:15.311965 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:15.312427 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:15.313195 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:15.313628 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:15.455995 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:15.464080 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-720f4464-5b49-4db0-aa06-ec8a671e42a1 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.164658 Jul 02 22:10:15.474424 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3285/6534] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:15 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:16.483770 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:16.484933 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:16.495109 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:16.495563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:16.496383 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:16.496820 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:16.642544 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:16.666799 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-36c2cbf5-662a-453d-a8ca-7fd66b74f707 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.186148 Jul 02 22:10:16.666799 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3250/6535] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:16 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:17.682346 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:17.683441 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:17.691329 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:17.691767 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:17.692794 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:17.693313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:17.836895 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:17.844724 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0ef645dc-0280-4825-b07b-0a061b2c7c56 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.166807 Jul 02 22:10:17.845304 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3286/6536] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:17 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:18.862497 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:18.863343 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:18.870997 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:18.872539 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:18.873396 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:18.873900 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:19.012390 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:19.020334 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-acf6cf39-3402-46c7-a06f-7923b4dfbc0b tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.161996 Jul 02 22:10:19.020905 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3251/6537] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:18 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:20.041365 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:20.042312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:20.053702 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:20.054162 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:20.055925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:20.055925 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:20.218424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:20.227443 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b52f5e5-26bd-4386-a3f5-d02993607f32 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.192791 Jul 02 22:10:20.228082 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3287/6538] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:20 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:21.248356 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:21.249280 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:21.258759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:21.259145 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:21.259923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:21.260400 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:21.399853 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:21.412626 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1cd050f3-d166-4f49-85fa-11454706c628 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.168442 Jul 02 22:10:21.413231 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3252/6539] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:21 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:22.435399 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:22.436471 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:22.448649 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:22.449389 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:22.450645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:22.451392 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:22.591979 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:22.603616 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-47fce949-e311-4989-9916-10feb4a67572 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.175004 Jul 02 22:10:22.604472 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3288/6540] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:22 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:23.629323 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:23.630295 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:23.638129 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:23.638563 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:23.639377 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:23.639817 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:23.812547 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:23.824491 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5953c298-b26c-4912-8f56-729ae6481965 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.201650 Jul 02 22:10:23.825318 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3253/6541] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:23 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:24.845011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:24.845606 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:24.852993 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:24.853449 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:24.854229 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:24.854669 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:25.002758 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:25.010950 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b571d26b-3fe6-4fda-beed-e8124caf19f8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.169930 Jul 02 22:10:25.011545 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3289/6542] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:24 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:26.032938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:26.033583 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:26.041440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:26.041440 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:26.042160 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:26.042594 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:26.180203 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:26.188266 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-e212a08a-a4ae-4a8b-8fe2-d7e518b62416 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.159372 Jul 02 22:10:26.188845 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3254/6543] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:26 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:27.209754 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:27.210789 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:27.222666 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:27.223494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:27.224836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:27.225591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:27.362424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:27.370314 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8ac1a120-6ada-4976-a52d-4d6a0a4ec849 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1687 microversion: 2.1 time: 0.167342 Jul 02 22:10:27.370892 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3290/6544] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:27 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:28.391312 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:10:28.392230 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:10:28.401349 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:28.401805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:28.402586 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:28.403031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:28.542616 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:10:28.553884 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-73e30084-e83e-4b42-a8d6-0743259849f3 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1674 microversion: 2.1 time: 0.168461 Jul 02 22:10:28.554468 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3255/6545] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:10:28 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:10:29.617009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-f54d5483-57a7-4905-be42-f3aae2886900 req-da44ae66-b2cf-480a-ac5e-9ba5a772e68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "name": "network-vif-plugged", "status": "completed", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:10:29.626480 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f54d5483-57a7-4905-be42-f3aae2886900 req-da44ae66-b2cf-480a-ac5e-9ba5a772e68d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:10:29.626884 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-f54d5483-57a7-4905-be42-f3aae2886900 req-da44ae66-b2cf-480a-ac5e-9ba5a772e68d service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:10:29.638565 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-f54d5483-57a7-4905-be42-f3aae2886900 req-da44ae66-b2cf-480a-ac5e-9ba5a772e68d service nova] Creating event network-vif-plugged:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:10:29.643763 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-f54d5483-57a7-4905-be42-f3aae2886900 req-da44ae66-b2cf-480a-ac5e-9ba5a772e68d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030575 Jul 02 22:10:29.644487 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3291/6546] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:10:50.925746 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:10:50.926506 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:10:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:12:16.791219 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=21 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:16.792601 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:16.795120 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 02 22:12:16.798440 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] AMQP server on 10.222.0.43:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 02 22:12:16.798590 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:16.799148 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=19 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:16.799299 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:16.800317 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=53 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:16.808554 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:16.809489 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:16.810283 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:16.810732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:16.839672 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 22:12:16.865313 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-882ab0ec-5bd3-4257-8f3f-8ce390fdf4f7 req-6c6cc7cc-7534-4c81-96f9-eb07f8c03fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:16.874864 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-882ab0ec-5bd3-4257-8f3f-8ce390fdf4f7 req-6c6cc7cc-7534-4c81-96f9-eb07f8c03fc4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:16.875311 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-882ab0ec-5bd3-4257-8f3f-8ce390fdf4f7 req-6c6cc7cc-7534-4c81-96f9-eb07f8c03fc4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:16.889600 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-882ab0ec-5bd3-4257-8f3f-8ce390fdf4f7 req-6c6cc7cc-7534-4c81-96f9-eb07f8c03fc4 service nova] Creating event network-changed:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:12:16.895943 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-882ab0ec-5bd3-4257-8f3f-8ce390fdf4f7 req-6c6cc7cc-7534-4c81-96f9-eb07f8c03fc4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104583 Jul 02 22:12:16.898536 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3292/6547] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:12:16.935410 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ba4c8236-1460-48d4-b602-bee73079ed99 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 204 len: 0 microversion: 2.1 time: 0.146520 Jul 02 22:12:16.936475 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3256/6548] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 22:12:16 2022] DELETE /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 22:12:16.947310 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:16.948391 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:16.956970 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:16.957459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:16.958262 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:16.958709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:17.102072 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:17.110198 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-84e08039-17b4-48c6-8f89-f23e4b682140 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.168537 Jul 02 22:12:17.111130 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3293/6549] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:16 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:18.127763 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:18.128472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:18.136018 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:18.136548 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:18.137329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:18.137765 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:18.279102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:18.286936 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-dcb5eaf1-4730-47fa-8bcc-ee39e1a06e98 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1680 microversion: 2.1 time: 0.163662 Jul 02 22:12:18.287513 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3257/6550] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:18 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:19.128464 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37402. Jul 02 22:12:19.134482 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37404. Jul 02 22:12:19.177458 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-3fafe8d4-2fb5-4a62-a844-7e5bfbbd636d req-4ab1d68d-7cfb-40b9-86b6-c09aba30ec17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ac1be23-9308-4f52-b317-0bdcf55325c3", "name": "network-vif-deleted", "tag": "22c2289e-7953-4ee1-8c28-cbc0bd95d0ff"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:19.187142 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3fafe8d4-2fb5-4a62-a844-7e5bfbbd636d req-4ab1d68d-7cfb-40b9-86b6-c09aba30ec17 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:19.187590 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-3fafe8d4-2fb5-4a62-a844-7e5bfbbd636d req-4ab1d68d-7cfb-40b9-86b6-c09aba30ec17 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:19.197939 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-3fafe8d4-2fb5-4a62-a844-7e5bfbbd636d req-4ab1d68d-7cfb-40b9-86b6-c09aba30ec17 service nova] Creating event network-vif-deleted:22c2289e-7953-4ee1-8c28-cbc0bd95d0ff for instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 on nch1-master-1 Jul 02 22:12:19.204166 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-3fafe8d4-2fb5-4a62-a844-7e5bfbbd636d req-4ab1d68d-7cfb-40b9-86b6-c09aba30ec17 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090823 Jul 02 22:12:19.205096 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3294/6551] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:12:19.304906 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:19.305509 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:19.313292 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:19.313742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:19.314511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:19.314946 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:19.346271 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:19.346644 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:19.347094 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.objects.instance [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lazy-loading 'fault' on Instance uuid 2ac1be23-9308-4f52-b317-0bdcf55325c3 {{(pid=131045) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 02 22:12:19.399097 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5fdbc9c99f204d0bbb5f03771f5ff453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cba9051146cc4baa8e9ad5b1773bd2d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:19.407225 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2a64eb37-aaa7-4923-a8f9-cd75be2ad93d tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 200 len: 1336 microversion: 2.1 time: 0.106321 Jul 02 22:12:19.407816 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3258/6552] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:19 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 1336 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:20.426663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:20.427364 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [instance: 2ac1be23-9308-4f52-b317-0bdcf55325c3] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:20.435595 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:20.436065 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:20.436846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:20.437280 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:20.450882 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] HTTP exception thrown: Instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 could not be found. Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Request method failure captured: Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 HTTP/1.1 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwMF2CIjVqe5PqN43twH5IY7g8fudvbHqzz1v2ziYjxXABTFWcVVOKuzJXASSh4Jex_3Kdc2FFbEwqmL4RFOMjVHNvZmT5XQEkNXhVp-wdo8fAJQLUWUnHHiWzT9x9sANzLQBcpSVgYsBOQIAbTQea9Jf_b7yJerXfg2IjX6VfwVyYnQ Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: cba9051146cc4baa8e9ad5b1773bd2d4 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestShelveInstance-121528893 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cba9051146cc4baa8e9ad5b1773bd2d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cba9051146cc4baa8e9ad5b1773bd2d4", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cba9051146cc4baa8e9ad5b1773bd2d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cba9051146cc4baa8e9ad5b1773bd2d4"}]}] Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestShelveInstance-121528893 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: cba9051146cc4baa8e9ad5b1773bd2d4 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestShelveInstance-121528893 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestShelveInstance-121528893-project Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: 5fdbc9c99f204d0bbb5f03771f5ff453 Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestShelveInstance-121528893-project Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 could not be found. Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '2ac1be23-9308-4f52-b317-0bdcf55325c3'} Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 could not be found. Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 could not be found. Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:12:20.452525 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 could not be found. Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Returning 404 to user: Instance 2ac1be23-9308-4f52-b317-0bdcf55325c3 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-42baab28-6fce-4239-9c83-7bb73b6b83e5 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3" status: 404 len: 111 microversion: 2.1 time: 0.031545 Jul 02 22:12:20.460786 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3295/6553] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:20 2022] GET /compute/v2.1/servers/2ac1be23-9308-4f52-b317-0bdcf55325c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 22:12:20.622179 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-5fda631a-8e89-4078-8570-f6592ac2bc93 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '.version_select at 0x7fabea2b15e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:20.625534 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5fda631a-8e89-4078-8570-f6592ac2bc93 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [c96e68b1-4b7d-4d47-88b0-22db9fb8bf07] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:12:21.639367 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [None req-5fda631a-8e89-4078-8570-f6592ac2bc93 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [c96e68b1-4b7d-4d47-88b0-22db9fb8bf07] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37414. Jul 02 22:12:21.663374 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-5fda631a-8e89-4078-8570-f6592ac2bc93 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-206899934" status: 202 len: 0 microversion: 2.1 time: 1.045196 Jul 02 22:12:21.664060 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3259/6554] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 22:12:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-206899934 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 02 22:12:21.688614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-3e95717e-052b-4590-b002-3886ec4674ed tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Action: 'create', calling method: .version_select at 0x7fabea153ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-708020895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvqsiJJ3paJ0PsPlNf5C/I9yxM3v3GUzJ4vJ0bZXQRYFoI7svUPcNCiwSem1InkteUubBlvrqh6OAVop88tbhfxyUKFt48Dbr4EAcOt7dv92SNKoa7hmuWAWxZjWY2v+w=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:21.706113 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3e95717e-052b-4590-b002-3886ec4674ed tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Getting quotas for project cba9051146cc4baa8e9ad5b1773bd2d4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:12:21.711921 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-3e95717e-052b-4590-b002-3886ec4674ed tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Getting quotas for user 5fdbc9c99f204d0bbb5f03771f5ff453 and project cba9051146cc4baa8e9ad5b1773bd2d4. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:12:21.726234 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e95717e-052b-4590-b002-3886ec4674ed tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [dfba8099-c748-46f6-bcd8-09ba6c45cf67] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:12:22.733837 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e95717e-052b-4590-b002-3886ec4674ed tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] [dfba8099-c748-46f6-bcd8-09ba6c45cf67] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37418. Jul 02 22:12:22.751095 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-3e95717e-052b-4590-b002-3886ec4674ed tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.066754 Jul 02 22:12:22.751703 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3296/6555] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 22:12:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:12:25.574329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-149cddff-d6bc-47ed-9754-dd703212e8b8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] Calling method '.version_select at 0x7fabea32d5e0>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:25.595115 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-149cddff-d6bc-47ed-9754-dd703212e8b8 tempest-TestShelveInstance-121528893 tempest-TestShelveInstance-121528893-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-708020895" status: 202 len: 0 microversion: 2.1 time: 0.025641 Jul 02 22:12:25.595734 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3260/6556] 10.222.0.43 () {58 vars in 1250 bytes} [Sat Jul 2 22:12:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-708020895 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:12:43.291372 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=12 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:43.292275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=4 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:43.293084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:43.496570 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-16b83c07-be08-45a0-9c58-efac8bc7501c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Action: 'create', calling method: .version_select at 0x7fabd75489d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1995481580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJZsg4bNuOgj6xkM91NLWqz8j7cauiBiMh2Sz/D66VcqzUV1Fb+GKkIcq4xYaqnkat2wAqPwocS+/JTgf/MnA7YFiPZcfK8MAJqpj066AA5/FpyINyI3giAbbsrvS0Bsg=="}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:43.512152 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-16b83c07-be08-45a0-9c58-efac8bc7501c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Getting quotas for project 11c2539cbdbb4e1abc2819a46eb87404. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:12:43.518231 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-16b83c07-be08-45a0-9c58-efac8bc7501c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Getting quotas for user b6d022b31b82474ea335f541e7699b90 and project 11c2539cbdbb4e1abc2819a46eb87404. Resources: {'key_pairs'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:12:43.566850 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-16b83c07-be08-45a0-9c58-efac8bc7501c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.277150 Jul 02 22:12:43.574517 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3297/6557] 10.222.0.43 () {60 vars in 1158 bytes} [Sat Jul 2 22:12:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:12:44.600764 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-761210228", "imageRef": "e482b755-1c1a-4758-a7c0-b3edf1610541", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1995481580", "security_groups": [{"name": "tempest-secgroup-smoke-1625829030"}], "networks": [{"uuid": "6882c409-61a3-4b8e-a6f2-0e8261f99983"}]}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:44.612540 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:44.613602 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:44.719273 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.network.neutron [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] validate_networks() for [('6882c409-61a3-4b8e-a6f2-0e8261f99983', None, None, None, None, None)] {{(pid=131045) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 22:12:45.203551 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Flavor limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 22:12:45.203981 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Image limits 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 22:12:45.204529 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Flavor pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 22:12:45.205128 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Image pref 0:0:0 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 22:12:45.205716 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.virt.hardware [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131045) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 22:12:45.215471 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:45.215929 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:45.216847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:45.217297 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:45.234443 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Getting quotas for project 11c2539cbdbb4e1abc2819a46eb87404. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:12:45.239857 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.quota [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Getting quotas for user b6d022b31b82474ea335f541e7699b90 and project 11c2539cbdbb4e1abc2819a46eb87404. Resources: {'ram', 'cores', 'instances'} {{(pid=131045) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:12:45.252847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Going to run 1 instances... {{(pid=131045) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 22:12:45.255269 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e482b755-1c1a-4758-a7c0-b3edf1610541',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131045) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 22:12:45.305691 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-2f03ddfc-6d04-4ff1-93c4-c1fa85d1796b tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708975 Jul 02 22:12:45.306717 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3261/6558] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 22:12:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 22:12:45.318053 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-88a04497-54d3-425b-9082-7dd555ae6242 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:45.319309 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-88a04497-54d3-425b-9082-7dd555ae6242 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:45.395614 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-88a04497-54d3-425b-9082-7dd555ae6242 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:45.403149 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-88a04497-54d3-425b-9082-7dd555ae6242 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1248 microversion: 2.1 time: 0.090104 Jul 02 22:12:45.403739 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3298/6559] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:45 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1248 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:46.421414 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:46.422043 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:46.428840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:46.429291 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:46.430075 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:46.430511 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:46.514793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:46.539564 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-82c85a96-df1f-42b2-a411-13565207a6f3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1300 microversion: 2.1 time: 0.122876 Jul 02 22:12:46.540926 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3262/6560] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:46 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1300 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:47.558843 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:47.559567 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:47.568939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:47.569494 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:47.570505 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:47.572155 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:47.781385 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:47.789615 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-6a391bc7-97be-4e86-9331-4c2157ec7fef tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.235814 Jul 02 22:12:47.790318 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3299/6561] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:47 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:48.339970 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2f7b5335-9dd7-4cf0-b752-88ae352a1b81 req-7d70da83-e854-4637-b390-abc134daf672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:48.351801 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2f7b5335-9dd7-4cf0-b752-88ae352a1b81 req-7d70da83-e854-4637-b390-abc134daf672 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:48.352613 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2f7b5335-9dd7-4cf0-b752-88ae352a1b81 req-7d70da83-e854-4637-b390-abc134daf672 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:48.365726 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2f7b5335-9dd7-4cf0-b752-88ae352a1b81 req-7d70da83-e854-4637-b390-abc134daf672 service nova] Creating event network-changed:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:12:48.371042 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2f7b5335-9dd7-4cf0-b752-88ae352a1b81 req-7d70da83-e854-4637-b390-abc134daf672 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034962 Jul 02 22:12:48.372102 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3263/6562] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:12:48.807370 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:48.808762 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:48.816379 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:48.816865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:48.817675 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:48.818757 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:48.957436 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:48.965742 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-f2b05a93-6c7b-4d8c-a71f-f9765064c263 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.162674 Jul 02 22:12:48.966322 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3300/6563] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:48 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:49.983682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:49.984580 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:49.991533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:49.992102 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:49.992962 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:49.993412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:50.217730 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:50.225796 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1f78da41-712c-458e-a3a8-086d3f8cd59f tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.247490 Jul 02 22:12:50.226366 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3264/6564] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:49 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:51.246939 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:51.247665 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:51.256098 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:51.256679 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:51.257641 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:51.258183 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:51.403029 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:51.414138 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-36215a71-546d-4125-8c20-dd708a814f28 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.173784 Jul 02 22:12:51.414865 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3301/6565] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:51 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:52.434071 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:52.434705 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:52.441938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:52.442401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:52.443190 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:52.443636 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:52.591805 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:52.599977 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b769199f-216d-442b-8ebf-828e8ea8eb3c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.171679 Jul 02 22:12:52.602249 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3265/6566] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:52 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:53.618664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:53.619515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:53.629620 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:53.630227 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:53.631261 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:53.631844 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:53.782308 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:53.791127 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-00f6c9ce-4a67-4a1e-b1c2-cc0b7abcf41e tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.177811 Jul 02 22:12:53.791755 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3302/6567] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:53 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:54.358435 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-72c54a73-fd4d-4923-9d8d-03a8a9c14a24 req-bf369b18-81a5-46cb-84ea-e010aaff8f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "name": "network-vif-plugged", "status": "completed", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:54.368403 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-72c54a73-fd4d-4923-9d8d-03a8a9c14a24 req-bf369b18-81a5-46cb-84ea-e010aaff8f50 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:54.369012 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-72c54a73-fd4d-4923-9d8d-03a8a9c14a24 req-bf369b18-81a5-46cb-84ea-e010aaff8f50 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:54.381066 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-72c54a73-fd4d-4923-9d8d-03a8a9c14a24 req-bf369b18-81a5-46cb-84ea-e010aaff8f50 service nova] Creating event network-vif-plugged:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:12:54.386147 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-72c54a73-fd4d-4923-9d8d-03a8a9c14a24 req-bf369b18-81a5-46cb-84ea-e010aaff8f50 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031601 Jul 02 22:12:54.386754 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3266/6568] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:12:54.813137 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:54.814009 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:54.825846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:54.826307 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:54.827097 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:54.827898 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:54.964105 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:54.971851 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0eee9867-8942-4798-a945-4db98ca3c1cd tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1374 microversion: 2.1 time: 0.165955 Jul 02 22:12:54.972479 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3303/6569] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:54 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:55.986399 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:55.987185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=6 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:55.992290 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:55.993000 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:56.000712 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:56.001163 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:56.001972 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:56.002434 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:56.145572 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:56.153786 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f48f9d39-428a-4b35-8f40-665918bab7d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1559 microversion: 2.1 time: 0.168376 Jul 02 22:12:56.154446 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3267/6570] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:55 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:56.170282 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:12:56.170899 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:12:56.172846 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:12:56.179478 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:56.179935 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:56.181087 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:56.181545 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:56.323573 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:12:56.332005 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-eafd990b-bebc-48cd-b33b-d0b5ead7a9d5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1559 microversion: 2.1 time: 0.165724 Jul 02 22:12:56.332612 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3304/6571] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:12:56 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:12:58.059813 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-4261d5d8-0cf0-481f-b4c2-039b4c3a4703 req-e9787c17-e97f-4bc4-acc6-160b912dd97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:12:58.069329 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4261d5d8-0cf0-481f-b4c2-039b4c3a4703 req-e9787c17-e97f-4bc4-acc6-160b912dd97b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:12:58.069783 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-4261d5d8-0cf0-481f-b4c2-039b4c3a4703 req-e9787c17-e97f-4bc4-acc6-160b912dd97b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:12:58.081416 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-4261d5d8-0cf0-481f-b4c2-039b4c3a4703 req-e9787c17-e97f-4bc4-acc6-160b912dd97b service nova] Creating event network-changed:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:12:58.086787 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-4261d5d8-0cf0-481f-b4c2-039b4c3a4703 req-e9787c17-e97f-4bc4-acc6-160b912dd97b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031125 Jul 02 22:12:58.087903 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3268/6572] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:14:10.938592 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:14:10.939383 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:14:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:14:35.665754 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:14:35.666864 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:14:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:14:56.227424 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:14:56.228760 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=36 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:14:56.235147 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1754528023"}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:14:56.236944 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:14:56.245520 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:14:56.245938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:14:56.246705 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:14:56.247134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:14:56.789104 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-0b5e32d1-ad30-401c-93ad-5d74424540c9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "POST /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413/action" status: 202 len: 0 microversion: 2.1 time: 0.565207 Jul 02 22:14:56.789719 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3305/6573] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:14:56 2022] POST /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 22:15:03.140711 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [-] [35662bbb-83f2-4e2a-9c02-91311131c30d] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:15:03.141535 ncdv-master-1 devstack@n-api.service[131045]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0110b08e-b0dd-476d-bbab-ad64d125228e] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 02 22:15:03.142412 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:03.143242 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=32 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:03.151498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-2f53f7ce-f55e-4f7b-b0db-58189b9d9b7b req-ae607406-e8d1-496d-acc1-dac555c796a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "name": "network-vif-plugged", "status": "completed", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:15:03.165250 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2f53f7ce-f55e-4f7b-b0db-58189b9d9b7b req-ae607406-e8d1-496d-acc1-dac555c796a4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:03.166148 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-2f53f7ce-f55e-4f7b-b0db-58189b9d9b7b req-ae607406-e8d1-496d-acc1-dac555c796a4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:03.178724 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-2f53f7ce-f55e-4f7b-b0db-58189b9d9b7b req-ae607406-e8d1-496d-acc1-dac555c796a4 service nova] Creating event network-vif-plugged:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:15:03.187148 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-2f53f7ce-f55e-4f7b-b0db-58189b9d9b7b req-ae607406-e8d1-496d-acc1-dac555c796a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047846 Jul 02 22:15:03.189051 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3269/6574] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:15:10.340836 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-300933023", "imageRef": "d8dab00c-2d56-47ff-b7a7-efc826fc6ec5", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1995481580", "security_groups": [{"name": "tempest-secgroup-smoke-1625829030"}], "networks": [{"uuid": "6882c409-61a3-4b8e-a6f2-0e8261f99983"}]}} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:15:10.349335 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:10.350003 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:10.454021 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.network.neutron [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] validate_networks() for [('6882c409-61a3-4b8e-a6f2-0e8261f99983', None, None, None, None, None)] {{(pid=131044) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 02 22:15:10.918776 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Flavor limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 02 22:15:10.919203 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Image limits 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 02 22:15:10.919686 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Flavor pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 02 22:15:10.920092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Image pref 0:0:0 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 02 22:15:10.920534 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.virt.hardware [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131044) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 02 22:15:10.931201 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:10.931636 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:10.932591 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:10.933020 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:10.952946 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Getting quotas for project 11c2539cbdbb4e1abc2819a46eb87404. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 02 22:15:10.958361 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.quota [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Getting quotas for user b6d022b31b82474ea335f541e7699b90 and project 11c2539cbdbb4e1abc2819a46eb87404. Resources: {'ram', 'cores', 'instances'} {{(pid=131044) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 02 22:15:10.971004 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Going to run 1 instances... {{(pid=131044) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 02 22:15:10.973664 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d8dab00c-2d56-47ff-b7a7-efc826fc6ec5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131044) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 02 22:15:11.022492 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-fac30eeb-c9a7-4114-9813-9812f24f03a3 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.685966 Jul 02 22:15:11.023142 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3306/6575] 10.222.0.43 () {60 vars in 1146 bytes} [Sat Jul 2 22:15:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 02 22:15:11.039738 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d91fc1e5-08a9-4185-ba0b-eef9237ea605 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:11.040915 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d91fc1e5-08a9-4185-ba0b-eef9237ea605 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:11.077851 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] [0110b08e-b0dd-476d-bbab-ad64d125228e] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37872. Jul 02 22:15:11.079375 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] [35662bbb-83f2-4e2a-9c02-91311131c30d] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 37870. Jul 02 22:15:11.168537 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-d91fc1e5-08a9-4185-ba0b-eef9237ea605 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:11.176546 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d91fc1e5-08a9-4185-ba0b-eef9237ea605 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1248 microversion: 2.1 time: 0.146998 Jul 02 22:15:11.177482 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3270/6576] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:11 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1248 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:12.197023 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:12.197644 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:12.206028 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:12.206476 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:12.207248 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:12.207681 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:12.272347 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:12.280080 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8cf21e46-5026-4a9b-8926-76fe14c7466c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1318 microversion: 2.1 time: 0.089354 Jul 02 22:15:12.280656 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3307/6577] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:12 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1318 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:13.297690 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:13.299041 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:13.302923 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:13.309611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:13.310059 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:13.310835 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:13.311266 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:13.455550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:13.464452 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-ad10a61e-e030-4711-b73c-6f3e5fb3719a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.170747 Jul 02 22:15:13.465762 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3271/6578] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:13 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:14.482745 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:14.483401 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:14.490709 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:14.491156 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:14.491942 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:14.492411 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:14.645524 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:14.654012 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-d50ff6c4-013c-4afd-94f8-df163e7dfdb9 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.175163 Jul 02 22:15:14.654710 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3308/6579] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:14 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:15.238456 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5e901677-2b5f-486a-9e1b-5c69afbc42b0 req-be18a969-9015-4052-a3d7-7d842a2c687a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "name": "network-vif-unplugged", "status": "completed", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:15:15.253965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5e901677-2b5f-486a-9e1b-5c69afbc42b0 req-be18a969-9015-4052-a3d7-7d842a2c687a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:15.254800 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5e901677-2b5f-486a-9e1b-5c69afbc42b0 req-be18a969-9015-4052-a3d7-7d842a2c687a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:15.268295 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5e901677-2b5f-486a-9e1b-5c69afbc42b0 req-be18a969-9015-4052-a3d7-7d842a2c687a service nova] Creating event network-vif-unplugged:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:15:15.278601 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5e901677-2b5f-486a-9e1b-5c69afbc42b0 req-be18a969-9015-4052-a3d7-7d842a2c687a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119140 Jul 02 22:15:15.279350 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3272/6580] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:15:15.671784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:15.672515 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:15.679974 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:15.680835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:15.681632 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:15.682106 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:15.830197 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:15.838302 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-210729ff-7093-4769-bb28-4b5026aaf65a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.170454 Jul 02 22:15:15.839132 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3309/6581] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:15 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:16.856924 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:16.858157 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:16.866140 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:16.866848 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:16.868358 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:16.869031 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:17.012964 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:17.021851 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-8a06292a-1f6b-4183-8ff1-63ac910f0194 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.169079 Jul 02 22:15:17.028796 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3273/6582] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:16 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:18.039575 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:18.040312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:18.048078 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:18.048684 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:18.049489 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:18.049920 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:18.201134 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:18.209987 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-ba0edae2-4b41-4ada-ab2d-b98760f687f0 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.174729 Jul 02 22:15:18.220068 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3310/6583] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:18 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 02 22:15:19.227033 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:19.227682 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:19.236284 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:19.236742 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:19.240611 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:19.241137 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:19.397965 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:19.406007 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a642fb36-1416-4009-8425-f2627732b150 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.182960 Jul 02 22:15:19.406867 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3274/6584] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:19 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:20.427825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:20.428910 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:20.439936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:20.440825 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:20.442101 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:20.442835 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:20.588475 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:20.600135 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-7b92f165-e8bf-43f8-84c2-11ed7d805d82 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.179075 Jul 02 22:15:20.600927 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3311/6585] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:20 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:21.627663 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:21.628746 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:21.633430 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell0:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:21.644324 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:21.645138 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:21.646401 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:21.647143 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:21.802501 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:21.815254 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-0a8b16bd-b987-472f-ac12-9ac2da66e01c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.198935 Jul 02 22:15:21.816250 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3275/6586] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:21 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:22.841132 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:22.842000 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:22.845008 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:22.846275 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell0:SELECT=6 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:22.855624 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:22.856092 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:22.856904 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:22.857303 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:23.000442 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:23.012514 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-55fad329-53aa-4496-8846-e4512ebe4166 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.177914 Jul 02 22:15:23.013443 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3312/6587] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:22 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:24.034416 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:24.035176 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:24.042753 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:24.043207 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:24.044005 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:24.044481 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:24.116012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-74f6bcf0-8b41-4ac7-a1e2-f4618b73257a req-108ccf13-462a-4955-aa85-1a0a77319fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:15:24.134334 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-74f6bcf0-8b41-4ac7-a1e2-f4618b73257a req-108ccf13-462a-4955-aa85-1a0a77319fd4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:24.134940 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-74f6bcf0-8b41-4ac7-a1e2-f4618b73257a req-108ccf13-462a-4955-aa85-1a0a77319fd4 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:24.159111 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-74f6bcf0-8b41-4ac7-a1e2-f4618b73257a req-108ccf13-462a-4955-aa85-1a0a77319fd4 service nova] Creating event network-changed:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:15:24.164730 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-74f6bcf0-8b41-4ac7-a1e2-f4618b73257a req-108ccf13-462a-4955-aa85-1a0a77319fd4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053110 Jul 02 22:15:24.171403 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3313/6588] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:15:24.210550 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:24.219082 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-14c901a5-0b09-4f5a-b377-c2b631d853e4 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.188676 Jul 02 22:15:24.219758 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3276/6589] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:24 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:25.237981 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:25.238704 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:25.245546 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:25.246011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:25.246784 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:25.247199 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:25.390131 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:25.400339 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8c509e68-2583-4d63-bc30-6f76d042e196 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.167566 Jul 02 22:15:25.400920 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3314/6590] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:25 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:26.421653 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:26.422637 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:26.434199 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:26.434833 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:26.435861 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:26.436666 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:26.579364 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:26.588524 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-146710a2-a8de-49ba-ae86-b1877cd7b47a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.173347 Jul 02 22:15:26.589123 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3277/6591] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:26 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:27.609467 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:27.610330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:27.621377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:27.621838 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:27.622617 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:27.623061 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:27.762842 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:27.770945 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-c4dead7e-8c0b-4ca6-b2cc-525a33a94447 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.168387 Jul 02 22:15:27.771520 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3315/6592] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:27 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:28.792797 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:28.793734 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:28.805967 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:28.806719 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:28.807986 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:28.808757 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:28.953351 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:28.961313 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-b48caeee-08de-41b2-bf97-824853919cdf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.175225 Jul 02 22:15:28.961893 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3278/6593] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:28 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:29.982693 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:29.983688 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:29.994934 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:29.995406 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:29.996219 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:29.996663 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:30.148690 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:30.157184 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b244d04e-0bc6-4d30-8b4d-2c7043eee142 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.181131 Jul 02 22:15:30.157771 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3316/6594] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:29 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:31.160314 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-6e14cc99-14a5-43d4-bb52-661345b7c3a6 req-571ba262-bd95-48ca-8f8f-cbc7a5770598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "name": "network-vif-plugged", "status": "completed", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:15:31.170872 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e14cc99-14a5-43d4-bb52-661345b7c3a6 req-571ba262-bd95-48ca-8f8f-cbc7a5770598 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:31.171326 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-6e14cc99-14a5-43d4-bb52-661345b7c3a6 req-571ba262-bd95-48ca-8f8f-cbc7a5770598 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:31.174753 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:31.176585 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:31.184600 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-6e14cc99-14a5-43d4-bb52-661345b7c3a6 req-571ba262-bd95-48ca-8f8f-cbc7a5770598 service nova] Creating event network-vif-plugged:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:15:31.184788 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:31.185226 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:31.186011 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:31.186451 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:31.190329 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-6e14cc99-14a5-43d4-bb52-661345b7c3a6 req-571ba262-bd95-48ca-8f8f-cbc7a5770598 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034428 Jul 02 22:15:31.190940 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3279/6595] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:15:31.328084 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:31.335969 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-4a2e4f7c-7733-4bf2-b167-ace013170ab5 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.165475 Jul 02 22:15:31.336605 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3317/6596] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:31 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:32.358472 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:32.359498 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:32.371950 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:32.372769 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:32.374064 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:32.374802 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:32.518262 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:32.530478 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-1c8d9256-37fc-4d17-97c8-c121604b929a tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1374 microversion: 2.1 time: 0.179254 Jul 02 22:15:32.531318 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3280/6597] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:32 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:33.555290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:33.556548 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:33.564096 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:33.564605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:33.565410 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:33.565863 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:33.709290 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:33.717269 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-200b02ad-f5aa-45a8-bba8-dc2e4a5c0f4c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1559 microversion: 2.1 time: 0.168545 Jul 02 22:15:33.717859 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3318/6598] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:33 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:33.733777 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:15:33.734298 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:15:33.737201 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=27 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:15:33.744378 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:33.744815 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:33.745631 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:33.746076 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:33.893226 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:15:33.907197 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-98a4e5a7-4997-4dbe-8234-f0c9afd83866 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1559 microversion: 2.1 time: 0.177122 Jul 02 22:15:33.908254 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3281/6599] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:15:33 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:15:35.581363 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-6cc9a1ee-d04f-422e-be6e-a030c342a28f req-12ab2885-67bd-4080-a970-addda31fedba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:15:35.590927 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6cc9a1ee-d04f-422e-be6e-a030c342a28f req-12ab2885-67bd-4080-a970-addda31fedba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:15:35.591377 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-6cc9a1ee-d04f-422e-be6e-a030c342a28f req-12ab2885-67bd-4080-a970-addda31fedba service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:15:35.602886 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-6cc9a1ee-d04f-422e-be6e-a030c342a28f req-12ab2885-67bd-4080-a970-addda31fedba service nova] Creating event network-changed:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:15:35.608393 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-6cc9a1ee-d04f-422e-be6e-a030c342a28f req-12ab2885-67bd-4080-a970-addda31fedba service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030767 Jul 02 22:15:35.609027 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3319/6600] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:15:50.714693 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:15:50.715320 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:15:50.852873 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:15:50.853485 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:17:30.688004 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:17:30.689095 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:17:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:17:49.043114 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:17:49.044256 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=58 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:17:49.097961 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1743672718"}} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:17:49.099004 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:17:49.106375 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:17:49.106829 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:17:49.107599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:17:49.108065 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:17:49.413793 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-d3925476-aa0b-43e8-91cf-e2e3a454bbc6 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "POST /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1/action" status: 202 len: 0 microversion: 2.1 time: 0.374288 Jul 02 22:17:49.414435 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3282/6601] 10.222.0.43 () {60 vars in 1277 bytes} [Sat Jul 2 22:17:49 2022] POST /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 02 22:17:55.675747 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:17:55.676615 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:17:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:17:55.873836 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 22:17:55.877865 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-8a4e5eac-d902-479b-aa56-a3991388d0a9 req-2ca61294-9a51-42fa-a315-c5fed28b6c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "name": "network-vif-plugged", "status": "completed", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:17:55.883222 ncdv-master-1 devstack@n-api.service[131044]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 02 22:17:55.883959 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:17:55.885019 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=72 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:17:55.893928 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8a4e5eac-d902-479b-aa56-a3991388d0a9 req-2ca61294-9a51-42fa-a315-c5fed28b6c0a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:17:55.894369 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-8a4e5eac-d902-479b-aa56-a3991388d0a9 req-2ca61294-9a51-42fa-a315-c5fed28b6c0a service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:17:55.906668 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-8a4e5eac-d902-479b-aa56-a3991388d0a9 req-2ca61294-9a51-42fa-a315-c5fed28b6c0a service nova] Creating event network-vif-plugged:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:17:55.913547 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-8a4e5eac-d902-479b-aa56-a3991388d0a9 req-2ca61294-9a51-42fa-a315-c5fed28b6c0a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041621 Jul 02 22:17:55.914367 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3320/6602] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:18:08.284072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:08.284660 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:08.290485 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_cell1:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:08.291604 ncdv-master-1 devstack@n-api.service[131044]: DEBUG dbcounter [-] [131044] Writing DB stats nova_api:SELECT=2 {{(pid=131044) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:08.307847 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_api:SELECT=2 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:08.310447 ncdv-master-1 devstack@n-api.service[131045]: DEBUG dbcounter [-] [131045] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131045) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 22:18:08.314856 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [e58872f4-8f9d-408d-b3a5-59fd687d4156] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38224. Jul 02 22:18:08.318185 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:08.319016 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:08.319685 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] [f8fc4c23-5b5a-4d6d-b198-ea923c7ad0a5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 38226. Jul 02 22:18:08.320781 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:08.322204 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:08.354651 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Going to try to terminate instance {{(pid=131045) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 22:18:08.391386 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-5cdfddd3-faa8-4c9c-a113-d258b5a61521 req-8afd4c45-a26e-4b1a-a4c4-56f804affd14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:18:08.403605 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5cdfddd3-faa8-4c9c-a113-d258b5a61521 req-8afd4c45-a26e-4b1a-a4c4-56f804affd14 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:08.404648 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-5cdfddd3-faa8-4c9c-a113-d258b5a61521 req-8afd4c45-a26e-4b1a-a4c4-56f804affd14 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:08.416660 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-5cdfddd3-faa8-4c9c-a113-d258b5a61521 req-8afd4c45-a26e-4b1a-a4c4-56f804affd14 service nova] Creating event network-changed:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:18:08.423380 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-5cdfddd3-faa8-4c9c-a113-d258b5a61521 req-8afd4c45-a26e-4b1a-a4c4-56f804affd14 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134600 Jul 02 22:18:08.424763 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3321/6603] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 22:18:08.450024 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a557fb25-0d34-46de-9148-900f824f0baf tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "DELETE /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 204 len: 0 microversion: 2.1 time: 0.169906 Jul 02 22:18:08.450618 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3283/6604] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 22:18:08 2022] DELETE /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 22:18:08.460592 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:08.461312 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:08.469340 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:08.471542 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:08.472771 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:08.473382 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:08.630067 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:18:08.637842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-32fd518f-0e15-4f9a-bea7-57a798fcc73c tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1684 microversion: 2.1 time: 0.182687 Jul 02 22:18:08.638433 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3322/6605] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:08 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:18:09.660098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:09.661117 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:09.669759 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:09.670285 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:09.671228 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:09.671745 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:09.820098 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:18:09.828319 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-71e1b2b1-9507-48fe-99f6-6b7956055199 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1684 microversion: 2.1 time: 0.175297 Jul 02 22:18:09.829056 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3284/6606] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:09 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:18:09.937640 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [req-2a0fe0fe-7555-41ac-a9d9-b41bb602c5cb req-2b4c0e6b-4dd2-43fb-829d-a8268acf093b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "name": "network-vif-unplugged", "status": "completed", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:18:09.948083 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2a0fe0fe-7555-41ac-a9d9-b41bb602c5cb req-2b4c0e6b-4dd2-43fb-829d-a8268acf093b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:09.948611 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [req-2a0fe0fe-7555-41ac-a9d9-b41bb602c5cb req-2b4c0e6b-4dd2-43fb-829d-a8268acf093b service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:09.960966 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.compute.server_external_events [req-2a0fe0fe-7555-41ac-a9d9-b41bb602c5cb req-2b4c0e6b-4dd2-43fb-829d-a8268acf093b service nova] Creating event network-vif-unplugged:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:18:09.965842 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [req-2a0fe0fe-7555-41ac-a9d9-b41bb602c5cb req-2b4c0e6b-4dd2-43fb-829d-a8268acf093b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031993 Jul 02 22:18:09.966968 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3323/6607] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:18:10.814830 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-c3e6d172-e280-4474-bb46-e67ee3d861b8 req-f7cb3ba5-125c-45b1-82cb-d6bb9548e4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41893df1-6403-4662-825d-e7c4575dd3a1", "name": "network-vif-deleted", "tag": "e9a213c4-1718-48b5-9ace-94775c85b262"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:18:10.828072 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c3e6d172-e280-4474-bb46-e67ee3d861b8 req-f7cb3ba5-125c-45b1-82cb-d6bb9548e4f5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:10.828528 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-c3e6d172-e280-4474-bb46-e67ee3d861b8 req-f7cb3ba5-125c-45b1-82cb-d6bb9548e4f5 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:10.841947 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-c3e6d172-e280-4474-bb46-e67ee3d861b8 req-f7cb3ba5-125c-45b1-82cb-d6bb9548e4f5 service nova] Creating event network-vif-deleted:e9a213c4-1718-48b5-9ace-94775c85b262 for instance 41893df1-6403-4662-825d-e7c4575dd3a1 on nch1-master-1 Jul 02 22:18:10.847012 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:10.847686 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-c3e6d172-e280-4474-bb46-e67ee3d861b8 req-f7cb3ba5-125c-45b1-82cb-d6bb9548e4f5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036752 Jul 02 22:18:10.847988 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:10.849363 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3285/6608] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:18:10.855102 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:10.855556 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:10.856368 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:10.856820 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:10.922540 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:18:10.930904 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-a41e77f4-1d2b-4190-a23e-b21fb74d4082 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 200 len: 1333 microversion: 2.1 time: 0.088780 Jul 02 22:18:10.931609 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3324/6609] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:10 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:18:11.953732 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:11.954899 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 41893df1-6403-4662-825d-e7c4575dd3a1] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:11.966037 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:11.966793 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:11.968191 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:11.968840 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:11.984291 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.wsgi [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] HTTP exception thrown: Instance 41893df1-6403-4662-825d-e7c4575dd3a1 could not be found. Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Request method failure captured: Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: request: GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 HTTP/1.1 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Accept: application/json Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Accept-Encoding: identity Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Connection: close Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Content-Length: 0 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Content-Type: application/json Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Host: 10.222.0.43 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: Openstack-System-Scope: None Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: User-Agent: python-urllib3/1.26.9 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Auth-Token: gAAAAABiwMLWpq3Q6sWBl0y_QK9mjfemEh3_c_xF_goAxjkE43K38aYeHh7pRqcPMd1Ap0705micUZwede2QgqDmIYKuwi9nvz9QZOVd0Z64KFmhN0RW76RnLjRoNMbT4ZejRPp3tFFo3rOmECIh4k8gOQvTwhGkiMlH9DE3jNOP3Ll9cP2BD8U Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Id: None Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Domain-Name: None Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Identity-Status: Confirmed Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Is-Admin-Project: True Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Id: default Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Domain-Name: Default Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Id: 11c2539cbdbb4e1abc2819a46eb87404 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Project-Name: tempest-TestSnapshotPattern-941707286 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Role: member,reader Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Roles: member,reader Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11c2539cbdbb4e1abc2819a46eb87404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_11c2539cbdbb4e1abc2819a46eb87404", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11c2539cbdbb4e1abc2819a46eb87404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/11c2539cbdbb4e1abc2819a46eb87404"}]}] Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant: tempest-TestSnapshotPattern-941707286 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Id: 11c2539cbdbb4e1abc2819a46eb87404 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-Tenant-Name: tempest-TestSnapshotPattern-941707286 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-User: tempest-TestSnapshotPattern-941707286-project Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Id: default Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Domain-Name: Default Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Id: b6d022b31b82474ea335f541e7699b90 Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: X-User-Name: tempest-TestSnapshotPattern-941707286-project Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: method: > Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: exception: Instance 41893df1-6403-4662-825d-e7c4575dd3a1 could not be found. Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: action_args: {'id': '41893df1-6403-4662-825d-e7c4575dd3a1'} Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41893df1-6403-4662-825d-e7c4575dd3a1 could not be found. Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41893df1-6403-4662-825d-e7c4575dd3a1 could not be found. Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:18:11.985938 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41893df1-6403-4662-825d-e7c4575dd3a1 could not be found. Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: ERROR nova.api.openstack.wsgi Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Returning 404 to user: Instance 41893df1-6403-4662-825d-e7c4575dd3a1 could not be found. {{(pid=131045) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-73b26988-6974-49bc-9371-75332cafbccc tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1" status: 404 len: 111 microversion: 2.1 time: 0.041203 Jul 02 22:18:11.991088 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3286/6610] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:11 2022] GET /compute/v2.1/servers/41893df1-6403-4662-825d-e7c4575dd3a1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 22:18:13.421587 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:13.422109 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:13.424238 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-5365204e-4cf2-437b-95d7-b48ec680aa0d req-45bddc03-cb70-4339-a245-8c475a72f346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:18:13.430040 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:13.430495 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:13.432129 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:13.432252 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:13.435011 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5365204e-4cf2-437b-95d7-b48ec680aa0d req-45bddc03-cb70-4339-a245-8c475a72f346 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:13.435533 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-5365204e-4cf2-437b-95d7-b48ec680aa0d req-45bddc03-cb70-4339-a245-8c475a72f346 service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:13.447386 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-5365204e-4cf2-437b-95d7-b48ec680aa0d req-45bddc03-cb70-4339-a245-8c475a72f346 service nova] Creating event network-changed:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:18:13.453164 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-5365204e-4cf2-437b-95d7-b48ec680aa0d req-45bddc03-cb70-4339-a245-8c475a72f346 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033165 Jul 02 22:18:13.453766 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3287/6611] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 02 22:18:13.458945 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Going to try to terminate instance {{(pid=131044) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 02 22:18:13.546885 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-b6fc91db-5b2f-4adf-8ee0-746d704b6815 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "DELETE /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 204 len: 0 microversion: 2.1 time: 0.129128 Jul 02 22:18:13.550689 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3325/6612] 10.222.0.43 () {58 vars in 1238 bytes} [Sat Jul 2 22:18:13 2022] DELETE /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 02 22:18:13.557822 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:13.558917 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.compute.api [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131045) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:13.568599 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:13.569303 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:13.570393 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:13.570913 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:13.736309 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.policy [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131045) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:18:13.744472 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-a9a324b3-2ffc-41a8-9aca-724fa9d99877 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1684 microversion: 2.1 time: 0.192113 Jul 02 22:18:13.745064 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3288/6613] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:13 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1684 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:18:14.765211 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:14.765936 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:14.774445 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:14.774938 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:14.775718 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:14.776184 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:14.854459 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.policy [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d022b31b82474ea335f541e7699b90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11c2539cbdbb4e1abc2819a46eb87404', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131044) authorize /opt/stack/nova/nova/policy.py:199}} Jul 02 22:18:14.863878 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8fc81c22-ddd9-4eb2-a41c-5e2e798f1349 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 200 len: 1497 microversion: 2.1 time: 0.104846 Jul 02 22:18:14.864820 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3326/6614] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:14 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 1497 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 02 22:18:14.873936 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [req-825545a2-4924-486a-89a6-c0fafffb296c req-9e61e114-e1bd-480a-ae82-89e55a5744da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b219ea3-7998-4adb-a12c-06eba6333413", "name": "network-vif-deleted", "tag": "2fee5012-b5d1-4e35-8a6f-7c0482f47613"}]} {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 02 22:18:14.884589 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-825545a2-4924-486a-89a6-c0fafffb296c req-9e61e114-e1bd-480a-ae82-89e55a5744da service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:14.885063 ncdv-master-1 devstack@n-api.service[131045]: DEBUG oslo_concurrency.lockutils [req-825545a2-4924-486a-89a6-c0fafffb296c req-9e61e114-e1bd-480a-ae82-89e55a5744da service nova] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131045) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:14.897049 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.compute.server_external_events [req-825545a2-4924-486a-89a6-c0fafffb296c req-9e61e114-e1bd-480a-ae82-89e55a5744da service nova] Creating event network-vif-deleted:2fee5012-b5d1-4e35-8a6f-7c0482f47613 for instance 6b219ea3-7998-4adb-a12c-06eba6333413 on nch2-master-1 Jul 02 22:18:14.903461 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [req-825545a2-4924-486a-89a6-c0fafffb296c req-9e61e114-e1bd-480a-ae82-89e55a5744da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102246 Jul 02 22:18:14.904287 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3289/6615] 10.222.0.43 () {64 vars in 1317 bytes} [Sat Jul 2 22:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 02 22:18:15.886645 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '>' {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:15.887586 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.compute.api [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] [instance: 6b219ea3-7998-4adb-a12c-06eba6333413] Fetching instance by UUID {{(pid=131044) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 02 22:18:15.897849 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:15.898330 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:15.899089 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 02 22:18:15.899529 ncdv-master-1 devstack@n-api.service[131044]: DEBUG oslo_concurrency.lockutils [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Lock "de9904c6-61a4-467b-9f20-25602691bcd4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131044) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 02 22:18:15.913493 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.wsgi [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] HTTP exception thrown: Instance 6b219ea3-7998-4adb-a12c-06eba6333413 could not be found. Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Request method failure captured: Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: request: GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 HTTP/1.1 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Accept: application/json Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Accept-Encoding: identity Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Connection: close Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Content-Length: 0 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Content-Type: application/json Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Host: 10.222.0.43 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: Openstack-System-Scope: None Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: User-Agent: python-urllib3/1.26.9 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Auth-Token: gAAAAABiwMLWpq3Q6sWBl0y_QK9mjfemEh3_c_xF_goAxjkE43K38aYeHh7pRqcPMd1Ap0705micUZwede2QgqDmIYKuwi9nvz9QZOVd0Z64KFmhN0RW76RnLjRoNMbT4ZejRPp3tFFo3rOmECIh4k8gOQvTwhGkiMlH9DE3jNOP3Ll9cP2BD8U Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Id: None Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Domain-Name: None Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Identity-Status: Confirmed Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Is-Admin-Project: True Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Id: default Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Domain-Name: Default Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Id: 11c2539cbdbb4e1abc2819a46eb87404 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Project-Name: tempest-TestSnapshotPattern-941707286 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Role: member,reader Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Roles: member,reader Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11c2539cbdbb4e1abc2819a46eb87404"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_11c2539cbdbb4e1abc2819a46eb87404", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/11c2539cbdbb4e1abc2819a46eb87404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/11c2539cbdbb4e1abc2819a46eb87404"}]}] Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant: tempest-TestSnapshotPattern-941707286 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Id: 11c2539cbdbb4e1abc2819a46eb87404 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-Tenant-Name: tempest-TestSnapshotPattern-941707286 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-User: tempest-TestSnapshotPattern-941707286-project Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Id: default Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-User-Domain-Name: Default Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-User-Id: b6d022b31b82474ea335f541e7699b90 Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: X-User-Name: tempest-TestSnapshotPattern-941707286-project Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: method: > Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: exception: Instance 6b219ea3-7998-4adb-a12c-06eba6333413 could not be found. Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: action_args: {'id': '6b219ea3-7998-4adb-a12c-06eba6333413'} Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: {{(pid=131044) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b219ea3-7998-4adb-a12c-06eba6333413 could not be found. Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b219ea3-7998-4adb-a12c-06eba6333413 could not be found. Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 02 22:18:15.915196 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b219ea3-7998-4adb-a12c-06eba6333413 could not be found. Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: ERROR nova.api.openstack.wsgi Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: DEBUG nova.api.openstack.wsgi [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Returning 404 to user: Instance 6b219ea3-7998-4adb-a12c-06eba6333413 could not be found. {{(pid=131044) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: INFO nova.api.openstack.requestlog [None req-8953151c-7c08-40ea-b61b-726bdc4f12fb tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413" status: 404 len: 111 microversion: 2.1 time: 0.036764 Jul 02 22:18:15.920539 ncdv-master-1 devstack@n-api.service[131044]: [pid: 131044|app: 0|req: 3327/6616] 10.222.0.43 () {58 vars in 1235 bytes} [Sat Jul 2 22:18:15 2022] GET /compute/v2.1/servers/6b219ea3-7998-4adb-a12c-06eba6333413 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 02 22:18:16.098990 ncdv-master-1 devstack@n-api.service[131045]: DEBUG nova.api.openstack.wsgi [None req-f90c30a9-9705-494b-a6a1-d90b251d4d95 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] Calling method '.version_select at 0x7fabea186040>' {{(pid=131045) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 02 22:18:16.126915 ncdv-master-1 devstack@n-api.service[131045]: INFO nova.api.openstack.requestlog [None req-f90c30a9-9705-494b-a6a1-d90b251d4d95 tempest-TestSnapshotPattern-941707286 tempest-TestSnapshotPattern-941707286-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1995481580" status: 202 len: 0 microversion: 2.1 time: 0.036155 Jul 02 22:18:16.127517 ncdv-master-1 devstack@n-api.service[131045]: [pid: 131045|app: 0|req: 3290/6617] 10.222.0.43 () {58 vars in 1256 bytes} [Sat Jul 2 22:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1995481580 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 02 22:19:10.725541 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:19:10.726705 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:19:10.864235 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:19:10.865198 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:20:50.702223 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:20:50.702960 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:20:50.953745 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:20:50.954632 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:20:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:21:03.881564 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:21:03.882221 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:21:15.688834 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:21:15.689453 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:22:30.739520 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:22:30.741056 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:22:30.877161 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:22:30.877785 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:24:10.712072 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:24:10.713073 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:24:10.965288 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:24:10.965772 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:24:23.892230 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:24:23.893133 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:24:35.698254 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:24:35.698843 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:24:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:25:50.759564 ncdv-master-1 devstack@n-api.service[131045]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:25:50.760297 ncdv-master-1 devstack@n-api.service[131045]: Sat Jul 2 22:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 02 22:25:50.887487 ncdv-master-1 devstack@n-api.service[131044]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 02 22:25:50.888120 ncdv-master-1 devstack@n-api.service[131044]: Sat Jul 2 22:25:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!